We present a framework to automatically infer topology and geometry from an unorganized 3D point cloud obtained from a 3D scene. If the cloud is not oriented, we use existing methods to orient it prior to recovering the topology. We develop a quality measure for scoring a chosen topology/orientation. The topology is used to segment the cloud into manifold components and later in the computation of shape descriptors.