Sensible Deep Learning for 3D Data

Classification
Justin Solomon

Machine learning from 3D shapes is fundamentally different from learning on images. Rather than shoehorning popular image-based deep networks to take in shape data, we will build deep learning for point clouds, CAD models, and triangulated surfaces from the ground up. In particular, we will design, implement, train, and test networks built from operations that are mathematically well-posed and practically-minded specifically for geometric data. The end result is a general method for learning from 3D data of varying modalities and geometries, with application to object detection and analysis.

[June-1-2018 - current]

 

Publications:

  • Y. Wang and J. Solomon, “PRNet: Self-Supervised Learning for Partial-to-Partial Registration,” in NeurIPS 2019, 2019.

  • Y. Wang and J. Solomon, “Deep Closest Point: Learning Representations for Point Cloud Registration,” in ICCV 2019, 2019.

  • Y. Wang, V. Kim, M. M. Bronstein, and J. Solomon, “LEARNING GEOMETRIC OPERATORS ON MESHES,” in ICLR 2019 Workshop on Representation Learning on Graphs and Manifolds, 2019 [Online]. Available: https://rlgm.github.io/papers/28.pdf

  • Y. Wang, Y. Sun, Z. Liu, S. Sarma, M. Bronstein, and J. Solomon, “Dynamic Graph CNN for Learning on Point Clouds,” ACM Graphics, 2019.