CNN-based object segmentation in urban LIDAR with missing points

Proceedings - 2016 4th International Conference on 3D Vision, 3DV 2016

Volumn , Issue , 2016, Pages 417-425

  Zelener, Allan ^a   Stamos, Ioannis ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

3D Vision; deep learning; neural networks; segmentation

Indexed keywords

DEEP LEARNING; DEEP NEURAL NETWORKS; IMAGE SEGMENTATION; NEURAL NETWORKS;

3-D VISION; 3D POINT CLOUD; CONVOLUTIONAL NEURAL NETWORK; INPUT FEATURES; OBJECT CATEGORIES; OBJECT SEGMENTATION; SEGMENTATION MASKS; TECHNICAL LIMITATIONS;

OPTICAL RADAR;

EID: 85011277882     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/3DV.2016.51     Document Type: Conference Paper

References (35)

1. M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, S. Ghemawat, I. Goodfellow, A. Harp, G. Irving, M. Isard, Y. Jia, R. Jozefowicz, L. Kaiser, M. Kudlur, J. Levenberg, D. Mané, R. Monga, S. Moore, D. Murray, C. Olah, M. Schuster, J. Shlens, B. Steiner, I. Sutskever, K. Talwar, P. Tucker, V. Vanhoucke, V. Vasudevan, F. Viégas, O. Vinyals, P. Warden, M.Wattenberg, M.Wicke, Y. Yu, and X. Zheng. Tensor-Flow: Large-scale machine learning on heterogeneous systems, 2015
2. A. Anand, H. S. Koppula, T. Joachims, and A. Saxena. Contextually guided semantic labeling and search for 3D point clouds. Int. J. Rob. Res., 32(1): 19-34, Jan. 2013. 2
3. D. Anguelov, B. Taskar, V. Chatalbashev, D. Koller, D. Gupta, G. Heitz, and A. Ng. Discriminative learning of markov random fields for segmentation of 3D scan data. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), volume 2, pages 169-176. IEEE, 2005
4. L. Bo, X. Ren, and D. Fox. Unsupervised feature learning for RGB-D based object recognition. In Experimental Robotics, pages 387-402. Springer, 2013
5. Y. Cheng, R. Cai, X. Zhao, and K. Huang. Convolutional fisher kernels for RGB-D object recognition. In 3D Vision (3DV), 2015 International Conference on, pages 135-143. IEEE, 2015
6. C. Couprie, C. Farabet, L. Najman, and Y. LeCun. Indoor semantic segmentation using depth information. In International Conference on Learning Representations (ICLR), 2013
7. J. Dai, K. He, and J. Sun. Instance-Aware semantic segmentation via multi-Task network cascades. Computer Vision and Pattern Recognition (CVPR), 2016
8. D. Dohan, B. Matejek, and T. Funkhouser. Learning hierarchical semantic segmentations of lidar data. In 3D Vision (3DV), 2015 International Conference on, pages 273-281. IEEE, 2015
9. A. Frome, D. Huber, R. Kolluri, T. Bulow, and J. Malik. Recognizing objects in range data using regional point descriptors. In European Conference on Computer Vision (ECCV), pages Vol III: 224-237, 2004
10. X. Glorot, and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In AISTATS, volume 9, pages 249-256, 2010
11. A. Golovinskiy, V. G. Kim, and T. Funkhouser. Shape-based recognition of 3D point clouds in urban environments. In 2009 IEEE 12th International Conference on Computer Vision, pages 2154-2161. IEEE, 2009
12. S. Gupta, R. Girshick, P. Arbeláez, and J. Malik. Learning rich features from RGB-D images for object detection and segmentation. In European Conference on Computer Vision (ECCV). Springer, 2014
13. K. He, X. Zhang, S. Ren, and J. Sun. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE International Conference on Computer Vision, pages 1026-1034, 2015
14. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. Computer Vision and Pattern Recognition (CVPR), 2016
15. A. E. Johnson, and M. Hebert. Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(5): 433-449, 1999
16. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pages 1097-1105, 2012
17. K. Lai, and D. Fox. Object recognition in 3D point clouds using web data and domain adaptation. The International Journal of Robotics Research, 29(8): 1019-1037, 2010
18. J. Long, E. Shelhamer, and T. Darrell. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 3431-3440, 2015
19. B. Matei, Y. Shan, H. Sawhney, Y. Tan, R. Kumar, D. Huber, and M. Hebert. Rapid object indexing using locality sensitive hashing and joint 3D-signature space estimation. IEEE Trans. on Pattern Analysis and Machine Intelligence, 28(7): 1111-1126, July 2006. 2
20. A. Mian, M. Bennamoun, and R. Owens. On the repeatability and quality of keypoints for local feature-based 3D object retrieval from cluttered scenes. International Journal of Computer Vision, 89(2-3): 348-361, 2010
21. D. Munoz, J. A. Bagnell, and M. Hebert. Co-inference machines for multi-modal scene analysis. In European Conference on Computer Vision (ECCV), 2012
22. A. Patterson, P. Mordohai, and K. Daniilidis. Object detection from large-scale 3D datasets using bottom-up and topdown descriptors. In European Conference on Computer Vision (ECCV), pages 553-566, 2008
23. X. Ren, L. Bo, and D. Fox. RGB-(D) scene labeling: Features and algorithms. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 2759-2766. IEEE, 2012
24. R. B. Rusu, G. Bradski, R. Thibaux, and J. Hsu. Fast 3D recognition and pose using the viewpoint feature histogram. In Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, pages 2155-2162. IEEE, 2010
25. N. Silberman, and R. Fergus. Indoor scene segmentation using a structured light sensor. In Computer Vision Workshops (ICCV Workshops), 2011 IEEE International Conference on, pages 601-608. IEEE, 2011
26. N. Silberman, D. Sontag, and R. Fergus. Instance segmentation of indoor scenes using a coverage loss. In European Conference on Computer Vision (ECCV), pages 616-631. Springer, 2014
27. R. Socher, B. Huval, B. Bath, C. D. Manning, and A. Y. Ng. Convolutional-recursive deep learning for 3D object classification. In Advances in Neural Information Processing Systems, pages 665-673, 2012
28. S. Song, and J. Xiao. Sliding shapes for 3D object detection in depth images. In European Conference on Computer Vision (ECCV), pages 634-651. Springer, 2014
29. S. Song, and J. Xiao. Deep sliding shapes for amodal 3D object detection in RGB-D images. Computer Vision and Pattern Recognition (CVPR), 2016
30. I. Stamos, O. Hadjiliadis, H. Zhang, and T. Flynn. Online algorithms for classification of urban objects in 3D point clouds. In International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 2012
31. F. Tombari, S. Salti, and L. Di Stefano. Unique signatures of histograms for local surface description. In European Conference on Computer Vision (ECCV), pages 356-369. Springer, 2010
32. A. Toshev, P. Mordohai, and B. Taskar. Detecting and parsing architecture at city scale from range data. In Computer Vision and Pattern Recognition (CVPR), 2010
33. C. Wu, I. Lenz, and A. Saxena. Hierarchical semantic labeling for task-relevant RGB-D perception. In Robotics: Science and Systems (RSS), 2014
34. X. Xiong, D. Munoz, J. A. Bagnell, and M. Hebert. 3-D scene analysis via sequenced predictions over points and regions. In IEEE International Conference on Robotics and Automation (ICRA), 2011
35. A. Zelener, P. Mordohai, and I. Stamos. Classification of vehicle parts in unstructured 3D point clouds. In 3D Vision (3DV), 2014 International Conference on, volume 1, pages 147-154. IEEE, 2014