Multi-modal sensor registration for vehicle perception via deep neural networks

2015 IEEE High Performance Extreme Computing Conference, HPEC 2015

Volumn , Issue , 2015, Pages

  Giering, Michael ^a   Venugopalan, Vivek ^a   Reddy, Kishore ^a  

^a UNITED TECHNOLOGIES RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION SUPPORT SYSTEMS; NEURAL NETWORKS; STATISTICAL TESTS;

AUTOMATED VEHICLES; CONVOLUTIONAL NEURAL NETWORK; DEEP NEURAL NETWORKS; HETEROGENEOUS DATA; MULTIMODAL REGISTRATION; MULTIPLE CHANNELS; SENSOR INFORMATIONS; VIDEO REGISTRATION;

OPTICAL RADAR;

EID: 84964843997     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HPEC.2015.7322485     Document Type: Conference Paper

References (30)

1. C. Bodensteiner and M. Arens, "Real-time 2D Video 3D LiDAR Registration," in Pattern Recognition (ICPR), 2012 21st International Conference on. IEEE, 2012, pp. 2206-2209.
2. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Y. Ng, "Multimodal Deep Learning," in Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 689-696.
3. G. Pandey, J. R. McBride, and R. M. Eustice, "Ford Campus Vision And Lidar Data Set," The International Journal of Robotics Research, vol. 30, no. 13, pp. 1543-1552, 2011.
4. A. Ross and A. Jain, "Information Fusion In Biometrics," Pattern recognition letters, vol. 24, no. 13, pp. 2115-2125, 2003.
5. K. Gregor and Y. LeCun, "Learning Representations By Maximizing Compression," arXiv preprint arXiv:1108.1169, 2011.
6. Y. Wu, E. Y. Chang, K. C.-C. Chang, and J. R. Smith, "Optimal Multimodal Fusion For Multimedia Data Analysis," in Proceedings of the 12th annual ACM international conference on Multimedia. ACM, 2004, pp. 572-579.
7. C. G. Snoek, M. Worring, J. C. Van Gemert, J.-M. Geusebroek, and A. W. Smeulders, "The Challenge Problem For Automated Detection Of 101 Semantic Concepts In Multimedia," in Proceedings of the 14th annual ACM international conference on Multimedia. ACM, 2006, pp. 421-430.
8. S. Thrun, "Google's driverless car," Ted Talk, Ed, 2011.
9. L. Wang and U. Neumann, "A Robust Approach For Automatic Registration Of Aerial Images With Untextured Aerial LIDAR Data," in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009, pp. 2623-2630.
10. H. Kim, C. D. Correa, and N. Max, "Automatic registration of lidar and optical imagery using depth map stereo," in Computational Photography (ICCP), 2014 IEEE International Conference on. IEEE, 2014, pp. 1-8.
11. A. Mastin, J. Kepner, and J. Fisher, "Automatic Registration of LIDAR and Optical Images of Urban Scenes," in Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 2009, pp. 2639-2646.
12. L. Liu and I. Stamos, "A systematic approach for 2d-image to 3d-range registration in urban environments," in Computer Vision, 2007. ICCV 2007. IEEE 11th International Conference on, Oct 2007, pp. 1-8.
13. M. Ding, K. Lyngbaek, and A. Zakhor, "Automatic registration of aerial imagery with untextured 3d lidar models," in Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, June 2008, pp. 1-8.
14. C. Frueh, R. Sammon, and A. Zakhor, "Automated texture mapping of 3d city models with oblique aerial imagery," in 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004. Proceedings. 2nd International Symposium on, Sept 2004, pp. 396-403.
15. I. Stamos, L. Liu, C. Chen, G. Wolberg, G. Yu, and S. Zokai, "Integrating automated range registration with multiview geometry for the photorealistic modeling of large-scale scenes," International Journal of Computer Vision, vol. 78, no. 2-3, pp. 237-260, 2008. [Online]. Available: http://dx.doi.org/10.1007/s11263-007-0089-1
16. A. J. Troccoli and P. K. Allen, "A shadow based method for image to model registration," in In IEEE Workshop on Image and Video Registration, Conf. on Comp. Vision and, 2004.
17. W. Zhao, D. Nister, and S. Hsu, "Alignment of continuous video onto 3d point clouds," in Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, vol. 2, June 2004, pp. II-II.
18. L. Liu, I. Stamos, G. Yu, G. Wolberg, and S. Zokai, "Multiview geometry for texture mapping 2d images onto 3d range data," in Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, vol. 2, June 2006, pp. 2293-2300.
19. Y. Kim, H. Lee, and E. M. Provost, "Deep Learning for Robust Feature Generation in Audiovisual Emotion Recognition," in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. IEEE, 2013, pp. 3687-3691.
20. N. Srivastava and R. Salakhutdinov, "Multimodal Learning With Deep Boltzmann Machines," in Advances in neural information processing systems, 2012, pp. 2222-2230.
21. I. Lenz, H. Lee, and A. Saxena, "Deep Learning for Detecting Robotic Grasps," arXiv preprint arXiv:1301.3592, 2013.
22. K. Prazdny, "Egomotion and relative depth map from optical flow," Biological Cybernetics, vol. 36, no. 2, pp. 87-102, 1980. [Online]. Available: http://dx.doi.org/10.1007/BF00361077
23. B. Shahraray and M. Brown, "Robust depth estimation from optical flow," in Computer Vision., Second International Conference on, Dec 1988, pp. 641-650.
24. Y. Yang, Q. Liu, R. Ji, and Y. Gao, "Dynamic 3D Scene Depth Reconstruction via Optical Flow Field Rectification," PLoS ONE, vol. 7, p. 47041, Nov. 2012.
25. S.-Y. Chien, S.-Y. Ma, and L.-G. Chen, "Efficient moving object segmentation algorithm using background registration technique," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 12, no. 7, pp. 577-586, Jul 2002.
26. C. Liu, "Beyond Pixels: Exploring New Representations and Applications for Motion Analysis," Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, USA, 2009, aAI0822221.
27. V. Nair and G. E. Hinton, "Rectified Linear Units Improve Restricted Boltzmann Machines," in Proceedings of the 27th International Conference on Machine Learning (ICML-10), 2010, pp. 807-814.
28. NVIDIA Inc., "NVIDIA's Next Generation CUDA Compute Architecture: Kepler TM GK110," Whitepaper, May 2012.
29. V. Venugopal and S. Kannan, "Accelerating real-time lidar data processing using GPUs," in Circuits and Systems (MWSCAS), 2013 IEEE 56th International Midwest Symposium on, August 2013, pp. 1168-1171.
30. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet Classification With Deep Convolutional Neural Networks," in Advances in neural information processing systems, 2012, pp. 1097-1105.