Depth and surface normal estimation from monocular images using regression on deep features and hierarchical CRFs

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 07-12-June-2015, Issue , 2015, Pages 1119-1127

  Li, Bo ^a,b   Shen, Chunhua ^b,c   Dai, Yuchao ^d   Van Den Hengel, Anton ^b,c   He, Mingyi ^a  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b UNIVERSITY OF ADELAIDE   (Australia)

^c AUSTRALIAN CENTRE FOR ROBOTIC VISION   (Australia)

^d AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NEURAL NETWORKS; PATTERN RECOGNITION; RANDOM PROCESSES; REFINING; REGRESSION ANALYSIS;

AUTO REGRESSION; CLOSED FORM SOLUTIONS; CONDITIONAL RANDOM FIELD; CONVOLUTIONAL NEURAL NETWORK; INFERENCE PROBLEM; MONOCULAR IMAGE; POST PROCESSING; SURFACE NORMAL ESTIMATION;

PIXELS;

EID: 84952783215     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2015.7298715     Document Type: Conference Paper

References (30)

1. X. Ren, L. Bo, and D. Fox, "RDB-D scene labeling: Features and algorithms," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2012, pp. 2759-2766
2. J. Shotton, T. Sharp, A. Kipman, A. Fitzgibbon, M. Finocchio, A. Blake, M. Cook, and R. Moore, "Real-time human pose recognition in parts from single depth images," Com-munications of the ACM, vol. 56, no. 1, pp. 116-124, 2013
3. S. R. Fanello, C. Keskin, S. Izadi, P. Kohli, D. Kim, D. Sweeney, A. Criminisi, J. Shotton, S. B. Kang, and T. Paek, "Learning to be a depth camera for close-range human capture and interaction," ACM T. Graphics, vol. 33, no. 4, pp. 86, 2014
4. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus, "Indoor segmentation and support inference from rgbd images," in Proc. Eur. Conf. Comp. Vis., pp. 746-760. Springer, 2012
5. A. Gupta, A. Efros, and M. Hebert, "Blocks world revisited: Image understanding using qualitative geometry and mechanics," in Proc. Eur. Conf. Comp. Vis., pp. 482-496. 2010
6. D. Fouhey, A. Gupta, and M. Hebert, "Unfolding an indoor origami world," in Proc. Eur. Conf. Comp. Vis., pp. 687-702. 2014
7. R. Zhang, P.-S. Tsai, J. E. Cryer, and M. Shah, "Shape-fromshading: a survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 8, pp. 690-706, 1999
8. C. Wu, J.-M. Frahm, and M. Pollefeys, "Repetition-based dense single-view reconstruction," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2011, pp. 3113-3120
9. A. Saxena, M. Sun, and A. Y. Ng, "Make3d: Learning 3d scene structure from a single still image," IEEE Trans. Pat-tern Anal. Mach. Intell., vol. 31, no. 5, pp. 824-840, 2009
10. A. Saxena, S. Chung, and A. Ng, "3-d depth reconstruction from a single still image," Int. J. Comp. Vis., vol. 76, no. 1, pp. 53-69, 2008
11. M. Liu, M. Salzmann, and X. He, "Discrete-continuous depth estimation from a single image," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2014, pp. 716-723
12. L. Ladick, B. Zeisl, and M. Pollefeys, "Discriminatively trained dense surface normal estimation," in Proc. Eur. Conf. Comp. Vis., pp. 468-484. 2014
13. K. Karsch, C. Liu, and S. B. Kang, "Depth extraction from video using non-parametric sampling," in Proc. Eur. Conf. Comp. Vis., pp. 775-788. Springer, 2012
14. J. Konrad, M. Wang, and P. Ishwar, "2d-to-3d image conversion by learning depth from examples," in Proc. IEEE Conf. Computer Vis. & Pattern Recogn. Workshops. IEEE, 2012, pp. 16-22
15. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, pp. 1097-1105
16. A. Saxena, J. Schulte, and A. Y. Ng, "Depth estimation using monocular and stereo cues," in Proc. IEEE Int. Joint Conf. Artificial Intell., 2007, vol. 7
17. B. Liu, S. Gould, and D. Koller, "Single image depth estimation from predicted semantic labels," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2010, pp. 1253-1260
18. L. Ladicky, J. Shi, and M. Pollefeys, "Pulling things out of perspective," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn. IEEE, 2014, pp. 89-96
19. D. Eigen, C. Puhrsch, and R. Fergus, "Depth map prediction from a single image using a multi-scale deep network," in Proc. Adv. Neural Inf. Process. Syst., 2014
20. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2014
21. M. Oquab, L. Bottou, I. Laptev, J. Sivic, et al., "Learning and transferring mid-level image representations using convolutional neural networks," in Proc. IEEE Conf. Comp. Vis. Patt. Recogn., 2013
22. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," in Proc. Int. Conf. Learning Representations. 2015
23. T. Lindeberg, "Scale-space theory: A basic tool for analysing structures at different scales," J. Applied Statistics, vol. 21, no. 2, pp. 224-270, 1994
24. B. Fulkerson, A. Vedaldi, and S. Soatto, "Class segmentation and object localization with superpixel neighborhoods," in Proc. IEEE Int. Conf. Comp. Vis., 2009, pp. 670-677
25. A. Levin, D. Lischinski, and Y. Weiss, "Colorization using optimization," in ACM T. Graphics, 2004, vol. 23, pp. 689-694
26. J. Diebel and S. Thrun, "An application of markov random fields to range sensing," in Proc. Adv. Neural Inf. Process. Syst., 2005, pp. 291-298
27. O. Mac Aodha, N. D. Campbell, A. Nair, and G. J. Brostow, "Patch based synthesis for single depth image superresolution," in Proc. Eur. Conf. Comp. Vis., pp. 71-84. Springer, 2012
28. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Susstrunk, "SLIC superpixels compared to state-of-theart superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, 2012
29. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678
30. D. F. Fouhey, A. Gupta, and M. Hebert, "Data-driven 3D primitives for single image understanding," in Proc. IEEE Int. Conf. Comp. Vis., 2013.