Human pose estimation with iterative error feedback

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 4733-4742

  Carreira, Joao ^a,b   Agrawal, Pulkit ^a   Fragkiadaki, Katerina ^a,c   Malik, Jitendra ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b DEEPMIND   (United Kingdom)

^c GOOGLE INC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BENCHMARKING; COMPUTER VISION; ERRORS; FEEDBACK; PATTERN RECOGNITION;

ARTICULATED POSE ESTIMATIONS; CLASSIFICATION TASKS; CONVOLUTIONAL NETWORKS; FEED-FORWARD ARCHITECTURES; FEEDFORWARD PROCESSING; HIERARCHICAL FEATURES; HUMAN POSE ESTIMATIONS; OBJECT SEGMENTATION;

MOTION ESTIMATION;

EID: 85009914889     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.512     Document Type: Conference Paper

References (48)

1. P. Agrawal, D. Stansbury, J. Malik, and J. L. Gallant. Pixels to voxels: Modeling visual representation in the human brain. arXiv preprint arXiv:1407.5104, 2014.
2. M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2d human pose estimation: New benchmark and state of the art analysis. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 3686-3693. IEEE, 2014.
3. K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman. Return of the devil in the details: Delving deep into convolutional nets. In British Machine Vision Conference, 2014.
4. L.-C. Chen, A. G. Schwing, A. L. Yuille, and R. Urtasun. Learning deep structured models. arXiv preprint arXiv:1407.2538, 2014.
5. X. Chen and A. L. Yuille. Articulated pose estimation by a graphical model with image dependent pairwise relations. In Advances in Neural Information Processing Systems, pages 1736-1744, 2014.
6. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham. Active shape models-their training and application. Computer vision and image understanding, 61(1):38-59, 1995.
7. H. Daumé III, J. Langford, and D. Marcu. Search-based structured prediction. Machine learning, 75(3):297-325, 2009.
8. P. Dollár, P. Welinder, and P. Perona. Cascaded pose regression. In CVPR, 2010.
9. X. Fan, K. Zheng, Y. Lin, and S. Wang. Combining local appearance and holistic view: Dual-source deep neural networks for human pose estimation. arXiv preprint arXiv:1504.07159, 2015.
10. X. Fan, K. Zheng, Y. Lin, and S. Wang. Combining local appearance and holistic view: Dual-source deep neural networks for human pose estimation. June 2015.
11. D. J. Felleman and D. C. Van Essen. Distributed Hierarchical Processing in the Primate Cerebral Cortex. Cerebral Cortex, 1(1):1-47, Jan. 1991.
12. F. Fleuret and D. Geman. Stationary features and cat detection. Technical Report Idiap-RR-56-2007, 0 2007.
13. K. Fukushima. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biological cybernetics, 36(4):193-202, 1980.
14. C. D. Gilbert and M. Sigman. Brain states: Top-down influences in sensory processing. Neuron, 54(5):677-696, 2007.
15. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik. Hypercolumns for object segmentation and fine-grained localization. arXiv preprint arXiv:1411.5752, 2014.
16. J. M. Hupe, A. C. James, B. R. Payne, S. G. Lomber, P. Girard, and J. Bullier. Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons. Nature, 394(6695):784-787, Aug. 1998.
17. C. Ionescu, J. Carreira, and C. Sminchisescu. Iterated second-order label sensitive pooling for 3d human pose estimation. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1661-1668. IEEE, 2014.
18. M. Jaderberg, K. Simonyan, A. Vedaldi, and A. Zisserman. Deep structured output learning for unconstrained text recognition. ICLR 2015, 2014.
19. S. Johnson and M. Everingham. Clustered pose and nonlinear appearance models for human pose estimation. In Proceedings of the British Machine Vision Conference, 2010. doi:10.5244/C.24.12.
20. M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active contour models. International journal of computer vision, 1(4):321-331, 1988.
21. B. C. U. L. M. M. Kravitz DJ, Saleem KS. The ventral visual pathway: An expanded neural framework for the processing of object quality. volume 17(1), 2013.
22. V. A. F. Lamme and P. R. Roelfaema. The distinct modes of vision offered by feedforward and recurrent processing. Trends in Neurosciences, 23:571, 2000.
23. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
24. Q. Li, J. Wang, Z. Tu, and D. P. Wipf. Fixed-point model for structured labeling. In Proceedings of the 30th International Conference on Machine Learning (ICML-13), pages 214-221, 2013.
25. V. Mnih, N. Heess, A. Graves, and K. Kavukcuoglu. Recurrent models of visual attention. In Z. Ghahramani, M.Welling, C. Cortes, N. Lawrence, and K.Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 2204-2212. Curran Associates, Inc., 2014.
26. S. Nowozin and C. H. Lampert. Structured learning and prediction in computer vision. Foundations and Trends R in Computer Graphics and Vision, 6(3-4):185-365, 2011.
27. M. Oberweger, P. Wohlhart, and V. Lepetit. Training a feedback loop for hand pose estimation. In Proceedings of the IEEE International Conference on Computer Vision, pages 3316-3324, 2015.
28. T. Pfister, J. Charles, and A. Zisserman. Flowing convnets for human pose estimation in videos. In Proceedings of the IEEE International Conference on Computer Vision, pages 1913-1921, 2015.
29. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele. Poselet conditioned pictorial structures. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pages 588-595. IEEE, 2013.
30. L. Pishchulin, M. Andriluka, P. Gehler, and B. Schiele. Strong appearance and expressive spatial models for human pose estimation. In International Conference on Computer Vision (ICCV), 2013 IEEE Conference on, pages 3487-3494. IEEE, 2013.
31. V. Ramakrishna, D. Munoz, M. Hebert, J. A. Bagnell, and Y. Sheikh. Pose machines: Articulated pose estimation via inference machines. In Computer Vision-ECCV 2014, pages 33-47. Springer International Publishing, 2014.
32. G. Shakhnarovich, P. Viola, and T. Darrell. Fast pose estimation with parameter-sensitive hashing. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pages 750-757. IEEE, 2003.
33. L. Sigal, M. Isard, H. Haussecker, and M. J. Black. Looselimbed people: Estimating 3D human pose and motion using non-parametric belief propagation. International Journal of Computer Vision, 98(1):15-48, May 2011.
34. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
35. M. F. Stollenga, J. Masci, F. Gomez, and J. Schmidhuber. Deep networks with internal selective attention through feedback connections. In Advances in Neural Information Processing Systems, pages 3545-3553, 2014.
36. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. June 2015.
37. J. Tompson, R. Goroshin, A. Jain, Y. LeCun, and C. Bregler. Efficient object localization using convolutional networks. June 2015.
38. J. J. Tompson, A. Jain, Y. LeCun, and C. Bregler. Joint training of a convolutional network and a graphical model for human pose estimation. In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 1799-1807. 2014.
39. A. Toshev and C. Szegedy. Deeppose: Human pose estimation via deep neural networks. In Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on, pages 1653-1660. IEEE, 2014.
40. I. Tsochantaridis, T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. In Proceedings of the twenty-first international conference on Machine learning, page 104. ACM, 2004.
41. Z. Tu. Auto-context and its application to high-level vision tasks. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, pages 1-8. IEEE, 2008.
42. E. Tulving and D. L. Schacter. Priming and human memory systems. Science, 247(4940):301-306, 1990.
43. A. Vedaldi and K. Lenc. Matconvnet-convolutional neural networks for matlab. arXiv preprint arXiv:1412.4564, 2014.
44. D. Weiss, B. Sapp, and B. Taskar. Structured prediction cascades. arXiv preprint arXiv:1208.3279, 2012.
45. D. H. Wolpert. Stacked generalization. Neural networks, 5(2):241-259, 1992.
46. D.Wyatte, T. Curran, and R. C. O'Reilly. The limits of feedforward vision: Recurrent processing promotes robust object recognition when objects are degraded. J. Cognitive Neuroscience, pages 2248-2261, 2012.
47. X. Xiong and F. De la Torre. Supervised descent method and its applications to face alignment. In CVPR.
48. Y. Yang and D. Ramanan. Articulated pose estimation with flexible mixtures-of-parts. In CVPR, 2011.