Real-time human pose estimation: A case study in algorithm design for smart camera networks

Proceedings of the IEEE

Volumn 96, Issue 10, 2008, Pages 1715-1732

  Wu, Chen ^a   Aghajan, Hamid ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

Distributed vision processing; Embedded vision; Gesture analysis; Human pose estimation; Real time vision for gaming; Smart camera networks

Indexed keywords

ASSISTED LIVING; DATA FUSION; DATA HANDLING; DISTRIBUTED COMPUTER SYSTEMS; MULTIMEDIA SERVICES; PATIENT MONITORING; VIRTUAL REALITY;

DISTRIBUTED VISION; EMBEDDED VISIONS; GESTURE ANALYSIS; HUMAN POSE ESTIMATIONS; REAL TIME VISION; SMART CAMERA NETWORKS;

CAMERAS;

EID: 55549097782     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2008.928766     Document Type: Article

References (37)

1. Y.-L. Tian, M. Lu, and A. Hampapur, "Robust and efficient foreground analysis for real-time video surveillance, " in Proc. IEEE Camput. Soc. Conf. Camput. Vis. Pattern Recog., San Diego, CA, Jun. 2005, vol. 1, pp. 1182-1187.
2. B. Kwolek, "Visual system for tracking and interpreting selected human actions," in Proc. 11th Int. Conf. Central Eur. Comput. Graph., Vis. Comput. Vis. (WSCG), Plzen-Bory, Czech Republic, vol. 11, no. 1, Feb. 2003.
3. G. Ye, J. J. Corso, and G. D. Hager, "7: Visual modeling of dynamic gestures using 3d appearance and motion features," in Real-Time Vision for Human-Computer Interaction. Berlin, Germany: Springer-Verlag, 2005, pp. 103-120.
4. A. M. Tabar, A. Keshavarz, and H. Aghajan, "Smart home care network using sensor fusion and distributed vision-based reasoning," in Proc. 4th ACM Int. Workshop Video Surveillance Sensor Netw. (VSSN), Santa Barbara, CA, Oct. 2006, pp. 145-154.
5. H. Aghajan, J. Augusto, C. Wu, P. McCullagh, and J.-A. Walkden, "Distributed vision-based accident management for assisted living," in Proc. 5th Int. Conf. Smart Homes Health Telematics (ICOST), Nara, Japan, Jun. 2007, pp. 196-205.
6. R. Patil, P. E. Rybski, T. Kanade, and M. M. Veloso, "People detection and tracking in high resolution panoramic video mosaic," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Sendai, Japan, Oct. 2004, vol. 1, pp. 1323-1328.
7. C. Robertson and E. Trucco, "Human body posture via hierarchical evolutionary optimization," in Proc. Brit. Mach. Vis. Conf. (BMVC), Edinburg, U.K., Sep. 2006, p. III:999.
8. A. Hilton, D. Beresford, T. Gentils, R. Smith, W. Sun, and J. Illingworth, "Whole-body modelling of people from multi-view images to populate virtual worlds," Visual Comput. Int. J. Comput. Graph., vol. 16, no. 7, pp. 411-436, 2000.
9. L. Muendermann, S. Corazza, and T. Andriacchi, "The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications, " J. NeuroEng. Rehab., vol. 3, no. 1, Mar. 2006.
10. R. Kleihorst, B. Schueler, and A. Danilin, "Architecture and applications of wireless smart cameras (networks)," in Proc. Int. Conf. Acoust., Speech, Signal Process., Honolulu, Hawaii, Apr. 2007, pp. 1373-1376.
11. C. Wu, H. Aghajan, and R. Kleihorst, "Mapping vision algorithms on SIMD architecture smart cameras," in Proc. Int. Conf. Distrib. Smart Cameras (ICDSC), Vienna, Austria, Sep. 2007, pp. 27-34.
12. C. Wu and H. Aghajan, "Layered and collaborative gesture analysis in multi-camera networks," in Proc. Int. Conf. Acoustics, Speech, Signal Process., Honolulu, Hawaii, Apr. 2007, pp. 1377-1380.
13. H. Sidenbladh, M. J. Black, and L. Sigal, "Implicit probabilistic models of human motion for synthesis and tracking," in Proc. 7th Eur. Conf. Comput. Vis.-Part I (ECCV '02), London, U.K., 2002, pp. 784-800.
14. J. Deutscher, A. Blake, and I. D. Reid, "Articulated body motion capture by annealed particle filtering," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog. (CVPR), Hilton Head Island, SC, Jun. 2000, pp. II: 126-133.
15. K. M. Cheung, S. Baker, and T. Kanade, "Shape-from-silhouette across time: Part ii: Applications to human modeling and markerless motion tracking," Int. J. Comput. Vis., vol. 63, no. 3, pp. 225-245, Aug. 2005.
16. C. Ménier, E. Boyer, and B. Raffin, "3D skeleton-based body pose recovery," in Proc. 3rd Int. Symp. 3D Data Process., Vis. Transm., Chapel Hill, NC, Jun. 2006, pp. 389-396.
17. I. Mikic, M. Trivedi, E. Hunter, and P. Cosman, "Human body model acquisition and tracking using voxel data," Int. J. Comput. Vis., vol. 53, no. 3, pp. 199-223, 2003.
18. H. Sidenbladh and M. J. Black, "Learning the statistics of people in images and video," Proc. IJCV, vol. 54, no. 1-3, pp. 183-209, 2003.
19. D. M. Gavrila and L. S. Davis, "3-D model-based tracking of humans in action: A multi-view approach," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., San Francisco, CA, Jun. 1996, pp. 73-80.
20. S. Ivecovic and E. Trucco, "Human body pose estimation with PSO," in IEEE Congr. Evol. Comput., 2006, pp. 1256-1263.
21. M. Dimitrijevic, V. Lepetit, and P. Fua, "Human body pose detection using bayesian spatio-temporal templates," Comput. Vis. Image Understanding, vol. 104, no. 2, pp. 127-139, 2006.
22. L. Sigal and M. J. Black, "Predicting 3D people from 2D pictures," in Proc. IV Conf. Artic. Motion Deform. Objects, Mallorca, Spain, Jul. 2006, pp. 185-195.
23. Y. Weiss and E. Adelson, "Perceptually organized EM: A framework for motion segmentation that combines information about form and motion," MIT Media Lab., Tech. Rep. 315.
24. C. Wu and H. Aghajan, "Model-based image segmentation for multi-view human gesture analysis," in Proc. Adv. Concepts Intell. Vis. Syst. (ACIVS), Delft, The Netherlands, Aug. 2007, pp. 310-321.
25. C. Wu and H. Aghajan, "Model-based human posture estimation for gesture analysis in an opportunistic fusion smart camera network," in Proc. IEEE Conf. Adv. Video Signal Based Surveillance, London, U.K., Sep. 2007, pp. 453-458.
26. E. B. Sudderth, M. I. Mandel, W. T. Freeman, and A. S. Willsky, "Visual hand tracking using nonparametric belief propagation," in Proc. Workshop Generative Model Based Vis. Conjunction With IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Washington, DC, Jul. 2004, p. 189.
27. L. Sigal and M. J. Black, "Measure locally, reason globally: Occlusion-sensitive articulated pose estimation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., New York, NY, Jun. 2006, pp. 2041-2048.
28. P. F. Felzenszwalb and D. P. Huttenlocher, "Pictorial structures for object recognition," Int. J. Comput. Vis., vol. 61, no. 1, pp. 55-79, 2005.
29. M. Bergtholdt, J. H. Kappes, and C. Schnörr, "Graphical knowledge representation for human detection, " in Proc. Int. Workshop Represent. Use Prior Knowl. Vis., Graz, Austria, May 2006.
30. D. Ramanan, D. A. Forsyth, and A. Zisserman, "Strike a pose: Tracking people by finding stylized poses," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., San Diego, CA, Jun. 2005, vol. 1, pp. 271-278.
31. C. Bregler and J. Malik, "Tracking people with twists and exponential maps," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Santa Barbara, CA, Jun. 1998, p. 8.
32. M. Isard, "Pampas: Real-valued graphical models for computer vision," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Madison, WI, Jun. 2003, vol. 1, p. 613.
33. F. Sudderth, T. Ihler, W. Freeman, and A. Willsky, "Nonparametric belief propagation," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recog., Madison, WI, Jun. 2003, vol. 1, pp. 605-612.
34. P. A. Viola and M. J. Jones, "Robust real-time face detection," Proc. IJCV, vol. 57, no. 2, pp. 137-154, May 2004.
35. Y. Chen, Y. Rui, and T. S. Huang, "Multicue HMM-UKF for real-time contour tracking," IEEE Trans. Pattern Anal. Machine Intell., vol. 28, no. 9, pp. 1525-1529, 2006.
36. H. Sidenbladh, M. J. Black, and D. J. Fleet, "Stochastic tracking of 3D human figures using 2D image motion," in Proc. 6th ECCV, Dublin, Ireland, Jun. 2000, pp. 702-718.
37. C. Wu, H. Aghajan, and R. Kleihorst, "Real-time human posture reconstruction in wireless smart camera networks," in Proc. Int. Conf. Inform. Process. Sensor Netw., St. Louis, MO, Apr. 2008, pp. 321-331.