Shape-from-silhouette across time part II: Applications to human modeling and markerless motion tracking

International Journal of Computer Vision

Volumn 63, Issue 3, 2005, Pages 225-245

  Cheung, Kong Man ^a   Baker, Simon ^b   Kanade, Takeo ^b  

^a Neven Vision   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

3D reconstruction; Articulated human tracking; Human kinematic modeling; Markerless motion capture; Shape From Silhouette; Stereo; Temporal alignment; Visual hull

Indexed keywords

ALGORITHMS; COLOR; IMAGE SEGMENTATION; MOTION CONTROL; PHOTOMETRY;

HUMAN KINEMATIC MODELS; SHAPE-FROM-SILHOUETTE (SFS); TEMPORAL ALIGNMENT; VISUAL HULL;

COMPUTER VISION;

EID: 24044503340     PISSN: 09205691     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11263-005-6879-4     Document Type: Article

References (60)

1. Allen, B., Curless, B., and Popovic, Z. 2003. The space of human body shapes: Reconstruction and parameterization from range scans. In Computer Graphics Annual Conference Series (SIGGRAPH'03), San Diego, CA, pp. 587-594.
2. Beymer, D. and Konolige. K. 1999. Real-time tracking of multiple people using stereo. In Proceedings of International Conference on Computer Vision (ICCV'99), Corfu, Greece.
3. Barron, C. and Kakadiaris, I. 2000. Estimating anthropometry and pose from a single image. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00), Hilton Head Island SC.
4. Blinn, J. 1982. A generalization of algebraic surface drawing. ACM Transactions on Graphics, 1(3):235-256.
5. Bregler, C. and Malik, J. 1997. Video motion capture. Technical Report CSD-97-973, University of California Berkeley.
6. Bregler, C. and Malik, J. 1998. Tracking people with twists and exponential map. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'98), Santa Barbara, CA, vol. 1, pp. 8-15.
7. Baker, S. and Matthews, I. 2004. Lucas-kanade 20 years on: A unifying framework. International Journal of Computer Vision, 56(3):221-255.
8. Cai, Q. and Aggarwal, J. 1996. Tracking human motion using multiple cameras. In Proceedings of International Conference on Pattern Recognition (ICPR'96), vol. 3, pp. 68-72.
9. Cai, Q. and Aggarwal, J. 1998. Automatic tracking of human motion in indoor scenes across multiple synchronized video streams. In Proceedings of the Sixth International Conference on Computer Vision (ICCV'98), Bombay, India.
10. Cheung, K., Baker, S., Hodgins, J., and Kanade, T. 2004. Markerless human motion transfer. In Proceedings of the Second International Symposium on 3D Data Processing, Visualization and Transmission (3DPVT'04), Thessaloniki, Greece.
11. Cheung, G., Baker, S., and Kanade, T. 2003b. Shape-from-silhouette for articulated objects and its use for human body kinematics estimation and motion capture. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Madison, MI.
12. Cheung, G., Baker, S., and Kanade, T. 2003a. Visual hull alignment and refinement across time: A 3D reconstruction algorithm combining shape-frame-silhouette with stereo. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'03), Madison, MI.
13. Cheung, K., Baker, S., and Kanade, T. 2005. Shape-from-silhouette across time part I: Theory and algorithms. International Journal on Computer Vision, 62(3):221-247.
14. Cheung, G. 2003. Visual hull construction, alignment and refinement for human kinematic modeling, motion tracking and rendering. PhD thesis, Carnegie Mellon University.
15. Cheung, G., Kanade, T., Bouquet, J., and Holler, M. 2000. A real time system for robust 3D voxel reconstruction of human motions. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00), Hilton Head Island, SC.
16. Coen, M. 1998. Design principals for intelligent environments. In Proceedings of AAAI Spring Symposium on Intelligent Environments, Stanford, CA.
17. Cham, T. and Rehg, J. 1999a. A multiple hypothesis approach to figure tracking. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'99), Ft. Collins, CO.
18. Cham, T. and Rehg, J. 1999b. Dynamic feature ordering for efficient registration. In Proceedings of International Conference on Computer Vision (ICCV'99), Corfu, Greece.
19. Carranza, J., Theobalt, C., Magnor, M., and Seidel, H. 2003. Free-viewpoint video of human actors. In Computer Graphics Annual Conference Series (SIGGRAPH'03), San Diego, CA, pp. 569-577.
20. Cybearware. http://www.cyberware.com.
21. Deutscher, J., Blake, A., and Reid, I. 2000. Articulated body motion capture by annealed particle filtering. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'00), Hilton Head Island, SC.
22. Drammond, T. and Cipolla, R. 2001. Real-time tracking of highly articulated structures in the presence of noisy measurements. In Proceedings of International Conference on Computer Vision (ICCV'01), Vancouver, Canada, pp. 315-320.
23. DiFranco, D., Cham, T., and Rehg, J. 1999. Recovering of 3D articulated motion from 2d correspondences. Technical Report CRL 99/7, Compaq Cambridge Research Laboratory.
24. Difranco, D., Cham, T., and Rehg, J. 2001. Reconstruction of 3D figure motion from 2D correspondences. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'01), Kauai, HI.
25. Delamarre, Q. and Faugeras, O. 1999. 3D articulated models and multi-view tracking with silhouettes. In Proceedings of International Conference on Computer Vision (ICCV'99), Corfu, Greece.
26. Fua, P., Gruen, A., D'Apuzzo, N., and Plänkers, R. 2002. Markerless full body shape and motion capture from video sequences. International Archives of Photogrammetry and Remote Sensing, 34(5):256-261.
27. Fua, P., Herda, L. Plänkers, R., and Boulic, R. 2000. Human shape and motion recovery using animation models. In XIX ISPRS Congress.
28. Gavrila, G. and Davis, L. 1996. Tracking of humans in action: 3D model-based approach. In ARPA Image Understanding Workshop 1996.
29. Haritaoglu, I., Harwood, D., and Davis, L.S. 1998. W4: Who? when? where? what? a real time system for detecting and tracking people. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (ICAFGR'98), Japan.
30. Ju, S., Black, M., and Yacoob, Y. 1996. Cardboard people: A parameterized model of articulated image motion. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (ICAFGR'96), Vermont, USA.
31. Jojic, N., Turk, M., and Huang, T. 1999. Tracking self-occluding articulated objects in dense disparity maps. In Proceedings of International Conference on Computer Vision (ICCV'99), Corfu, Greece.
32. Kakadiaris, I. and Metaxas, D. 1995. 3D human body model acquisition from multiple views. In Proceedings of International Conference on Computer Vision (ICCV'95), Cambridge MA, pp. 618-623.
33. Kakadiaris, I. and Metaxas, D. 1998. 3D human body model acquisition from multiple views. International Journal on Computer Vision, 30(3):191-218.
34. Kakadiaris, I., Metaxas, D., and Bajcsy, R. 1994. Active part-decomposition, shape and motion estimation of articulated objects: A physics-based approach. Technical Report IRCS Report 94-18, University of Pennsylvania.
35. Krahnstoever, N., Yeasin, M., and Sharma, R. 2001. Automatic acquisition and initialization of kinematic models. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'01), Technical Sketches, Kauai, HI.
36. Krahnstoever, N., Yeasin, M., and Sharma, R. 2003. Automatic acquisition and initialization of articulated models. In To appear in Machine Vision and Applications.
37. Liebowitz, D. and Carlsson, S. 2001. Uncalibrated motion capture exploiting articulated structure constraints. In Proceedings of International Conference on Computer Vision (ICCV'01), Vancouver, Canada.
38. Leung, M. and Yang, Y. 1995. First sight: A human body outline labeling system. IEEE Transactions Pattern Analysis and Machine Intelligence, 17(4):359-377.
39. Lucente, M., Zwart, G., and George, A. 1998. Visualization space: A testbed for deviceless multimodal user interface. In Proceedings of AAAI Spring Symposium on Intelligent Environments, Stanford, CA.
40. Matusik, W. 2001. Image-based visual hulls. Master's thesis, Massachusetts Institute of Technology.
41. Meta motion, http://www.metamotion.com.
42. Moeslund, T. and Granum, E. 2001. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding: CVIU, 81(3):231-268.
43. Mikic, I., Hunter, E., Trivedi, M., and Cosman, P. 2001. Articulated body posture estimation from multi-camera voxel data. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'01), Kauai, HI.
44. Murray, R., Li, Z., and Sastry, S. 1994. A Mathematical Introduction to Robotic Manipulation, CRC Press.
45. Moezzi, S., Tai, L., and Gerard, P. 1997. Virtual view generation for 3D digital video. IEEE Computer Society Multimedia, 4(1).
46. Mikic, I., Trivedi, M., Hunter, E., and Cosman, P. 2003. Human body model acquisition and tracking using voxel data. International Journal on Computer Vision, 53(3): 199-223.
47. O'Brien, J., Bodenheimer, R., Brostow, G., and Hodgins, J. 2000. Automatic joint parameter estimation from magnetic motion capture data. In Proceedings of Graphics Interface'00, pp. 53-60.
48. Plänkers, R. and Fua, P. 2001. Articulated soft objects for video-based body modeling. In Proceedings of International Conference on Computer Vision (ICCV'01), Vancouver, Canada, pp. 394-401.
49. Plänkers, R., Fua, P., and D'Apuzzo, N. 1999. Automated body modeling from video sequences. In Proceedings of the 1999 International Workshop on Modeling People (MPEOPLE'99), Corfu, Greece.
50. Pavlovic, V., Rehg, J., Cham, T., and Murphy, K. 1999. A dynamic bayesian network approach to figure tracking using learned dynamic models. In Proceedings of International Conference on Computer Vision (ICCV'99), Corfu, Greece.
51. Rehg, J. and Kanade, T. 1995. Model-based tracking of self-occluding articulated objects. In Proceedings of International Conference on Computer Vision (ICCV'95), Cambridge MA., pp. 612-617.
52. Sidenbladh, H., Black, M., and Fleet, D. 2000a. Stochastic tracking of 3D human figures using 2D image motion. In Proceedings of European Conference on Computer Vision (ECCV'00), Dublin, Ireland.
53. Sullivan, J. and Carlsson, S. 2002. Recognizing and tracking human action. In Proceedings of European Conference on Computer Vision (ECCV'02), Denmark.
54. Sidenbladh, H., DeLaTorre, F., and Black, M. 2000b. A framework for modeling the appearance of 3D articulated figures. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (ICAFGR'00).
55. Shafer, S., Krumm, J., Brumitt, B., Meyers, B., Czerwinski, M., and Robbins, D. 1998. The new easyliving project at microsoft research. In Proceedings of Joint DARPA/NIST Smart Spaces Workshop, Gaithersburgh, MD.
56. Sand, P., McMillan, L., and Popovic, J. 2003. Continuous capture of skin deformation. In Computer Graphics Annual Conference Series (SIGGRAPH'03), San Diego, CA, pp. 578-586.
57. Thirdtech inc. http://www.3rdtech.com.
58. Vicon motion systems, http://www.vicon.com.
59. Wren, C., Azarbayejani, A., Darrell, T., and Pentland, A. 1997. Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):780-785.
60. Yamamoto, M., Sato, A., Kawada, S., Kondo, T., and Osaki, Y. 1998. Incremental tracking of human actions from multiple views. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'98), CA, vol. 1, pp. 2-7.