Multiple camera tracking of interacting and occluded human motion

Proceedings of the IEEE

Volumn 89, Issue 10, 2001, Pages 1441-1455

  Dockstader, Shiloh L ^a,c   Murat Tekalp, A ^b  

^a University of Rochester   (United States)

^b Golden Key National Honor Society   (United States)

^c IEEE   (United States)

Author keywords

Bayesian network; Human motion; Kalman filtering; Multiple camera fusion; Occlusion; Real time tracking

Indexed keywords

EID: 0011956976     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.959340     Document Type: Article

References (53)

1. Y. Ivanov, C. Stauffer, A. Bobick, and W. E. L. Grimson, "Video surveillance of interactions," in Proc. Workshop Visual. Surveillance, Fort Collins, CO, June 26, 1999, pp. 82-89.
2. T. Boult, R. Micheals, A. Erkan, P. Lewis, C. Powers, C. Qian, and W. Yin, "Frame-rate multi-body tracking for surveillance," in Proc. DARPA Image Understanding Workshop, Monterey, CA, Nov. 20-23, 1998, pp. 305-313.
3. S. L. Dockstader and A. M. Tekalp, "Tracking multiple objects in the presence of articulated and occluded motion," in Proc. Workshop Human Motion, Austin, TX, Dec. 7-8, 2000, pp. 88-95.
4. I. Haritaoglu, D. Harwood, and L. S. Davis, "Hydra: Multiple people detection and tracking using silhouettes," in Proc. Workshop Visual Surveillance, Fort Collins, CO, June 26, 1999, pp. 6-13.
5. L. W. Campbell, D. A. Becker, A. Azarbayejani, A. F. Bobick, and A. Pentland, "Invariant features for 3-D gesture recognition," in Proc. Int. Conf. Automatic Face and Gesture Recognition, Killington, VT, Oct. 14-16, 1996, pp. 157-162.
6. A. D. Wilson and A. F. Bobick, "Parametric hidden Markov models for gesture recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, pp. 884-890, Sept. 1999.
7. A. Pentland, "Looking at people: Sensing for ubiquitous and wearable computing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 107-119, Jan. 2000.
8. J. M. Nash, J. N. Carter, and M. S. Nixon, "Extraction of moving articulated-objects by evidence gathering," in Proc. British Machine Vision Conf., Southampton, U.K., Sept. 14-17, 1998, pp. 609-618.
9. C. Bregler, "Learning and recognizing human dynamics in video sequences," in Proc. Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 17-19, 1997, pp. 568-574.
10. H. A. Rowley and J. M. Rehg, "Analyzing articulated motion using expectation-maximization," in Proc. Conf. Computer Vision and Pattern Recognition, San Juan, Puerto Rico, June 17-19, 1997, pp. 935-941.
11. D. Hogg, "Model-based Vision: A program to see a walking person," Image Vis. Comput., vol. 1, pp. 5-20, Jan. 1983.
12. D. M. Gavrila and L. S. Davis. "3-D model-based tracking of humans in action: A multiview approach," in Proc. Conf. Computer Vision and Pattern Recognition, San Francisco, CA, Jan. 18-20, 1996, pp. 73-80.
13. J. O'Rourke and N. I. Badler, "Model-based image analysis of human motion using constraint propagation," IEEE Trans. Pattern Anal Mach. Intell., vol. 2, pp. 522-536, Nov. 1980.
14. J. M. Rehg and T. Kanade, "Model-based tracking of self-occluding articulated objects," in Proc. Int. Conf. Computer Vision, Cambridge, MA, June 20-23, 1995, pp. 618-623.
15. S. Wachter and H.-H. Nagel, "Tracking persons in monocular image sequences," Comput. Vis. Image Understand., vol. 74, June 1999.
16. E.-J. Ong and S. Gong, "Tracking hybrid 2D-3D human models from multiple views," in Proc. Int. Workshop Modeling People, Kerkyra, Greece, Sept. 20, 1999, pp. 11-18.
17. M. Isard and A. Blake, "Condensation - conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, pp. 5-28, Aug. 1998.
18. K. Akita, "Image sequence analysis of real world human motion," Pattern Recognit., vol. 17, pp. 73-83, Jan. 1984.
19. M. K. Leung and Y.-H. Yang, "Human body motion segmentation in a complex scene," Pattern Recognit., vol. 20, pp. 55-64, Jan. 1987.
20. S. X. Ju, M. J. Black, and Y. Yacoob, "Cardboard people: A parameterized model of articulated image motion," in Proc. Int. Conf. Automatic Face and Gesture Recognition, Killington, VT, Oct. 14-16, 1996, pp. 38-44.
21. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, "Pfinder: Real-time tracking of the human body," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, pp. 780-785, July 1997.
22. Y.-S. Yao and R. Chellappa. "Tracking a dynamic set of feature points," IEEE Trans. Image Processing, vol. 4, pp. 1382-1395, Oct. 1995.
23. A. Azarbayejani and A. P. Pentland, "Recursive estimation of motion, structure and focal length," IEEE Trans. Pattern Anal. Mach. Intel!., vol. 17, pp. 562-575, June 1995.
24. T. J. Broida and R. Chellappa, "Estimating the kinematics, and structure of a rigid object from a sequence of monocular images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 13, pp. 497-513, June 1991.
25. F. Lerasle, G. Rives, and M. Dhome, ''Tracking of human limbs by multiocular vision," Comput. Vis. Image Understand., vol. 75, pp. 229-246, Sept. 1999.
26. D.-S. Jang and H.-I. Choi, "Active models for tracking moving objects," Pattern Recognit., vol. 33, pp. 1135-1146, July 2000.
27. N. Peterfreund, "Robust tracking of position and velocity with Kalman snakes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, pp. 564-569, June 1999.
28. J. MacCormick and A. Blake. "A probabilistic exclusion principle for tracking multiple objects," in Proc. Int. Conf. Computer Vision, Kerkyra, Greece, Sept. 20-27, 1999, pp. 572-578.
29. S. J. McKenna, S. Jabri, Z. Duric, and H. Wechsler, "Tracking interacting people," in Proc. Int. Conf. on Automatic Face and Gesture Recognition, Grenoble, France, Mar. 28-30, 2000, pp. 348-353.
30. 4: Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 809-830, Aug. 2000.
31. V. Kettnaker and R. Zabih, "Counting people from multiple cameras," in Proc. Int. Conf. Multimedia Computing and Systems, Florence, Italy, June 7-11, 1999, pp. 267-271.
32. G.-W. Chu and M. J. Chung, "An optimal image selection from multiple cameras under the limitation of communication capacity," in Proc. Int. Conf. Multisensor Fusion and Integration for Intelligent Systems, Taipei, Taiwan, Aug. 15-18, 1999, pp. 261-266.
33. T. Darrell, G. Gordon, M. Harville, and J. Woodfill, "Integrated person tracking using stereo, color and pattern detection," Int. J. Comput. Vis., vol. 37, pp. 175-185, June 2000.
34. Q. Cai and J. K. Aggarwal, "Tracking human motion in structured environments using a distributed-camera system," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, pp. 1241-1247, Nov. 1999.
35. S. Stillman, R. Tanawongsuwan, and I. Essa, "A system for tracking and recognizing multiple people with multiple cameras," in Proc. Int. Conf. Audio and Video-Based Biometric Person Authentication, Washington, DC, Mar. 22-23, 1999, pp. 96-101.
36. A. Utsumi, H. Mori, J. Ohya, and M. Yachida, "Multiple-human tracking using multiple cameras," in Proc. Int. Conf. Automatic Face and Gesture Recognition, Nara, Japan, Apr. 14-16, 1998, pp. 498-503.
37. J. Yamato, J. Ohya, and K. Ishii, "Recognizing human action in time-sequential images using hidden Markov model," in Proc. Conf. Computer Vision and Pattern Recognition, Champaign, IL, June 15-18, 1992, pp. 379-385.
38. M. J. Black and A. J. Jepson, "Recognizing temporal trajectories using the condensation algorithm," in Proc. Int Conf. Automatic Face and Gesture Recognition, Nara , Japan, Apr. 14-16, 1998, pp. 16-21.
39. T. J. Olson and F. Z. Brill, "Moving object detection and event recognition algorithms for smart cameras," in Proc. DARPA Image Understanding Workshop, New Orleans, LA, May 11-14, 1997, pp. 159-175.
40. Y. Yacoob and M. J. Black, "Parameterized modeling and recognition of activities," Comput. Vis. Image Understand., vol. 73. pp. 232-247, Feb. 1999.
41. Y. Yacoob and L. S. Davis, "Learned models for estimation of rigid and articulated human motion from stationary or moving camera," Int. J. Comput. Vis., vol. 12, pp. 5-30, Jan, 2000.
42. C. R. Wren and A. P. Pentland, "Dynamic models of human motion," in Proc. Int. Conf. Automatic Face, and Gesture Recognition, Nara , Japan, Apr. 14-16, 1998, pp. 22-27.
43. S. Nagaya, S. Seki, and R. Oka, "A theoretical consideration of pattern space trajectory for gesture spotting recognition," in Proc. Int. Conf. Automatic Face and Gesture Recognition, Killington. VT. Oct. 14-16, 1996, pp. 72-77.
44. D. M. Gavrila, "The visual analysis of human movement: A survey," Comput. Vis. Image Understand., vol. 73, pp. 82-98, Jan. 1999.
45. J. K. Aggarwal and Q. Cai, "Human motion analysis: A review," Computer Vis. Image Understand., vol. 73, pp. 428-440, Mar. 1999.
46. R. T. Collins, A. J. Lipton, and T. Kanade, "Introduction to the special section on video surveillance," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 745-746, Aug. 2000.
47. J. Pearl, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference. San Francisco, CA: Morgan Kaufmann, 1988.
48. Y. Altunbasak, A. M. Tekaip, and G. Bozdagi, "Simultaneous stereomotion fusion and 3-D motion tracking," in Proc. Int. Conf. Acoustics, Speech and Signal Processing, vol. 4, Detroit, MI, May 9-12, 1995, pp. 2270-2280.
49. N. M. Oliver, B. Rosario, and A. P. Pentland, "A Bayesian computer vision system for modeling human interactions," IEEE Trans. Pattern Anal. Mach. Intett., vol. 22, pp. 831-843, Aug. 2000.
50. J. L. Barron, D. J. Fleet, and S. S. Beauchemin, "Systems and experiment: Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
51. Z. Sun, "Object-based video processing with depth," Ph.D. dissertation, Univ. Rochester, Rochester, NY, 2000.
52. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1998.
53. H. Sidenbladh, M. J. Black, and D. J. Fleet, "Stochastic tracking of 3D human figures using 2D image motion," in Proc. Eur. Conf. Computer Vision, Dublin, Ireland, June 26, 2000, pp. 702-718.