A framework for heading-guided recognition of human activity

Computer Vision and Image Understanding

Volumn 91, Issue 3, 2003, Pages 335-367

  Rosales, Rómer ^a   Sclaroff, Stan ^a  

^a BOSTON UNIVERSITY   (United States)

Author keywords

Computer vision; Motion recognition; Motion tracking; Recursive estimation; Temporal compares; Video surveillance

Indexed keywords

ALGORITHMS; CAMERAS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; IMAGE SEGMENTATION; KALMAN FILTERING; MATHEMATICAL MORPHOLOGY; MOTION ESTIMATION; OBJECT RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS;

ACTION RECOGNITION; EXTENDED KALMAN FILTERING; HEADING GUIDED RECOGNITION; MOTION RECOGNITION; MOTION TRACKING; RECURSIVE ESTIMATION; TEMPORAL TEMPLATES; VIDEO SURVEILLANCE;

COMPUTER VISION;

EID: 0141919383     PISSN: 10773142     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1077-3142(03)00096-1     Document Type: Article

References (71)

1. A. Azarbayejani, A. Pentland, Recursive estimation of motion, structure, and focal length, IEEE Trans. Pattern Anal. Mach. Intell. 17 (6) (1995) 562-575.
2. C. Barron, I. Kakadiaris, Estimating anthropometry and pose from a single uncalibrated image, Comput. Vision Image Understanding 81 (3) (2001) 269-284.
3. A. Baumberg, D. Hogg, An efficient method for contour tracking using active shape models, in: Proc. IEEE Workshop on Motion of Non-rigid and Articulated Objects, IEEE Computer Society Press, 1994, pp. 194-199.
4. A. Baumberg, D. Hogg, Learning flexible models from image sequences, in: Proc. Eur. Conf. on Computer Vision, vol. 1, 1994, pp. 299-308.
5. M. Bichsel, Segmenting simply connected moving objects in a static scene, IEEE Trans. Pattern Anal. Mach. Intell. 16 (11) (1994) 1138-1142.
6. M. Black, A. Jepson, A probabilistic framework for matching temporal trajectories: CONDENSATION-based recognition of gestures and expressions, in: Proc. Eur. Conf. on Computer Vision, 1998, pp. 909-924.
7. M. Black, Y. Yacoob, Tracking and recognizing rigid and non-rigid facial motion using local parametric models of image motion, in: Proc. Internat. Conf. on Computer Vision, 1995, pp. 374-381.
8. H. Blom, An efficient filter for abruptly changing systems, in: Proc. Conf. on Decision Control, 1984, pp. 656-658.
9. A. Bobick, J. Davis, The representation and recognition of action using temporal templates, IEEE Trans. Pattern Anal. Mach. Intell. 23 (3) (2001) 257-267.
10. K. Bradshaw, I. Reid, D. Murray, The active recovery of 3D motion trajectories and their use in prediction, IEEE Trans. Pattern Anal. Mach. Intell. 19 (3) (1997) 219-234.
11. M. Brand, Shadow puppetry, in: Proc. Internat. Conf. on Computer Vision, 1999, pp. 1237-1244.
12. C. Bregler, Tracking people with twists and exponential maps, in: Proc. Computer Vision and Pattern Recognition, 1998, pp. 8-15.
13. T. Broida, R. Chellappa, Estimating the kinematics and structure of a rigid object from a sequence of monocular images, IEEE Trans. Pattern Anal. Mach. Intell. 13 (6) (1991) 497-513.
14. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, Proc. Comput. Vision Pattern Recog. (2) (2000) 142-149.
15. T.J. Darell, A.P. Pentland, Classifying hand gestures with a view-based distributed representation, in: J.D. Cowan et al. (Eds.), Advances in Neural Information Processing Systems, 6, Morgan Kaufman, 1994, pp. 945-952.
16. J. Davis, Human motion analysis using hierarchical motion history images, IEEE Workshop on Detection and Recognition of Events in Video 23 (3) (2001) 257-267.
17. Q. Delamarre, O. Faugeras, 3D articulated models and multiview tracking with physical forces, Comput. Vision Image Understanding 81 (3) (2001) 328-357.
18. A. Dempster, N. Laird, D. Rubin, Maximum likelihood estimation from incomplete data, J. Roy. Statist. Soc. Ser. B. 39 (1) (1977) 1-38.
19. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, Proc. Comput. Vision Pattern Recog. (2) (2000) 126-133.
20. S. Fejes, L. Davis, What can projections of flow fields tell us about the visual motion, in: Proc. Internat. Conf. on Computer Vision, 1998, pp. 979-986.
21. H. Fujiyoshi, A. Lipton, Real-time human motion analysis by image skeletonization, in: Workshop on Applications of Computer Vision, 1998, pp. 15-21.
22. K. Fukunaga, Introduction to Statistical Pattern Recognition, Academic Press, New York, 1972.
23. A. Galata, N. Johnson, D. Hogg, Learning variable-length Markov models of behavior, Comput. Vision Image Understanding 81 (3) (2001) 398-413.
24. D. Gavrila, The visual analysis of human movement: a survey, Comput. Vision Image Understanding 73 (1) (1999) 82-98.
25. D. Gavrila, L. Davis, Tracking of humans in actions: a 3-D model-based approach, in: Proc. ARPA Image Understanding Workshop, Palm Springs, 1996, pp. 737-746.
26. W.E.L. Grimson, C. Stauffer, R. Romano, L. Lee, Using adaptive tracking to classify and monitor activities in a site, Proc. Comput. Vision Pattern Recog. (1998) 22-31.
27. I. Haritaouglu, R. Cutler, D. Harwood, L.S. Davis, Backpack: detection of people carrying objects using silhouettes, Comput. Vision Image Understanding 81 (3) (2001) 385-397.
28. N. Howe, M. Leventon, B. Freeman, Bayesian reconstruction of 3D human motion from single-camera video, in: S.A. Solla et al. (Eds.), Advances in Neural Information Processing Systems, MIT Press, 2000, pp. 820-826.
29. L. Davis, I. Haritaouglu, D. Harwood, W4S: A realtime system for detecting and tracking people in 2.5D, in: Proc. Eur. Conf. on Computer Vision, 1998, pp. 877-892.
30. S. Intille, A. Bobick, Recognizing planned, multiperson action, Comput. Vision Image Understanding 81 (3) (2001) 414-445.
31. S. Intille, A.F. Bobick. Real time close world tracking, Proc. Comput. Vision Pattern Recog. (1997) 697-703.
32. M. Irani, P. Anandan, A unified approach to moving object detection in 2D and 3D scenes, IEEE Trans. Pattern Anal. Mach. Intell. 20 (2) (1998) 577-589.
33. M. Isard, A. Blake, Condensation-conditional density propagation for visual tracking, Internat. J. Comput. Vision 29 (1) (1998) 5-28.
34. M. Isard, A. Blake, ICONDENSATION: unifying low-level and high-level tracking in a stochastic framework, in: Proc. Eur. Conf. Computer Vision, 1998, pp. 893-908.
35. N. Johnson, D.C. Hogg, Learning the distribution of object trajectories for event recognition, Image Vision Comput. 14 (1996) 609-615.
36. S. Ju, M. Black, Y. Yacoob. Cardboard people: a parameterized model for articulated image motion, in: Proc. Internat. Conf. on Automatic Face and Gesture Recognition. 1996, pp. 38-44.
37. I. Kakadiaris, D. Metaxas, R. Bajcsy, Active part-decomposition, shape and motion estimation of articulated objects: a physics-based approach, Proc. Comput. Vision Pattern Recog. (1994) 980-984.
38. T. Kohonen, Self-organized formation of topologically correct feature maps, Biol. Cybernet. 43 (1982) 59-69.
39. P. Kornprobst, G. Medioni, Tracking segmented objects using tensor voting, Proc. Comput. Vision Pattern Recog. (2) (2000) 118-125.
40. M.W. Krueger, Virtual Reality II, Addison-Wesley, 1990.
41. D. Metaxas, D. Terzopoulos, Shape and non-rigid motion estimation through physics-based synthesis, IEEE Trans. Pattern Anal. Mach. Intell. 15 (6) (1993) 580-591.
42. T. Moeslund, E. Granum, A survey of computer vision-based human motion capture, Comput. Vision Image Understanding 81 (3) (2001) 231-268.
43. D. Morris, J. Rehg, Singularity analysis for articulated object tracking, Proc. Comput. Vision Pattern Recog. (1998) 289-296.
44. R. Nelson, Qualitative detection of motion by a moving observer, Internat. J. Comput. Vision 7 (1) (1991) 33-46.
45. N. Oliver, B. Rosario, A. Pentland, A Bayesian computer vision system for modeling human interactions, IEEE Trans. Pattern Anal. Mach. Intell., Special Issue Video Surveillance (2001), pp. 831-843.
46. A. Pentland, B. Horowitz, Recovery of non-rigid motion and structure, IEEE Trans. Pattern Anal. Mach. Intell. 13 (7) (1991) 730-742.
47. R. Plankers, P. Fua, Tracking and modeling people in video sequences, Comput. Vision Image Understanding 81 (3) (2001) 285-302.
48. R. Polana, R. Nelson, Low level recognition of human motion, in: Proc. IEEE Workshop on Nonrigid and Articulate Motion of d Objects, 1994, pp. 77-82.
49. B. Rao, H. Durran-Whyte, J. Sheen, A fully decentralized multi-sensor system for tracking and surveillance, Internat. J. Robot. Res. 12 (1) (1993) 20-44.
50. C. Rao, A. Yilmaz, M. Shah, View-invariant representation and recognition of actions, Internat. J. Comput. Vis. 50 (2) (2002) 203-226.
51. J. M. Regh, T. Kanade, Model-based tracking of self-occluding articulated objects, in: Proc. Internat. Conf. on Computer Vision, 1995, pp. 612-617.
52. P. Remagnino, A. Baumberg, T. Grove, D. Hogg, T. Tan, A. Worrall, K. Baker, An integrated traffic and pedestrian model-bassed vision system, in: British Machine Vision Conference, 1997, pp. 380-389.
53. D. Reynard, A. Wildenberg, A. Blake, J. Marchant, Learning dynamics of complex motions from image sequences, in: Proc. Eur. Conf. on Computer Vision, 1996, pp. 357-368.
54. K. Rohr, Towards model-based recognition of human movements in image sequences, CVGIP: Image Understanding 59 (1) (1994) 94-115.
55. R. Rosales, Recognition of human action using moment-based features, Technical Report BU 98-020, Boston University, 1998.
56. R. Rosales, A collection of results on tracking people in real scenes, 2000. Available from http://cs-people.bu.edu/rrosales/research/IMHT/.
57. R. Rosales, Improved tracking of multiple humans with trajectory prediction, occlusion modeling, and motion analysis, Master's thesis, Boston University, 2000.
58. R. Rosales, Street and Charles River human activity sequences, 2000. Available from http://cs-people.bu.edu/rrosales/SCRSeqs/.
59. R. Rosales, S. Sclaroff, Improved tracking of multiple humans with trajectory prediction and occlusion modeling, in: IEEE CVPR Workshop on the Interpretation of Visual Motion, 1998.
60. R. Rosales, S. Sclaroff, Learning body pose using specialized maps, in: T.G. Dietterich et al. (Eds.), Advances in Neural Information Processing Systems 14, MIT Press, 2002, pp. 1263-1270.
61. R. Rosales, S. Sclaroff, Inferring body pose without tracking body parts, Proc. Comput. Vision Pattern Recog. 2 (2000) 721-727.
62. M. Shah, R. Jain, Motion-Based Recognition, Kluwer Academic, 1997.
63. H. Siddenbladh, M. Black, D. Fleet, Stochastic tracking of 3D human figures using 2D image motion, in: Proc. Eur. Conf. on Computer Vision, 2000, pp. 702-718.
64. Y. Song, L. Goncalves, E. DiBernardo, P. Perona, Monocular perception of biological motion in Johansson displays, Comput. Vision Image Understanding 81 (3) (2001) 303-327.
65. H.W. Sorenson, Least-squares estimation: from Gauss to Kalman, IEEE Spectrum 7 (1970) 63-68.
66. C. Stauffer, W.E.L. Grimson, Adaptive background mixture models for real-time tracking, Proc. Comput. Vision Pattern Recog. 2 (1999) 246-252.
67. R. Szeliski, S. Bing Kang, Recovering 3d shape and motion from image streams using nonlinear least squares, J. Visual Commun. Image Rep. 5 (1) (1994) 10-28.
68. G. Welch, G. Bishop, An introduction to the Kalman filter, Technical Report TR 95-041, Computer Science, UNC Chapel Hill, 1995.
69. C. Wren, A. Azarbayejani, T. Darell, A. Pentland, Pfinder: Real time tracking of the human body, IEEE Trans. Pattern Anal. Mach. Intell 19 (7) (1997) 780-785.
70. M. Yamamoto, A. Sato, S. Kawada, T. Kondo, Y. Osaki, Incremental tracking of human actions from multiple views, in: Proc. Comput. Vision and Pattern Recog., 1998, pp. 2-7.
71. Z. Zhang, O. Faugeras, 3D Dynamic Scene Analysis: A Stereo Based Approach, Springer, Berlin, 1992.