Tracking pedestrians using local spatio-temporal motion patterns in extremely crowded scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 34, Issue 5, 2012, Pages 987-1002

  Kratz, Louis ^a   Nishino, Ko ^a  

^a Drexel University   (United States)

Author keywords

crowded scenes; hidden Markov models; spatio temporal motion patterns; Tracking; video analysis

Indexed keywords

BAYESIAN FRAMEWORKS; BEHAVIOR ANALYSIS; COLLECTIVE MOTIONS; COMPLEX SCENES; COMPUTER VISION APPLICATIONS; CROWDED SCENES; HIDDEN MARKOV MODELS (HMMS); MOTION PATTERN; PARTIAL OCCLUSIONS; SCENE UNDERSTANDING; SPACE-TIME MODEL; SPACE-TIME REGION; SPATIO-TEMPORAL; STRUCTURED PATTERNS; VIDEO ANALYSIS;

COMPUTER VISION; HIDDEN MARKOV MODELS; SURFACE DISCHARGES;

TIME AND MOTION STUDY;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; CROWDING; HUMAN; IMAGE PROCESSING; METHODOLOGY; PROBABILITY; VIDEORECORDING; WALKING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; CROWDING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; PATTERN RECOGNITION, AUTOMATED; VIDEO RECORDING; WALKING;

EID: 84859198469     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2011.173     Document Type: Article

References (29)

1. S. Ali and M. Shah, "A Lagrangian Particle Dynamics Approach for Crowd Flow Segmentation and Stability Analysis," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 1-6, 2007.
2. S. Ali and M. Shah, "Floor Fields for Tracking in High Density Crowd Scenes," Proc. European Conf. Computer Vision, 2008.
3. S.M. Arulampalam, S. Maskell, and N. Gordon, "A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking," IEEE Trans. Signal Processing, vol. 50, no. 2, pp. 174-188, Feb. 2002. (Pubitemid 34291500)
4. J. Barron, D. Fleet, and S. Beauchemin, "Performance of Optical Flow Techniques," Int'l J. Computer Vision, vol. 12, no. 1, pp. 43-77, 1994.
5. M. Betke, D.E. Hirsh, A. Bagchi, N.I. Hristov, N.C. Makris, and T.H. Kunz, "Tracking Large Variable Numbers of Objects in Clutter," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
6. C.M. Bishop, Pattern Recognition and Machine Learning. Springer, Oct. 2007.
7. M.J. Black and D.J. Fleet, "Probabilistic Detection and Tracking of Motion Boundaries," Int'l J. Computer Vision, vol. 38, no. 3, pp. 231-245, July/Aug. 2000.
8. G.J. Brostow and R. Cipolla, "Unsupervised Bayesian Detection of Independent Motion in Crowds," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 594-601, June 2006. (Pubitemid 44931380)
9. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2005.
10. C. Hue, J.-P. Le Cadre, and P. Pérez, "Posterior Cramer-Rao Bounds for Multi-Target Tracking," IEEE Trans. Aerospace and Electronic Systems, vol. 42, no. 1, pp. 37-49, Jan. 2006. (Pubitemid 43379964)
11. M. Isard and A. Blake, "CONDENSATION-Conditional Density Propagation for Visual Tracking," Int'l J. Computer Vision, vol. 29, no. 1, pp. 5-28, Aug. 1998. (Pubitemid 128523364)
12. Z. Khan, T. Balch, and F. Dellaert, "MCMC-Based Particle Filtering for Tracking a Variable Number of Interacting Targets," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1805-1819, Nov. 2005. (Pubitemid 41685115)
13. Z. Khan, T. Balch, and F. Dellaert, "MCMC Data Association and Sparse Factorization Updating for Real Time Multitarget Tracking with Merged and Multiple Measurements," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 1960-1972, Oct. 2006. (Pubitemid 46405707)
14. A. Kläser, M. Marszałek, and C. Schmid, "A Spatio-Temporal Descriptor Based on 3D-Gradients," Proc. British Machine Vision Conf., pp. 995-1004, 2008.
15. L. Kratz and K. Nishino, "Anomaly Detection in Extremely Crowded Scenes Using Spatio-Temporal Motion Pattern Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1446-1453, 2009.
16. L. Kratz and K. Nishino, "Tracking with Local Spatio-Temporal Motion Patterns in Extremely Crowded Scenes," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2010.
17. S. Kullback and R.A. Leibler, "On Information and Sufficiency," The Annals of Math. Statistics, vol. 22, no. 1, pp. 79-86, 1951.
18. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, "Learning Realistic Human Actions from Movies," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
19. B. Leibe, E. Seemann, and B. Schiele, "Pedestrian Detection in Crowded Scenes," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, June 2005.
20. Y. Li, C. Huang, and R. Nevatia, "Learning to Associate: HybridBoosted Multi-Target Tracker for Crowded Scene," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
21. O. Nestares and D.J. Fleet, "Probabilistic Tracking of Motion Boundaries with Spatiotemporal Predictions," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 358-365, 2001.
22. P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, "Color-Based Probabilistic Tracking," Proc. European Conf. Computer Vision, pp. 661-675, 2002.
23. L. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
24. M. Rodriguez, S. Ali, and T. Kanade, "Tracking in Unstructured Crowded Scenes," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
25. E. Shechtman and M. Irani, "Space-Time Behavior Based Correlation," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 405-412, 2005.
26. D. Sugimura, K. Kitani, T. Okabe, Y. Sato, and A. Sugimoto, "Using Individuality to Track Individuals: Clustering Individual Trajectories in Crowds Using Local Appearance and Frequency Trait," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
27. J. Wright and R. Pless, "Analysis of Persistent Motion Patterns Using the 3D Structure Tensor," Proc. IEEE Workshop Motion and Video Computing, pp. 14-19, 2005.
28. B. Wu and R. Nevatia, "Tracking of Multiple, Partially Occluded Humans Based on Static Body Part Detection," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 951-958, 2006. (Pubitemid 44931425)
29. T. Zhao, R. Nevatia, and B. Wu, "Segmentation and Tracking of Multiple Humans in Crowded Environments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 7, pp. 1198-1212, July 2008.