Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents

International Journal of Computer Vision

Volumn 111, Issue 1, 2015, Pages 50-68

  Zhou, Bolei ^a   Tang, Xiaoou ^b   Wang, Xiaogang ^b  

^a Department of Electrical Engineering and Computer Science   (United States)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Crowd behavior analysis; Motion analysis; Video surveillance

Indexed keywords

AUTONOMOUS AGENTS; COMPUTATIONAL METHODS; LINEAR CONTROL SYSTEMS; MIXTURES; MONITORING; MOTION ANALYSIS; SECURITY SYSTEMS; STATISTICAL PHYSICS;

COLLECTIVE BEHAVIOR; CROWD BEHAVIOR ANALYSIS; LINEAR DYNAMIC SYSTEM; PEDESTRIAN BEHAVIOR; QUANTITATIVE EXPERIMENTS; SCIENTIFIC FIELDS; TRAFFIC MANAGEMENT; VIDEO SURVEILLANCE;

BEHAVIORAL RESEARCH;

EID: 84921069235     PISSN: 09205691     EISSN: 15731405     Source Type: Journal    
DOI: 10.1007/s11263-014-0735-3     Document Type: Article

References (80)

1. Ali, S., Shah, M. (2007). A lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In Proceedinds CVPR.
2. Ali, S., Shah, M. (2008). Floor fields for tracking in high density crowd scenes. In Proceedings ECCV.
3. Antonini, G., Martinez, S., Bierlaire, M., & Thiran, J. (2006). Behavioral priors for detection and tracking of pedestrians in video sequences. International Journal of Computer Vision, 69, 159–180.
4. Ball, P. (2004). Critical mass: How one thing leads to another. New York: Farrar Straus & Giroux.
5. Van den Berg, J., Lin, M., Manocha, D. (2008). Reciprocal velocity obstacles for real-time multi-agent navigation. In Proceedings ICRA.
6. Berg, J., Lin, M., Manocha, D. (2008). Reciprocal velocity obstacles for real-time multi-agent navigation. In Proceedings of IEEE International Conference on Robotics and Automation.
7. Bonabeau, E. (2002). Agent-based modeling: Methods and techniques for simulating human systems. PNAS, 14, 7280–7287.
8. Chan, A. B., & Vasconcelos, N. (2008). Modeling, clustering, and segmenting video with mixtures of dynamic textures. IEEE Transactions on PAMI, 30, 909–926.
9. Chang, M., Krahnstoever, N., Ge, W. (2011). Probabilistic group-level motion analysis and scenario recognition. In Proceedings ICCV.
10. Choi, W., Shahid, K., Savarese, S. (2011). Learning context for collective activity recognition. In Proceedings CVPR.
11. Couzin, I. (2009). Collective cognition in animal groups. Trends in Cognitive Sciences, 13(1), 36–43.
12. Couzin, I., Krause, J., James, R., Ruxton, G., & Franks, N. (2002). Collective memory and spatial sorting in animal groups. Journal of Theoretical Biology, 218(1), 1–11.
13. Doretto, G., & Chiuso, A. (2003). Dynamic textures. International Journal of Computer Vision, 51, 91–109.
14. Emonet, R., Varadarajan, J., Odobez, J. (2011). Extracting and locating temporal motifs in video scenes using a hierarchical non parametric bayesian model. In Proceedings CVPR.
15. Forsyth, D. (2009). Group dynamics. Belmont: Wadsworth Pub Co.
16. Ge, W., Collins, R., & Ruback, R. (2011). Vision-based analysis of small groups in pedestrian crowds. IEEE Transactions on PAMI, 34(5), 1003–1016.
17. Helbing, D., & Molnar, P. (1995). Social force model for pedestrian dynamics. Physical Review E, 51(5), 4282–4286.
18. Helbing, D., Farkas, I., & Vicsek, T. (2000). Simulating dynamical features of escape panic. Nature, 407, 487–490.
19. Hospedales, T., Gong, S., Xiang, T. (2009). A markov clustering topic model for mining behaviour in video. In Proceedings ICCV.
20. Hospedales, T., Li, J., Gong, S., & Xiang, T. (2011). Identifying rare and subtle behaviours: A weakly supervised joint topic model. IEEE Transactions on PAMI, 33(12), 2451–2464.
21. Hu, W., Tan, T., Wang, L., & Maybank, S. (2004). A survey on visual surveillance of object motion and behaviors. IEEE Transactions on SMC - Part C, 34(3), 334–352.
22. Hu, W., Xie, D., Fu, Z., Zeng, W., & Maybank, S. (2007). Semantic-based surveillance video retrieval. IEEE Transactions on Image Processing, 16(4), 1168–1181.
23. Hughes, R. (2003). The flow of human crowds. Annual Review of Fluid Mechanics, 35(1), 169–182.
24. Kaucic, R., Perera, A., Brooksby, G., Kaufhold, J., Hoogs, A. (2005). A unified framework for tracking through occlusions and across sensor gaps. In Proceedings CVPR.
25. Kim, K., Lee, D., Essa, I. (2011). Gaussian process regression flow for analysis of motion trajectories. In Proceedings ICCV.
26. Kingman, J. (1993). Poisson processes. Oxford: Oxford University Press.
27. Kratz, L., Nishino, K. (2009). Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models. In Proceedings CVPR.
28. Kuettel, D., Breitenstein, M., Van Gool, L., Ferrari, V. (2010). What’s going on? discovering spatio-temporal dependencies in dynamic scenes. In Proceedings CVPR.
29. Lan, T., Wang, Y., Yang, W., Robinovitch, S. N., & Mori, G. (2011). Discriminative latent models for recognizing contextual group activities. IEEE Transactions on PAMI, 34(8), 1549–1562.
30. Lan, T., Sigal, L., Mori, G. (2012). Social roles in hierarchical models for human activity recognition. In Proceedings CVPR.
31. Le Bon, G. (1897). The crowd: A study of the popular mind. New York: The Macmillan Co.
32. Li, J., Gong, S., Xiang, T. (2008). Scene segmentation for behaviour correlation. In Proceedings ECCV.
33. Lin, D., Grimson, E., Fisher, J. (2009). Learning visual flows: A Lie algebraic approach. In Proceedings CVPR.
34. Lin, D., Grimson, E., Fisher, J. (2010). Modeling and estimating persistent motion with geometric flows. In Proceedings CVPR.
35. Loy, C., Xiang, T., Gong, S. (2009). Multi-camera activity correlation analysis. In Proceedings CVPR.
36. Mahadevan, V., Li, W., Bhalodia, V., Vasconcelos, N. (2010). Anomaly detection in crowded scenes. In Proceedings CVPR.
37. Makris, D., & Ellis, T. (2005). Learning semantic scene models from observing activity in visual surveillance. IEEE Transactions on SMC - Part B, 35(3), 397–408.
38. Mehran, R., Oyama, A., Shah, M. (2009). Abnormal crowd behavior detection using social force model. In Proceedings CVPR.
39. Mehran, R., Moore, B., Shah, M. (2010). A streakline representation of flow in crowded scenes. In Proceedings ECCV.
40. Moberts, B., Vilanova, A., Jake, J.W. (2005). Evaluation of fiber clustering methods for diffusion tensor imaging. In Proceedings of IEEE Visualization.
41. Morris, B. T., & Trivedi, M. M. (2008). A survey of vision-based trajectory learning and analysis for surveillance. IEEE Transactions on CSVT, 18, 1114–1127.
42. Morris, T. B., & Trvedi, M. M. (2011). Trajectory learning for activity understanding: Unsupervised, multilevel, and long-term adaptive approach. IEEE Transactions on PAMI, 33, 2287–2301.
43. Moussaid, M., Garnier, S., Theraulaz, G., & Helbing, D. (2009). Collective information processing and pattern formation in swarms, flocks, and crowds. Topics in Cognitive Science, 1(3), 469–497.
44. Moussaid, M., Perozo, N., Garnier, S., Helbing, D., & Theraulaz, G. (2010). The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PLoS One, 5(4), e10047.
45. Moussaid, M., Helbing, D., & Theraulaz, G. (2011). How simple rules determine pedestrian behavior and crowd disasters. PNAS, 108, 6884–6888.
46. Oh, S.M., Rehg, J.M., Balch, T., Dellaert. F. (2005). Learning and inference in parametric switching linear synamic systems. In Proceedings ICCV.
47. Palma, W. (2007). Long-memory time series: Theory and methods. Hoboken: Wiley-Blackwell.
48. Parrish, J., & Edelstein-Keshet, L. (1999). Complexity, pattern, and evolutionary trade-offs in animal aggregation. Science, 284, 99– 101.
49. Patil, S., Van Den Berg, J., Curtis, S., Lin, M. C., & Manocha, D. (2011). Directing crowd simulations using navigation fields. IEEE Transactions on Visualization and Computer Graphics, 17(2), 244–254.
50. Pavlovic, V., Frey, B., Huang, T. (1999). Time-series classification using mixed-state dynamic bayesian networks. In Proceedings CVPR.
51. Pellegrini, S., Ess, A., Schindler, K., Van Gool, L. (2009). You’ll never walk alone: Modeling social behavior for multi-target tracking. In Proceedings ICCV.
52. Pellegrini, S., Ess, A., Van Gool, L. (2010). Improving data association by joint modeling of pedestrian trajectories and groupings. In Proceedings ECCV.
53. Rand, W. M. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66, 846–850.
54. Rodriguez, M., Ali, S., Kanade, T. (2009). Tracking in unstructured crowded scenes. In Proceedings ICCV.
55. Rodriguez, M., Sivic, J., Laptev, I., Audibert, J. (2011). Data-driven crowd analysis in videos. In Proceedings ICCV.
56. Saleemi, I., Hartung, L., Shah, M. (2010). Scene understanding by statistical modeling of motion patterns. In Proceedings CVPR.
57. Saligrama, V., Chen, Z. (2012). Video anomaly detection based on local statistical aggregates. In Proceedings CVPR.
58. Schneider, P., & Eberly, D. H. (2003). Geometric Tools for Computer Graphics. San Francisco: Morgan Kaufmann.
59. Scovanner, P., Tappen, M. (2009). Learning pedestrian dynamics from the real world. In Proceedings ICCV.
60. Shumway, R., & Stoffer, D. (1982). An approach to time series smoothing and forecasting using the EM algorithm. Journal of time series analysis, 3(4), 253–264.
61. Stauffer, C. (2003). Estimating tracking sources and sinks. In Proceedings CVPR Workshop.
62. Tomasi, C., Kanade, T. (1991). Detection and Tracking of Point Features. International Journal of Computer Vision.
63. Treuille, A., Cooper, S., & Popović, Z. (2006). Continuum crowds. ACM SIGGRAPH, 25(3), 1160–1168.
64. Vicsek, T., Czirók, A., Ben-Jacob, E., Cohen, I., & Shochet, O. (1995). Novel type of phase transition in a system of self-driven particles. Physical Review Letters, 75(6), 1226–1229.
65. Wang, M., Wang, X. (2011). Automatic adaptation of a generic pedestrian detector to a specific traffic scene. In Proceedings CVPR.
66. Wang, X., Tieu, K., Grimson, W. (2006). Learning semantic scene models by trajectory analysis. In Proceedings ECCV.
67. Wang, X., Ma, K., Ng, G., Grimson, W. (2008a). Trajectory analysis and semantic region modeling using a nonparametric bayesian model. In Proceedings CVPR.
68. Wang, X., Ma, X., & Grimson, W. (2008b). Unsupervised activity perception in crowded and complicated scenes using hierarchical bayesian models. IEEE Transactions on PAMI, 31(3), 539–555.
69. Wang, X., Ma, K., Ng, G., & Grimson, W. (2011). Trajectory analysis and semantic region modeling using nonparametric hierarchical bayesian models. International Journal of Computer Vision, 95(3), 287–312.
70. Wu, S., Moore, B.E., Shah, M. (2010). Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes. In Proceedings CVPR.
71. Yamaguchi, K., Berg, A.C., Ortiz, L.E., Berg, T.L. (2011). Who are you with and where are you going? In Proceedings CVPR.
72. Yang, Y., Liu, J., Shah, M. (2009). Video scene understanding using multi-scale analysis. In Proceedings ICCV.
73. Zen, G., Ricci, E. (2011). Earth mover’s prototypes: a convex learning approach for discovering activity patterns in dynamic scenes. In Proceedings ICCV.
74. Zhao, X., Medioni, G. (2011). Robust unsupervised motion pattern inference from video and application. In Proceedings ICCV.
75. Zhou, B., Wang, X., Tang, X. (2011). Random field topic model for semantic region analysis in crowded scenes from tracklets. In Proceedings CVPR.
76. Zhou, B., Tang, X., Wang, X. (2012a). Coherent filtering: detecting coherent motions from crowd clutters. In Proceedings ECCV.
77. Zhou, B., Wang, X., Tang, X. (2012b). Understanding collective crowd behaviors: Learning a mixture model of dynamic pedestrian-agents. In Proceedings CVPR.
78. Zhou, B., Tang, X., Wang, X. (2013). Measuring crowd collectiveness. In Proceedings CVPR.
79. Zhou, B., Tang, X., Zhang, H., Wang, X. (2014). Measuring crowd collectiveness. IEEE Transactions on PAMI.
80. Zhou, S., Chen, D., Cai, W., Lyo, L., Yoke, M., Hean, L., et al. (2010). Crowd modeling and simulation technologies. ACM Transactions on Modeling and Computer Simulation, 20(4), 20.