Detecting motion patterns via direction maps with application to surveillance

Computer Vision and Image Understanding

Volumn 113, Issue 2, 2009, Pages 291-307

  Gryn, Jacob M ^a   Wildes, Richard P ^a   Tsotsos, John K ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

Direction maps; Dominant direction; Event detection; Motion analysis; Spatiotemporal analysis; Surveillance

Indexed keywords

ABSTRACTING; MOTION ESTIMATION; OPTICAL PROJECTORS; VIDEO RECORDING;

DIRECTION MAPS; DOMINANT DIRECTION; EVENT DETECTION; MOTION ANALYSIS; SPATIOTEMPORAL ANALYSIS; SURVEILLANCE;

SECURITY SYSTEMS;

EID: 58149149624     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.10.006     Document Type: Article

References (65)

1. J. Gryn, Automated surveillance using local dominant direction templates, Master's thesis, York University, May 2004.
2. Beauchemin S., and Barron J. The computation of optical-flow. ACM Computing Surveys 27 3 (1995) 433-467
3. H. Nagel, Image sequence evaluation: 30 years and still going strong, in: Proceedings of the International Conference on Pattern Recognition, vol. I, 2000, pp. 149-158.
4. A. Baumberg, Learning deformable models for tracking human motion, Ph.D. thesis, University of Leeds, 1995.
5. I. Haritaoglu, D. Harwood, L. Davis, W4: Who? When? Where? What? A real time system for detecting and tracking people, in: Proceedings of the International Conference on Automatic Face and Gesture Recognition, 1998, pp. 222-227.
6. I. Haritaoglu, D. Harwood, L. Davis, Hydra: Multiple people detection and tracking using silhouettes, in: Proceedings of the International Conference on Image Analysis and Processing, 1999, pp. 280-285.
7. I. Haritaoglu, D. Harwood, L. Davis, Backpack: detection of people carrying objects using silhouettes, in: Proceedings of the IEEE International Conference on Computer Vision, vol. 1, 1999, pp. 102-107.
8. Haritaoglu I., Harwood D., and Davis L. W4: Real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 (2000) 809-830
9. N. Siebel, S. Maybank, Real-time tracking of pedestrians and vehicles, in: Proceedings of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance, 2001.
10. Haag M., and Nagel H. Tracking of complex driving maneuvers in traffic image sequences. Image and Vision Computing 16 8 (1998) 517-527
11. Haag M., and Nagel H. Combination of edge element and optical flow estimates for 3D-model-based vehicle tracking in traffic image sequences. International Journal of Computer Vision 35 3 (1999) 295-319
12. Medioni G., Cohen I., Bremond F., Hongeng S., and Nevatia R. Event detection and analysis from video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 8 (2001) 873-889
13. L. Davis, Real time computer surveillance for crime detection, Tech. Rep. 192734, US Department of Justice, February 2002.
14. C. Lu, H. Liu, N. Ferrier, Multidimensional motion segmentation and identification, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. II, 2000, pp. 629-636.
15. Ng J., and Gong S. Learning pixel-wise signal energy for understanding semantics. Image and Vision Computing 21 12-13 (2003) 1183-1189
16. M. Spengler, B. Schiele, Automatic detection and tracking of abandoned objects, in: Proceedings of the Joint IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance, 2003.
17. Hoose N., and Willumsen L.G. Automatically extracting traffic data from videotape using CLIP4 parallel image processor. Pattern Recognition Letters 6 3 (1987) 199-213
18. I. Haritaoglu, D. Harwood, L. Davis, A fast background scene modeling and maintenance for outdoor surveillance, in: Proceedings of the International Conference on Pattern Recognition, vol. 4, 2000, pp. 179-183.
19. C. Stauffer, E. Grimson, Adaptive background mixture models for real-time tracking, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1999, pp. 246-252.
20. Little J., and Boyd J. Recognizing people by their gait: The shape of motion. Videre 1 2 (1998) 2-32
21. C. Papageorgiou, T. Poggio, A pattern classification approach to dynamical object detection, in: Proceedings of the IEEE International Conference on Computer Vision, 1999, pp. 1223-1228.
22. Y. Freund, R. Schapire, A decision theoretic generalization of on-line learning and an application to boosting, in: Proceedings of the European Conference on Computational Learning Theory, 1995, pp. 23-37.
23. Viola P., Jones M., and Snow D. Detecting pedestrians using patterns of motion and appearance. International Journal of Computer Vision 63 2 (2005) 153-161
24. R. Pless, J. Wright, Analysis of persistent motion patterns using the 3D structure tensor, in: Proceedings of the IEEE Workshop on Visual Motion, 2005, pp. 14-19.
25. F. Cupillard, F. Bremond, M. Thonnat, Group behavior recognition with multiple cameras, in: Proceedings of the IEEE Workshop on Applications of Computer Vision, 2002, pp. 177-183.
26. A. Efros, A. Berg, G. Mori, J. Malik, Recognizing action at a distance, in: Proceedings of the IEEE International Conference on Computer Vision, 2003, pp. 726-733.
27. Howarth R., and Buxton H. Conceptual descriptions from monitoring and watching image sequences. Image and Vision Computing 18 2 (2000) 105-135
28. R. Polana, R. Nelson, Recognizing activities, in: Proceedings of the International Conference on Pattern Recognition, vol. A, 1994, pp. 815-818.
29. N. Rota, M. Thonnat, Video sequence interpretation for visual surveillance, in: Proceedings of the IEEE International Workshop on Visual Surveillance, 2000, pp. 59-68.
30. N. Rota, R. Stahr, R. Thonnat, Tracking for visual surveillance in VSIS, in: Proceedings of the IEEE Workshop on Performance Evaluation of Tracking and Surveillance, 2000.
31. Yacoob Y., and Black M. Parameterized modeling and recognition of activities. Computer Vision and Image Understanding 73 2 (1999) 232-247
32. J. Alon, S. Sclaroff, G. Kollios, V. Pavlovic, Discovering clusters in motion time-series data, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. I, 2003, pp. 375-381.
33. V. Kettnaker, M. Brand, Minimum-entropy models of scene activity, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. I, 1999, pp. 281-286.
34. Brand M., and Kettnaker V. Discovery and segmentation of activities in video. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 (2000) 844-851
35. O. Chomat, J. Martin, J. Crowley, A probabilistic sensor for the perception and the recognition of activities, in: Proceedings of the European Conference of Computer Vision, vol. I, 2000, pp. 487-503.
36. Fablet R., and Bouthemy P. Motion recognition using nonparametric image motion models estimated from temporal and multiscale co-occurrence statistics. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 12 (2003) 1619-1624
37. Fernyhough J., Cohn A., and Hogg D. Constructing qualitative event models automatically from video input. Image and Vision Computing 18 2 (2000) 81-103
38. S. Hongeng, F. Bremond, R. Nevatia, Bayesian framework for video surveillance application, in: Proceedings of the International Conference on Pattern Recognition, vol. 1, 2000.
39. Johnson N., and Hogg D. Learning the distribution of object trajectories for event recognition. Image and Vision Computing 14 8 (1996) 609-615
40. Laptev I., and Lindeberg T. Velocity adaptation of spatio-temporal receptive fields for direct recognition of activities: An experimental study. Image and Vision Computing 22 2 (2004) 105-116
41. North B., Blake A., Isard M., and Rittscher J. Learning and classification of complex dynamics. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 9 (2000) 1016-1034
42. N. Peyrard, P. Bouthemy, Detection of meaningful events in videos based on a supervised classification approach, in: Proceedings of the IEEE International Conference on Image Processing, vol. III, 2003, pp. 621-624.
43. Stauffer C., and Grimson W. Learning patterns of activity using real-time tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 8 (2000) 747-757
44. H. Zhong, J. Shi, M. Visontai, Detecting unusual activity in video, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. II, 2004, pp. 819-826.
45. Bobick A., and Davis J. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 23 3 (2001) 257-267
46. D. Koller, J. Weber, T. Huang, J. Malik, G. Ogasawara, B. Rao, S. Russell, Towards robust automatic traffic scene analysis in real-time, in: Proceedings of the International Conference on Pattern Recognition, vol. A, 1994, pp. 126-131.
47. M. Rahman, K. Nakamura, S. Ishikawa, Recognizing human behavior using universal eigenspace, in: Proceedings of the International Conference on Pattern Recognition, vol. 1, 2002, pp. 295-298.
48. Sumpter N., and Bulpitt A. Learning spatio-temporal patterns for predicting object behaviour. Image and Vision Computing 18 9 (2000) 697-704
49. L. Zelnik-Manor, M. Irani, Event-based analysis of video, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. II, 2001, pp. 123-130.
50. Z. Zhu, B. Yang, G. Xu, D. Shi, A real-time vision system for automatic traffic monitoring based on 2D spatio-temporal images, in: Proceedings of the IEEE Workshop on Applications of Computer Vision, 1996, pp. 162-167.
51. Adelson E., and Bergen J. Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A 2 2 (1985) 284-299
52. Murase H., and Nayar S. Visual learning and recognition of 3-D objects from appearance. International Journal of Computer Vision 14 1 (1995) 5-24
53. J. Gryn, R. Wildes, J. Tsotsos, Detecting motion patterns via direction maps with application to surveillance, in: Proceedings of the IEEE Workshop on Applications of Computer Vision, 2005, pp. 202-209.
54. Fahle M., and Poggio T. Visual hyperacuity: Spatiotemporal interpolation in human vision. Proceedings of Royal Society of London B 213 (1981) 451-477
55. Watson A., and Ahumada A. Model of human visual-motion sensing. Journal of the Optical Society of America A 2 2 (1985) 322-342
56. Freeman W., and Adelson E. The design and use of steerable filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 13 9 (1991) 891-906
57. K. Derpanis, J. Gryn, Three-dimensional nth derivative of Gaussian separable steerable filters, in: Proceedings of the IEEE International Conference on Image Processing, vol. III, 2005, pp. 553-556.
58. Pearce P., and Pearce S. Polyhedra Primer (1978), Van Nostrand, New York
59. Granlund G., and Knutsson H. Signal Processing for Computer Vision (1995), Kluwer Academic, Dordrecht, The Netherlands
60. Lowe D. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 2 (2004) 91-110
61. Christopher L., Mayweather W., and Perlman S. A VLSI median filter for impulse noise elimination in composite or component TV signals. IEEE Transactions on Consumer Electronics 34 1 (1988) 262-267
62. Macmillan N., and Creelman C. Detection Theory: A User's Guide. sixth ed. (1991), Cambridge University Press, Cambridge
63. Heeger D. Model for the extraction of image flow. Journal of the Optical Society of America A 2 2 (1987) 1455-1471
64. Buxton B., and Buxton H. Monocular depth perception from optical flow by space time signal processing. Proceedings of the Royal Society of London Series B 218 1210 (1983) 27-47
65. L. Haglund, Adaptive multidimensional filtering, Ph.D. thesis, Linkoping University, 1992.