The applicability of spatiotemporal oriented energy features to region tracking

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 36, Issue 4, 2014, Pages 784-796

  Cannons, Kevin J ^a   Wildes, Richard P ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

feature representations; motion analysis; spatiotemporal orientation; visual spacetime; Visual tracking

Indexed keywords

INSTRUMENTS;

EMPIRICAL EVALUATIONS; FEATURE REPRESENTATION; IDENTITY TRANSFORM; ILLUMINATION VARIATION; MOTION ANALYSIS; ORIENTATION STRUCTURE; SPACETIME; VISUAL TRACKING;

TRACKING (POSITION);

EID: 84897546038     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2013.233     Document Type: Article

References (72)

1. A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey," ACM Computing Surveys, vol. 38, no. 4, pp. 1-45, 2006.
2. K. Cannons, "A Review of Visual Tracking," Technical Report CSE-2008-07 Dept. of Computer Science and Eng., York Univ., 2008.
3. S.S. Intille, J.W. Davis, and A.F. Bobick, "Real-Time Closed-World Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
4. C. Wren, A. Azarbayejani, T. Darrell, and A. Pentland, "Pfinder: Real-Time Tracking of the Human Body," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780-785, July 1997.
5. C. Stauffer and W. Grimson, "Learning Patterns of Activity Using Real-Time Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 747-757, Aug. 2000.
6. Z. Yin and R. Collins, "Belief Propagation in a 3D Spatio-Temporal MRF for Moving Object Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
7. V. Reilly, H. Idrees, and M. Shah, "Detection and Tracking of Large Number of Targets in Wide Area Surveillance," Proc. 11th European Conf. Computer Vision, pp. 186-199, 2010.
8. B. Song, T.Y. Jeng, E. Staudt, and A.K. Roy-Chowdhury, "A Stochastic Graph Evolution Framework for Robust Multi-Target Tracking," Proc. 11th European Conf. Computer Vision, pp. 605-619, 2010.
9. C. Huang, B. Wu, and R. Nevatia, "Robust Object Tracking by Hierarchical Association of Detection Responses," Proc. 10th European Conf. Computer Vision, pp. 788-801, 2008.
10. A. Andriyenko and K. Schindler, "Globally Optimal Multi-Target Tracking on a Hexagonal Lattice," Proc. 11th European Conf. Computer Vision, pp. 466-479, 2010.
11. H. Grabner, C. Leistner, and H. Bischof, "Semi-Supervised On-Line Boosting for Robust Tracking," Proc. 10th European Conf. Computer Vision, pp. 234-247, 2008.
12. B. Babenko, M. Yang, and S. Belongie, "Visual Tracking with Online Multiple Instance Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
13. Z. Kalal, J. Matas, and K. Mikolajczyk, "P-N Learning: Bootstrapping Binary Classifiers by Structural Constraints," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
14. A. Saffari, M. Godec, T. Pock, and C. Leistner, "Online Multi-Class LP Boost," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
15. J. Santner, C. Leistner, A. Saffari, T. Pock, and H. Bischof, "PROST: Parallel Robust Online Simple Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 723-730, 2010.
16. B. Zeisl, C. Leistner, A. Saffari, and H. Bischof, "On-Line Semi-Supervised Multiple-Instance Boosting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
17. R. Yao, Q. Shi, C. Shen, Y. Zhang, and A. Hengel, "Robust Tracking with Weighted Online Structured Learning," Proc. 12th European Conf. Computer Vision, 2012.
18. N. Dalal and B. Triggs, "Histograms of Oriented Gradients for Human Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
19. D. Comaniciu, V. Ramesh, and P. Meer, "Real-Time Tracking of Non-Rigid Objects Using Mean Shift," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
20. G. Hager, M. Dewan, and C. Stewart, "Multiple Kernel Tracking with SSD," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
21. S. Birchfield and S. Rangarajan, "Spatiograms versus Histograms for Region-Based Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
22. A. Adam, E. Rivlin, and I. Shimshoni, "Robust Fragments-Based Tracking Using the Integral Histogram," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
23. K. Cannons and R. Wildes, "Spatiotemporal Oriented Energy Features for Visual Tracking," Proc. Asian Conf. Computer Vision, pp. 532-543, 2007.
24. F. Wang, S. Yu, and J. Yang, "A Novel Fragments-Based Tracking Algorithm Using Mean Shift," Proc. Int'l Conf. Control, Automation, Robotics and Vision, 2008.
25. K. Okuma, A. Taleghani, N.D. Freitas, J. Little, and D. Lowe, "A Boosted Particle Filter: Multitarget Detection and Tracking," Proc. Eighth European Conf. Computer Vision, pp. 28-39, 2004.
26. B. Lucas and T. Kanade, "An Iterative Image Registration Technique with Application to Stereo Vision," Proc. DARPA Image Understanding Workshop, pp. 121-130, 1981.
27. F.G. Meyer and P. Bouthemy, "Region-Based Tracking Using Affine Motion Models in Long Image Sequences," CVGIP: Image Understanding, vol. 60, no. 2, pp. 119-140, 1994.
28. D. Beymer and K. Konolige, "Real-Time Tracking of Multiple People Using Continuous Detection," Proc. Seventh IEEE Int'l Conf. Computer Vision, 1999.
29. H.T. Nguyen, M. Worring, and R. Boomgaard, "Occlusion Robust Adaptive Template Tracking," Proc. Eighth IEEE Int'l Conf. Computer Vision, pp. 678-683, 2001.
30. A. Jepson, D. Fleet, and T. El-Maraghi, "Robust Online Appearance Models for Visual Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
31. D.A. Ross, J. Lim, and R.S. Lin, "Incremental Learning for Robust Visual Tracking," Int'l J. Computer Vision, vol. 77, pp. 125-141, 2008.
32. J. Kwon and K.M. Lee, "Tracking of a Non-Rigid Object via Patch-Based Dynamic Appearance Modeling and Adaptive Basin Hopping Monte Carlo Sampling," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
33. J. Kwon and K.M Lee, "Visual Tracking Decomposition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
34. J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, "Hierarchical Model-Based Motion Estimation," Proc. Second European Conf. Computer Vision, pp. 237-252, 1992.
35. M.J. Black and P. Anandan, "The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields," Computer Vision and Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
36. S. Oron, A. Bar-Hillel, D. Levi, and S. Avidan, "Locally Orderless Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012.
37. P. Anandan, "A Computational Framework and an Algorithm for the Measurement of Visual Motion," Int'l J. Computer Vision, vol. 2, no. 3, pp. 283-310, 1989.
38. P. Fieguth and D. Terzopoulos, "Color-Based Tracking of Heads and Other Mobile Objects at Video Frame Rates," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
39. S.M.S. Nejhum, J. Ho, and M.H. Yang, "Visual Tracking with Histograms and Articulating Blocks," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
40. I. Haritaoglu and M. Flickner, "Detection and Tracking of Shopping Groups in Stores," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
41. Y. Bogomolov, G. Dror, S. Lapchev, E. Rivlin, and M. Rudzsky, "Classification of Moving Targets Based on Motion and Appearance," Proc. British Machine Vision Conf., pp. 142-149, 2003.
42. D. Cremers and C. Schnorr, "Statistical Shape Knowledge in Variational Motion Segmentation," Image and Vision Computing, vol. 21, no. 1, pp. 77-86, 2003.
43. K. Sato and J. Aggarwal, "Temporal Spatio-Velocity Transformation and Its Application to Tracking and Interaction," Computer Vision and Image Understanding, vol. 96, no. 2, pp. 100-128, 2004.
44. S. Birchfield, "Elliptic Head Tracking with Intensity Gradients and Color Histograms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1998.
45. A. Elgammal, R. Duraiswami, and L. Davis, "Probabilistic Tracking in Joint Feature-Spatial Spaces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
46. C. Yang, R. Duraiswami, and L. Davis, "Efficient Mean-Shift Tracking via a New Similarity Measure," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
47. S. Avidan, "Ensemble Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 261-271, Feb. 2007.
48. Z. Yin, F. Porikli, and R.T. Collins, "Likelihood Map Fusion for Visual Object Tracking," Proc. IEEE Workshop on Applications of Computer Vision, 2008.
49. T. Brox, B. Rosenhahn, J. Gall, and D. Cremers, "Combined Region and Motion-Based 3D Tracking of Rigid and Articulated Objects," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 402-415, Mar. 2010.
50. D. Heeger, "Optical Flow from Spatiotemporal Filters," Int'l J. Computer Vision, vol. 1, no. 4, pp. 297-302, 1988.
51. E. Simoncelli, "Distributed Analysis and Representation of Visual Motion," PhD dissertation, MIT, 1993.
52. P. Dollar, V. Rabaud, G. Cottrell, and S. Belongie, "Behavior Recognition via Sparse Spatio-Temporal Features," Proc. IEEE Int'l Workshop Performance Evaluation of Tracking and Surveillance, pp. 65-72, 2005.
53. K.G. Derpanis, M. Sizintsev, K. Cannons, and R. Wildes, "Action Spotting and Recognition Based on a Spatiotemporal Orientation Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 527-540, Mar. 2013.
54. K.G. Derpanis and R.P. Wildes, "Spacetime Texture Representation and Recognition Based on a Spatiotemporal Orientation Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 6, pp. 1193-1205, June 2012.
55. R. Wildes and J. Bergen, "Qualitative Spatiotemporal Analysis Using an Oriented Energy Representation," Proc. Sixth European Conf. Computer Vision, pp. 784-796, 2000.
56. M. Sizintsev and R.P. Wildes, "Spatiotemporal Stereo and Scene Flow Via Stequel Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 6, pp. 1206-1219, June 2012.
57. K.J. Cannons, J.M. Gryn, and R.P. Wildes, "Visual Tracking Using a Pixelwise Spatiotemporal Oriented Energy Representation," Proc. 11th European Conf. Computer Vision, pp. 511-524, 2010.
58. E. Adelson and J. Bergen, "Spatiotemporal Energy Models for the Perception of Motion," J. Optical Soc. Am. A, vol. 2, no. 2, pp. 284-299, 1985.
59. T. Lindeberg, Scale-Space Theory in Computer Vision. Kluwer Academic Publishers, 1994.
60. M. Brand and V. Kettnaker, "Discovery and Segmentation of Activities in Video," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 844-851, Aug. 2000.
61. W. Freeman and E. Adelson, "The Design and Use of Steerable Filters," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 9, pp. 891-906, Sept. 1991.
62. A. Zaharescu and R. Wildes, "Anomalous Behaviour Detection Using Spatiotemporal Oriented Energies, Subset Inclusion Histogram Comparison and Event-Driven Processing," Proc. 11th European Conf. Computer Vision, 2010.
63. A. Bhattacharyya, "On a Measure of Divergence between Two Statistical Populations Defined by Their Probability Distribution," Bull. of the Calcutta Math. Soc., vol. 35, pp. 99-110, 1943.
64. J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994.
65. P. Huber, Robust Statistical Procedures. SIAM Press, 1977.
66. R. Collins, "Mean-Shift Blob Tracking through Scale Space," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
67. Z. Zivkovic and B. Krose, "An EM-Like Algorithm for Color-Histogram Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
68. PETS, http://www.cvg.rdg.ac.uk/PETS2001/, 2001.
69. D. Ross, J. Lim, and M. Yang, "Adaptive Probabilistic Visual Tracking with Incremental Subspace Update," Proc. Eighth European Conf. Computer Vision, 2004.
70. X. Jia, H. Lu, and M. Yang, "Visual Tracking via Adaptive Structural Local Sparse Appearance Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2012.
71. M. Everingham, L.V. Gool, C. Williams, J. Winn, and A. Zisserman, "The PASCAL Visual Object Classes (VOC) Challenge," Int'l J. Computer Vision, vol. 88, pp. 303-338, 2010.
72. P.J. Burt, J.R. Bergen, R. Hingorani, W.A. Lee, and A. Leung, "Object Tracking with a Moving Camera," Proc. IEEE Workshop Visual Motion, pp. 2-12, 1989.