Adaptive fusion of particle filtering and spatio-temporal motion energy for human tracking

Pattern Recognition

Volumn 47, Issue 11, 2014, Pages 3552-3567

  Zhou, Huiyu ^a   Fei, Minrui ^b   Sadka, Abdul ^c   Zhang, Yi ^d   Li, Xuelong ^e  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^b SHANGHAI UNIVERSITY   (China)

^c BRUNEL UNIVERSITY   (United Kingdom)

^d CHONGQING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^e XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Colour; Computer vision; Motion energy; Object tracking; Occlusion

Indexed keywords

COLOR; COMPUTER VISION; HUMAN COMPUTER INTERACTION; MONTE CARLO METHODS; SECURITY SYSTEMS; SIGNAL FILTERING AND PREDICTION; TRACKING (POSITION);

HUMAN COMPUTER INTERFACES; ILLUMINATION CHANGES; MOTION ENERGY; OBJECT TRACKING; OCCLUSION; RELIABILITY EVALUATION; SPATIO-TEMPORAL DYNAMICS; STATE-OF-THE-ART TECHNIQUES;

IMAGE PROCESSING;

EID: 84904338176     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.05.006     Document Type: Article

References (67)

1. X. Liu, L. Lin, S. Yan, H. Jin, and W. Jiang Adaptive object tracking by learning hybrid template online IEEE Trans. Circuits Syst. Video Technol. 21 11 2011 1588 1599
2. N. Widynski, S. Dubuisson, and I. Bloch Integration of fuzzy spatial information in tracking based on particle filtering IEEE Trans. Syst. Man Cybern. Part B 41 3 2011 635 649
3. L. Li, S. Yan, X. Yu, Y. Tan, and H. Li Robust multiperson detection and tracking for mobile service and social robots IEEE Trans. Syst. Man Cybern. Part B 42 5 2012 1398 1412
4. Z. Husz, A. Wallace, and P. Green Tracking with a hierarchical partitioned particle filter and movement modelling IEEE Trans. Syst. Man Cybern. Part B 41 6 2011 1571 1584
5. 1 tracker with a subtle template dictionary Pattern Recognit. 46 7 2013 1750 1761
6. S. Zhang, H. Yao, X. Sun, and X. Lu Sparse coding based visual tracking review and experimental comparison Pattern Recognit. 46 7 2013 1772 1788
7. P. Cui, L.-F. Sun, F. Wang, and S.-Q. Yang Contextual mixture tracking IEEE Trans. Multimed. 11 2009 333 341
8. T. Yu, Y. Wu, Collaborative tracking of multiple targets, in: IEEE Conference on Computer Vision and Pattern Recognition, 2004, pp. 834-841.
9. K. Hariharakrishnan, and D. Schonfeld Fast object tracking using adaptive block matching IEEE Trans. Multimed. 7 5 2005 853 859 (Pubitemid 41452513)
10. M. Lee, and R. Nevatia Human pose tracking in monocular sequence using multilevel structured models IEEE Trans. Pattern Anal. Mach. Intell. 31 2009 27 38
11. D. Ross, J. Lim, R.-S. Lin, and M.-H. Yang Incremental learning for robust visual tracking Int. J. Comput. Vis. 77 1-3 2008 125 141 (Pubitemid 351294740)
12. B. Babenko, M.-H. Yang, S. Belongie, Visual tracking with online multiple instance learning, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2009, pp. 983- 990.
13. Q. Wang, F. Chen, J. Yang, W. Xu, and M.-H. Yang Transferring visual prior for online object tracking IEEE Trans. Image Process. 21 7 2012 3296 3305
14. C.-T. Hsu, and M.-S. Hsieh Region tracking for non-rigid video objects in a non-parametric map framework Signal Process.: Image Commun. 21 3 2006 235 251
15. L. Zhang, B. Wu, R. Nevatia, Detection and tracking of multiple humans with extensive pose articulation, in: International Joint Conference on Computer Vision, 2007, pp. 1-8.
16. V. Reilly, H. Idrees, M. Shah, Detection and tracking of large number of targets in wide area surveillance, in: European Conference on Computer Vision Conference on Computer Vision, 2010, pp. 186-199.
17. H. Zhou, Y. Yuan, and C. Shi Object tracking using sift features and mean shift Comput. Vis. Image Underst. 113 3 2009 345 352
18. H. Zhou, A. Wallace, and P. Green Efficient tracking and ego-motion recovery using gait analysis Signal Process. 89 12 2009 2367 2384
19. A. Adam, E. Rivlin, I. Shimshoni, Robust fragments-based tracking using the integral histogram, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 798-805. (Pubitemid 44931406)
20. K. Cannons, J. Gryn, R. Wildes, Visual tracking using a pixelwise spatiotemporal oriented energy representation, in: Proceedings of the 11th European Conference on Computer Vision, 2010, pp. 511-524.
21. N. Anjum, and A. Cavallaro Multifeature object trajectory clustering for video analysis IEEE Trans. Circuits Syst. Video Technol. 18 11 2008 1555 1564
22. H. Zhou, M. Taj, and A. Cavallaro Target detection and tracking with heterogeneous sensors IEEE J. Sel. Top. Signal Process. 2 4 2008 503 513
23. E.H. Adelson, and J.R. Bergen Spatiotemporal energy models for the perception of motion J. Opt. Soc. Am. A 2 2 1985 284 299
24. E. Maggio, F. Smerladi, and A. Cavallaro Adaptive multifeature tracking in a particle filtering framework IEEE Trans. Circuits Syst. Video Technol. 17 10 2007 1348 1359 (Pubitemid 47525329)
25. D.-Y. Chen, K. Cannons, H.-R. Tyan, S.-W. Shih, and H.-Y.M. Liao Spatiotemporal motion analysis for the detection and classification of moving targets IEEE Trans. Multimed. 10 8 2008 1578 1591
26. D. Tsai, M. Flagg, J. Rehg, Motion coherent tracking with multi-label mrf optimization, in: Proceedings of the British Machine Vision Conference, 2010, pp. 56.1-56.11.
27. G. Welch, G. Bishop, An Introduction to the Kalman Filter, Technical Report, University of North Carolina at Chapel Hill, NC, USA, 1995.
28. M. Isard, and A. Blake Condensation - conditional density propagation for visual tracking Int. J. Comput. Vis. 29 1 1998 5 28 (Pubitemid 128523364)
29. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, in: IEEE Conference on Computer Vision and Pattern Recognition, 2000, pp. 142-151.
30. B. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: Proceedings of International Joint Conference on Artificial Intelligence, 1981, pp. 674-679. (Pubitemid 14478744)
31. J. Shi, C. Tomasi, Good Features to Track, Technical Report, Cornell University, Ithaca, NY, USA, 1993.
32. I. Cox, and S. Hingorani An efficient implementation of Reid's multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking IEEE Trans. Pattern Anal. Mach. Intell. 18 2 1996 138 150
33. T.-J. Cham, J. Rehg, A multiple hypothesis approach to figure tracking, in: IEEE Conference on Computer Vision and Pattern Recognition, 1999, pp. 2239-2245.
34. V. Pavlovic, J. Rehg, T.-J. Cham, K. Murphy, A dynamic Bayesian network approach to figure tracking using learned dynamic models, in: IEEE International Conference on Computer Vision, 1999, p. 94.
35. Y. Chen, Y. Rui, T. Huang, JPDAF based HMM or real-time contour tracking, in: IEEE Conference on Computer Vision and Pattern Recognition, 2001, pp. 543-550.
36. Y. Yoon, A. Kosaka, and A. Kak A new Kalman-filter-based framework for fast and accurate visual tracking of rigid objects IEEE Trans. Robot. 24 5 2008 1238 1251
37. F. Gustafsson, F. Gunnarsson, N. Bergman, U. Forssell, J. Jansson, R. Karlsson, and P.J. Nordlund Particle filters for positioning, navigation, and tracking IEEE Trans. Signal Process. 50 2002 425 437 (Pubitemid 34291522)
38. M. Li, W. Chen, K. Huang, T. Tan, Visual tracking via incremental self-tuning particle filtering on the affine group, in: IEEE Conference on Computer Vision and Pattern Recognition, 2010, pp. 1315-1322.
39. J. Vermaak, N. Lawrence, P. Perez, Variational inference for visual tracking, in: IEEE Conference on Computer Vision and Pattern Recognition, 2003, pp. 773-780.
40. K. Fukunaga, and L. Hostetler The estimation of the gradient of a density function, with applications in pattern recognition IEEE Trans. Info. Theor. 21 1 1975 32 40
41. A. Yilmaz, Object tracking by asymmetric kernel mean shift with automatic scale and orientation selection, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-6.
42. D. Freedman, P. Kisilev, Fast mean shift by compact density representation, in: IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1818-1825.
43. Y.-J. Yeh, and C.-T. Hsu Online selection of tracking features using adaboost IEEE Trans. Circuits Syst. Video Technol. 19 2009 442 446
44. N.M. Artner, A comparison of mean shift tracking methods, in: 12th Central European Seminar on Computer Graphics, 2008, p. 197-204.
45. J. Kwon, K. Lee, Tracking by sampling trackers, in: ICCV, 2011, pp. 1195-1202.
46. J. Kwon, and K. Lee Wang-Landau Monte Carlo-based tracking methods for abrupt motions IEEE Trans. Pattern Anal. Mach. Intell. 35 4 2013 1011 1024
47. M. Schaap, I. Smal, C. Metz, T. van Walsum, W. Niessen, Bayesian tracking of elongated structures in 3d images, in: 20th International Conference on Information Processing in Medical Imaging, 2007.
48. J. Cui, S. Acton, and Z. Lin A monte carlo approach to rolling leukocyte tracking in vivo Med. Image Anal. 10 4 2006 598 610 (Pubitemid 44161158)
49. J.-Z. Cheng, C.-M. Chen, E. Cole, E. Pisano, and D. Shen Automated delineation of calcified vessels in mammography by tracking with uncertainty and graphical linking techniques IEEE Trans. Med. Imaging 31 11 2012 2143 2155
50. A. Smith, and T. Ledgeway Motion detection in human vision a unifying approach based on energy and features Proc. R. Soc. Lond.: Ser. B 268 2001 1889 1899 (Pubitemid 32897054)
51. Y.M. Lam, and B. Shi Extending position/phase-shift tuning to motion energy neurons improves velocity discrimination J. Platt, D. Koller, Y. Singer, S. Roweis, Advances in Neural Information Processing Systems Vol. 20 2008 MIT Press Cambridge, MA 809 816
52. Q. Zaidi, and J.S. DeBonet Motion energy versus position tracking spatial, temporal, and chromatic parameters Vis. Res. 40 2000 3613 3635
53. K. Cannons, R. Wildes, Spatiotemporal oriented energy features for visual tracking, in: Proceedings of Asian Conference on Computer Vision, 2007, pp. 532-543.
54. C. Shan, T. Tan, and Y. Wei Real-time hand tracking using a mean shift embedded particle filter Pattern Recogn. 40 2007 1958 1970 (Pubitemid 46497247)
55. T. Xiang, and S. Gong Beyond tracking modelling activity and understanding behaviour Int. J. Comput. Vis. 67 1 2006 21 51
56. P. Cui, Z.-Q. Liu, L.-F. Sun, and S.-Q. Yang Hierarchical visual event pattern mining and its applications Data Min. Knowl. Discov. 22 2011 467 492
57. A. Bobick, and J. Davis The recognition of human movement using temporal templates IEEE Trans. Pattern Anal. Mach. Intell. 23 3 2001 257 267 (Pubitemid 32286632)
58. K. Nummiaro, E. Koller-Meier, and L.V. Gool An adaptive color based particle filter Image Vis. Comput. 2003 99 110
59. T. Kailath The divergence and Bhattacharyya distance measures in signal selection IEEE Trans. Commun. Technol. 15 1 1967 52 60
60. Z. Lu, and G. Sperling Three-systems theory of human visual motion perception review and update J. Opt. Soc. Am. A 18 9 2001 2231 2270
61. Q. Hu, and J.D. Victor A set of high-order spatiotemporal stimuli that elicit motion and reverse-phi percepts J. Vis. 10 3 2010 1 16
62. C. Zitnick, N. Jojic, S. Kang, Consistent segmentation for optical flow estimation, in: Proceedings of International Conference on Computer Vision, 2005, pp. II: 1308-1315.
63. M. Spengler, B. Schiele, Towards robust multi-cue integration for visual tracking, in: Lecture Notes in Computer Science, vol. 2095, 2001, pp. 93-106. (Pubitemid 33303945)
64. R. Jacobs What determines visual cue reliability? Trends Cognit. Sci. 6 8 2002 345 350 (Pubitemid 34828313)
65. P. Ragothaman, T. Yang, W. Mikhael, R. Muise, and A. Mahalanobis Efficient adaptive subspace tracking algorithm for automatic target recognition Electron. Lett. 42 2006 1183 1184 (Pubitemid 44496064)
66. J. Triesch, and C. Von Der Malsburg Democratic integration self-organized integration of adaptive cues Neural Comput. 13 2001 2049 2074 (Pubitemid 33595042)
67. B. Babenko, M.-H. Yang, and S. Belongie Robust object tracking with online multiple instance learning IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 1619 1632