Human tracking using convolutional neural networks

IEEE Transactions on Neural Networks

Volumn 21, Issue 10, 2010, Pages 1610-1623

  Fan, Jialue ^a   Xu, Wei ^b,c   Wu, Ying ^a   Gong, Yihong ^b  

^a Northwestern University   (United States)

^b NEC LABORATORIES AMERICA   (United States)

^c FACEBOOK   (United States)

Author keywords

Convolutional neural networks; machine learning; visual tracking

Indexed keywords

CLUTTERED ENVIRONMENTS; CONVOLUTIONAL NEURAL NETWORK; DRIFT PROBLEM; GLOBAL INFORMATIONS; HUMAN TRACKING; IMAGE FRAMES; IMAGE PAIRS; KEYPOINTS; LEARNING METHODS; LEARNING PROBLEM; MACHINE LEARNING; MULTIPLE-PATH; SHIFT-VARIANT; TEMPORAL FEATURES; TESTING SEQUENCES; VISUAL TRACKING;

CONVOLUTION; EVOLUTIONARY ALGORITHMS; LEARNING SYSTEMS; TRACKING (POSITION);

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; MOVEMENT (PHYSIOLOGY);

HUMANS; IMAGE ENHANCEMENT; MOVEMENT; NEURAL NETWORKS (COMPUTER);

EID: 77957774108     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2066286     Document Type: Article

References (33)

1. D. Comaniciu, V. Ramesh, and P. Meer, "The variable bandwidth mean shift and data-driven scale selection", in Proc. IEEE Int. Conf. Comput. Vi s., Vancouver, Canada, Jul. 2001, pp. 438-445.
2. J. Fan, M. Yang, and Y. Wu, "A bi-subspace model for robust visual tracking", in Proc. IEEE Int. Conf. Image Process., San Diego, CA, Oct. 2008, pp. 2660-2663.
3. A. D. Jepson, D. Fleet, and T. El-Maraghi, "Robust online appearance models for visual tracking", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Kauai, HI, Dec. 2001, pp. 415-422.
4. T. Zhao and R. Nevatia, "Tracking multiple humans in complex situations", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 9, pp. 1208-1221, Sep. 2004.
5. S. Avidan, "Ensemble tracking", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 2, pp. 261-271, Feb. 2007.
6. R. T. Collins and Y. Liu, "On-line selection of discriminative tracking features", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Madison, WI, Jun. 2003, pp. 346-352.
7. J. Ho, K. Lee, M.-H. Yang, and D. J. Kriegman", Visual tracking using learned linear subspaces", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Washington D. C., Jun. 2004, pp. 782-789.
8. M. Andriluka, S. Roth, and B. Schiele, "People-tracking-by-detection and people-detection-by-tracking", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, Jun. 2008, pp. 1-8.
9. C. Huang, B. Wu, and R. Nevatia, "Robust object tracking by hierarchical association of detection responses", in Proc. Eur. Conf. Comput. Vi s., Marseille, France, Oct. 2008, pp. 788-801.
10. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition", Proc. IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998.
11. A. Ahmed, K. Yu, W. Xu, Y. Gong, and E. Xing, "Training hierarchical feed-forward visual recognition models using transfer learning from pseudo-tasks", in Proc. Eur. Conf. Comput. Vis., Marseille, France, Oct. 2008, pp. 69-82.
12. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back, "Face recognition: A convolutional neural network approach", IEEE Trans. Neural Netw., vol. 8, no. 1, pp. 98-113, Jan. 1997.
13. O. Matan, C. Burges, Y. LeCun, and J. Denker, "Multi-digit recognition using a space displancement neural networks", in Proc. Neural Inform. Process. Syst., Denver, CO, Nov. 1992, pp. 488-495.
14. S. Nowlan and J. Platt, "A convolutional neural network hand tracker", in Proc. Neural Inform. Process. Syst., Denver, CO, Nov. 1994, pp. 901-908.
15. B. Leibe, K. Schindler, and L. Van Gool, "Coupled detection and trajectory estimation for multi-object tracking", in Proc. IEEE 11th Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
16. K. Okuma, A. Taleghani, O. Freitas, J. Little, and D. Lowe, "A boosted particle filter: Multitarget detection and tracking", in Proc. Eur. Conf. Comput. Vis., Prague, Czech Republic, May 2004, pp. 28-39.
17. R. Serrano-Gotarredona, M. Oster, P. Lichtsteiner, A. Linares-Barranco, R. Paz-Vicente, F. Gomez-Rodriguez, L. Camunas-Mesa, R. Berner, M. Rivas-Perez, T. Delbruck, S.-C. Liu, R. Douglas, P. Hafliger, G. Jimenez-Moreno, A. C. Ballcels, T. Serrano-Gotarredona, A. J. Acosta-Jimenez, and B. Linares-Barranco, "CAVIAR: A 45k neuron, 5M synapse, 12G connects/s AER hardware sensory-processing-learning-actuating system for high-speed visual object recognition and tracking", IEEE Trans. Neural Netw., vol. 20, no. 9, pp. 1417-1438, Sep. 2009.
18. O. Tuzel, F. Porikli, and P. Meer, "Learning on lie groups for invariant detection and tracking", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, Jun. 2008, pp. 1-8.
19. Y. Wu and T. Yu, "A field model for human detection and tracking", IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 753-765, May 2006.
20. B. Wu and R. Nevatia, "Detection and tracking of multiple, partially occluded humans by Bayesian combination of edgelet based part detectors", Int. J. Comput. Vis., vol. 75, no. 2, pp. 247-266, Nov. 2007.
21. A. Ess, B. Leibe, K. Schindler, and L. V. Gool, "A mobile vision system for robust multi-person tracking", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, Jun. 2008, pp. 1-8.
22. D. Ramanan, D. A. Forsyth, and A. Zisserman, "Tracking people by learning their appearance", IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 65-81, Jan. 2007.
23. S. Avidan, "Support vector tracking", IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 1064-1072, Aug. 2004.
24. H. Grabner and H. Bischof, "On-line boosting and vision", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., New York, Jun. 2006, pp. 260-267.
25. Y. Li, H. Ai, T. Yamashita, S. Lao, and M. Kawade, "Tracking in low frame rate video: A cascade particle filter with discriminative observers of different life spans", IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 10, pp. 1728-1740, Oct. 2008.
26. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking", Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, May 2008.
27. H. Grabner, C. Leistner, and H. Bischof, "Semi-supervised on-line boosting for robust tracking", in Proc. Eur. Conf. Comput. Vis., Marseille, France, Oct. 2008, pp. 234-247.
28. B. Babenko, M.-H. Yang, and S. Belongie, "Visual tracking with online multiple instance learning", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, Jun. 2009, pp. 983-990.
29. D. H. Hubel and T. N. Wiesel, "Receptive fields, binocular interaction and functional architecture in the cat's visual cortex", J. Physiol., vol. 160, no. 1, pp. 106-154, Jan. 1962.
30. R. T. Collins, "Mean-shift blob tracking through scale space", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Madison, WI, Jun. 2003, pp. 234-240.
31. D. Comaniciu, V. Ramesh, and P. Meer, "Real-time tracking of non-rigid objects using mean shift", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Hilton Head, SC, Jun. 2000, pp. 142-149.
32. M. Yang, Z. Fan, J. Fan, and Y. Wu, "Tracking non-stationary visual appearances by data-driven adaptation", IEEE Trans. Image Process., vol. 18, no. 7, pp. 1633-1644, Jul. 2009.
33. Y. Wu and J. Fan, "Contextual flow", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami, FL, Jun. 2009, pp. 33-40.