Video Tracking Using Learned Hierarchical Features

IEEE Transactions on Image Processing

Volumn 24, Issue 4, 2015, Pages 1424-1435

  Wang, Li ^a   Liu, Ting ^a   Wang, Gang ^a,b   Chan, Kap Luk ^a   Yang, Qingxiong ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^c CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

deep feature learning; domain adaptation; Object tracking

Indexed keywords

NETWORK LAYERS; NEURAL NETWORKS; TRACKING (POSITION);

CONVOLUTIONAL NEURAL NETWORK; DEEP FEATURE LEARNING; DOMAIN ADAPTATION; HIERARCHICAL FEATURES; MOTION TRANSFORMATION; OBJECT TRACKING; TRACKING METHOD; VISUAL OBJECT TRACKING;

VIDEO RECORDING;

EID: 84924350847     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2403231     Document Type: Article

References (63)

1. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. NIPS, 2012, pp. 1097-1105.
2. Q. V. Le, W. Y. Zou, S. Y. Yeung, and A. Y. Ng, "Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 3361-3368.
3. G. Hinton et al., "Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 82-97, Nov. 2012.
4. N. Wang and D.-Y. Yeung, "Learning a deep compact image representation for visual tracking," in Proc. NIPS, 2013, pp. 809-817.
5. C. F. Cadieu and B. A. Olshausen, "Learning transformational invariants from natural movies," in Proc. NIPS, 2008, pp. 209-216.
6. W. Y. Zou, A. Y. Ng, S. Zhu, and K. Yu, "Deep learning of invariant features via simulated fixations in video," in Proc. NIPS, 2012, pp. 3212-3220.
7. J. Nocedal, "Updating quasi-Newton matrices with limited storage,"Math. Comput., vol. 35, no. 151, pp. 773-782, 1980.
8. J. Lu, G. Wang, and P. Moulin, "Human identity and gender recognition from gait sequences with arbitrary walking directions," IEEE Trans. Inf. Forensics Security, vol. 9, no. 1, pp. 51-61, Jan. 2014.
9. B. Wang, G. Wang, K. L. Chan, and L. Wang, "Tracklet association with online target-specific metric learning," in Proc. IEEE Conf. CVPR, Jun. 2014, pp. 1234-1241.
10. M. J. Black and A. D. Jepson, "EigenTracking: Robust matching and tracking of articulated objects using a view-based representation," Int. J. Comput. Vis., vol. 26, no. 1, pp. 63-84, Jan. 1998.
11. J. Ho, K.-C. Lee, M.-H. Yang, and D. Kriegman, "Visual tracking using learned linear subspaces," in Proc. IEEE Conf. CVPR, Jun./Jul. 2004, pp. I-782-I-789.
12. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking," Int. J. Comput. Vis., vol. 77, nos. 1-3, pp. 125-141, May 2008.
13. M. Isard and A. Blake, "CONDENSATION - Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, Aug. 1998.
14. A. Doucet, N. de Freitas, and N. Gordon, "An introduction to sequential Monte Carlo methods," in Sequential Monte Carlo Methods in Practice. Berlin, Germany: Springer-Verlag, 2001.
15. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-577, May 2003.
16. D. Comaniciu and P. Meer, "Mean shift: A robust approach toward feature space analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 5, pp. 603-619, May 2002.
17. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, Feb. 2004.
18. A. D. Jepson, D. J. Fleet, and T. F. El-Maraghi, "Robust online appearance models for visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
19. G. Wang, D. Hoiem, and D. Forsyth, "Learning image similarity from Flickr groups using fast kernel machines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2177-2188, Nov. 2012.
20. G. Wang, D. Forsyth, and D. Hoiem, "Improved object categorization and detection using comparative object similarity," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 10, pp. 2442-2453, Oct. 2013.
21. S. Avidan, "Support vector tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 1064-1072, Aug. 2004.
22. S. Avidan, "Ensemble tracking," in Proc. IEEE Conf. CVPR, Sep. 2005, pp. 494-501.
23. H. Grabner, C. Leistner, and H. Bischof, "Semi-supervised on-line boosting for robust tracking," in Proc. ECCV, 2008, pp. 234-247.
24. B. Babenko, M.-H. Yang, and S. J. Belongie, "Visual tracking with online multiple instance learning," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 983-990.
25. Z. Kalal, J. Matas, and K. Mikolajczyk, "P-N learning: Bootstrapping binary classifiers by structural constraints," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 49-56.
26. J. Yang, K. Yu, Y. Gong, and T. Huang, "Linear spatial pyramid matching using sparse coding for image classification," in Proc. IEEE Conf. CVPR, Jun. 2009, pp. 1794-1801.
27. 1 minimization,"in Proc. ICCV, Sep./Oct. 2009, pp. 1436-1443.
28. 1 tracker with occlusion detection," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1257-1264.
29. H. Li, C. Shen, and Q. Shi, "Real-time visual tracking using compressive sensing," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1305-1312.
30. B. Liu, L. Yang, J. Huang, P. Meer, L. Gong, and C. Kulikowski, "Robust and fast collaborative tracking with two stage sparse optimization," in Proc. ECCV, 2010, pp. 624-637.
31. B. Liu, J. Huang, L. Yang, and C. Kulikowsk, "Robust tracking using local sparse appearance model and K-selection," in Proc. IEEE Conf. CVPR, Jun. 2011, pp. 1313-1320.
32. X. Jia, H. Lu, and M.-H. Yang, "Visual tracking via adaptive structural local sparse appearance model," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1822-1829.
33. R. T. Collins, Y. Liu, and M. Leordeanu, "Online selection of discriminative tracking features," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 10, pp. 1631-1643, Oct. 2005.
34. H. Grabner, M. Grabner, and H. Bischof, "Real-time tracking via on-line boosting," in Proc. BMVC, 2006, pp. 47-56.
35. M. Grabner, H. Grabner, and H. Bischof, "Learning features for tracking,"in Proc. IEEE Conf. CVPR, Jun. 2007, pp. 1-8.
36. K. Zhang, L. Zhang, and M.-H. Yang, "Real-time compressive tracking,"in Proc. ECCV, 2012, pp. 864-877.
37. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, Jul. 2006.
38. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, Jul. 2006.
39. S. M. A. Eslami, N. Heess, and J. M. Winn, "The shape Boltzmann machine: A strong model of object shape," in Proc. IEEE Conf. CVPR, Jul. 2012, pp. 406-413.
40. A. Coates, A. Karpathy, and A. Y. Ng, "Emergence of object-selective features in unsupervised feature learning," in Proc. NIPS, 2012, pp. 2681-2689.
41. A. Coates and A. Y. Ng, "Selecting receptive fields in deep networks,"in Proc. NIPS, 2011, pp. 2528-2536.
42. Q. V. Le, A. Karpenko, J. Ngiam, and A. Y. Ng, "ICA with reconstruction cost for efficient overcomplete feature learning," in Proc. NIPS, 2011, pp. 1017-1025.
43. Q. V. Le et al., "Building high-level features using large scale unsupervised learning," in Proc. ICML, 2012, pp. 1-11.
44. N. Li and J. J. DiCarlo, "Unsupervised natural experience rapidly alters invariant object representation in visual cortex," Science, vol. 321, no. 5895, pp. 1502-1507, Sep. 2008.
45. K. Saenko, B. Kulis, M. Fritz, and T. Darrell, "Adapting visual category models to new domains," in Proc. ECCV, 2010, pp. 213-226.
46. th Int. ACM Multimedia, 2007, pp. 188-197.
47. L. Duan, D. Xu, I. W. Tsang, and J. Luo, "Visual event recognition in videos by learning from web data," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 1959-1966.
48. X. Glorot, A. Bordes, and Y. Bengio, "Domain adaptation for large-scale sentiment classification: A deep learning approach," in Proc. ICML, 2011, pp. 513-520.
49. Q. Wang, F. Chen, J. Yang, W. Xu, and M.-H. Yang, "Transferring visual prior for online object tracking," IEEE Trans. Image Process., vol. 21, no. 7, pp. 3296-3305, Jul. 2012.
50. nd ed. New York, NY, USA: Springer-Verlag, 2006.
51. C. Bao, Y. Wu, H. Ling, and H. Ji, "Real time robust L1 tracker using accelerated proximal gradient approach," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1830-1837.
52. Y. Pang and H. Ling, "Finding the best from the second bests - Inhibiting subjective bias in evaluation of visual tracking algorithms," in Proc. ICCV, Dec. 2013, pp. 2784-2791.
53. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Conf. CVPR, Jun. 2005, pp. 886-893.
54. Y. Wu, J. Lim, and M.-H. Yang, "Online object tracking: A benchmark,"in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 2411-2418.
55. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram," in Proc. IEEE Conf. CVPR, Jun. 2006, pp. 798-805.
56. Z. Kalal, K. Mikolajczyk, and J. Matas, "Tracking-learning-detection,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1409-1422, Jul. 2012.
57. J. Kwon and K. M. Lee, "Visual tracking decomposition," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 1269-1276.
58. T. Zhang, B. Ghanem, S. Liu, and N. Ahuja, "Robust visual tracking via multi-task sparse learning," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 2042-2049.
59. W. Zhong, H. Lu, and M.-H. Yang, "Robust object tracking via sparsity-based collaborative model," in Proc. IEEE Conf. CVPR, Jun. 2012, pp. 1838-1845.
60. D. Wang, H. Lu, and M.-H. Yang, "Online object tracking with sparse prototypes," IEEE Trans. Image Process., vol. 22, no. 1, pp. 314-325, Jan. 2013.
61. D. Wang, H. Lu, and M.-H. Yang, "Least soft-threshold squares tracking,"in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 2371-2378.
62. X. Li, C. Shen, A. R. Dick, and A. van den Hengel, "Learning compact binary codes for visual tracking," in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 2419-2426.
63. S. He, Q. Yang, R.W. H. Lau, J.Wang, and M.-H. Yang, "Visual tracking via locality sensitive histograms," in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 2427-2434.