Joint Sparse Representation and Robust Feature-Level Fusion for Multi-Cue Visual Tracking

IEEE Transactions on Image Processing

Volumn 24, Issue 12, 2015, Pages 5826-5841

  Lan, Xiangyuan ^a   Ma, Andy J ^a,b   Yuen, Pong C ^a   Chellappa, Rama ^c  

^a HONG KONG BAPTIST UNIVERSITY   (Hong Kong)

^b Johns Hopkins University   (United States)

^c UNIVERSITY OF MARYLAND   (United States)

Author keywords

feature fusion; joint sparse representation; Visual tracking

Indexed keywords

IMAGE PROCESSING; MATHEMATICAL MODELS;

FEATURE FUSION; FEATURE LEVEL FUSION; MULTIPLE FEATURES; ROBUST APPROACHES; ROBUST TRACKING; SPARSE REPRESENTATION; VIDEO SEQUENCES; VISUAL TRACKING;

TRACKING (POSITION);

EID: 84959491321     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2481325     Document Type: Article

References (80)

1. X. Li, W. Hu, C. Shen, Z. Zhang, A. Dick, and A. Van Den Hengel, "A survey of appearance models in visual object tracking," ACM Trans. Intell. Syst. Technol., vol. 4, no. 4, p. 58, Sep. 2013.
2. S. He, Q. Yang, R. W. H. Lau, J. Wang, and M.-H. Yang, "Visual tracking via locality sensitive histograms," in Proc. CVPR, Jun. 2013, pp. 2427-2434.
3. W. Hu, X. Li, W. Luo, X. Zhang, S. J. Maybank, and Z. Zhang, "Single and multiple object tracking using log-Euclidean Riemannian subspace and block-division appearance model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 12, pp. 2420-2440, Dec. 2012.
4. K. Zhang, L. Zhang, and M.-H. Yang, "Real-time compressive tracking," in Proc. ECCV, 2012, pp. 864-877.
5. W. W. Zou, P. C. Yuen, and R. Chellappa, "Low-resolution face tracker robust to illumination variations," IEEE Trans. Image Process., vol. 22, no. 5, pp. 1726-1739, May 2013.
6. F. Yang, H. Lu, and M.-H. Yang, "Robust visual tracking via multiple kernel boosting with affinity constraints," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 2, pp. 242-254, Feb. 2014.
7. H. Grabner and H. Bischof, "On-line boosting and vision," in Proc. CVPR, Jun. 2006, pp. 260-267.
8. B. Babenko, M.-H. Yang, and S. Belongie, "Robust object tracking with online multiple instance learning," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1619-1632, Aug. 2011.
9. Y. Wu, E. Blasch, G. Chen, L. Bai, and H. Ling, "Multiple source data fusion via sparse representation for robust visual tracking," in Proc. Int. Conf. Inf. Fusion, Jul. 2011, pp. 1-8.
10. A. J. Ma, P. C. Yuen, and J.-H. Lai, "Linear dependency modeling for classifier fusion and feature combination," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 5, pp. 1135-1148, May 2013.
11. A. J. Ma and P. C. Yuen, "Reduced analytic dependency modeling: Robust fusion for visual recognition," Int. J. Comput. Vis., vol. 109, no. 3, pp. 233-251, Sep. 2014.
12. H. Grabner, C. Leistner, and H. Bischof, "Semi-supervised on-line boosting for robust tracking," in Proc. ECCV, 2008, pp. 234-247.
13. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York, NY, USA: Wiley, 2006.
14. X. Jia, D. Wang, and H. Lu, "Fragment-based tracking using online multiple kernel learning," in Proc. ICIP, Sep./Oct. 2012, pp. 393-396.
15. X.-T. Yuan and S. Yan, "Visual classification with multi-task joint sparse representation," in Proc. CVPR, Jun. 2010, pp. 3493-3500.
16. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-227, Feb. 2009.
17. X. Mei and H. Ling, "Robust visual tracking and vehicle classification via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 11, pp. 2259-2272, Nov. 2011.
18. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. ICCV, Sep./Oct. 2009, pp. 221-228.
19. X. Lan, A. J. Ma, and P. C. Yuen, "Multi-cue visual tracking using robust feature-level fusion based on joint sparse representation," in Proc. CVPR, Jun. 2014, pp. 1194-1201.
20. A. Yilmaz, O. Javed, and M. Shah, "Object tracking: A survey," ACM Comput. Surv., vol. 38, no. 4, p. 13, 2006.
21. Y. Wu, J. Lim, and M.-H. Yang, "Online object tracking: A benchmark," in Proc. CVPR, Jun. 2013, pp. 2411-2418.
22. S. Zhang, H. Yao, X. Sun, and X. Lu, "Sparse coding based visual tracking: Review and experimental comparison," Pattern Recognit., vol. 46, no. 7, pp. 1772-1788, Jul. 2013.
23. A. W. M. Smeulders, D. M. Chu, R. Cucchiara, S. Calderara, A. Dehghan, and M. Shah, "Visual tracking: An experimental survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 7, pp. 1442-1468, Jul. 2014.
24. H. Yang, L. Shao, F. Zheng, L. Wang, and Z. Song, "Recent advances and trends in visual tracking: A review," Neurocomputing, vol. 74, no. 18, pp. 3823-3831, Nov. 2011.
25. A. D. Jepson, D. J. Fleet, and T. F. El-Maraghi, "Robust online appearance models for visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
26. S. K. Zhou, R. Chellappa, and B. Moghaddam, "Visual tracking and recognition using appearance-adaptive models in particle filters," IEEE Trans. Image Process., vol. 13, no. 11, pp. 1491-1506, Nov. 2004.
27. D. Comaniciu, V. Ramesh, and P. Meer, "Kernel-based object tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 5, pp. 564-577, May 2003.
28. C. Shen, M. J. Brooks, and A. van den Hengel, "Fast global kernel density mode seeking: Applications to localization and tracking," IEEE Trans. Image Process., vol. 16, no. 5, pp. 1457-1469, May 2007.
29. I. Leichter, "Mean shift trackers with cross-bin metrics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 695-706, Apr. 2012.
30. M. J. Black and A. D. Jepson, "EigenTracking: Robust matching and tracking of articulated objects using a view-based representation," in Proc. ECCV, 1996, pp. 329-342.
31. D. A. Ross, J. Lim, R.-S. Lin, and M.-H. Yang, "Incremental learning for robust visual tracking," Int. J. Comput. Vis., vol. 77, no. 1, pp. 125-141, May 2008.
32. L. Wen, Z. Cai, Z. Lei, D. Yi, and S. Z. Li, "Robust online learned spatio-temporal context model for visual tracking," IEEE Trans. Image Process., vol. 23, no. 2, pp. 785-796, Feb. 2014.
33. J. Kwon and K. M. Lee, "Visual tracking decomposition," in Proc. CVPR, Jun. 2010, pp. 1269-1276.
34. X. Mei, H. Ling, Y. Wu, E. P. Blasch, and L. Bai, "Efficient minimum error bounded particle resampling L1 tracker with occlusion detection," IEEE Trans. Image Process., vol. 22, no. 7, pp. 2661-2675, Jul. 2013.
35. X. Li, C. Shen, Q. Shi, A. Dick, and A. van den Hengel, "Non-sparse linear representations for visual tracking with online reservoir metric learning," in Proc. CVPR, Jun. 2012, pp. 1760-1767.
36. S. Zhang, H. Zhou, F. Jiang, and X. Li, "Robust visual tracking using structurally random projection and weighted least squares," to be published, doi: 10.1109/TCSVT.2015.2406194.
37. S. Zhang, H. Yao, H. Zhou, X. Sun, and S. Liu, "Robust visual tracking based on online learning sparse representation," Neurocomputing, vol. 100, pp. 31-40, Jan. 2013.
38. S. Zhang, H. Yao, X. Sun, and S. Liu, "Robust visual tracking using an effective appearance model based on sparse coding," ACM Trans. Intell. Syst. Technol., vol. 3, no. 3, p. 43, May 2012.
39. Z. Hong, X. Mei, D. Prokhorov, and D. Tao, "Tracking via robust multitask multi-view joint sparse representation," in Proc. ICCV, Dec. 2013, pp. 649-656.
40. X. Mei, Z. Hong, D. Prokhorov, and D. Tao, "Robust multitask multiview tracking in videos," IEEE Trans. Neural. Netw. Learn. Syst., to be published, doi: 10.1109/TNNLS.2015.2399233.
41. A. Adam, E. Rivlin, and I. Shimshoni, "Robust fragments-based tracking using the integral histogram," in Proc. CVPR, Jun. 2006, pp. 798-805.
42. S. Avidan, "Support vector tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 8, pp. 1064-1072, Aug. 2004.
43. X. Li, A. R. Dick, C. Shen, Z. Zhang, A. van den Hengel, and H. Wang, "Visual tracking with spatio-temporal Dempster-Shafer information fusion," IEEE Trans. Image Process., vol. 22, no. 8, pp. 3028-3040, Aug. 2013.
44. K. Zhang and H. Song, "Real-time visual tracking via online weighted multiple instance learning," Pattern Recognit., vol. 46, no. 1, pp. 397-411, Jan. 2013.
45. N. Jiang, W. Liu, and Y. Wu, "Learning adaptive metric for robust visual tracking," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2288-2300, Aug. 2011.
46. N. Jiang, W. Liu, and Y. Wu, "Order determination and sparsityregularized metric learning adaptive visual tracking," in Proc. CVPR, Jun. 2012, pp. 1956-1963.
47. N. Jiang and W. Liu, "Data-driven spatially-adaptive metric adjustment for visual tracking," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1556-1568, Apr. 2014.
48. W. Hu, X. Li, X. Zhang, X. Shi, S. J. Maybank, and Z. Zhang, "Incremental tensor subspace learning and its applications to foreground segmentation and tracking," Int. J. Comput. Vis., vol. 91, no. 3, pp. 303-327, Feb. 2011.
49. S. Hare, A. Saffari, and P. H. S. Torr, "Struck: Structured output tracking with kernels," in Proc. ICCV, Nov. 2011, pp. 263-270.
50. J. F. Henriques, R. Caseiro, P. Martins, and J. Batista, "Exploiting the circulant structure of tracking-by-detection with kernels," in Proc. ECCV, 2012, pp. 702-715.
51. F. Yang, H. Lu, and M.-H. Yang, "Robust superpixel tracking," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1639-1651, Apr. 2014.
52. H. Li, C. Shen, and Q. Shi, "Real-time visual tracking using compressive sensing," in Proc. CVPR, Jun. 2011, pp. 1305-1312.
53. B. Liu, L. Yang, J. Huang, P. Meer, L. Gong, and C. Kulikowski, "Robust and fast collaborative tracking with two stage sparse optimization," in Proc. ECCV, 2010, pp. 624-637.
54. B. Liu, J. Huang, C. Kulikowski, and L. Yang, "Robust visual tracking using local sparse appearance model and K-selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2968-2981, Dec. 2013.
55. C. Bao, Y. Wu, H. Ling, and H. Ji, "Real time robust L1 tracker using accelerated proximal gradient approach," in Proc. CVPR, Jun. 2012, pp. 1830-1837.
56. W. Zhong, H. Lu, and M.-H. Yang, "Robust object tracking via sparse collaborative appearance model," IEEE Trans. Image Process., vol. 23, no. 5, pp. 2356-2368, May 2014.
57. T. Zhang, B. Ghanem, S. Liu, and N. Ahuja, "Robust visual tracking via structured multi-task sparse learning," Int. J. Comput. Vis., vol. 101, no. 2, pp. 367-383, Jan. 2013.
58. X. Jia, H. Lu, and M.-H. Yang, "Visual tracking via adaptive structural local sparse appearance model," in Proc. CVPR, Jun. 2012, pp. 1822-1829.
59. D. Wang, H. Lu, and M.-H. Yang, "Online object tracking with sparse prototypes," IEEE Trans. Image Process., vol. 22, no. 1, pp. 314-325, Jan. 2013.
60. B. Zhuang, H. Lu, Z. Xiao, and D. Wang, "Visual tracking via discriminative sparse similarity map," IEEE Trans. Image Process., vol. 23, no. 4, pp. 1872-1881, Apr. 2014.
61. Q. Wang, F. Chen, J. Yang, W. Xu, and M.-H. Yang, "Transferring visual prior for online object tracking," IEEE Trans. Image Process., vol. 21, no. 7, pp. 3296-3305, Jul. 2012.
62. L. Wang, H. Yan, K. Lv, and C. Pan, "Visual tracking via kernel sparse representation with multikernel fusion," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 7, pp. 1132-1141, Jul. 2014.
63. Y. Wu, B. Ma, M. Yang, J. Zhang, and Y. Jia, "Metric learning based structural appearance model for robust visual tracking," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 5, pp. 865-877, May 2014.
64. H. Zhang, N. M. Nasrabadi, Y. Zhang, and T. S. Huang, "Multiobservation visual recognition via joint dynamic sparse representation," in Proc. ICCV, Nov. 2011, pp. 595-602.
65. S. Shekhar, V. M. Patel, N. M. Nasrabadi, and R. Chellappa, "Joint sparse representation for robust multimodal biometrics recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 1, pp. 113-126, Jan. 2014.
66. S. Bahrampour, A. Ray, N. M. Nasrabadi, and K. W. Jenkins, "Qualitybased multimodal classification using tree-structured sparsity," in Proc. CVPR, Jun. 2014, pp. 4114-4121.
67. P. Gong, J. Ye, and C. Zhang, "Robust multi-task feature learning," in Proc. KDD, 2012, pp. 895-903.
68. Y. Nesterov, "Gradient methods for minimizing composite functions," Math. Program., vol. 140, no. 1, pp. 125-161, Aug. 2013.
69. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
70. P. Tseng, "On accelerated proximal gradient methods for convexconcave optimization," SIAM J. Optim., 2008.
71. X.-T. Yuan, X. Liu, and S. Yan, "Visual classification with multitask joint sparse representation," IEEE Trans. Image Process., vol. 21, no. 10, pp. 4349-4360, Oct. 2012.
72. X. Chen, W. Pan, J. T. Kwok, and J. G. Carbonell, "Accelerated gradient method for multi-task sparse learning problem," in Proc. ICDM, Dec. 2009, pp. 746-751.
73. A. Shrivastava, V. M. Patel, and R. Chellappa, "Multiple kernel learning for sparse representation-based classification," IEEE Trans. Image Process., vol. 23, no. 7, pp. 3013-3024, Jul. 2014.
74. S. Gao, I. W. Tsang, and L.-T. Chia, "Sparse representation with kernels," IEEE Trans. Image Process., vol. 22, no. 2, pp. 423-434, Feb. 2013.
75. Z. Kalal, K. Mikolajczyk, and J. Matas, "Tracking-learning-detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1409-1422, Jul. 2012.
76. M. Godec, P. M. Roth, and H. Bischof, "Hough-based tracking of nonrigid objects," in Proc. ICCV, Nov. 2011, pp. 81-88.
77. L. Sevilla-Lara and E. G. Learned-Miller, "Distribution fields for tracking," in Proc. CVPR, Jun. 2012, pp. 1910-1917.
78. P. Li, Q. Wang, W. Zuo, and L. Zhang, "Log-Euclidean kernels for sparse representation and dictionary learning," in Proc. ICCV, Dec. 2013, pp. 1601-1608.
79. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. CVPR, Jun. 2005, pp. 886-893.
80. Q. Wang, F. Chen, W. Xu, and M.-H. Yang, "Object tracking via partial least squares analysis," IEEE Trans. Image Process., vol. 21, no. 10, pp. 4454-4465, Oct. 2012.