Robust Sparse Coding for Mobile Image Labeling on the Cloud

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 27, Issue 1, 2017, Pages 62-72

  Tao, Dapeng ^a   Cheng, Jun ^b,c   Gao, Xinbo ^d   Li, Xuelong ^e   Deng, Cheng ^d  

^a YUNNAN UNIVERSITY   (China)

^b SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^d XIDIAN UNIVERSITY   (China)

^e XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Cloud computing; correntropy; mobile image labeling; sparse coding

Indexed keywords

CLOUD COMPUTING; CODES (SYMBOLS); ERROR ANALYSIS; IMAGE CODING; IMAGE PROCESSING; QUADRATIC PROGRAMMING; SEMANTICS;

CORRENTROPY; GENERALIZATION ERROR BOUNDS; HALF-QUADRATIC OPTIMIZATIONS; MOBILE IMAGES; ONLINE SOCIAL NETWORKINGS; ROBUST SPARSE CODING; SEMANTIC CONTENT; SPARSE CODING;

SOCIAL NETWORKING (ONLINE);

EID: 85009775863     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2016.2539778     Document Type: Article

References (77)

1. S. Aeron, V. Saligrama, and M. Zhao, "Information theoretic bounds for compressed sensing, " IEEE Trans. Inf. Theory, vol. 56, no. 10, pp. 5111-5130, Oct. 2010.
2. K. Barnard, P. Duygulu, D. Forsyth, N. de Freitas, D. M. Blei, and M. I. Jordan, "Matching words and pictures, " J. Mach. Learn. Res., vol. 3, pp. 1107-1135, Mar. 2003.
3. A. Beck and M. Teboulle, "A fast iterative shrinkage-Thresholding algorithm for linear inverse problems, " SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
4. C. M. Bishop, Pattern Recognition and Machine Learning. Berlin, Germany: Springer, 2006.
5. P. T. Boufounos and R. G. Baraniuk, "1-bit compressive sensing, " in Proc. 42nd Annu. Conf. Inf. Sci. Syst. (CISS), 2008, pp. 16-21.
6. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge, U.K.: Cambridge Univ. Press, 2004.
7. D. Cai, H. Bao, and X. He, "Sparse concept coding for visual analysis, " in Proc. 24th IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Colorado Springs, CO, USA, Jun. 2011, pp. 2905-2910.
8. J. Chao, R. Huitl, E. Steinbach, and D. Schroeder, "A novel rate control framework for SIFT/SURF feature preservation in H.264/AVC video compression, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 6, pp. 958-972, Jun. 2015.
9. S. Dasiopoulou, E. Giannakidou, G. Litos, P. Malasioti, and Y. Kompatsiaris, "A survey of semantic image and video annotation tools, " in Knowledge-Driven Multimedia Information Extraction and Ontology Evolution. Berlin, Germany: Springer, 2011, pp. 196-239.
10. K. Dimitropoulos, P. Barmpoutis, and N. Grammalidis, "Spatio-Temporal flame modeling and dynamic texture analysis for automatic video-based fire detection, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 2, pp. 339-351, Feb. 2015.
11. D. L. Donoho, "Compressed sensing, " IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
12. M. Douze, H. Jégou, H. Sandhawalia, L. Amsaleg, and C. Schmid, "Evaluation of GIST descriptors for Web-scale image search, " in Proc. ACM Int. Conf. Image Video Retr., Jul. 2009, Art. no. 19.
13. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries, " IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, Dec. 2006.
14. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman, "The PASCAL visual object classes (VOC) challenge, " Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, 2010.
15. H. Fu, Q. Zhang, and G. Qiu, "Random forest for image annotation, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 86-99.
16. D. Geman and C. Yang, "Nonlinear image recovery with half-quadratic regularization, " IEEE Trans. Signal Process., vol. 4, no. 7, pp. 932-946, Jul. 1995.
17. B. Geng, Y. Li, D. Tao, M. Wang, Z.-J. Zha, and C. Xu, "Parallel lasso for large-scale video concept detection, " IEEE Trans. Multimedia, vol. 14, no. 1, pp. 55-65, Feb. 2012.
18. N. Guan, D. Tao, Z. Luo, and J. Shawe-Taylor. (2012). "MahNMF: Manhattan non-negative matrix factorization." [Online]. Available: http://arxiv.org/abs/1207.3438
19. N. Guan, D. Tao, Z. Luo, and B. Yuan, "NeNMF: An optimal gradient method for nonnegative matrix factorization, " IEEE Trans. Signal Process., vol. 60, no. 6, pp. 2882-2898, Jun. 2012.
20. J. Han, D. Farin, and P. H. N. de With, "A mixed-reality system for broadcasting sports video to mobile devices, " IEEE Multimedia, vol. 18, no. 2, pp. 72-84, Feb. 2011.
21. A. Hanbury, "A survey of methods for image annotation, " J. Vis. Lang. Comput., vol. 19, no. 5, pp. 617-627, 2008.
22. R. He, W.-S. Zheng, and B.-G. Hu, "Maximum correntropy criterion for robust face recognition, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1561-1576, Aug. 2011.
23. H. Hotelling, "Analysis of a complex of statistical variables into principal components, " J. Edu. Psychol., vol. 24, no. 6, pp. 417-441, 1933.
24. P. J. Huber, "Robust estimation of a location parameter, " Ann. Math. Statist., vol. 35, no. 1, pp. 73-101, 1964.
25. R. Jenatton, J. Mairal, G. Obozinski, and F. Bach, "Proximal methods for sparse hierarchical dictionary learning, " in Proc. 27th Int. Conf. Mach. Learn. (ICML), 2010, pp. 487-494.
26. J. Jeon, V. Lavrenko, and R. Manmatha, "Automatic image annotation and retrieval using cross-media relevance models, " in Proc. 26th Annu. Int. ACM SIGIR Conf. Res. Develop. Inf. Retr., 2003, pp. 119-126.
27. W. Jiang, F. Nie, and H. Huang, "Robust dictionary learning with capped l1-norm, " in Proc. 24th Int. Conf. Artif. Intell., 2015, pp. 3590-3596.
28. L. Jing, C. Zhang, and M. K. Ng, "SNMFCA: Supervised NMF-based image classification and annotation, " IEEE Trans. Image Process., vol. 21, no. 11, pp. 4508-4521, Nov. 2012.
29. M. M. Kalayeh, H. Idrees, and M. Shah, "NMF-KNN: Image annotation using weighted multi-view non-negative matrix factorization, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 184-191.
30. K. Kreutz-Delgado, J. F. Murray, B. D. Rao, K. Engan, T.-W. Lee, and T. J. Sejnowski, "Dictionary learning algorithms for sparse representation, " Neural Comput., vol. 15, no. 2, pp. 349-396, 2003.
31. Y. H. Lai and C. K. Yang, "Video object retrieval by trajectory and appearance, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 6, pp. 1026-1037, Jun. 2015.
32. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization, " Nature, vol. 401, no. 6755, pp. 788-791, Oct. 1999.
33. D. D. Lee and H. S. Seung, "Algorithms for non-negative matrix factorization, " in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 556-562.
34. X. Li, L. Mou, and X. Lu, "Scene parsing from an MAP perspective, " IEEE Trans. Cybern., vol. 45, no. 9, pp. 1876-1886, Sep. 2015.
35. X. Li, Z. Wang, and X. Lu, "Surveillance video synopsis via scaling down objects, " IEEE Trans. Image Process., vol. 25, no. 2, pp. 740-755, Feb. 2016.
36. T. Liu and D. Tao, "Classification with noisy labels by importance reweighting, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 447-461, Mar. 2016.
37. T. Liu and D. Tao, "On the robustness and generalization of Cauchy regression, " in Proc. 4th IEEE Int. Conf. Inf. Sci. Technol. (ICIST), Apr. 2014, pp. 100-105.
38. W. Liu, P. P. Pokharel, and J. C. Príncipe, "Correntropy: Properties and applications in non-Gaussian signal processing, " IEEE Trans. Signal Process., vol. 55, no. 11, pp. 5286-5298, Nov. 2007.
39. Z. Ma, F. Nie, Y. Yang, J. R. Uijlings, and N. Sebe, "Web image annotation via subspace-sparsity collaborated feature selection, " IEEE Trans. Multimedia, vol. 14, no. 4, pp. 1021-1030, Aug. 2012.
40. J. Mairal, F. Bach, J. Ponce, G. Sapiro, and A. Zisserman, "Discriminative learned dictionaries for local image analysis, " in Proc. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
41. A. Makadia, V. Pavlovic, and S. Kumar, "A new baseline for image annotation, " in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 316-329.
42. A. Maurer, M. Pontil, and B. Romera-Paredes. "Sparse coding for multitask and transfer learning, " in Proc. 30th Int. Conf. Mach. Learn., 2013, pp. 343-351.
43. F. Nie, H. Huang, X. Cai, and C. H. Ding, "Efficient and robust feature selection via joint l2, 1-norms minimization, " in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1813-1821.
44. F. Nie, J. Yuan, and H. Huang, "Optimal mean robust principal component analysis, " in Proc. 31st Int. Conf. Mach. Learn., 2014, pp. 1062-1070.
45. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope, " Int. J. Comput. Vis., vol. 42, no. 3, pp. 145-175, 2001.
46. J.-S. Pan, Q. Feng, L. Yan, and J.-F. Yang, "Neighborhood feature line segment for image classification, " IEEE Trans. Circuits Syst. Video Technol., vol. 25, no. 3, pp. 387-398, Mar. 2015.
47. S. Papadopoulos, C. Zigkolis, Y. Kompatsiaris, and A. Vakali, "Clusterbased landmark and event detection for tagged photo collections, " IEEE Multimedia Mag., vol. 18, no. 1, pp. 52-63, Jan. 2011.
48. R. Peharz and F. Pernkopf, "Sparse nonnegative matrix factorization with l0-constraints, " Neurocomputing, vol. 80, pp. 38-46, Mar. 2012.
49. Y. Shao, Y. Zhou, X. He, D. Cai, and H. Bao, "Semi-supervised topic modeling for image annotation, " in Proc. 17th ACM Int. Conf. Multimedia, 2009, pp. 521-524.
50. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
51. D. Tao, X. Tang, X. Li, and Y. Rui, "Direct kernel biased discriminant analysis: A new content-based image retrieval relevance feedback algorithm, " IEEE Trans. Multimedia, vol. 8, no. 4, pp. 716-727, Aug. 2006.
52. D. Tao, J. Cheng, M. Song, and X. Lin, "Manifold ranking-based matrix factorization for saliency detection, " IEEE Trans. Neural Netw. Learn. Syst., vol. 27, no. 6, pp. 1122-1134, Jun. 2016.
53. D. Tao, L. Jin, W. Liu, and X. Li, "Hessian regularized support vector machines for mobile image annotation on the cloud, " IEEE Trans. Multimedia, vol. 15, no. 4, pp. 833-844, Jun. 2013.
54. D. Tao, L. Jin, Y. Wang, Y. Yuan, and X. Li, "Person re-identification by regularized smoothing KISS metric learning, " in Proc. IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 10, pp. 1675-1685, Oct. 2013.
55. M. F. Tappen, B. C. Russell, and W. T. Freeman, "Exploiting the sparse derivative prior for super-resolution and image demosaicing, " in Proc. 3rd IEEE Workshop Statist. Comput. Theories Vis., Jun. 2003, pp. 1-24.
56. R. Tibshirani, "Regression shrinkage and selection via the lasso, " J. Roy. Statist. Soc. B (Methodol.), vol. 58, no. 1, pp. 267-288, 1996.
57. D. Vainsencher, S. Mannor, and A. M. Bruckstein, "The sample complexity of dictionary learning, " J. Mach. Learn. Res., vol. 12, pp. 3259-3281, Feb. 2011.
58. V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer, 2013.
59. C. Wang, S. Yan, L. Zhang, and H.-J. Zhang, "Multi-label sparse coding for automatic image annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1643-1650.
60. C. Wang, D. Blei, and L. Fei-Fei, "Simultaneous image classification and annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2009, pp. 1903-1910.
61. M. Wang and X.-S. Hua, "Active learning in multimedia annotation and retrieval: A survey, " ACM Trans. Intell. Syst. Technol, vol. 2, no. 2, 2011, Art. no. 10.
62. R. Wang and D. Tao. (2014). "Recent progress in image deblurring." [Online]. Available: http://arxiv.org/abs/1409.6838
63. W. Xia, Y. Wen, C. H. Foh, D. Niyato, and H. Xie, "A survey on software-defined networking, " IEEE Commun. Surveys Tuts., vol. 17, no. 1, pp. 27-51, Mar. 2014.
64. C. Xu, D. Tao, and C. Xu, "Large-margin multi-view information bottleneck, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1559-1572, Aug. 2014.
65. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 12, pp. 2531-2544, Dec. 2015.
66. H. Xu, C. Caramanis, and S. Mannor, "Sparse algorithms are not stable: A no-free-lunch theorem, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 1, pp. 187-193, Jan. 2012.
67. H. Xu and S. Mannor, "Robustness and generalization, " Mach. Learn., vol. 86, no. 3, pp. 391-423, 2012.
68. Z. Xu, Y. Zhang, and L. Cao, "Social image analysis from a non-IID perspective, " IEEE Trans. Multimedia, vol. 16, no. 7, pp. 1986-1998, Nov. 2014.
69. M. Yan, Y. Yang, and S. Osher, "Robust 1-bit compressive sensing using adaptive outlier pursuit, " IEEE Trans. Signal Process., vol. 60, no. 7, pp. 3868-3875, Jul. 2012.
70. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
71. J. Yang and Y. Zhang, "Alternating direction algorithms for l1-problems in compressive sensing, " SIAM J. Sci. Comput., vol. 33, no. 1, pp. 250-278, 2011.
72. C. Yao, Z. Lu, J. Li, Y. Xu, and J. Han, "A subset method for improving linear discriminant analysis, " Neurocomputing, vol. 138, pp. 310-315, Aug. 2014.
73. J. Yu, D. Tao, J. Li, and J. Cheng, "Semantic preserving distance metric learning and applications, " Inf. Sci., vol. 281, pp. 674-686, Oct. 2014.
74. D. Zhang, M. M. Islam, and G. Lu, "A review on automatic image annotation techniques, " Pattern Recognit., vol. 45, no. 1, pp. 346-362, 2012.
75. S. Zhang, J. Huang, Y. Huang, Y. Yu, H. Li, and D. N. Metaxas, "Automatic image annotation using group sparsity, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 3312-3319.
76. W. Zhang, Y. Wen, and D. O. Wu, "Collaborative task execution in mobile cloud computing under a stochastic wireless channel, " IEEE Trans. Wireless Commun., vol. 14, no. 1, pp. 81-93, Jan. 2015.
77. T. Zhou and D. Tao. (2011). "Hamming compressed sensing." [Online]. Available: http://arxiv.org/abs/1110.0073