Visual classification with multitask joint sparse representation

IEEE Transactions on Image Processing

Volumn 21, Issue 10, 2012, Pages 4349-4360

  Yuan, Xiao Tong ^a   Liu, Xiaobai ^b   Yan, Shuicheng ^c  

^a RUTGERS UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Feature fusion; multitask learning; sparse representation; visual classification

Indexed keywords

COVARIATES; FEATURE FUSION; JOINT SPARSITY; KERNEL MATRICES; MULTIPLE FEATURES; MULTIPLE INSTANCES; MULTIPLE KERNELS; MULTIPLE REPRESENTATION; MULTITASK LEARNING; OBJECT CATEGORIZATION; QUERY IMAGES; REAL WORLD DATA; SPARSE REPRESENTATION; STATE-OF-THE-ART METHODS; VISUAL CLASSIFICATION;

FACE RECOGNITION; GRADIENT METHODS;

VIRTUAL REALITY;

EID: 84866609133     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2205006     Document Type: Article

References (60)

1. E. Candés, J. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Commun. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, 2006. (Pubitemid 43988295)
2. 1-minimization," IEEE Trans. Inf. Theory, vol. 56, no. 7, pp. 3540-3560, Jul. 2010.
3. A. Wagner, J. Wright, A. Ganesh, Z. Zhou, and Y. Ma, "Toward a practical face recognition system: Robust registration and illumination by sparse representation," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2009, pp. 597-604.
4. J. Wright, Y. Ma, J. Mairal, G. Spairo, T. Huang, and S. Yan, "Sparse representation for computer vision and pattern recognition," Proc. IEEE, vol. 98, no. 6, pp. 1031-1044, Jun. 2010.
5. J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma, "Robust face recognition via sparse representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 210-226, Feb. 2009.
6. S. Yan and H. Wang, "Semi-supervised learning by sparse representation," in Proc. SIAM Int. Conf. Data Mining, 2009, pp. 792-801.
7. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
8. R. Rao, B. Olshausen, and M. Lewicki, Probabilistic Models of the Brain: Perception and Neural Function. Cambridge, MA: MIT Press, 2002.
9. B. Olshausen and D. Field, "Sparse coding with an overcomplete basis set: A strategy employed by v1?" Vis. Res., vol. 37, no. 23, pp. 3311-3325, 1997. (Pubitemid 27493805)
10. R. Caruana, "Multi-task learning," Mach. Learn., vol. 28, no. 1, pp. 41-75, 1997.
11. T. Kato, H. Kashima, M. Sugiyama, and K. Asai, "Multi-task learning via conic programming," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2008.
12. S. Ozawa, A. Roy, and D. Roussinov, "A multitask learning model for online pattern recognition," IEEE Trans. Neural Netw., vol. 20, no. 3, pp. 430-445, Mar. 2009.
13. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learn., vol. 73, no. 3, pp. 243-272, 2008.
14. S. Bickel, J. Bogojeska, T. Lengauers, and T. Scheffer, "Multi-task learning for HIV therapy screening," in Proc. Int. Conf. Mach. Learn., 2008, pp. 56-63.
15. H. Liu, M. Palatucci, and J. Zhang, "Blockwise coordinate descent procedures for the multi-task lasso, with applications to neural semantic basis discovery," in Proc. Int. Conf. Mach. Learn., 2009, pp. 649-656.
16. G. Obozinski, B. Taskar, and M. Jordan, "Joint covariate selection and joint subspace selection for multiple classification problems," J. Stat. Comput., vol. 20, no. 2, pp. 231-252, 2009.
17. J. Zhang, "A probabilistic framework for multi-task learning," School Comput. Sci., Carnegie Mellon University, Pittsburgh, PA, Tech. Rep. CMU-LTI-06-006, 2006.
18. M. Fornasier and H. Rauhut, "Recovery algorithm for vector-valued data with joint sparsity constraints," SIAM J. Numer. Anal., vol. 46, no. 2, pp. 577-613, 2008.
19. Y. Nesterov, "Gradient methods for minimizing composite objective function," CORE, Catholic Univ. Louvain, Louvain-la-Neuve, Belgium, Tech. Rep. 2007/076, 2007.
20. P. Tseng, "On accelerated proximal gradient methods for convexconcave optimization," SIAM J. Optim., submitted for publication.
21. A. Berg, T. Berg, and J. Malik, "Shape matching and object recognition using low distortion correspondences," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 26-33.
22. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2005, pp. 887-893.
23. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Oct. 2006, pp. 2169-2178. (Pubitemid 44931582)
24. E. Shechtman and M. Irani, "Matching local self-similarities across images and videos," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
25. P. Gehler and S. Nowozin, "On feature combination for multiclass object classification," in Proc. Int. Conf. Comput. Vis., Oct. 2009, pp. 221-228.
26. M. Nilsback and A. Zisserman, "Automated flower classification over a large number of classes," in Proc. Indian Conf. Comput. Vis., Graph. Image Process., 2008, pp. 722-729.
27. M. Varma and D. Ray, "Learning the discriminative power-invariance trade-off," in Proc. IEEE Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
28. P. Viola and M. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
29. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems," SIAM J. Imag. Sci., vol. 2, no. 1, pp. 183-202, 2009.
30. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani, "Least angle regression," Ann. Stat., vol. 32, no. 2, pp. 407-451, 2004.
31. T. Zhang, "Some sharp performance bounds for least squares regression with L1 regularization," Ann. Stat., vol. 37, no. 5A, pp. 2109-2144, 2009.
32. P. Zhao and B. Yu, "On model selection consistancy of lasso," J. Mach. Learn. Res., vol. 7, pp. 2541-2567, Dec. 2006.
33. F. Bach, R. Jenatton, J. Mairal, and G. Obozinski, "Structured sparsity through convex optimization," Dept. Stat. Sci., Univ. California, Berkeley, Tech. Rep. HAL 00621245-v2, 2012.
34. M. Yuan and Y. Lin, "Model selection and estimation in regression with grouped variables," J. Royal Stat. Soc. Ser. B, vol. 68, no. 1, pp. 49-67, 2006. (Pubitemid 43415335)
35. P. Zhao, G. Rocha, and B. Yu, "The composite absolute penalties family for grouped and hierarchical variable selection," Ann. Stat., vol. 37, no. 6A, pp. 3468-3497, 2009.
36. D. Singaraju, R. Tron, E. Elhamifar, A. Yang, and S. S. Sastry, "On the lagrangian biduality of sparsity minimization problems," Dept. Electr. Eng. Comput. Sci., Univ. California, Berkeley, Tech. Rep. UCB/EECS-2011-70, 2011.
37. B. D. Rao, "Analysis and extensions of the focuss algorithm," in Proc. Conf. Record 30th Asilomar Conf. Signals, Syst. Comput., 1996, pp. 1218-1223.
38. J. A.Tropp, A. C. Gilbert, and M. J. Strauss, "Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit," EURASIP J. Appl. Signal Process., vol. 86, no. 3, pp. 572-588, 2006. (Pubitemid 43106572)
39. Y. C. Eldar and M. Mishali, "Robust recovery of signals from a structured union of subspaces," IEEE Trans. Inf. Theory, vol. 55, no. 11, pp. 5302-5316, Nov. 2009.
40. M. Elad, M. Figueiredo, and Y. Ma, "On the role of sparse and redundant representations in image processing," Proc. IEEE, vol. 98, no. 6, pp. 972-982, Jun. 2010.
41. E. Elhamifar and R. Vidal, "Robust classification using structured sparse representation," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1873-1879.
42. A. Majumdar and R. Ward, "Classification via group sparsity promoting regularization," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., vol. 1. Apr. 2009, pp. 861-864.
43. H. Zou and T. Hastie, "Regularization and variable selection via the elastic net," J. Royal Stat. Soc. B, vol. 67, no. 2, pp. 301-320, 2005. (Pubitemid 40465877)
44. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. ACM SIGKDD Conf. Knowl. Discovery Data Mining, 2004, pp. 109-117. (Pubitemid 40114921)
45. Y. Zhou, R. Jin, and S.-C. Hoi, "Exclusive lasso for multi-task feature selection," in Proc. Int. Conf. Artif. Intell. Stat., 2010, pp. 988-995.
46. Y. Lin, T. Liu, and C. Fuh, "Local ensemble kernel learning for object category recognition," in Proc. IEEE Int. Conf. Comput. Vis., Jun. 2007, pp. 1-8.
47. R. Tibshirani, "Regression shrinkage and selection via the lasso," J. Royal Stat. Soc., Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
48. J. Friedman, T. Hastie, H. Hudotofling, and R. Tibshirani. "Pathwise coordinate optimization," Ann. Appl. Stat., vol. 1, no. 2, pp. 302-332, 2007.
49. 1-norm solution is also the sparsest solution," Commun. Pure Appl. Math., vol. 59, no. 6, pp. 797-826, 2006.
50. S. Becker, J. Bobin, and E. J. Candès, "NESTA: A fast and accurate firstorder method for sparse recovery," SIAM J. Imag. Sci., vol. 4, no. 1, pp. 1-39, 2009.
51. X. Chen, W. Pan, J. Kwok, and J. Garbonell, "Accelerated gradient method for multi-task sparse learning problem," in Proc. IEEE Int. Conf. Data Mining, Dec. 2009, pp. 746-751.
52. M. Kowalski, "Sparse regression using mixed norms," Appl. Comput. Harmonic Anal., vol. 27, no. 3, pp. 303-324, 2009.
53. M. Kowalski and B. Torreesani, "Sparsity and persistence: Mixed norms provide simple signals models with dependent coefficient," Signal, Image Video Process., vol. 3, pp. 251-264, 2009.
54. M. Schmidt, E. Berg, M. Friedlander, and K. Murphy, "Optimizing costly functions with simple constraints: A limited-memory projected quasi-Newton algorithm," in Proc. Int. Conf. Artif. Intell. Stat., vol. 5. 2009, pp. 456-463.
55. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006. (Pubitemid 46405714)
56. M. Nilsback and A. Zisserman, "A visual vocabulary for flower classification," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recognit., Oct. 2006, pp. 1447-1454. (Pubitemid 44931490)
57. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories," in Proc. CVPR Workshop Generat.-Model Based Vis., 2004, pp. 59-70. (Pubitemid 46528761)
58. C. Sanderson, Biometric Person Recognition: Face, Speech and Fusion. Saarbrücken, Germany: VDM-Verlag, 2008.
59. D. Gorodnichy, "Video-based framework for face recognition in video," in Proc. 2nd Canadian Conf. Comput. Robot Vis., 2005, pp. 330-338.
60. W. Zhao, R. Chellappa, P. Phillips, and A. Rosenfeld, "Face recognition: A literature survey," ACM Comput. Surveys, vol. 35, no. 4, pp. 399-458, 2003.