The heterogeneous feature selection with structural sparsity for multimedia annotation and hashing: a survey

International Journal of Multimedia Information Retrieval

Volumn 1, Issue 1, 2012, Pages 3-15

  Wu, Fei ^a   Han, Yahong ^a   Liu, Xiang ^b   Shao, Jian ^a   Zhuang, Yueting ^a   Zhang, Zhongfei ^b  

^a ZHEJIANG UNIVERSITY   (China)

^b ZHEJIANG UNIVERSITY   (China)

Author keywords

Factor decomposition; Hashing index; Latent structure; Structural sparsity

Indexed keywords

EID: 84990873037     PISSN: 21926611     EISSN: 2192662X     Source Type: Journal    
DOI: 10.1007/s13735-012-0001-9     Document Type: Article

References (95)

1. Argyriou A, Evgeniou T, Pontil M (2007) Multi-task feature learning. In: Advances in neural information processing systems (NIPS)
2. Bach FR (2008) Consistency of the group Lasso and multiple kernel learning. J Mach Learn Res 9:1179–1225
3. Beck A, Teboulle M (2009) A fast iterative shrinkage-thresholding algorithm for linear inverse problems. SIAM J Imaging Sci 2(1):193–202
4. Berchtold S, Bohm C, Jagadish HV, Kriegel HP, Sander J (2000) Independent quantization: an index compression technique for high-dimensional data spaces. In: Proceedings of international conference on data engineering (ICDE), pp 577–588
5. Berge C (1973) Graphs and hypergraphs. North-Holland, Amsterdam
6. Bousquet O, Elisseeff A (2002) Stability and generalization. J Mach Learn Res 2:499–526
7. Breiman L (1995) Better subset regression using the nonnegative garrote. Technometrics 373–384
8. Breiman L (1996) Heuristics of instability and stabilization in model selection. Ann Stat 24(6):2350–2383
9. Breiman L, Friedman J (1997) Predicting multivariate responses in multiple linear regression. J R Stat Soc Ser B (Methodological) 59(1):3–54
10. Candes EJ, Donoho DL (2002) New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities. In: Communications on pure and applied mathematics, pp 219–266
11. Cao L, Luo J, Liang F, Huang T (2009) Heterogeneous feature machines for visual recognition. In: Proceedings of the IEEE internation conference on computer vision (ICCV), pp 1095–1102
12. Carroll JD, Chang JJ (1970) Analysis of individual differences in multidimensional scaling via an N-way generalization of Eckart-Young decomposition. Psychometrika 35(3):283–319
13. Chen X, Lin Q, Kim S, Carbonell J, Xing E (2010) Efficient proximal gradient method for general structured sparse learning. Preprint, arXiv:1005.4717
14. Cheng B, Yang J, Yan S, Fu Y, Huang T (2010) Learning with -graph for image analysis. IEEE Trans Image Process (TIP) 19(4):858–866
15. Clemmensen L, Hastie T, Ersbøll B (2008) Sparse discriminant analysis. http://www-stat.stanford.edu/hastie/Papers/
16. d’Aspremont A, El Ghaoui L, Jordan MI, Lanckriet GRG (2004) A direct formulation for sparse PCA using semidefinite programming. In: Advances in neural information processing systems (NIPS)
17. Datar M, Immorlica N, Indyk P, Mirrokni VS (2004) Locality-sensitive hashing scheme based on p-stable distributions. In: Proceedings of annual symposium on computational geometry, pp 253–262
18. Efron B (1979) Bootstrap methods: another look at the jackknife. Ann Stat 7(1):1–26
19. Efron B, Hastie T, Johnstone I, Tibshirani R (2004) Least angle regression. Ann Stat 32(2):407–499
20. Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96(456):1348–1360
21. Friedman J, Hastie T, Holger H, Tibshirani R (2007) Pathwise coordinate optimization. In: Annals of applied statistics, pp 302–332
22. Friedman J, Hastie T, Tibshirani R (2008) Sparse inverse covariance estimation with the graphical lasso. Biostatistics 9(3)
23. Gewin V (2011) Self-reflection. Nature 471:667–669
24. Grauman K, Darrell T (2005) Pyramid match kernels: discriminative classification with sets of image features. In: Proceedings of international conference on computer vision (ICCV), pp 1458-1465
25. Han Y, Wu F, Jia J, Zhuang Y, Yu. B (2010) Multi-task sparse discriminant analysis (MtSDA) with overlapping categories. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), pp 469-474
26. Harshman RA (1970) Foundations of the PARAFAC procedure: models and conditions for an “explanatory” multimodal factor analysis. University of California at Los Angeles
27. Hastie T, Buja A, Tibshirani R (1995) Penalized discriminant analysis. Ann Stat 23(1):73–102
28. He X, Niyogi P (2006) Tensor subspace analysis. In: Advances in neural information processing systems (NIPS)
29. Irani M (1999) Multi-frame optical flow estimation using subspace constraints. In: Proceedings of international conference on computer vision (ICCV), pp 623–633
30. Jenatton R, Julien M, Guillaume O, Bach F (2010) Proximal methods for sparse hierarchical dictionary learning. In: Proceedings of the 27th international conference on machine learning (ICML)
31. Jenatton R, Audibert JY, Bach F (2009) Structured variable selection with sparsity-inducing norms. Preprint, arXiv:0904.3523
32. Jenatton R, Obozinski G, Bach F (2010) Structured sparse principal component analysis. In: Proceedings of international conference on artificial intelligence and statistics (AISTATS)
33. Jia Y, Salzmann M, Darrell T (2010) Factorized latent spaces with structured sparsity. In: Advances in neural information processing systems (NIPS)
34. Jia J, Yu B (2010) On model selection consistency of the elastic net when p n. Stat Sin 20:595–611
35. Kearns M, Ron D (1999) Algorithmic stability and sanity-check bounds for leave-one-out cross-validation. Neural Comput 11(6): 1427–1453
36. Kim J, Park H (2011) Fast nonnegative matrix factorization: an active-set-like method and comparisons. SIAM J Sci Comput
37. Kim S, Xing EP (2010) Tree-guided group lasso for multi-task regression with structured sparsity. In: Proceedings of the 27th international conference on machine learning (ICML)
38. Kim H, Park H (2007) Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis. Bioinforma/Comput Appl Biosci 23:1495–1502
39. Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51(3):455–500
40. Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR)
41. Lee D, Seung H (1999) Learning the parts of objects by nonnegative matrix factorization. Nature 401(6755):788–791
42. Lee TS (1996) Image representation using 2D Gabor wavelets. IEEE Trans Pattern Anal Mach Intell 18(10):959–971
43. Li L, Zhou M, Sapiro G, Carin L (2011) On the integration of topic modeling and dictionary learning. In: Proceedings of international conferences on machine learning (ICML)
44. Liu H, Zhang J (2009) Estimation consistency of the group lasso and its applications. In: Proceedings of the twelfth international conference on artificial intelligence and statistics (AISTATS)
45. Liu N, Zhang B, Yan J, Chen J (2005) Text representation: from vector to tensor. In: Proceedings of international conferences on data mining (ICDM)
46. Liu Y, Wu F, Zhang Z, Zhuang Y, Yan S (2010) Sparse representation using nonnegative curds and whey. In: Proceedings of computer vision and pattern recognition (CVPR), pp 3578–3585
47. Lv Q, Josephson W, Wang Z, Charikar M., Li K (2007) Multi-probe LSH: efficient indexing for high-dimensional similarity search. In: Proceedings of international conference on very large data bases (VLDB), pp 950–961
48. Ma ZG, Yang Y, Nie FP, Uijlings J, Sebe N (2011) Exploiting the entire feature space with sparsity for automatic image annotation. In: Proceedings of the ACM multimedia (ACM MM)
49. Maron O, Ratan A.L (1998) Multiple-instance learning for natural scene classification. In: Proceedings of the international conference on machine learning (ICML), pp 341–349
50. Meinshausen N, Yu B (2009) Lasso-type recovery of sparse representations for high-dimensional data. Ann Stat 37(1):246–270
51. Miller RG (1974) The jackknife—a review. Biometrika 6(1):1–15
52. Mu Y, Dong J, Yuan X, Yan S (2011) Accelerated low-rank visual recovery by random projection. In: Proceedings of IEEE conference on computer vision and pattern recognition (CVPR)
53. Nesterov Y (2007) Gradient methods for minimizing composite objective function. Technical report, Universit catholique de Louvain. Center for Operations Research and Econometrics (CORE)
54. Nesterov Y (2005) Smooth minimization of non-smooth functions. Math Program 103(1):127–152
55. Obozinski G, Taskar B, Jordan MI (2006) Multi-task feature selection. Technical report, Statistics Department, UC Berkeley
56. Olshausen B, Field D (1996) Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381:607–609
57. Quattoni, A, Collins, M, Darrell, T (2008) Transfer learning for image classification with sparse prototype representations. In: Proceedings of computer vision and pattern recognition (CVPR), pp 1-8
58. Riesenhuber M, Poggio T (1999) Hierarchical models of object recognition in cortex. Nat Neurosci 2(11):1019–1025
59. Salakhutdinov R, Hinton GE (2007) Learning a nonlinear embedding by preserving class neighbourhood structure. In: AI and statistics
60. Salakhutdinov R, Hinton G (2009) Semantic hashing. Int J Approx Reason 50(7):969–978
61. Saul L, Weinberger K, Sha F, Ham J, Lee D (2006) Spectral methods for dimensionality reduction. In: Semisupervised learning, pp 293-308
62. Shakhnarovich G, Viola P, Darrell T (2003) Fast pose estimation with parameter-sensitive hashing. In: Proceedings of IEEE international conference on computer vision (ICCV), pp 750-757
63. Shao J, Wu F, Ouyang C, Zhang X (2011) Sparse spectral hashing. In: Pattern recognition letters
64. Shen X, Huang HC (2010) Grouping pursuit through a regularization solution surface. J Am Stat Assoc 105(490):727–739
65. Shevade S, Keerthi S (2008) A simple and efficient algorithm for gene selection using sparse logistic regression. Bioinformatics 19(17):2246–2253
66. Shi J, Ren X, Dai G, Wang J, Zhang Z (2011) A non-convex relaxation approach to sparse dictionary learning. In: Proceedings of computer vision and pattern recognition (CVPR)
67. Spielman D, Teng S (2009) Smoothed analysis: an attempt to explain the behavior of algorithms in practice. Commun ACM 52(10):76–84
68. Sun L, Ji S, Ye J (2008) Hypergraph spectral learning for multi-label classification. In: Proceeding of the 14th ACM SIGKDD international conference on knowledge discovery and data mining (SIGKDD), pp 668-676
69. Tao D, Li X, Wu X, Hu W, Maybox J (2005) Supervised tensor learning. In: Proceedings of IEEE conference on data mining (ICDM)
70. Tibshirani R, Saunders M (2005) Sparsity and smoothness via the fused lasso. J R Stat Soc Ser B (Statistical Methodology) 67(1):91–108
71. Tibshirani R (1996) Regression shrinkage and selection via the lasso. J R Stat Soc Ser B (Statistical Methodology) 58(1):267–288
72. Tucker LR (1996) Some mathematical notes on three-mode factor analysis. Psychometrika 31(3):279–311
73. Wang J, Yang J, Yu K, Lv F (2005) Locality-constrained linear coding for image classification. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition (CVPR), pp 3360-3367
74. Weiss Y, Torralba A, Fergus R (2009) Spectral hashing. In: Advances in neural information processing systems (NIPS), pp 1753-1760
75. Wright J, Ganesh A, Rao S, Ma Y (2009) Exact recovery of corrupted low-rank matrices. Robust principal component analysis. In: Advances in neural information processing systems (NIPS)
76. Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach intell 31(2):210–227
77. Wu F, Han Y, Tian Q, Zhuang Y (2010) Multi-label boosting for image annotation by structural grouping sparsity. In: Proceedings of the 2010 ACM international conference on multimedia (ACM MM), pp 15–24
78. Wu F, Zhang H, Zhuang Y (2006) Learning semantic correlations for cross-media retrieval. In: Proceedings of IEEE international conference on image processing (ICIP), pp 1465-1468
79. Wu F, Liu Y, Zhuang Y (2009) Tensor-based transductive learning for multimodality video semantic concept detection. IEEE Trans Multimed 11(5):868–878
80. Xu H, Mannor S, Caramanis C (2011) Sparse algorithms are not stable: a no-free-lunch theorem. In: IEEE transactions on pattern analysis and machine intelligence
81. Xu L, Lu C, Xu Y, Jia J (2011) Image smoothing via L0 gradient minimization. ACM Trans Graph (SIGGRAPH, Asia 2011) 30(6)
82. Yang Y, Shen HY, Ma ZG, Huang Z, Zhou XF (2011) L21-norm regularized discriminative feature selection for unsupervised learning. In: International joint conferences on artificial intelligence (IJCAI)
83. Yang Y, Yang Y, Huang Z, Shen HT, Nie F (2011) Tag localization with spatial correlations and joint group sparsity. In: Proceedings of computer vision and pattern recognition (CVPR), pp 881–888
84. Yang Y, Wu F, Xu D, Zhuang Y, Chia LT (2010) Cross-media retrieval using query dependent search methods. Pattern Recognit 43(8):2927–2936
85. Yu H, Bennamoun M (2006) 1D-PCA, 2D-PCA to nD-PCA. In: Proceedings of international conference on pattern recognition (ICPR), pp 181–184
86. Yuan Y, Wu F, Zhuang Y, Shao J (2011) Image annotation by composite kernel learning with group structure. In: Proceedings of ACM conference on multimedia (ACM MM)
87. Yuan M, Lin Y (2006) Model selection and estimation in regression with grouped variables. J R Stat Soc Ser B (Methodological) 68(1):49–67
88. Yuan M, Lin Y (2007) On the non-negative garrotte estimator. J R Stat Soc Ser B (Statistical Methodology) 69(2):143–161
89. Zhang CH (2010) Nearly unbiased variable selection under minimax concave penalty. Ann Stat 38(2):894–942
90. Zhao P, Yu B (2006) On model selection consistency of Lasso. J Mach Learn Res 7:2541–2563
91. Zhou D, Huang J, Schölkopf B (2006) Learning with hypergraphs: clustering, classification, and embedding. In: Advances in neural information processing systems (NIPS), pp 1601–1608
92. Zhu J, Xing EP (2011) Sparse topical coding. In: Proceedings of the 27th international conference on uncertainty in artificial intelligence (UAI)
93. Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J R Stat Soc Ser B (Statistical Methodology) 67(2):301–320
94. Zou H, Hastie T, Tibshirani R (2006) Sparse principal component analysis. J Comput Graph Stat 15(2):265–286
95. Zou H (2006) The adaptive lasso and its oracle properties. J Am Stat Assoc 101(476):1418–1429