Two-stage multiple kernel learning for supervised dimensionality reduction

Pattern Recognition

Volumn 48, Issue 5, 2015, Pages 1854-1862

  Nazarpour, Abdollah ^a   Adibi, Peyman ^a  

^a UNIVERSITY OF ISFAHAN   (Iran)

Author keywords

Handwritten digit recognition; Multiple kernel learning; Objection recognition; Pattern recognition; Supervised dimensionality reduction

Indexed keywords

CHARACTER RECOGNITION; DISCRIMINANT ANALYSIS; PATTERN RECOGNITION;

CLASSIFICATION ACCURACY; DIMENSIONALITY REDUCTION METHOD; DIMENSIONALITY-REDUCTION MODELS; FAST CLASSIFICATION; HANDWRITTEN DIGIT RECOGNITION; KERNEL DISCRIMINANT ANALYSIS; MULTIPLE KERNEL LEARNING; OBJECTION RECOGNITION;

DIMENSIONALITY REDUCTION;

EID: 84921627833     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.12.001     Document Type: Article

References (58)

1. S. Theodoridis, and K. Koutroumbas Pattern Recognition 4th ed. 2009 Academic Press (Elsevier) Cambridge, UK
2. O.C. Hamsici, and A.M. Martinez Bayes optimality in linear discriminant analysis IEEE Trans. Pattern Anal. Mach. Intell. 30 2008 647 657
3. X. Geng, D.-C. Zhan, and Z.-H. Zhou Supervised nonlinear dimensionality reduction for visualization and classification IEEE Trans. Syst. Man. Cybern. Part B: Cybern. 35 2005 1098 1107
4. R. Jenssen Mean vector component analysis for visualization and clustering of nonnegative data IEEE Trans. Neural Netw. Learn. Syst. 24 2013 1553 1564
5. A.C. Berg, J. Malik, Geometric blur for template matching, CVPR 2001, in: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, 2001, vol. 601, pp. 607-614.
6. D.G. Lowe Distinctive image features from scale-invariant keypoints Int. J. Comput. Vis. 60 2004 91 110
7. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, Computer Vision and Pattern Recognition, CVPR'05, IEEE Comput Society Conference, IEEE 2005, pp. 886-893.
8. E. Tola, V. Lepetit, P. Fua, A fast local descriptor for dense matching, Computer Vision and Pattern Recognition, CVPR'08, IEEE Conference, IEEE, 2008, pp. 1-8.
9. Y.-Y. Lin, T.-L. Liu, and C.-S. Fuh Multiple kernel learning for dimensionality reduction IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 1147 1160
10. H. Cai, K. Mikolajczyk, and J. Matas Learning linear discriminant projections for dimensionality reduction of image descriptors IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 338 352
11. B. Scholkopft, K.-R. Mullert, Fisher discriminant analysis with kernels, IEEE Signal Processing Society. Workshop Neural Networks for Signal Processing IX, 1999, pp. 41-48.
12. R.A. Fisher The statistical utilization of multiple measurements Ann. Eugen. 8 1938 376 386
13. R.A. Fisher The use of multiple measurements in taxonomic problems Ann. Eugen. 7 1936 179 188
14. B. Scholkopft, and K.-R. Mullert Fisher discriminant analysis with kernels (Workshop Neural Networks for Signal Processing IX) IEEE Signal Process. Soc. 1999 41 48
15. G. Baudat, and F. Anouar Generalized discriminant analysis using a kernel approach Neural Comput. 12 2000 2385 2404
16. D. You, O.C. Hamsici, and A.M. Martinez Kernel optimization in discriminant analysis IEEE Trans. Pattern Anal. Mach. Intell. 33 2011 631 638
17. D. You, A.M. Martinez, Bayes optimal kernel discriminant analysis, Computer Vision and Pattern Recognition (CVPR), IEEE Conference on, IEEE, 2010, pp. 3533-3538.
18. G.R.G. Lanckriet, T. De Bie, N. Cristianini, M.I. Jordan, and W.S. Noble A statistical framework for genomic data fusion Bioinformatics 20 2004 2626 2635
19. A. Kumar, A. Niculescu-mizil, K. Kavukcuoglu, H. Daume, A Binary Classification Framework for Two-Stage Multiple Kernel Learning, in: Proceedings of the 29th International Conference on Machine Learning (ICML-12), 2012, pp. 1295-1302.
20. C. Cortes, and V. Vapnik Support vector machine Mach. Learn. 20 1995 273 297
21. M. Zhu, and A.M. Martinez Subclass discriminant analysis IEEE Trans. Pattern Anal. Mach. Intell. 28 2006 1274 1286
22. M. Loog, R.P.W. Duin, and R. Haeb-Umbach Multiclass linear dimension reduction by weighted pairwise Fisher criteria IEEE Trans. Pattern Anal. Mach. Intell. 23 2001 762 766
23. J. Liu, F. Zhao, and Y. Liu Learning kernel parameters for kernel Fisher discriminant analysis Pattern Recognit. Lett. 34 2013 1026 1031
24. M. Sugiyama Dimensionality reduction of multimodal labeled data by local fisher discriminant analysis J. Mach. Learn. Res. 8 2007 1027 1061
25. M. Sugiyama, Local fisher discriminant analysis for supervised dimensionality reduction, in: Proceedings of the 23rd international conference on Machine learning, ACM, 2006, pp. 905-912.
26. X. He, and P. Niyogi Locality preserving projections Neural Inf. Process. Syst. 2003 234 241
27. N. Gkalelis, V. Mezaris, I. Kompatsiaris, and T. Stathaki Mixture subclass discriminant analysis link to restricted Gaussian model and other generalizations IEEE Trans. Neural Netw. Learn. Syst. 24 2013 8 21
28. N. Gkalelis, V. Mezaris, and I. Kompatsiaris Mixture subclass discriminant analysis Signal Process. Lett. IEEE 18 2011 319 322
29. A. Diaf, B. Boufama, and R. Benlamri Non-parametric Fisher discriminant analysis with kernels for data classification Pattern Recognit. Lett. 34 2013 552 558
30. A. Rakotomamonjy, F.R. Bach, S.p. Canu, Y. Grandvalet, and M.K.L. Simple J. Mach. Learn. Res. 9 2008 2491 2521
31. F. Orabona, L. Jie, and B. Caputo Multi kernel learning with online-batch optimization J. Mach. Learn. Res. 13 2012 227 253
32. M. Gonen, Bayesian efficient multiple kernel learning, in: Proceedings of the 29th International Conference on Machine Learning (ICML-12), 2012.
33. S. Gu, Y. Guo, Learning SVM classifiers with indefinite kernels, in: Proceedings of the 26th Conference Artificial Intelligence (AAAI-12), 2012.
34. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, and S. Lin Graph embedding and extensions: a general framework for dimensionality reduction IEEE Trans. Pattern Anal. Mach. Intell. 29 2007 40 51
35. G. Wahba Spline Models for Observational Data 1990 SIAM Philadelphia, PA, USA
36. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer New York
37. S.P. Boyd, and L. Vandenberghe Convex Optimization 2004 Cambridge university press Cambridge, UK
38. G.B. Dantzig, A. Orden, and P. Wolfe The generalized simplex method for minimizing a linear form under linear inequality restraints Pac. J. Math. 5 1955 183 195
39. M. Grant, S. Boyd, Y. Ye, CVX: Matlab software for disciplined convex programming at 〈http://cvxr.com/cvx〉, September 2013.
40. M.C. Grant, and S.P. Boyd Graph implementations for nonsmooth convex programs in: Recent Advances in Learning and Control 2008 Springer London, UK pp. 95-110
41. C. Blake, and C.J. Merz UCI Repository of machine learning databases 1998 University of California Irvine 〈http://www.ics.uci.edu/~mlearn/MLRepository.html〉
42. B. Leibe, B. Schiele, Analyzing appearance and contour based methods for object categorization, in: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, 2003, vol. 402, pp. II-409-415.
43. M. Everingham, L. Van Gool, C.K.I. Williams, J. Winn, A. Zisserman, The PASCAL Visual Object Classes Challenge 2008 (VOC 2008) Results (2008), 2008, 〈http://www.pascal-network.org/challenges/VOC/voc2008/workshop/index.html〉.
44. S. Ebert, D. Larlus, B.S chiele, Extracting structures in image collections for object recognition, 11th European Conference on Computer Vision (ECCV), 09/2010, Crete, Greece, 2010, 720-733
45. Y. LeCun, C. Cortes, The MNIST database of handwritten digits, 1998, Available electronically at: 〈http://yann.lecun.com/exdb/mnist〉.
46. J.J. Hull A database for handwritten text recognition research IEEE Trans. Pattern Anal. Mach. Intell. 16 1994 550 554
47. A. Bosch, A. Zisserman, and X. Munoz Image classification using random forests and ferns Int. Conf. Comput. Vis. (ICCV) 2007 1 8
48. S. Maji, and J. Malik Fast and Accurate Digit Classification (Tech. Rep. UCB/EECS-2009-159) 2009 EECS Department, University of California Berkeley
49. C. Xu, D. Tao, C. Xu, A survey on multi-view learning, arXiv:1304.5634.
50. P. Jawanpuria, M. Varma, S. Nath, On p-norm path following in multiple kernel learning for non-linear feature selection, in: Proceedings of the 31st International Conference on Machine Learning (ICML-14), pp. 118-126.
51. T. Zhang, D. Tao, X. Li, and J. Yang Patch alignment for dimensionality reduction IEEE Trans. Knowl. Data Eng. 21 2009 1299 1313
52. J. Yu, D. Tao, J. Li, and J. Cheng Semantic preserving distance metric learning and applications Inf. Sci. 281 2014 674 686
53. J. Yu, Y. Rui, Y.Y. Tang, and D. Tao High-order distance-based multiview stochastic learning in image classification IEEE Trans. Cybern. 2014 1 12
54. J. Yu, Y. Rui, and D. Tao Click prediction for web image reranking using multimodal sparse coding IEEE Trans. Image Process. 23 2014 2019 2032
55. J. Yu, M. Wang, and D. Tao Semisupervised multiview distance metric learning for cartoon synthesis IEEE Trans. Image Process. 21 2012 4636 4648
56. Y. Hou, H.-K. Min, S. Lee, S. Yoon, S.R. Lee, I. Song, Complexity reduction of kernel discriminant analysis, Information Sciences and Systems (CISS), 2012 46th Annual Conference on, IEEE 2012, pp. 1-6.
57. Q. Ke, M. Isard, and S. Lazebnik A multi-view embedding space for modeling internet images, tags, and their semantics Int. J. Comput. Vis. 106 2014 210 233
58. C. Xu, D. Tao, and C. Xu Large-margin multi-view information bottleneck IEEE Trans. Pattern Anal. Mach. Intell. 36 2014 1559 1572