Discriminatively regularized least-squares classification

Pattern Recognition

Volumn 42, Issue 1, 2009, Pages 93-104

  Xue, Hui ^a   Chen, Songcan ^a   Yang, Qiang ^b  

^a NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS   (China)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Classifier design; Discriminative information; Manifold learning; Pattern recognition

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); COMPUTATIONAL FLUID DYNAMICS; COMPUTER NETWORKS; LEARNING SYSTEMS; LEAST SQUARES APPROXIMATIONS; SUPPORT VECTOR MACHINES; VECTORS;

CLASSIFIER DESIGN; DISCRIMINATIVE INFORMATION; LEAST-SQUARES; MANIFOLD LEARNING; PATTERN RECOGNITION;

LEARNING ALGORITHMS;

EID: 51649109792     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.07.010     Document Type: Article

References (62)

1. Vapnik V. Statistical Learning Theory (1998), Wiley, New York
2. Chen Z., and Haykin S. On different facets of regularization theory. Neural Comput. 14 12 (2002) 2791-2846
3. Schuurmans D., and Southey F. Metric-based methods for adaptive model selection and regularization. Mach. Learn. 48 (2002) 51-84
4. O. Bousquet, O. Chapelle, M. Hein, Measure based regularization, in: Neural Information Processing Symposium, Vancouver, British Columbia, Canada, 2003.
5. M. Belkin, P. Niyogi, V. Sindhwani, Manifold regularization: a geometric framework for learning from examples, Technical Report TR-2004-06, Department of Computer Science, University of Chicago, 2004.
6. Micchelli C.A., and Pontil M. Learning the kernel function via regularization. J. Mach. Learn. Res. 6 (2005) 1099-1125
7. Rifkin R.M., and Lippert R.A. Value regularization and fenchel duality. J. Mach. Learn. Res. 8 (2007) 441-479
8. Corduneanu A., and Jaakkola T. On information regularization. UAI (2003)
9. Xue H., Chen S., and Zeng X. Classifier learning with a new locality regularization method. Pattern Recognition 41 5 (2008) 1496-1507
10. M. Belkin, P. Niyogi, V. Sindhwani, On mainfold regularization, in: Proceedings of the International Workshop on Artificial Intelligence and Statistics, 2005.
11. T. Poggio, F. Girosi, Networks for approximation and learning, in: Proceedings of the IEEE, vol. 78, 1990, pp. 1481-1497.
12. Poggio T., and Girosi F. Regularization algorithms for learning that are equivalent to multilayer networks. Science 247 (1990) 978-982
13. A.R. Barron, Complexity regularization with application to artificial neural networks, in: G. Roussas (Eds.), Nonparametric Functional Estimation and Related Topics, 1991, pp. 561-576.
14. J.J. Pan, Q. Yang, H. Chang, D.-Y. Yeung. A manifold regularization approach to calibration reduction for sensor-network based tracking, in: Proceedings of the 21st National Conference on Artificial Intelligence (AAAI 06), 2006, pp. 988-993.
15. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), Wiley, New York
16. Haykin S. Neural Networks: A Comprehensive Foundation (2001), Tsinghua University Press, China
17. Tikhonov A.N. On solving incorrectly posed problems and method of regularization. Dokl. Akad. Nauk USSR 151 (1963) 501-504
18. Tikhonov A.N., and Aresnin V.Y. Solutions of Ill-posed Problems (1977), Winston, Washington, DC
19. Morozov V.A. Methods for Solving Incorrectly Posed Problems (1984), Springer, Berlin
20. G. Wahba, Spline Models for Observational Data, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 59, Society for Industrial & Applied Mathematics, Philadelphia, PA, 1990.
21. R.M. Rifkin. Everything old is new again: a fresh look at historical approaches to machine learning, Ph.D. Thesis, Massachusetts Institute of Technology, 2002.
22. Girosi F. An equivalence between sparse approximation and support vector machines. Neural Comput. 10 6 (1998) 1455-1480
23. B. Scholkopf, R. Herbrich, A.J. Smola. A generalized representer theorem, in: Proceedings of the 14th Annual Conference on Computational Learning Theory, 2001, pp. 416-426.
24. Cristianini N., and Shawe-Taylor J. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods (2004), Publishing House of Electronics Industry, Beijing
25. Suykens J.A.K., and Vandewalle J. Least squares support vector machine classifiers. Neural Process. Lett. 9 (1999) 293-300
26. Evgeniou T., Pontil M., and Poggio T. Regularization networks and support vector machines. Adv. Comput. Math. 13 1 (2000) 1-50
27. Tenenbaum J., Silva V., and Langford J. A global geometric framework for nonlinear dimensionality reduction. Science 290 22 (2000) 2319-2323
28. Roweis S.T., and Saul L.K. Nonlinear dimensionality reduction by locally linear embedding. Science 290 22 (2000) 2323-2326
29. M. Belkin, P. Niyogi, Laplacian eigenmaps and spectral technique for embedding and clustering, in: Neural Information Processing Systems, vol.15, Vancouver, British Columbia, Canada, 2001.
30. X. He, D. Cai, S. Yan, H. Zhang, Neighborhood preserving embedding, in: Proceedings of the 10th IEEE International Conference on Computer Vision, 2005.
31. X. He, P. Niyogi, Locality Preserving Projection, Neural Information Processing Symposium, Vancouver, British Columbia, Canada, 2003.
32. D. Cai, X. He, K. Zhou, J. Han, H. Bao, Locality sensitive discriminant analysis, in: International Joint Conference on Artificial Intelligence, 2007, pp. 708-713.
33. Yan S., Xu D., Zhang B., Zhang H., Yang Q., and Lin S. Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29 1 (2007) 40-51
34. H. Chen, H. Chang, T. Liu, Local discriminant embedding and its variants, in: International Conference on Computer Vision Pattern Recognition, 2005.
35. S. Szedmak, J. Shawe-Taylor, Muticlass learning at one-class complexity, Technical Report 1508, School of Electronics and Computer Science, Southampton, UK, 2005.
36. Li H., Jiang T., and Zhang K. Efficient and robust feature extraction by maximun margin criterion. IEEE Trans. Neural Networks 17 1 (2006) 157-165
37. Lafon S., Keller Y., and Coifman R.R. Data fusion and multicue data matching by diffusion maps. IEEE Trans. Pattern Anal. Mach. Intell. 28 11 (2006) 1784-1797
38. F.R.K. Chung, Spectral Graph Theory, in: Regional Conference Series in Mathematics, vol. 92, 1997.
39. Yuille A.L., and Rangarajan A. The concave-convex procedure. Neural Comput. 15 (2003) 915-936
40. R. Collobert, F. Sinz, J. Weston, L. Bottou, Trading convexity for scalability, in: International Conference on Machine Learning, 2006.
41. Ou G., and Murphey Y.L. Multi-class pattern classification using neural networks. Pattern Recognition 40 1 (2007) 4-18
42. S. Asharaf, M.N. Murty, S.K. Shevade, Multiclass core vector machine, in: International Conference on Machine Learning, Corvallis, OR, 2007.
43. Xiong H., Swamy M.N.S., and Ahmad M.O. Optimizing the kernel in the empirical feature space. IEEE Trans. Neural Networks 16 2 (2005) 460-474
44. Mangasarian O., and Wild E. Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Trans. Pattern Anal. Mach. Intell. 28 1 (2006) 69-74
45. Wang Z., Chen S., and Sun T. MultiK-MHKS: a novel multiple kernel learning algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 30 2 (2008) 348-353
46. Martinez A., and Kak A. PCA versus LDA. IEEE Trans. Pattern Anal. Mach. Intell. 23 2 (2001) 228-233
47. Evgeniou T., Micchelli C.A., and Pontil M. Learning multiple tasks with kernel methods. J. Mach. Learn. Res. 6 (2005) 615-637
48. C.A. Micchelli, M. Pontil, Kernels for multi-task learning, in: Neural Information Processing Systems, Vancouver, British Columbia, Canada, 2004.
49. Micchelli C.A., and Pontil M. On learning vector-valued functions. Neural Comput. 17 (2005) 177-204
50. Saul L.K., and Roweis S.T. Think globally, fit locally: unsupervised learning of low dimensional manifolds. J. Mach. Learn. Res. 4 (2003) 119-155
51. A. Ghodsi, J. Huang, F. Southey, D. Schuurmans, Tangent-corrected embedding, CVPR, 2005.
52. A.M. Martinez, R. Benavente, The AR Face Database, CVC Technical Report #24, June, 1998.
53. S.A. Nene, S.K. Nayar, H. Murase, Columbia Object Image Library (COIL-20), Technical Report CUCS-005-96, February, 1996.
54. Sun T., and Chen S. Locality preserving CCA with applications to data visualization and pose estimation. Image Vision Comput. 25 5 (2007) 531-543
55. A. Argyriou, M. Herbster, M. Pontil, Combing graph Laplacians for semi-supervised learning, Neural Information Processing Systems, Vancouver, British Columbia, Canada, 2005.
56. X.Z. Fern, C.E. Brodley, Random projection for high dimensional data clustering: a cluster ensemble approach, in: International Conference on Machine Learning, 2003, pp. 186-193.
57. X.Z. Fern, C.E. Brodley, Cluster ensembles for high dimensional clustering: an empirical study, Technical Report CS06-30-02, Oregon State University, 2006.
58. S. Durand, M. Nikolova, Stability of minimizers of regularized least squares objective functions I: study of the local behavior, Technical Report TSI-ENST, Paris, France, 2001.
59. S. Durand, M. Nikolova. Stability of minimizers of regularized least squares objective functions II: study of the global behavior, Technical Report TSI-ENST, Paris, France, 2001.
60. R.H. Chan, C.-W. Ho, C.-Y. Leung, M. Nikolova, Minimization of detail-preserving regularization functional by Newtons method with continuation, in: International Conference on Image Processing, 2005, pp. 125-128.
61. Chan R.H., Ho C.-W., and Nikolova M. Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization. IEEE Trans. Image Process. 14 10 (2005) 1479-1485
62. I.W. Tsang, J.T. Kwok, Large-scale sparsified manifold regularization, in: Neural Information Processing Systems, Vancouver, British Columbia, Canada, 2006.