Exploring nonlinear relationships in chemical data using kernel-based methods

Chemometrics and Intelligent Laboratory Systems

Volumn 107, Issue 1, 2011, Pages 106-115

  Cao, Dong Sheng ^a   Liang, Yi Zeng ^a   Xu, Qing Song ^a   Hu, Qian Nan ^b   Zhang, Liang Xiao ^a   Fu, Guang Hui ^a  

^a CENTRAL SOUTH UNIVERSITY   (China)

^b WUHAN UNIVERSITY   (China)

Author keywords

Dual solution; Kernel Fisher discriminant analysis (KFDA); Kernel methods; Kernel partial least squares (KPLS); Kernel principal component analysis (KPCA); Support vector machines (SVMs)

Indexed keywords

CHEMICAL AGENT;

ALGORITHM; ARTICLE; CHEMOMETRICS; DISCRIMINANT ANALYSIS; KERNEL METHOD; NONLINEAR SYSTEM; PARTIAL LEAST SQUARES REGRESSION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; SUPPORT VECTOR MACHINE;

EID: 79955653069     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2011.02.004     Document Type: Article

References (56)

1. Frank I.E. Modern nonlinear regression methods. Chemometrics and Intelligent Laboratory Systems 1995, 27:1-19.
2. Breiman L., Friedman J.H., Olsen R.A., Stone C.J. Classification and Regression Trees 1984, Wadsworth International, California.
3. Friedman J.H. Multivariate adaptive regression splines. Annals of statistics 1991, 19:1-67.
4. Andersson M. A comparison of nine PLS1 algorithms. Journal of Chemometrics 2009, 23:518-529.
5. Araby I.A.-R., Gino J.L. A nonlinear partial least squares algorithm using quadratic fuzzy inference system. Journal of Chemometrics 2009, 23:530-537.
6. Walczak B., Massart D.L. The radial basis functions - partial least squares approach as a flexible non-linear regression technique. Analytica Chimica Acta 1996, 331:177-185.
7. Walczak B., Massart D.L. Application of radial basis functions - partial least squares to non-linear pattern recognition problems: diagnosis of process faults. Analytica Chimica Acta 1996, 331:187-193.
8. Wold S. Nonlinear partial least squares modelling II. Spline inner relation. Chemometrics and Intelligent Laboratory Systems 1992, 14:71-84.
9. Lombardo R., Durand J.F., Veaux R.D. Model building in multivariate additive partial least squares splines via the GCV criterion. Journal of Chemometrics 2009, 23:605-617.
10. Friedman J.H., Hastie T., Tibshirani R. The Elements of Statistical Learning: Data Mining, Inference and Prediction 2008, Springer-Verlag, New York.
11. Wythoff B.J. Backpropagation neural networks: a tutorial. Chemometrics and Intelligent Laboratory Systems 1993, 18:115-155.
12. Kateman G. Neural networks in analytical chemistry?. Chemometrics and Intelligent Laboratory Systems 1993, 19:135-142.
13. Svozil D., Kvasnicka V., Pospichal J. Introduction to multi-layer feed-forward neural networks. Chemometrics and Intelligent Laboratory Systems 1997, 39:43-62.
14. Schölkopf B., Smola A.J. Learning with Kernels 2002, MIT Press, Cambridge.
15. Shawe-Taylor J., Cristianini N. Kernel Methods for Pattern Analysis 2004, Cambridge.
16. Mller K., Mika S., Rtsch G., Tsuda K., Schölkopf B. An introduction to kernel-based learning algorithms. IEEE Transactions on Neural Networks 2001, 12:181-202.
17. Advances in Kernel Methods: Support Vector Learning 1999, MIT Press. B. Schölkopf, C.J.C. Burges, A.J. Smola (Eds.).
18. Czekaj T., Wu W., Walczak B. About kernel latent variable approaches and SVM. Journal of Chemometrics 2005, 19:341-354.
19. Vapnik V.N. The Nature of Statistical Learning Theory 2000, Springer-Verlag, New York.
20. Smola A.J., Schölkopf B. A tutorial on support vector regression. Statistics and Computing 2004, 14:199-222.
21. Burges C.J.C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 1998, 2:121-167.
22. Mayoraz E., Alpaydin E. Engineering Applications of Bio-Inspired Artificial Neural Networks 1999, 833-842. Springer.
23. Evgeniou T., Pontil M., Poggio T. Regularization networks and support vector machines. Advances in Computational Mathematics 2000, 13:1-50.
24. Ivanciuc O. Applications of support vector machines in chemistry. Rev. Comput. Chem. 2007, 23:291-400.
25. Suykens J.A.K., Gestel T.V., Brabanter J.D., Moor B.D., Vandewalle J. Least Squares Support Vector Machines 2002, World Scientific, Singapore.
26. Schölkopf B., Smola A.J., Müller K.-R. Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput. 1998, 10:1299-1319.
27. Wold S. Principal component analysis. Chemometrics and Intelligent Laboratory Systems 1987, 2:37-52.
28. Jolliffe I.T. Principal Component Analysis 1986, Springer, Berlin, Berlin.
29. Wu W., Massart D.L., de Jong S. The kernel PCA algorithms for wide data. Part I: theory and algorithms. Chemometrics and Intelligent Laboratory Systems 1997, 36:165-172.
30. Wu W., Massart D.L., de Jong S. Kernel-PCA algorithms for wide data part II: fast cross-validation and application in classification of NIR data. Chemometrics and Intelligent Laboratory Systems 1997, 37:271-280.
31. Mika S., Schölkopf B., Smola A.J., Müller K.-R., Scholz M., Rätsch G. Kernel PCA and de-noising in feature spaces. Proceedings of the 1998 conference on Advances in neural information processing systems II 1999, MIT Press.
32. Rosipal R., Leonard J.T. Kernel partial least squares regression in reproducing kernel hilbert space. J. Mach. Learn. Res. 2002, 2:97-123.
33. de Jong S. SIMPLS: an alternative approach to partial least squares regression. Chemometrics and Intelligent Laboratory Systems 1993, 18:251-263.
34. Rosipal R., Krämer N. Overview and recent advances in partial least squares. Subspace, Latent Structure and Feature Selection 2006, 34-51. Springer. G.M., C. Saunders, S. Gunn, J. Shawe-Taylor (Eds.).
35. Lewi P.J. Pattern recognition, reflections from a chemometric point of view. Chemometrics and Intelligent Laboratory Systems 1995, 28:23-33.
36. Fukunaga K. Handbook of Pattern Recognition and Computer Vision. World Scientific Publishing Co., Inc 2010, 33-60.
37. Wu W., Mallet Y., Walczak B., Penninckx W., Massart D.L., Heuerding S., Erni F. Comparison of regularized discriminant analysis linear discriminant analysis and quadratic discriminant analysis applied to NIR data. Analytica Chimica Acta 1996, 329:257-265.
38. Hastie T., Buja A., Tibshirani R. Penalized discriminant analysis. The Annals of Statistics 1995, 23:73-102.
39. Mika S., Rätsch G., Weston J., Schölkopf B., Mullers K.R. Fisher Discriminant Analysis with Kernels 1999, 41-48.
40. Yang J., Jin Z., Yang J.-Y., Zhang D., Frangi A.F. Essence of kernel Fisher discriminant: KPCA plus LDA. Pattern Recognition 2004, 37:2097-2100.
41. Jian Y., Frangi A.F., Jing-Yu Y., David Z., Zhong J. KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition. Pattern Analysis and Machine Intelligence, IEEE Transactions on 2005, 27:230-244.
42. Baudat G., Anouar F. Generalized discriminant analysis using a Kernel approach. Neural Comput. 2000, 12:2385-2404.
43. Herbrich R. Learning Kernel Classifiers 2002, MIT Press, Cambridge.
44. Vapnik V., Chervonenkis A. Theory of Pattern Recognition 1974, Nauka, Moscow.
45. Kecman V. Learning and Soft Computing 2001, MIT Press Cambridge.
46. Stone M. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B (Methodological) 1974, 36:111-147.
47. Efron B., Tibshirani R. Bootstrap methods for standard errors, confidence intervals, and other measures of statistical accuracy. Statistical Science 1986, 1:54-75.
48. Efron B., Tibshirani R. Improvements on cross-validation: the .632+ bootstrap method. Journal of the American Statistical Association 1997, 92:548-560.
49. Shao J. Linear model selection by cross-validation. Journal of the American Statistical Association 1993, 88:486-494.
50. Shao J. Bootstrap model selection. Journal of the American Statistical Association 1996, 91:655-665.
51. Xu Q.S., Liang Y.Z. Monte Carlo cross validation. Chemometrics and Intelligent Laboratory Systems 2001, 56:1-11.
52. Xu Q.S., Liang Y.Z., Du Y.P. Monte Carlo cross-validation for selecting a model and estimating the prediction error in multivariate calibration. Journal of Chemometrics 2004, 18:112-120.
53. Efron B., Tribshirani R. An Introduction to the Bootstrap 1993, Chapman & Hall/CRC, New York, 436 pp.
54. MacKay D.J.C. Information Theory, Inference and Learning Algorithms 2002, Cambridge University Press.
55. Filzmoser P., Liebmann B., Varmuza K. Repeated double cross validation. Journal of Chemometrics 2009, 23:160-171.
56. De Monte V.E., Geffen G.M., May C., McFarland K.A. Double cross-validation and improved sensitivity of the rapid screen of mild traumatic brain injury. Journal of Clinical and Experimental Neuropsychol 2004, 24:628-644.