A non-Gaussian regression algorithm based on mutual information maximization

Chemometrics and Intelligent Laboratory Systems

Volumn 111, Issue 1, 2012, Pages 1-19

  Zeng, Jiusun ^a,b   Xie, Lei ^a   Kruger, Uwe ^c   Gao, Chuanhou ^d  

^a STATE KEY LABORATORY OF INDUSTRIAL CONTROL TECHNOLOGY   (China)

^b CHINA JILIANG UNIVERSITY   (China)

^c KHALIFA UNIVERSITY   (United Arab Emirates)

^d ZHEJIANG UNIVERSITY   (China)

Author keywords

Edgeworth expansion; Latent variable regression; Mutual information; Non Gaussian variables

Indexed keywords

ACCURACY; ARTICLE; CHEMICAL REACTION; CONTROLLED STUDY; CORRELATION ANALYSIS; GEOMETRY; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; INTERMETHOD COMPARISON; KERNEL METHOD; MATHEMATICAL MODEL; NORMAL DISTRIBUTION; PARTIAL LEAST SQUARES REGRESSION; PREDICTION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS MODEL; PROCESS OPTIMIZATION; RAMAN SPECTROMETRY; REGRESSION ANALYSIS; SIGNAL PROCESSING;

EID: 84856098926     PISSN: 01697439     EISSN: 18733239     Source Type: Journal    
DOI: 10.1016/j.chemolab.2011.08.005     Document Type: Article

References (50)

1. Lieftucht D., Kruger U., Irwin G.W. Improved reliability in diagnosing faults using multivariate statistics. Computers and Chemical Engineering 2006, 30(5):901-912.
2. Lee K.M., Herrman T.J., Jones B. Application of multivariate statistics in risk-based approach to regulatory complience. Food Control 2009, 20:17-26.
3. Carranza E.J.M. Objective selection of suitable unit cell size in data-driven modeling of mineral prospectivity. Computers and Geosciences 2009, 35:2032-2046.
4. Kassab R., Alexandre F. Incremental data-driven learning of a novelty detection model for one-class classification with application to high dimensional noise data. Machine Learning 2009, 74:191-234.
5. Akkoyunlu A., Akiner M.E. Feasibility assessment of data-driven models in predicting pollution trends of Omerli lake, turkey. Water Resources Management 2010, 24:3419-3436.
6. Monakhova Y.B., Astakhov S.A., Kraskovb A., Mushtakovaa S.P. Independent components in spectroscopic analysis of complex mixtures. Chemometrics and Intelligent Laboratory Systems 2010, 103(2):108-115.
7. Pérez-Marína D., Fearnb T., Guerreroa J.E., Garrido-Varoa A. Robustness in pig fat NIRS calibrations by orthogonal projection. Chemometrics and Intelligent Laboratory Systems 2010, 100(1):36-40.
8. Castelan M., Van Horebeek J. Relating intensities with three-dimensional facial shape using partial least squares. IET Computer Vision 2009, 3(2):60-73.
9. Ghosh A., Hawkins T., Peers P., Frederiksen S., Debevec P. Practical modeling and acquisition of layered facial reflectance. ACM Transactions on Graphics 2008, 27(5):1-10.
10. Gustafsson M.G. Independent component analysis yields chemically interpretable latent variables in multivariate regression. Journal of Chemical Information and Modeling 2005, 45:1244-1255.
11. Joliffe I.T. Principal Component Analysis 2002, Springer-Verlag, New York.
12. Anderson T.W. An Introduction to Multivariate Statistical Analysis 2003, John Wiley & Sons, Hobroken NJ.
13. Hyvärinen A., Oja E. Fast fixed-point algorithm for independent component analysis. Neural Computation 1997, 9:1483-1492.
14. Hyvärinen A. Survey on independent component analysis. Neural Computing Surveys 1999, 2:94-128.
15. Hyvärinen A., Oja E. Independent component analysis: algorithms and applications. Neural Networks 2000, 133:411-430.
16. Du Q., Kopriva I. Dependent component analysis for blind restoration of images degraded by turbulent atmosphere. Neurocomputing 2009, 52:2682-2692.
17. Odiowei P.P., Cao Y. State-space independent component analysis for nonlinear dynamic process monitoring. Chemometrics and Intelligent Laboratory Systems 2010, 103:59-65.
18. Barriga E.S., Pattichis M., Ts'o D., Abramoff M., Kardon R., Kwon Y., Soliz P. Independent component analysis using prior information for signal detection in a functional imaging system of the retina. Medical Image Analysis 2011, 15:35-44.
19. Lee J.M., Yoo C.K., Lee I.B. Statistical process monitoring with independent component analysis. Journal of Process Control 2004, 14:467-485.
20. Lee J.M., Yoo C.K., Lee I.B. Statistical monitoring of dynamic processes based on dynamic independent component analysis. Chemical Engineering Science 2004, 59:2295-2306.
21. Ge Z.Q., Song Z.H. Process monitoring based on independent component analysis-principal component analysis (ICA-PCA) and similarity factors. Industrial and Engineering Chemistry Research 2007, 46:2054-2063.
22. Liu X.Q., Xie L., Kruger U., Littler T., Wang S.Q. Statistical-based monitoring of multivariate non-Gaussian systems. AICHE Journal 2008, 54:2379-2391.
23. Chen J., Wang X.Z. A new approach to near-infrared spectral data analysis using independent component analysis. Journal of Chemical Information and Computer Sciences 2001, 41:992-1001.
24. Shao X.G., Wang W., Hou Z.Y., Cai W.S. A new regression method based on independent component analysis. Talanta 2006, 69:676-680.
25. Kaneko H., Arakawa M., Funatsu K. Development of a new regression analysis method using independent component analysis. Journal of Chemical Information and Modeling 2008, 48:534-541.
26. Jackson J.E. A User's Guide to Principal Components 2003, John Wiley & Sons, Hoboken, N. J.
27. Westad F. Independent component analysis and regression applied on sensory data. Journal of Chemometrics 2005, 19:171-179.
28. Kwak C.K.N., Kim H. Dimensionality reduction based on ICA for regression problems. Neurocomputing 2008, 71:2596-2603.
29. Zhao C.H., Gao F.R., Wang F.L. An improved independent component regression modeling and quantitative calibration procedure. AICHE Journal 2010, 56:1519-1526.
30. Cover T.M., Thomas J.A. Elements of Information Theory 2006, John Wiley & Sons, Hoboken, NJ.
31. Barndorff-Nielsen O.E., Cox D.R. Inference and asymptotics 1989, Chapman and Hall, London.
32. Jutten C., Harault J. Independent component analysis versus PCA. Proceedings of European Signal Processing Conference 1998, 287-314.
33. Hyvärinen A. Advances in neural information processing systems. Chapter New approximations of differential entropy for independent component analysis and projection pursuit 1998, MIT Press, Cambridge, MA.
34. Scott D.W. Multivariable Density Estimation: Theory, Practice, and Visualization 1992, Wiley, New York.
35. Kraskov H.S.A., Grassberger P. Estimating mutual information. Physical Review E 2004, 69(6).
36. Silverman B.W. Density estimation for statistics and data analysis 1986, Chapman and Hall, London.
37. Hulle M.M.V. Edgeworth approximation of multivariate differential entropy. Neural Computation 2005, 17:1903-1910.
38. Dionísio A., Menezes R., Mendez D.A. Entropy-based independence test. Nonlinear Dynamics 2006, 44:351-357.
39. Wu E.H.C., Yu P.L.H., Li W.K. A smooth bootstrap test for independence based on mutual information. Computational Statistics and Data Analysis 2009, 53:2524-2536.
40. Granger C.W., Maasoumi E., Racine J. A dependence metric for possibly nonlinear processes. Journal of Time Series Analysis 2004, 25(5):649-669.
41. Efron R.J.T.B. An Introduction to the Bootstrap 1993, Chapman and Hall, New York.
42. Anderson T.W. Asymptotic theory for canonical correlation analysis. Journal of Multivariate Analysis 1999, 70(1):1-29.
43. Gray R.M. Entropy and Information Theory 1990, Springer Verlag, New York.
44. Kwak N., Choi C.H. Input feature selection by mutual information based on Parzen window. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002, 24:1667-1671.
45. Peng H.C., Long F.H., Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-dependency. IEEE Transactions on Pattern Analysis and Machine Intelligence 2005, 27:1226-1238.
46. Parzen E. On estimation of a probability density function and mode. Annals of Mathematical Statistics 1962, 33:1056-1076.
47. Burnham A.J., Viveros R., MacGregor J.F. Frameworks for latent variable multivariate regression. Journal of Chemometrics 1996, 10:31-45.
48. De Lathauwer L., De Moor B., Vandewalle J. Fetal electrocardiogram extraction by blind source separation. IEEE Transactions on Biomedical Engineering 2000, 47:537-572.
49. Zarzoso V., Nandi A.K. Noninvasive fetal electrocardiogram extraction:blind separation versus adaptive noise cancellation. IEEE Transactions on Biomedical Engineering 2001, 48:12-18.
50. Kruger U., Zhou Y., Wang X., Rooney D., Thompson J. Robust partial least squares regression-part III, outlier analysis and application studies. Journal of Chemometrics 2008, 22(5):323-334.