Multivariate image analysis: A review with applications

Chemometrics and Intelligent Laboratory Systems

Volumn 107, Issue 1, 2011, Pages 1-23

  Prats Montalban J M ^a   de Juan, A ^b   Ferrer, A ^a  

^a UNIVERSITAT POLITÈCNICA DE VALÈNCIA   (Spain)

^b UNIVERSITY OF BARCELONA   (Spain)

Author keywords

Hyperspectral images; Image resolution; MIA; Multispectral images; Multivariate image analysis; Multivariate image regression (MIR); RGB; Texture

Indexed keywords

ALGORITHM; CALIBRATION; CHEMOMETRIC ANALYSIS; CLASSIFICATION; COLOR; COST; DIGITAL IMAGING; IMAGE ANALYSIS; IMAGE PROCESSING; IMAGE QUALITY; MULTIVARIATE ANALYSIS; PATTERN RECOGNITION; PREDICTION; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROCESS MONITORING; REGRESSION ANALYSIS; REVIEW; SPECTROSCOPY; THREE DIMENSIONAL IMAGING;

EID: 79955666215     PISSN: 01697439     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chemolab.2011.03.002     Document Type: Review

References (121)

1. Ledley R.S. High-speed automatic analysis of biomedical pictures. Science 1964, 146(2461):216-223.
2. Berstein R. Digital image processing of earth observation sensor data. IBM Journal of Research and Development 1976, 20(1):40-56.
3. Sklansky J., Ballard D. Tumor detection in radiographs. Computers and Biomedical Research 1973, 6:299-321.
4. Strauss H.W., Zoret B.L., Hurley P.J. A scintiphotographic method for measuring left ventricular ejection fraction in man without cardiac catheterization. American Journal of Cardiology 1971, 28:985-991.
5. Brayer J.M., Swain P.H., Fu K.S. Modelling of Earth Resources Satellite Data. Syntactic Pattern Recognition Applications 1977, Springer-Verlag, Berlin. K.S. Fu (Ed.).
6. Cohen F.S., Fan Z., Attali S. Automatic inspection of textile fabrics using textural models. IEEE Transactions on Pattern Analysis and Machine Intelligence 1991, 13(8):803-808.
7. Goldstein M.D., Nagler Real M. time inspection of a large set of surface defects in metal parts. SPIE Automatic Inspection and High Speed Vision Architectures 1989, 849:184-189.
8. Boukouvalas C., Kittler J., Marik R., Petrou M. Automatic color grading of ceramic tiles using computer vision. IEEE Transactions on Industrial Electronics 1997, 44(1):132-135.
9. Sonka M., Hlavlac V., Boyle R. Image Processing, Analysis and Machine Vision 2007, Thomson Engineering, Glenrothes, UK.
10. González R.C., Woods R.E. Digital Image Processing 1992, Addison-Wesley, Massachusetts.
11. Jain A.K., Duin R.P.W., Mao J. Statistical pattern recognition: a review. IEEE Transactions on Pattern Analysis and Machine Intelligence 2000, 22(1):4-37.
12. Tuceryan M., Jain A.K. Texture analysis. The Handbook of Pattern Recognition and Computer Vision 1998, 207-248. World Scientific Publishing Co. 2nd edition. C.H. Chen, L.F. Pau, P.S.P. Wang (Eds.).
13. Pratt W.K. Digital Image Processing 2001, John Wiley & Sons, NY, USA. 3rd Edition.
14. Serra J. Image Analysis and Mathematical Morphology 1982, Academic Press Inc. (London) Ltd., UK.
15. Haralick R.M. Statistical and structural approaches to texture. Proceedings of the IEEE 1979, 67(5):780-803.
16. Porter R., Canagarajah N. Robust rotation-invariant texture classification: wavelet, gabor filter and GMRF based schemes. IEE Proceedings on Vision Image Signal Processing 1997, 144(3):180-188.
17. Tsatsanis M.K., Giannakis G.B. Object and texture classification using higher order statistics. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992, 14(7):733-749.
18. Unser M. Texture classification and segmentation using wavelet frames. IEEE Transactions on Image Processing 1995, 4(11):1549-1560.
19. B. Vidakovic. Statistical Modeling by Wavelets. Ed. John Wiley & Sons, Inc. New York, 1999.
20. F. López, Real-Time Surface Grading of Ceramic Tiles, PhD Thesis. Technical University of Valencia, Valencia, Spain. 2005.
21. Albregsten F. Statistical texture measures computed from gray level cooccurrence matrices. Technical Note 1995, Department of Informatics, University of Oslo, Norway.
22. Albregsten F. Statistical texture measures computed from gray level run-length matrices. Technical Note 1995, Department of Informatics, University of Oslo, Norway.
23. G. Winkler. Image Analysis, Random Fields and Markov Chain Monte Carlo Methods. 2nd Edition Ed. Springer, 2003.
24. Sarkar A., Sharma K.M.S., Sonak R.V. A new approach for subset 2-D AR model identification for describing textures. IEEE Transactions on Image Processing 1997, 6:407-413.
25. Keller J.M., Chen S., Crownover R.M. Texture description and segmentation trough fractal geometry. Computer Vision Graphics Image Processing 1989, 45:150-166.
26. Pentland A.P. Fractal-based description of natural scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence 1984, 6:661-672.
27. Rosenfeld A., Lipkin B.S. Texture synthesis. Picture Processing and Psychopictorics 1970, 309-340. New York Academic Press. Lipkin, Rosenfeld (Eds.).
28. Alsberg B.K., Woodward A.M., Kell D.B. An introduction to wavelets transforms for chemometricians. Chemometrics and Intelligent Laboratory Systems 1997, 37:215-239.
29. Walczak B. Wavelets in Chemistry 2000, Elsevier Science, Amsterdam.
30. Song K.Y., Petrou M., Kittler J. Texture crack detection. Machine Vision and Applications 1995, 8:63-76.
31. Boukouvalas C., DeNatale F., DeToni G., Kittler J., Marik R., Mirmehdi M., Petrou M. Automatic system for surface inspection and sorting of tiles. Journal of Materials Processing Technology 1998, 82:179-188.
32. Fioravanti S., Fioravanti R., DeNatale F., Marik R., Mirmehdi M., Kittler J., Petrou M. Spectral and rank order approaches to texture analysis. European Transactions on Telecomunications 1995, 6:287-299.
33. G. Van de Wouwer. Wavelets for Multiscale Texture Analysis, PhD Thesis, Department of Physics, University of Antwerp, Belgium., 1998.
34. Materka A., Strzelecki M. Texture analysis methods - a review. COST B11 Report 1998, Technical University of Lodz, Institute of Electronics, Brussels.
35. Simoncelli E.P., Freeman W.T., Adelson E.H., Heeger D.J. Shiftable multiscale transforms. IEEE Transactions on Information Theory 1992, 38(2):587-607.
36. Freeman W.T., Adelson E.H. The design and use of steerable filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 1991, 13(9):891-906.
37. Tzagkarakis G., Beferrull-Lozano B., Tsakalides P. Rotation-invariant texture retrieval with Gaussianized steerable pyramids. IEEE Transactions on Image Processing 2006, 15(9):2702-2718.
38. Bovik A.D., Clark M. Multichannel texture analysis using localized spatial filters. IEEE Transactions on Pattern Analysis and Machine Intelligence 1990, 12(1):55-73.
39. Palm C. Color texture classification by integrative co-occurrence matrices. Pattern Recognition 2004, 37:965-976.
40. Jiménez L.O., Rivera-Medina J.L., Rodríguez-Díaz E., Arzuaga-Cruz E., Ramírez-Vélez M.D. Integration of spatial and spectral information. IEEE Transactions on Geoscience and Remote Sensing 2005, 43(4):844-851.
41. Bhuiyan A., Nath B., Chua J., Kotagiri R. Blood vessel segmentation from color retinal images using unsupervised texture classification. Proceedings of the IEEE International Conference on Image Processing 2007, 5:521-524. ICIP 2007.
42. Mäenpää T., Viertola J., Pietinkäinen M. Optimising color and texture features for real-time visual inspection. Pattern Analysis and Applications 2003, 6:169-175.
43. Jackson J.E. A User's guide to Principal Components 1991, Wiley, New York.
44. Geladi P., Kowalski B.R. Partial least-squares regression: a tutorial. Analytica Chimica Acta 1986, 185:1-17.
45. Esbensen K., Geladi P. Strategy of multivariate image analysis. Chemometrics and Intelligent Laboratory Systems 1989, 7:67-86.
46. P. Geladi, H. Grahn. Multivariate Image Analysis. Ed. John Wiley & Sons Ltd. Chichester, England., 1996.
47. Geladi P., Esbensen K. Can image analysis provide information useful in chemistry?. Journal of Chemometrics 1989, 3:419-429.
48. Bharati M.H., MacGregor J.F. Texture analysis of images using Principal Component Analysis. SPIE/Photonics Conference on Process Imaging for Automatic Control, Boston 2000, 27-37.
49. Prats-Montalbán J.M., Ferrer A. Integration of color and textural information in multivariate image analysis: defect detection and classification issues. Journal of Chemometrics 2007, 21:10-23.
50. Bruwer M.J., MacGregor J.F., Noseworthy D. Dinamic contrast-enhanced MRI diagnosis in oncology via principal component analysis. Journal of Chemometrics 2008, 22:708-716.
51. Wold H. PLS regression. Encyclopedia of Statistical Sciences 1984, 6:581-591. John Wiley, New York. N.L. Johnson, S. Kotz (Eds.).
52. Lied T.T., Esbensen K. Principles of MIR, multivariate image regression. I: regression typology and representative application studies. Chemometrics and Intelligent Laboratory Systems 2001, 58:213-226.
53. Lied T.T., Geladi P., Esbensen K. Multivariate image regression (MIR): implementation of image PLSR-first forays. Journal of Chemometrics 2000, 14:585-598.
54. Sjöström M., Wold S., Söderström B. PLS discriminant plots. Proceedings of PARC in Practice 1986, Elsevier Science Publishers B.V., North-Holland, Amsterdam, June 19-21, 1985.
55. Liu J.J., MacGregor J.F. Estimation and monitoring of product aesthetics: application to manufacturing of "engineered stone" countertops. Machine Vision and Applications 2006, 16:374-383.
56. Liu J.J., MacGregor J.F., Duchesne C., Bartolacci G. Flotation froth monitoring using multiresolutional multivariate image analysis. Minerals Engineering 2005, 18:65-76.
57. Yu H., MacGregor J.F. Multivariate image analysis and regression for prediction of coating and distribution in the production of snack foods. Chemometrics and Intelligent Laboratory Systems 2003, 72:57-71.
58. Yu H., MacGregor J.F. Monitoring turbulent nonpremixed flames in an industrial boiler using Multivariate Image Analysis (MIA). Proceedings of the Seventeenth International Forum. Process Analytical Chemistry January 21-24, 2003, 597-602.
59. Huang J., Esbensen K.H. Applications of Angle Measure Technique (AMT) in image analysis: part I. A new methodology for in situ powder characterization. Chemometrics and Intelligent Laboratory Systems 2000, 54(1):1-19.
60. Dahl C.K., Esbensen K.H. Image analytical determination of particle size distribution characteristics of natural and industrial bulk aggregates. Chemometrics and Intelligent Laboratory Systems 2007, 89(1):9-25.
61. Indahl U.G., Naes T. Evaluation of alternative spectral feature extraction methods of textural images for multivariate modelling. Journal of Chemometrics 1998, 12:261-278.
62. Liu J.J., MacGregor J.F. On the extraction of spectral and spatial information from images. Chemometrics and Intelligent Laboratory Systems 2007, 85:119-130.
63. Prats-Montalbán J.M., López F., Valiente J.M., Ferrer A. Multivariate statistical projection methods to perform robust feature extraction and classification in surface grading. Journal of Electronic Imaging 2008, 17:031106. 10.1117/1.2957886.
64. López F., Valiente J.M., Prats J.M., Ferrer A. Feature selection using design of experiments and logistic regression: application to surface grading. Pattern Recognition 2008, 41:1161-1172.
65. MIA Code, http://mseg.webs.upv.es/Software.html.
66. Bro R., Kiedahl K., Smilde A.K., Kiers H.A.L. Cross-validation of component models: a critical look at current methods. Analytical and Bioanalytical Chemistry 2008, 390:1241-1251.
67. Bharati M.H., MacGregor J.F., Tropper W. Softwood lumber grading through on-line multivariate image analysis techniques. Industrial and Engineering Chemistry Research 2003, 42:5345-5353.
68. Reis M., Bauer A. Wavelet texture analysis of on-line acquired images for paper formation assessment and monitoring. Chemometrics and Intelligent Laboratory Systems 2009, 95:129-137.
69. García-Muñoz S., Gierer D.S. Coating assessment for colored immediate release tablets using multivariate image analysis. International Journal of Pharmaceutics 2010, 395:104-113.
70. Ferrer A. Multivariate statistical process control based on principal component analysis (MSPC-PCA): some reflections and a case study in an autobody assembly process. Quality Engineering 2007, 19:311-325.
71. Kourti T., MacGregor J.F. Process analysis, monitoring and diagnosis, using multivariate projection methods. Chemometrics and Intelligent Laboratory Systems 1995, 28:3-21.
72. Nomikos P., MacGregor J.F. Multivariate SPC charts for monitoring batch processes. Technometrics 1995, 37(1):41-59.
73. Tracy N.D., Young J.C., Mason R.L. Multivariate control charts for individual observations. Journal of Quality Technology 1992, 24:88-95.
74. Jackson J.E., Mudholkar G.S. Control procedures for residuals associated with principal component analysis. Technometrics 1979, 21(3):341-349.
75. Daubechies I. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics 1988, XLI:909-996.
76. Bharati M.H., MacGregor J.F. Multivariate image analysis for process monitoring and control. Industrial and Engineering Chemistry Research 1998, 37:4715-4724.
77. Kourti T., MacGregor J.F. Multivariate SPC methods for process and product monitoring. Journal of Quality Technology 1996, 28(4):409-428.
78. J.M. Prats-Montalbán, A. Ferrer. Statistical process control based on multivariate image analysis, Journal of Quality Technology (submitted for publication).
79. Wold S., Albano C., Dunn W.J., Edlund U., Esbensen K., Geladi P., Hellberg S., Johansson E., Lindberg W., Sjöström M. Multivariate data analysis in chemistry. Chemometrics: Mathematics and Statistics in Chemistry 1984, D. Reidel Publishing Company, Dordrecht, Holland. B.R. Kowalski (Ed.).
80. J.M. Prats-Montalbán, A. Ferrer, (2009) Applications and benefits of PLS-DA based MIA for isolation and quantification of different kind of features, Journal of Chemometrics (submitted for publication).
81. M.H. Bharati, (2002) Multivariate Image Analysis and Regression for Industrial Process Monitoring and Product Quality Control, Ph.D. Thesis, McMaster University, Hamilton (Ontario), Canada.
82. Chevallier S., Bertrand D., Kohler A., Courcoux P. Application of PLS-DA in multivariate image analysis. Journal of Chemometrics 2006, 20(5):221-229.
83. Pietikäinen M., Ojala T., Xu Z. Rotation-invariant texture classification using feature distributions. Pattern Recognition 2000, 33:43-52.
84. Yu H., Yang J. A direct LDA algorithm for high-dimensional data - with application to face recognition. Pattern Recognition 2001, 34:2067-2070.
85. Munder S., Gavrila D.M. An experimental study on pedestrian classification. IEEE on Pattern Analysis and Machine Intelligence 2006, 28(11):1863-1868.
86. Antonelli A., Cocchi M., Fava P., Foca G., Franchini G.C., Manzini D., Ulrici A. Automated evaluation of food color by means of multivariate image analysis coupled to a wavelet-based classification algorithm. Analytica Chimica Acta 2004, 515:3-13.
87. Eriksson L., Wold S., Trygg J. Multivariate analysis of congruent images (MACI). Journal of Chemometrics 2005, 19:393-403.
88. Kucheryavski S. Using hard and soft models for classification of medical images. Chemometrics and Intelligent Laboratory Systems 2007, 88(1):100-106.
89. Liu J.J., MagGregor J.F. Modeling and optimization of product appearance: application to injection-molded plastic models. Industrial Chemical Engineering Research 2005, 44:4687-4696.
90. Tessier J., Duchesne C., Gauthier C., Dufour G. Estimation of alumina content of anode cover materials using multivariate image analysis. Chemical Engineering Science 2008, 63:1370-1380.
91. Prats-Montalbán J.M., Ferrer A., Bro R., Hancewicz T. Prediction of skin quality properties by different multivariate image analysis methodologies. Chemometrics and Intelligent Laboratory Systems 2009, 96:6-13.
92. Facco P., Tomba E., Rosso M., Modesti M., Bezzo F., Barolo M. Automatic characterization of nanofiber assemblies by image texture analysis. Chemometrics and Intelligent Laboratory Systems 2010, 103:66-75.
93. Grahn H.F., Geladi P. Techniques and Applications of Hyperspectral Image Analysis 2007, John Wiley.
94. Infrared and Raman Spectroscopic Imaging 2009, Wiley-VCH, Weinheim (Germany). R. Salzer, H.W. Siesler (Eds.).
95. de Juan A., Maeder M., Hacewicz T., Duponchel L., Tauler R. Chemometric tools for image analysis. Infrared and Raman Spectroscopic Imaging 2009, 65-112. Wiley-VCH, Weinheim (Germany). R. Salzer, H.W. Siesler (Eds.).
96. Burger J., Geladi P. Hyperspectral NIR image regression. Part II: dataset preprocessing diagnostics. Journal of Chemometrics 2006, 20:106-119.
97. Geladi P., Wold S., Esbensen K.H. Image analysis and chemical information in images. Analytica Chimica Acta 1986, 191:473-480.
98. Kohler A., Bertrand D., Martens H., Hannesson K., Kirschner C., Ofstad R. MIA of a set of FTIR microspectroscopy images of aged bovine muscle tissue combining image and design information. Analytical and Bioanalytical Chemistry 2007, 389:1143-1153.
99. Geladi P., Esbensen K. Regression on multivariate images - principal component regression for modeling, prediction and visual diagnostic-tools. Journal of Chemometrics 1991, 5:97-111.
100. Esbensen K.H., Geladi P.L., Grahn H.F. Strategies for multivariate image regression. Chemometrics and Intelligent Laboratory Systems 1992, 14:357-374.
101. Geladi P., Burger J., Lestander T. Hyperspectral imaging: calibration problems and solutions. Chemometrics and Intelligent Laboratory Systems 2004, 72(2):209-217.
102. Burger J., Geladi P. Hyperspectral NIR imaging for calibration and prediction: a comparison between image and spectrometer data for studying organic and biological samples. The Analyst 2006, 131:1152-1160.
103. Chong, Jun Performance of some variable selection methods when multicollinearity is present. Chemometrics and Intelligent Laboratory Systems 2005, 78:103-112.
104. Trahn T.N., Wehrens R., Buydens L.M.C. Clustering multispectral images: a tutorial. Chemometrics and Intelligent Laboratory Systems 2005, 77:3-17.
105. Wehrens R., Simonetti A.W., Buydens L.M.C. Mixture modelling of medical magnetic resonance data. Journal of Chemometrics 2002, 16:274-282.
106. Lin W.Q., Jiang J.H., Yang H.F., Ozaki Y., Shen G.L., Yu R.Q. Characterization of chloramphenicol palmitate drug polymorphs by Raman mapping with multivariate image segmentation using a spatial directed agglomeration clustering method. Analytical Chemistry 2006, 78:6003-6011.
107. Massart D.L., Kaufman L. The Interpretation of Analytical Chemical Data by the Use of Cluster Analysis 1983, Wiley, NY.
108. Krooshof P.W.T., Trahn T.N., Postma G.J., Melsen W.J., Buydens L.M.C. Effects of including spatial information in clustering multivariate image data. TrAC Trends in Analytical Chemistry 2006, 25:1067-1080.
109. Bharati M.H., Liu J.J., MacGregor J.F. Image texture analysis: methods and comparisons. Chemometrics and Intelligent Laboratory Systems 2004, 72:57-71.
110. de Juan A., Tauler R., Dyson R., Marcolli C., Rault M., Maeder M. Spectroscopic imaging and chemometrics: a powerful combination for global and local sample analysis. TrAC Trends in Analytical Chemistry 2004, 23:70-79.
111. Wang J.H., Hopke P.K., Hancewicz T.M., Zhang S.L.L. Application of modified alternating least squares regression to spectroscopic image analysis. Analytica Chimica Acta 2003, 476:93-109.
112. Batonneau Y., Bremard C., Laureyns J., Merlin J.C., Windig W. Polarization effects of confocal Raman microspectrometry of crystal powders using interactive self-modeling analysis. The Journal of Physical Chemistry 2003, 107:1502-1513.
113. Windig W., Guilment J. Interactive self modeling mixture analysis. Analytical Chemistry 1991, 63:1425-1432.
114. Keller H.R., Massart D.L. Analytica Chimica Acta 1991, 246:379.
115. de Juan A., Maeder M., Hancewicz T., Tauler R. Local rank analysis for exploratory spectroscopic image analysis. Fixed size image window-evolving factor analysis. Chemometrics and Intelligent Laboratory Systems 2005, 77:64-74.
116. de Juan A., Tauler R. Chemometrics applied to unravel multicomponent processes and mixtures. Revisiting latest trends in multivariate resolution. Analytica Chimica Acta 2003, 500:195-210.
117. Tauler R. Multivariate curve resolution applied to second order data. Chemometrics and Intelligent Laboratory Systems 1995, 30:133-146.
118. Jaumot J., Gargallo R., de Juan A., Tauler R. A graphical user-friendly interface for MCR-ALS: a new tool for multivariate curve resolution in MATLAB. Chemometrics and Intelligent Laboratory Systems 2005, 76:101-110.
119. Hancewicz T.M., Wang J.H. Discriminant image resolution: a novel multivariate image analysis method utilizing a spatial classification constraint in addition to bilinear nonnegativity. Chemometrics and Intelligent Laboratory Systems 2005, 77:18-31.
120. Hancewicz T.M., Wang J.-H., Pudney P.D.A., Zhang S.L. Multivariate image resolution for spectroscopic image analysis. 228th ACS National Meeting. Philadelphia, PA August 22, 2004, Paper #15.
121. de Juan A., Maeder M., Hancewicz T., Tauler R. Use of local rank-based spatial information for resolution of spectroscopic images. Journal of Chemometrics 2008, 22:291.