An overview of independent component analysis and its applications

Informatica (Ljubljana)

Volumn 35, Issue 1, 2011, Pages 63-81

  Naik, Ganesh R ^a  

^a RMIT UNIVERSITY   (Australia)

Author keywords

Blind source separation; Independent component analysis; Multi run ICA; Non gaussianity; Overcomplete ICA; Undercomplete ICA

Indexed keywords

AREA OF INTEREST; COMPUTATIONALLY EFFICIENT; FUNDAMENTAL CONCEPTS; MULTI RUN ICA; NONGAUSSIANITY; OVERCOMPLETE ICA; POTENTIAL APPLICATIONS; SCIENCE AND ENGINEERING; SINGLE SOURCE; SOURCE SEPARATION; UNDERCOMPLETE ICA;

BLIND SOURCE SEPARATION; RESEARCH;

INDEPENDENT COMPONENT ANALYSIS;

EID: 79953324547     PISSN: 03505596     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (92)

1. L. Tong, Liu, V. C. Soon, and Y. F. Huang, "Indeterminacy and identifiability of blind identification," Circuits and Systems, IEEE Transactions on, vol. 38, no. 5, pp. 499-509, 1991.
2. C. Jutten and J. Karhunen, "Advances in blind source separation (bss) and independent component analysis (ica) for nonlinear mixtures." Int J Neural Syst, vol. 14, no. 5, pp. 267-292, October 2004.
3. A. J. Bell and T. J. Sejnowski, "An informationmaximization approach to blind separation and blind deconvolution." Neural Comput, vol. 7, no. 6, pp. 1129-1159, November 1995.
4. Kolenda, Independent components in text, ser. Advances in Independent Component Analysis. Springer-Verlag, 2000, pp. 229-250.
5. E. Bingham, J. Kuusisto, and K. Lagus, "Ica and som in text document analysis," in SIGIR '02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 2002, pp. 361-362.
6. Q. Pu and G.-W. Yang, "Short-text classification based on ica and lsa," Advances in Neural Networks -ISNN 2006, pp. 265-270, 2006. (Pubitemid 44045910)
7. C. J. James and C. W. Hesse, "Independent component analysis for biomedical signals," Physiological Measurement, vol. 26, no. 1, pp. R15+, 2005.
8. B. Azzerboni, M. Carpentieri, F. La Foresta, and F. C. Morabito, "Neural-ica and wavelet transform for artifacts removal in surface emg," in Neural Networks, 2004. Proceedings. 2004 IEEE International Joint Conference on, vol. 4, 2004, pp. 3223-3228 vol.4. (Pubitemid 40011550)
9. F. De Martino, F. Gentile, F. Esposito, M. Balsi, F. Di Salle, R. Goebel, and E. Formisano, "Classification of fmri independent components using icfingerprints and support vector machine classifiers," NeuroImage, vol. 34, pp. 177-194, 2007. (Pubitemid 44765254)
10. T. Kumagai and A. Utsugi, "Removal of artifacts and fluctuations from meg data by clustering methods," Neurocomputing, vol. 62, pp. 153-160, December 2004. (Pubitemid 39504661)
11. Y. Zhu, T. L. Chen, W. Zhang, T.-P. Jung, J.-R. Duann, S. Makeig, and C.-K. Cheng, "Noninvasive study of the human heart using independent component analysis," in BIBE '06: Proceedings of the Sixth IEEE Symposium on BionInformatics and BioEngineering. IEEE Computer Society, 2006, pp. 340-347. (Pubitemid 47159437)
12. J. Enderle, S. M. Blanchard, and J. Bronzino, Eds., Introduction to Biomedical Engineering, Second Edition. Academic Press, April 2005.
13. A. Cichocki and S.-I. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. John Wiley & Sons, Inc., 2002.
14. Q. Zhang, J. Sun, J. Liu, and X. Sun, "A novel ica-based image/video processing method," 2007, pp. 836-842.
15. Hansen, Blind separation of noicy image mixtures. Springer-Verlag, 2000, pp. 159-179.
16. D. J. C. Mackay, "Maximum likelihood and covariant algorithms for independent component analysis," University of Cambridge, London, Tech. Rep., 1996.
17. Sorenson, "Mean field approaches to independent component analysis," Neural Computation, vol. 14, pp. 889-918, 2002.
18. KabÂt'an, "Clustering of text documents by skewness maximization," 2000, pp. 435-440.
19. T. W. Lee, "Blind separation of delayed and convolved sources," 1997, pp. 758-764.
20. -, Independent component analysis: Theory and applications. Kluwer Academic Publishers, 1998.
21. H. Attias and C. E. Schreiner, "Blind source separation and deconvolution: The dynamic component analysis algorithm," Neural Comput., vol. 10, no. 6, pp. 1373-1424, August 1998. (Pubitemid 128464281)
22. M. S. Lewicki and T. J. Sejnowski, "Learning overcomplete representations." Neural Comput, vol. 12, no. 2, pp. 337-365, February 2000.
23. A. Hyvarinen, R. Cristescu, and E. Oja, "A fast algorithm for estimating overcomplete ica bases for image windows," in Neural Networks, 1999. IJCNN '99. International Joint Conference on, vol. 2, 1999, pp. 894-899 vol.2. (Pubitemid 30593091)
24. T. W. Lee, M. S. Lewicki, and T. J. Sejnowski, "Unsupervised classification with non-gaussian mixture models using ica," in Proceedings of the 1998 conference on Advances in neural information processing systems. Cambridge, MA, USA: MIT Press, 1999, pp. 508-514.
25. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. Wiley-Interscience, May 2001.
26. J. V. Stone, Independent Component Analysis : A Tutorial Introduction (Bradford Books). The MIT Press, September 2004.
27. C. D. Meyer, Matrix Analysis and Applied Linear Algebra. Cambridge, UK, 2000.
28. P. Comon, "Independent component analysis, a new concept?" Signal Processing, vol. 36, no. 3, pp. 287-314, april 1994.
29. A. Hyvrinen, "New approximations of differential entropy for independent component analysis and projection pursuit," in NIPS '97: Proceedings of the 1997 conference on Advances in neural information processing systems 10. MIT Press, 1998, pp. 273-279.
30. Olshausen, "Sparse coding of natural images produces localized, oriented, bandpass receptive fields," Department of Psychology, Cornell University, Tech. Rep., 1995.
31. G. F. Harpur and R. W. Prager, "Development of low entropy coding in a recurrent network." Network (Bristol, England), vol. 7, no. 2, pp. 277-284, May 1996. (Pubitemid 126714792)
32. B. A. Olshausen, "Learning linear, sparse, factorial codes," Tech. Rep., 1996.
33. T. W. Lee, M. Girolami, M. S. Lewicki, and T. J. Sejnowski, "Blind source separation of more sources than mixtures using overcomplete representations," Signal Processing Letters, IEEE, vol. 6, no. 4, pp. 87-90, 2000.
34. D. Lathauwer, P. L. Comon, B. De Moor, and J. Vandewalle, "Ica algorithms for 3 sources and 2 sensors," in Higher-Order Statistics, 1999. Proceedings of the IEEE Signal ProcessingWorkshop on, 1999, pp. 116-120.
35. Bofill, "Blind separation of more sources than mixtures using sparsity of their short-time fourier transform," Pajunen, Ed., 2000, pp. 87-92.
36. O. Shriki, H. Sompolinsky, and D. D. Lee, "An information maximization approach to overcomplete and recurrent representations," in In Advances in Neural Information Processing Systems, vol. 14, 2002, pp. 612-618.
37. F. J. Theis, E. W. Lang, T. Westenhuber, and C. G. Puntonet, "Overcomplete ica with a geometric algorithm," in ICANN '02: Proceedings of the International Conference on Artificial Neural Networks. Springer-Verlag, 2002, pp. 1049-1054.
38. F. J. Theis and E. W. Lang, "Geometric overcomplete ica," in Proc. of ESANN 2002, 2002, pp. 217-223.
39. K. Waheed and F. M. Salem, "Algebraic independent component analysis: An approach for separation of overcomplete speech mixtures," in Neural Networks, 2003. Proceedings of the International Joint Conference on, vol. 1, 2003, pp. 775-780 vol.1.
40. -, "Algebraic independent component analysis," in Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003 IEEE International Conference on, vol. 1, 2003, pp. 472-477 vol.1.
41. S. Mallat, AWavelet Tour of Signal Processing. Academic Press, 1998.
42. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM Rev., vol. 43, no. 1, pp. 129-159, 2001. (Pubitemid 32406896)
43. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: A strategy employed by v1?" Vision Res, vol. 37, no. 23, pp. 3311-3325, December 1997. (Pubitemid 27493805)
44. M. Joho, H. Mathis, and R. Lambert, "Overdetermined blind source separation: Using more sensors than source signals in a noisy mixture," 2000.
45. G. R. Naik, D. K. Kumar, and M. Palaniswami, "Multi run ica and surface emg based signal processing system for recognising hand gestures," in Computer and Information Technology, 2008. CIT 2008. 8th IEEE International Conference on, 2008, pp. 700-705.
46. A. Ypma, D. M. J. Tax, and R. P. W. Duin, "Robust machine fault detection with independent component analysis and support vector data description," in Neural Networks for Signal Processing IX, 1999. Proceedings of the 1999 IEEE Signal Processing Society Workshop, 1999, pp. 67-76. (Pubitemid 30510361)
47. Z. Li, Y. He, F. Chu, J. Han, andW. Hao, "Fault recognition method for speed-up and speed-down process of rotating machinery based on independent component analysis and factorial hidden markov model," Journal of Sound and Vibration, vol. 291, no. 1-2, pp. 60-71, March 2006. (Pubitemid 43069438)
48. M. Kano, S. Tanaka, S. Hasebe, I. Hashimoto, and H. Ohno, "Monitoring independent components for fault detection," AIChE Journal, vol. 49, no. 4, pp. 969-976, 2003. (Pubitemid 36504561)
49. L. Zhonghai, Z. Yan, J. Liying, and Q. Xiaoguang, "Application of independent component analysis to the aero-engine fault diagnosis," in 2009 Chinese Control and Decision Conference. IEEE, June 2009, pp. 5330-5333.
50. de La, C. G. Puntonet, J. M. Górriz, and I. Lloret, "An application of ica to identify vibratory low-level signals generated by termites," 2004, pp. 1126-1133.
51. F. Acernese, A. Ciaramella, S. De Martino, M. Falanga, C. Godano, and R. Tagliaferri, "Polarisation analysis of the independent components of low frequency events at stromboli volcano (eolian islands, italy)," Journal of Volcanology and Geothermal Research, vol. 137, no. 1-3, pp. 153-168, September 2004. (Pubitemid 40564109)
52. H. Farid and E. H. Adelson, "Separating reflections and lighting using independent components analysis," cvpr, vol. 01, 1999.
53. M. Yamazaki, Y.-W. Chen, and G. Xu, "Separating reflections from images using kernel independent component analysis," in Pattern Recognition, 2006. ICPR 2006. 18th International Conference on, vol. 3, 2006, pp. 194-197. (Pubitemid 46553096)
54. M. Coli, R. Di Nisio, and L. Ippoliti, "Exploratory analysis of financial time series using independent component analysis," in Information Technology Interfaces, 2005. 27th International Conference on, 2005, pp. 169-174.
55. E. H. Wu and P. L. Yu, "Independent component analysis for clustering multivariate time series data," 2005, pp. 474-482.
56. S.-M. Cha and L.-W. Chan, "Applying independent component analysis to factor model in finance," in IDEAL '00: Proceedings of the Second International Conference on Intelligent Data Engineering and Automated Learning, Data Mining, Financial Engineering, and Intelligent Agents. Springer-Verlag, 2000, pp. 538-544. (Pubitemid 33211368)
57. R. Cristescu, T. Ristaniemi, J. Joutsensalo, and J. Karhunen, "Cdma delay estimation using fast ica algorithm," vol. 2, 2000, pp. 1117-1120 vol.2.
58. J. P. Huang and J. Mar, "Combined ica and fca schemes for a hierarchical network," Wirel. Pers. Commun., vol. 28, no. 1, pp. 35-58, January 2004.
59. O. Déniz, M. Castrillón, and M. Hernández, "Face recognition using independent component analysis and support vector machines," Pattern Recogn. Lett., vol. 24, no. 13, pp. 2153-2157, 2003. (Pubitemid 36810737)
60. S. Fiori, "Overview of independent component analysis technique with an application to synthetic aperture radar (sar) imagery processing," Neural Netw., vol. 16, no. 3-4, pp. 453-467, 2003. (Pubitemid 36379096)
61. H. Wang, Y. Pi, G. Liu, and H. Chen, "Applications of ica for the enhancement and classification of polarimetric sar images," Int. J. Remote Sens., vol. 29, no. 6, pp. 1649-1663, 2008. (Pubitemid 351338293)
62. M. S. Karoui, Y. Deville, S. Hosseini, A. Ouamri, and D. Ducrot, "Improvement of remote sensing multispectral image classification by using independent component analysis," in 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing. IEEE, August 2009, pp. 1-4.
63. L. Xiaochun and C. Jing, "An algorithm of image fusion based on ica and change detection," in Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004. IEEE, 2004, pp. 1096-1098.
64. J.-H. H. Lee, S. Oh, F. A. Jolesz, H. Park, and S.-S. S. Yoo, "Application of independent component analysis for the data mining of simultaneous eegfmri: Preliminary experience on sleep onset." The International journal of neuroscience, vol. 119, no. 8, pp. 1118-1136, 2009. [Online]. Available: Http://view.ncbi.nlm.nih.gov/pubmed/19922343
65. C.-J. Lu, T.-S. Lee, and C.-C. Chiu, "Financial time series forecasting using independent component analysis and support vector regression," Decis. Support Syst., vol. 47, no. 2, pp. 115-125, 2009.
66. D.-M. Tsai, P.-C. Lin, and C.-J. Lu, "An independent component analysis-based filter design for defect detection in low-contrast surface images," Pattern Recogn., vol. 39, no. 9, pp. 1679-1694, 2006. (Pubitemid 43870360)
67. F. Castells, J. Igual, J. Millet, and J. J. Rieta, "Atrial activity extraction from atrial fibrillation episodes based on maximum likelihood source separation," Signal Process., vol. 85, no. 3, pp. 523-535, 2005. (Pubitemid 40205998)
68. H. Safavi, N. Correa, W. Xiong, A. Roy, T. Adali, V. R. Korostyshevskiy, C. C. Whisnant, and F. Seillier-Moiseiwitsch, "Independent component analysis of 2-d electrophoresis gels," ELECTROPHORESIS, vol. 29, no. 19, pp. 4017-4026, 2008.
69. R. Llinares and J. Igual, "Application of constrained independent component analysis algorithms in electrocardiogram arrhythmias," Artif. Intell. Med., vol. 47, no. 2, pp. 121-133, 2009.
70. E. Niedermeyer and F. L. Da Silva, Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. Lippincott Williams and Wilkins; 4th edition , January 1999.
71. J. C. Rajapakse, A. Cichocki, and Sanchez, "Independent component analysis and beyond in brain imaging: Eeg, meg, fmri, and pet," in Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference on, vol. 1, 2002, pp. 404-412 vol.1.
72. J. Wisbeck, A. Barros, and R. Ojeda, "Application of ica in the separation of breathing artifacts in ecg signals," 1998.
73. S. Calinon and A. Billard, "Recognition and reproduction of gestures using a probabilistic framework combining pca, ica and hmm," in ICML '05: Proceedings of the 22nd international conference on Machine learning. ACM, 2005, pp. 105-112. (Pubitemid 43183322)
74. M. Kato, Y.-W. Chen, and G. Xu, "Articulated hand tracking by pca-ica approach," in FGR '06: Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition. IEEE Computer Society, 2006, pp. 329-334. (Pubitemid 44711371)
75. G. R. Naik, D. K. Kumar, V. P. Singh, and M. Palaniswami, "Hand gestures for hci using ica of emg," in VisHCI '06: Proceedings of the HCSNet workshop on Use of vision in human-computer interaction. Australian Computer Society, Inc., 2006, pp. 67-72.
76. G. R. Naik, D. K. Kumar, H. Weghorn, and M. Palaniswami, "Subtle hand gesture identification for hci using temporal decorrelation source separation bss of surface emg," in Digital Image Computing Techniques and Applications, 9th Biennial Conference of the Australian Pattern Recognition Society on, 2007, pp. 30-37.
77. M. Scherg and D. Von Cramon, "Two bilateral sources of the late aep as identified by a spatiotemporal dipole model." Electroencephalogr Clin Neurophysiol, vol. 62, no. 1, pp. 32-44, January 1985. (Pubitemid 15160074)
78. R. Phlypo, V. Zarzoso, P. Comon, Y. D'Asseler, and I. Lemahieu, "Extraction of atrial activity from the ecg by spectrally constrained ica based on kurtosis sign," in ICA'07: Proceedings of the 7th international conference on Independent component analysis and signal separation. Berlin, Heidelberg: Springer-Verlag, 2007, pp. 641-648.
79. J. Oster, O. Pietquin, R. Abächerli, M. Kraemer, and J. Felblinger, "Independent component analysis-based artefact reduction: Application to the electrocardiogram for improved magnetic resonance imaging triggering," Physiological Measurement, vol. 30, no. 12, pp. 1381-1397, December 2009. [Online]. Available: Http://dx.doi.org/10.1088/0967-3334/30/12/007
80. R. Vigário, J. Särelä, V. Jousmäki, M. Hämäläinen, and E. Oja, "Independent component approach to the analysis of eeg and meg recordings." IEEE transactions on bio-medical engineering, vol. 47, no. 5, pp. 589-593, May 2000. (Pubitemid 30316977)
81. J. Onton, M. Westerfield, J. Townsend, and S. Makeig, "Imaging human eeg dynamics using independent component analysis," Neuroscience & Biobehavioral Reviews, vol. 30, no. 6, pp. 808-822, 2006. (Pubitemid 44292287)
82. B. Jervis, S. Belal, K. Camilleri, T. Cassar, C. Bigan, D. E. J. Linden, K. Michalopoulos, M. Zervakis, M. Besleaga, S. Fabri, and J. Muscat, "The independent components of auditory p300 and cnv evoked potentials derived from single-trial recordings," Physiological Measurement, vol. 28, no. 8, pp. 745-771, August 2007. (Pubitemid 47421713)
83. J. C. Mosher, P. S. Lewis, and R. M. Leahy, "Multiple dipole modeling and localization from spatiotemporal meg data," Biomedical Engineering, IEEE Transactions on, vol. 39, no. 6, pp. 541-557, 1992. (Pubitemid 23002695)
84. M. Hämäläinen, R. Hari, R. J. Ilmoniemi, J. Knuutila, and O. V. Lounasmaa, "Magnetoencephalography& 151;theory, instrumentation, and applications to noninvasive studies of the working human brain," Reviews of Modern Physics, vol. 65, no. 2, pp. 413+, April 1993.
85. A. C. Tang and B. A. Pearlmutter, "Independent components of magnetoencephalography: Localization," pp. 129-162, 2003.
86. J. Parra, S. N. Kalitzin, and Lopes, "Magnetoencephalography: An investigational tool or a routine clinical technique?" Epilepsy & Behavior, vol. 5, no. 3, pp. 277-285, June 2004. (Pubitemid 38950086)
87. K. Petersen, L. K. Hansen, T. Kolenda, and E. Rostrup, "On the independent components of functional neuroimages," in Third International Conference on Independent Component Analysis and Blind Source Separation, 2000, pp. 615-620.
88. T. Ristaniemi and J. Joutsensalo, "the performance of blind source separation in cdma downlink," 1999.
89. N. Cvejic, D. Bull, and N. Canagarajah, "Improving fusion of surveillance images in sensor networks using independent component analysis," Consumer Electronics, IEEE Transactions on, vol. 53, no. 3, pp. 1029-1035, 2007. (Pubitemid 47593372)
90. A. J. Bell and T. J. Sejnowski, "The "independent components" of natural scenes are edge filters." Vision Res, vol. 37, no. 23, pp. 3327-3338, December 1997. (Pubitemid 27493806)
91. T.-W. W. Lee and M. S. Lewicki, "Unsupervised image classification, segmentation, and enhancement using ica mixture models." IEEE transactions on image processing : A publication of the IEEE Signal Processing Society, vol. 11, no. 3, pp. 270-279, 2002. (Pubitemid 34440331)
92. G. Antoniol, M. Ceccarelli, P. Petrillo, and A. Petrosino, "An ica approach to unsupervised change detection in multispectral images," in Biological and Artificial Intelligence Environments, B. Apolloni, M. Marinaro, and R. Tagliaferri, Eds. Springer Netherlands, 2005, ch. 35, pp. 299-311.