Connection between multilayer perceptrons and regression using independent component analysis

Neurocomputing

Volumn 50, Issue , 2003, Pages 211-222

  Hyvärinen, Aapo ^a   Bingham, Ella ^a  

^a AALTO UNIVERSITY   (Finland)

Author keywords

Independent component analysis; Multilayer perception; Nonlinear regression; Projection pursuit

Indexed keywords

APPROXIMATION THEORY; DATA REDUCTION; INDEPENDENT COMPONENT ANALYSIS; MATHEMATICAL MODELS; PROBABILITY DENSITY FUNCTION; REGRESSION ANALYSIS;

GAUSSIAN DENSITIES;

MULTILAYER NEURAL NETWORKS;

CONTROLLED STUDY; INDEPENDENT COMPONENT ANALYSIS; INFORMATION PROCESSING; INTERMETHOD COMPARISON; LINEAR SYSTEM; PRIORITY JOURNAL; PROBABILITY; REGRESSION ANALYSIS; REVIEW; SIMULATION; STATISTICAL MODEL; THEORY;

EID: 0037241705     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(01)00705-6     Document Type: Article

References (16)

1. A.J. Bell, T.J. Sejnowski, An information-maximization approach to blind separation and blind deconvolution, Neural Comput. 7 (1995) 1129-1159.
2. P. Comon, Independent component analysis-a new concept? Signal Process. 36 (1994) 287-314.
3. D.L. Donoho, I.M. Johnstone, G. Kerkyacharian, D. Picard, Wavelet shrinkage: asymptopia? J. Roy. Statist. Soc. Ser. B 57 (1995) 301-337.
4. P.J. Huber, Projection pursuit, Ann. Statist. 13 (2) (1985) 435-475.
5. A. Hyvärinen, Sparse regression: utilizing the higher-order structure of data for prediction, in: Proceedings of the International Conference on Artificial Neural Networks (ICANN'98), Skövde, Sweden, 1998, pp. 541-546.
6. A. Hyvärinen, Fast and robust fixed-point algorithms for independent component analysis, IEEE Trans. Neural Networks 10 (3) (1999) 626-634.
7. A. Hyvärinen, Regression using independent component analysis, and its connection to multi-layer perceptrons, in: Proceedings of the International Conference on Artificial Neural Networks, Edinburgh, UK, 1999, pp. 491-496.
8. A. Hyvärinen, Sparse code shrinkage: denoising of nongaussian data by maximum likelihood estimation, Neural Comput. 11 (7) (1999) 1739-1768.
9. A. Hyvärinen, J. Karhunen, E. Oja, Independent Component Analysis, Wiley Interscience, New York, 2001.
10. A. Hyvärinen, R. Karthikesh, Sparse priors on the mixing matrix in independent component analysis, in: Proceedings of the International Workshop on Independent Component Analysis and Blind Signal Separation (ICA2000), Helsinki, Finland, 2000, pp. 452-477.
11. A. Hyvärinen, E. Oja, Independent component analysis: algorithms and applications, Neural Networks 13 (4-5) (2000) 411-430.
12. A. Hyvärinen, J. Särelä, R. Vigário, Spikes and bumps: artefacts generated by independent component analysis with insufficient sample size, in: Proceedings of the International Workshop on Independent Component Analysis and Signal Separation (ICA'99), Aussois, France, 1999, pp. 425-429.
13. C. Jutten, J. Hérault, Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture, Signal Process. 24 (1991) 1-10.
14. M. Lewicki, B. Olshausen, A probabilistic framework for the adaptation and comparison of image codes, J. Opt. Soc. Am. A: Opt. Image Sci. Vision 16 (7) (1998) 1587-1601.
15. B.A. Olshausen, D.J. Field, Emergence of simple-cell receptive field properties by learning a sparse code for natural images, Nature 381 (1996) 607-609.
16. Z. Roth, Y. Baram, Multidimensional density shaping by sigmoids, IEEE Trans. Neural Networks 7 (5) (1996) 1291-1298.