Optimal linear compression under unreliable representation and robust PCA neural models

IEEE Transactions on Neural Networks

Volumn 10, Issue 5, 1999, Pages 1186-1195

  Diamantaras, Konstantinos I ^a,b   Hornik, Kurt ^a,c   Strintzis, Michael Gerassimos ^a,d  

^a IEEE

^b ALEXANDER TECHNOLOGICAL EDUCATIONAL INSTITUTE OF THESSALONIKI   (Greece)

^c VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

^d ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

DATA COMPRESSION; DECODING; ENCODING (SYMBOLS); LEARNING ALGORITHMS; SPURIOUS SIGNAL NOISE; STATISTICAL METHODS;

HEBBIAN LEARNING ALGORITHM; NOISY PRINCIPAL COMPONENT ANALYSIS (NPCA);

NEURAL NETWORKS;

EID: 0032594918     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.788657     Document Type: Article

References (20)

1. P. Baldi and K. Hornik, "Learning in linear neural networks: A survey," IEEE Trans. Neural Networks, vol. 6, pp. 837-858, July 1995.
2. K. I. Diamantaras and K. Hornik, "Noisy principal component analysis," in Measurement'93, J. Volaufova and V. Witkowsky, Eds. Bratislava, Slovakia: Inst. Measurement Sci., Slovak Academy Sci., May 1993, pp. 25-33.
3. K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks: Theory and Applications. New York: Wiley, 1996.
4. K. I. Diamantaras, "Robust principal component extracting neural networks," in Proc. ICNN'96. Washington, D.C.: IEEE Press, 1996, pp. 74-77.
5. K. I. Diamantaras and M. G. Strintzis, "Noisy PCA theory and application in filter bank codec design," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing (ICASSP'97), Munich, Germany, May 21-24, 1997, pp. 3857-3860.
6. P. Földiák, "Adaptive network for optimal linear feature extraction," in Proc. Int. Joint Conf. Neural Networks, Washington, D.C., 1989, vol. 1, pp. 401-406.
7. R. G. Gallager, Information Theory and Reliable Communication. New York: Wiley, 1968.
8. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949.
9. K. Hornik, "Noisy linear networks," in Artificial Neural Networks with Applications in Speech and Vision, R. Mammone, Ed. London: Chapman & Hall, 1994.
10. H. Hotelling, "Analysis of a complex of statistical variables into principal components," J. Educ. Psych., vol. 24, pp. 498-520, 1933.
11. J. Karhunen and E. Oja, "New methods for stochastic approximation of truncated Karhunen-Loeve expansions," in Proc. 6th Int. Conf. Pattern Recognition. New York: Springer-Verlag, 1982, pp. 550-553.
12. S. Y. Kung, K. I. Diamantaras, and J. S. Taur, "Adaptive principal component extraction (APEX) and application," IEEE Trans. Signal Processing, vol. 42, pp. 1202-1217, May 1994.
13. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978.
14. R. Linsker, "An application of the principle of maximum information preservation to linear systems," in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed. San Mateo, CA: Morgan Kaufman, 1989, pp. 186-194.
15. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Automat. Contr., vol. 22, pp. 551-575, Aug. 1977.
16. D. F. Morrison, Multivariate Statistical Methods, 3rd ed. New York: McGraw-Hill, 1990.
17. E. Oja, "A simplified neuron model as a principal component analyzer," J. Math. Biol., vol. 15, pp. 267-273, 1982.
18. _, "Neural networks, principal components, and subspaces," Int. J. Neural Syst., vol. 1, no. 1, pp. 61-68, 1989.
19. M. D. Plumbley, "Efficient information transfer and anti-Hebbian networks," Neural Networks, vol. 6, no. 6, pp. 823-834, 1993.
20. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, no. 6, pp. 459-473, 1989.