Adaptive Principal Component EXtraction (APEX) and Applications

IEEE Transactions on Signal Processing

Volumn 42, Issue 5, 1994, Pages 1202-1217

  Kung, S Y ^a   Taur, J S ^a   Diamantaras, K I ^b  

^a PRINCETON UNIVERSITY   (United States)

^b SIEMENS CORPORATE RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS; SIGNAL DETECTION; SIGNAL PROCESSING;

MULTIPLE COMPONENTS; NEUROCOMPUTATION; ORTHOGONALIZATION;

NEURAL NETWORKS;

EID: 0028427087     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.295198     Document Type: Article

References (47)

1. H. M. Abbas and M. M. Fahmy, “A neural model for adaptive Karhunen Loève transformation (KLT)” in Proc. IJCNN-92, vol. II (Baltimore, MD), June, 1992, pp. 975–980
2. P. Baldi and K. Hornik. “Neural networks for principal component analysis: Learning from examples without local minima,” Neural Networks, vol. 2, pp. 53–58, 1989
3. S. Bannour and M. R. Azimi-Sadjadi. “Principal component extraction using recursive least squares method,” in Int. Joint Conf. Neural Networks (IJCNN) '91 (Singapore), 1991, pp. 2110–2115.
4. A. Benveniste and G. Ruget, “A measure of the tracking capability of recursive stochastic algorithms with constant gains,” IEEE Trans. Automat. Contr., vol. AC-27, no. 3, pp. 639–649, 1982
5. H. Bourlard and Y. Kamp. “Auto-association by multilayer perceptrons and singular value decomposition.” Biolog. Cyber., vol. 59, pp. 291–294, 1988
6. H. Chen and R. Liu, “An alternative proof of convergence for Kung-Diamantaras APEX algorithm,” in B. H. Juang, S. Y. Kung and C. A. Kamm, Eds., Neural Networks for Signal Processing. New York: IEEE Press, 1991, pp. 40–49
7. SVD and Signal Processing, E. F. Deprettere, Ed. North Hohhand: Elsevier, 1988
8. K. I. Diamantaras. “Principal component learning networks and applications,” Ph.D. dissertation, Princeton Univ., Princeton, NJ, 1992
9. K. I. Diamantaras and S. Y. Kung “Cross-correlation neural network models,” to be published
10. K. I. Diamantaras and S. Y. Kung. “Multilayer neural networks for reduced rank approximation,” to be published
11. K. I. Diamantaras and S. Y. Kung “An unsupervised neural model for oriented principal component extraction,” in Proc. Int. Conf. Acoust., Speech, Signal Processing (Toronto, Canada), 1991, pp. 1049–1052
12. P. Foldiak. “Adaptive network for optimal linear feature extraction,” in Proc. Int. Joint Conf. Neural Networks (Washington DC), 1989, pp. I 401–1 406
13. G. J. Foschini, L. J. Greenstein, and G. Vannucci, “Noncoherent detection of coherent lightwave signals corrupted by phase noise,” IEEE Trans. Commun., vol. 36, no. 3, pp. 306–314, Mar. 1988
14. C. Georghiades and D. L. Snyder, “A proposed receiver structure for optimal communication systems that employ heterodyne detection and a semiconductor laser as a local oscillator,” IEEE Trans. Commun., vol. COM-33, no. 4, Apr. 1985
15. G. H. Golub and C. F. Van Loan, “Matrix computations,” 2nd ed. Baltimore, MD: Johns Hopkins University Press, 1989
16. R. C. Gonzalez and P. Wintz, Digital Image Processing. Reading, MA: Addison-Wesley, 1977
17. D. O. Hebb, The Organization of Behavior. New York: Wiley, 1949
18. H. Hotelling, “Analysis of a complex of statistical variables into principal components,” J. Educ. Psych., vol. 24, 498–520, 1933
19. A. K. Jain, “Fundamentals of digital image processing,” Englewood Cliffs, NJ: Prentice-Hall, 1989
20. S. Y. Kung. “A new identification and model reduction algorithm via singular value decomposition,” in Proc. 12th Asilomar Conf. Circuits, Syst. Comput. (Pacific Grove, CA), Nov. 1978, pp. 705–714
21. S. Y. Kung “Adaptive principal component analysis via an orthogonal learning network,” in Proc. Int. Symp. Circuits, Syst. (New Orleans, LA), May, 1990, pp. 719–722
22. S. Y. Kung K. S. Arun, and D. V. Bhaskar Rao, “State-space and singular-value decomposition-based approximation methods for the harmonic retrieval problem,” J. Opt. Soc. Am., vol. 73, 1983
23. S. Y. Kung and K. 1. Diamantaras, “A neural network learning algorithm for adaptive principal component Extraction (APEX),” in Proc. ICASSP (Albuquerque, NM), Apr. 1990, pp. 861–864
24. S. Y. Kung and K. I. Diamantaras, “Neural networks for extracting unsymmetric principal components,” in Neural Networks for Signal Processing, B. H. Juang, S. Y. Kung and C. A. Kamm Eds. New York: IEEE Press, pp. 50–59
25. S. Y. Kung K. I. Diamantaras, and J. S. Taur, “Neural networks for extracting pure/constrained/oriented principal components,” in SVD and Signal Processing, II: Algorithms, Analysis and Applications, R. J. Vaccaro, Ed. Norht Holland: Elsevier, 1991
26. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1978
27. H. J. Kushner and H. Huang, “Asymptotic properties of stochastic approximations with constant coefficients,” SIAM J. Contr., Optimization, vol. 19, pp. 87–105, 1981
28. R. Linsker. “Self-organization in a perceptual network,” IEEE Comput. vol. 21, 105–117, Mar. 1988
29. L. Ljung, “Analysis of recursive stochastic algorithms,” IEEE Trans. Automat. Contr., vol. AC-22, no. 4, pp. 551–575, Aug. 1977
30. L. Ljung and T. Soderström, Theory and Practice of Recursive Identification. Cambridge, MA: MIT Press, 1983
31. S. Mayrargue and J. P. Jouveau, “A new application of SVD to harmonic retrieval,” in SVD and Signal Processing, E. F. Deprettere, Ed. North Holland: Elsevier 1988, pp. 467–472
32. J. L. McClelland, D. E. Rumelhart, and G. E. Hinton, “The appeal of parallel distributed processing,” in Parallel Distributed Processing, vol. 1, J. L. McClelland, D. E. Rumelhart, and the PDP Research Group, Eds. Cambridge, MA: MIT Press, 1986
33. E. Oja, “A simplified neuron model as a principal component analyzer,” J. Math. Biology, vol. 15, pp. 267–273, 1982.
34. E. Oja, Subspace Method for Pattern Recognition. Letchworth, Hertfordshire, U.K.: Research Studies Press, 1983.
35. E. Oja, “Neural networks, principal components, and subspaces,” Int. J.Neural Syst., vol. I, no. I, pp. 61–68, 1989.
36. B. N. Parlett, The Symmetric Eigenvalue Problem. Englewood Cliffs,NJ: Prentice-Hall, 1980.
37. B. Picinbono and P. Duvaut, “Optimal linear-quadratic systems for detection and estimation,” IEEE Trans. Inform. Theory, vol. 34, no. 2, pp. 30631 I, Mar. 1988.
38. R. Roy, A. Paulraj, and T. Kailath, “Direction-of-arrival estimation by subspace rotation methods-ESPRIT,” in Proc. ICASSP 86, (Tokyo, Japan), 1986, pp. 2495-2498.
39. R. Roy, A. Paulraj, and T. Kailath. “ESPRIT-A subspace rotation approach to estimation of parameters of cisoids in noise,” IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-34, no. S), pp. 1340–1342, Oct. 1986.
40. J. Rubner and K. Schulten, “Development of feature detectors by selforganization,”Biolog. Cyber., vol. 62, pp. 193–199, 1990.
41. T. D. Sanger, “Optimal unsupervised learning in a single-layer linear feed forward neural network,” Neural Networks, vol. 2, no. 6, pp, 459–473, 1989.
42. R. Schmidt, “Multiple emitter location and signal parameter estimation,” in Proc. RADC Spectrum Estimation Workshop, 1979, pp. 243–258.
43. D. W. Tufts and R. Kumaresan, “Estimation of frequencies of multiple sinusoids: Making linear prediction perform like maximum likelihood,” Proc. IEEE, vol. 70, no. 9, pp. 975–989, Sept. 1982.
44. SVD and Signal Processing, 11: Algorithms, Analysis and Applications. R. Vaccaro, Ed. Amsterdam: Elsevier, 1991.
45. J. Vanderschoot, et al., “Two methods for optimal MECG elimination and FECG detection from skin electrode signals,” IEEE Trans. Biomed. Eng., vol. BME, vol. 34, no. 3, pp. 233–242, Mar. 1987.
46. V.V. Veeravali and H. V. Poor, “Quadratic detection of signals with drifting phase,” J. Acoust. Soc. Am., vol. 89, no. 2, pp. 811–819, Feb. 1991.
47. A.D. Whalen. Detection of Signals in Noise. New York: Academic, 1971.