A Self-Stabilizing Neural Algorithm for Total Least Squares Filtering

Neural Processing Letters

Volumn 30, Issue 3, 2009, Pages 257-271

  Xiang Yu, Kong ^a   Chang Hua, Hu ^a   Chong Zhao, Han ^b  

^a XI'AN RESEARCH INSTITUTE OF HIGH TECHNOLOGY   (China)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Adaptive algorithm; FIR filters; Linear system identification; Total least square filtering

Indexed keywords

ADAPTIVE FIR FILTERS; DATA MATRICES; LEARNING FACTOR; LEARNING RULES; LINEAR SYSTEM IDENTIFICATION; NEURAL ALGORITHM; OBSERVATION VECTORS; SYSTEM IDENTIFICATIONS; TOTAL LEAST SQUARE FILTERING; TOTAL LEAST SQUARES;

COMPUTER SIMULATION; FIR FILTERS; LEARNING ALGORITHMS; LINEAR SYSTEMS; PARAMETER ESTIMATION; SURVEYING INSTRUMENTS;

ADAPTIVE ALGORITHMS;

EID: 70450237050     PISSN: 13704621     EISSN: 1573773X     Source Type: Journal    
DOI: 10.1007/s11063-009-9122-4     Document Type: Article

References (43)

1. T Chen S Amari 2001 Unified stabilization approach to principal and minor components extraction Neural Netw 14 1377 1387 10.1016/S0893-6080(01)00116-2 10.1016/S0893-6080(01)00116-2 (Pubitemid 33103769)
2. Cichocki A (1993) Unbehauen R neural networks for optimization and signal processing. Wiley, New York
3. Cirrincione G (1998) A neural approach to the structure from motion problem. Ph.D. dissertation, LIS INPG Grenoble, Grenoble, France
4. G Cirrincione M Cirrincione 1999 Linear system identification using the TLS EXIN neuron Neurocomputing 28 1 53 74 10.1016/S0925-2312(98)00115-5 (Pubitemid 29456841)
5. G Cirrincione M Cirrincione 2002 The MCA EXIN neuron for the minor component analysis IEEE Trans Neural Networks 13 1 160 187 10.1109/72.977295 (Pubitemid 34236845)
6. A Cichocki R Unbehauen 1994 Simplified neural networks for solving linear least squares and total least squares problems in real time IEEE Trans Neural Netw 5 6 910 923 10.1109/72.329687 10.1109/72.329687
7. SC Douglas SY Kung S Amari 1998 A self-stabilized minor subspace rule IEEE Signal Process Lett 5 12 328 330 10.1109/97.735427 10.1109/97.735427
8. Dunne BE, Williamson GA (2000) Stable simplified gradient algorithms for total least squares filtering. In Proceedings of 32nd Annual Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, pp. 1762-1766
9. DZ Feng Z Bao LC Jiao 1998 Total least mean squares algorithm IEEE Trans Signal Process 46 8 2122 2130 10.1109/78.705421 10.1109/78.705421
10. DZ Feng WX Zheng Y Jia 2005 Neural network learning algorithms for tracking minor subspace in high-dimensional data stream IEEE Trans Neural Netw 16 3 513 521 10.1109/TNN.2005.844854 10.1109/TNN.2005.844854
11. KQ Gao MO Ahmad MN Swamy 1992 Learning algorithm for total least-squares adaptive signal processing Electron Lett 28 4 430 432 10.1049/el:19920270 10.1049/el:19920270
12. KQ Gao MO Ahmad MN Swamy 1994 A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering IEEE Trans Circuits Syst II Analog Digit Signal Process 41 11 718 729 10.1109/82.331542 10.1109/82.331547
13. LJ Gleser 1981 Estimation in a multivariate "errors in variables" regression model: large sample results Ann Statis 9 24 44 0496.62049 10.1214/aos/1176345330 600530
14. GH Golub 1973 Some modified eigenvalue problems SIAM Rev 15 2 318 334 10.1137/1015032 0254.65027 10.1137/1015032 329227
15. GH Golub C Reinsch 1970 Singular value decomposition and least squares solutions Numer Math 14 5 403 420 0181.17602 10.1007/BF02163027 1553974
16. GH Golub CF Van Loan 1980 An analysis of the total least squares problem SIAM J Numer Anal 17 6 883 893 10.1137/0717073 0468.65011 10.1137/0717073 595451
17. Golub GH, Van Loan CF (1989) Matri computations. 2. The Johns Hopkins University Press, Baltimore
18. XY Kong CZ Han RX Wei 2006 Modified gradient algorithm for total least squares filtering Neurocomputing 70 568 576 10.1016/j.neucom.2005.10.005 10.1016/j.neucom.2005.10.005 (Pubitemid 44615764)
19. Kushner HJ, Clark DS (1976) Stochastic approximation methods for constrained and unconstrained systems. Springer, New York
20. Kushner H, Clark D (1978) Stochastic approximation methods for constrained and unconstrained systems. Springer, New York
21. LaSalle JP (1976) The stability of dynamical systems. SIAM, Philadelphia
22. L Ljung 1977 Analysis of recursive stochastic algorithms IEEE Trans Automat Contr 22 551 575 10.1109/TAC.1977.1101561 0362.93031 10.1109/TAC.1977.1101561 465458
23. F Luo R Unbehauen A Cichocki 1997 A minor component analysis algorithm Neural Netw 10 2 291 297 10.1016/S0893-6080(96)00063-9 10.1016/S0893-6080(96) 00063-9 (Pubitemid 27165631)
24. F Luo Y Li C He 1996 Neural network approach to the TLS linear prediction frequency estimation problem Neurocomputing 11 31 42 10.1016/0925-2312(94) 00077-8 0848.68121 10.1016/0925-2312(94)00077-8 (Pubitemid 26173938)
25. Luo F, Unbehauen R (1997) Applied neural networks for signal processing. Cambridge University Press, Cambridge
26. Magnus JR, Neudecker H (1991) Matrix differential calculus with applications in statistics and econometrics. 2. Wiley, New York
27. Y Mao X Fan X Li 2006 A class of self-stabilizing MCA learning algorithms IEEE Trans Neural Netw 17 6 1634 1638 10.1109/TNN.2006.880979 10.1109/TNN.2006.880979 (Pubitemid 44824274)
28. R Möller 2004 A self-stabilizing learning rule for minor component analysis Int J Neural Syst 14 1 8 10.1142/S0129065704001863 10.1142/ S0129065704001863
29. E Oja 1992 Principal components, minor components and linear neural networks Neural Netw 5 927 935 10.1016/S0893-6080(05)80089-9 10.1016/S0893-6080(05)80089-9
30. E Oja J Karhunen 1985 On stochastic approximation of the eigenvectors and eigenvalues of the expection of a random matrix J Math Anaysis Appl 106 69 84 10.1016/0022-247X(85)90131-3 0583.62077 10.1016/0022-247X(85)90131-3 780319 (Pubitemid 15476174)
31. Peng D, Yi Z (2005) Convergence analysis of an effective MCA learning algorithm. In Proceedings of International Conference of Neural Networks Brain, pp. 2003-2008 (Pubitemid 46289323)
32. D Peng Z Yi 2007 Dynamics of generalized PCA and MCA learning algorithms IEEE Trans Neural Netw 18 6 1777 1784 10.1109/TNN.2007.895821 10.1109/TNN.2007.895821 (Pubitemid 350148426)
33. D Peng Z Yi W Luo 2007 Convergence analysis of a simple minor component analysis algorithm Neural Netw 20 842 850 1124.68095 10.1016/j.neunet.2007.07. 001 (Pubitemid 47361678)
34. D Peng Z Yi J Lv Y Xiang 2007 Neural networks learning algorithm for minor component analysis and its convergence analysis Neurocomputing V71 1748 1752
35. D Peng Z Yi J Lv Y Xiang 2008 On the discrete time dynamics of a self-stabilizing MCA learning algorithm Math Comput Model 47 903 916 1144.37471 10.1016/j.mcm.2007.06.013
36. Peng, et al. 2008 A stable MCA learning algorithm Comput Math Appl 56 4 847 860 10.1016/j.camwa.2008.01.016 1155.68494 10.1016/j.camwa.2008.01.016 2437857
37. VF Pisarenko 1973 The retrieval of harmonics from a covariance function Geophys J R Astron Soc 33 347 366 0287.62048
38. A Taleb G Cirrincione 1999 Against the convergence of the minor component analysis neurons IEEE Trans Neural Netw 10 1 207 210 10.1109/72.737511 10.1109/72.737511
39. Thompson PA An adaptive spectral analysis technique for unbiased estimation in the presence of white noise. In Proceedings of 13th Asilomar Conf
40. Van Huffel S, Van dewalle J (1991) The total least squares problems: computational aspects and analysis, frontiers in applied mathematics. SIAM, Philadelphia
41. L Xu E Oja C Suen 1992 Modified Hebbian learning for curve and surface fitting Neural Netw 5 3 441 457 10.1016/0893-6080(92)90006-5 10.1016/0893-6080(92)90006-5
42. Q Zhang Y-W Leung 2000 A class of learning algorithms for principal component analysis and minor component analysis IEEE Trans Neural Netw 11 2 529 533 10.1109/72.839022 10.1109/72.839022 (Pubitemid 30861949)
43. PJ Zufiria 2002 On the discrete-time dynamics of the basic Hebbian neuralnetwork node IEEE Trans Neural Netw 13 6 1342 1352 10.1109/TNN.2002.805752 10.1109/TNN.2002.805752 (Pubitemid 35428524)