Neural-Based Orthogonal Data Fitting: The EXIN Neural Networks

Neural-Based Orthogonal Data Fitting: The EXIN Neural Networks

Volumn , Issue , 2011, Pages

  Cirrincione, Giansalvo ^a   Cirrincione, Maurizio ^b  

^a UNIVERSITÉ DE PICARDIE JULES VERNE   (France)

^b UNIVERSITÉ DE TECHNOLOGIE DE BELFORT MONTBÉLIARD   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84891584542     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470638286     Document Type: Book

References (202)

1. T.J. Abatzoglou and J.M. Mendel. Constrained total leastsquares. Proc. ICASSP, pp. 1485-1488, 1987.
2. T.J. Abatzoglou, J.M. Mendel, and G.A. Harada. The constrained total least squares technique and its application to harmonic superresolution. IEEE Trans. Signal Process., 39(5):1070-1087, May 1991.
3. R.J. Adcock. Aproblem in least squares. Analyst, 5:53-54, 1878.
4. P. Baldi and K. Hornik. Neural networks andprincipal component analysis: learning from examples without local minima. Neural Netw., 2:52-58, 1989.
5. S. Barbarossa, E. Daddio, and G. Galati. Comparisonof optimum and linear prediction technique for clutter cancellation. IEE Proc. F, 134:277-282, 1987.
6. E. Barnard. Optimizationfor training neural nets. IEEE Trans. Neural Netw., 3(2):232-240, 1992.
7. R. Battiti. Acceleratedbackpropagation learning: two optimization methods. Complex Syst., 3:331-342, 1989.
8. S. Beghelli, R.P. Guidorzi, and U. Soverini. Structuralidentification of multivariable systems by the eigenvector method. Int. J. Control, 46:671-678, 1987.
9. D.S. Bernstein. MatrixMathematics. Princeton University Press, Princeton, NJ, 2005.
10. C.M. Bishop. NeuralNetwork for Pattern Recognition. Clarendon Press, Oxford, UK, 1995.
11. N.K. Bose, H.C. Kim, and H.M. Valenzuela. Recursivetotal least squares algorithm for image reconstruction. Multidimens. Syst. Signal Process., 4:253-268, 1993.
12. R. Branham. Multivariateorthogonal regression in astronomy. Celestial Mech. Dyn. Astron., 61(3):239-251, Sept. 1995.
13. R.H. Byrd and J. Nocedal. A tool forthe analysis of quasi-Newton methods with application to unconstrained minimization. SIAM J. Numer. Anal., 26(3):727-739, June 1989.
14. F. Chatelin. Eigenvaluesof Matrices. Wiley, New York, 1993.
15. Y. Chauvin. Principalcomponent analysis by gradient descent on a constrained linear Hebbian cell. Proceedings of the IEEE International Conference on Neural Networks, Washington, DC, Vol. I, pp. 373-380. IEEE Press, New York, 1989.
16. H. Chen and R.W. Liu. Adaptive distributed orthogonalizationprocessing for principal component analysis. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 1992.
17. H. Chen and R.W. Liu. An on-line unsupervised learning machine for adaptive extraction. IEEE Trans. Circuits and Syst. II, 41:87-98, 1994.
18. T. Chen, S. Amari, and Q. Lin. Aunified algorithm for principal and minor components extraction. Neural Netw., 11:385-390, 1998.
19. W. Chen, J. Zhang, J. Ma, and B. Lu. Applicationof the total least squares method to the determination of preliminary orbit. Chin. Astron. Astrophys., 30(4):431-436, Oct.-Dec. 2006.
20. C.L. Cheng and J.W. Van Ness. Robust Errors-in-Variables Regression. Technical Report 179. Programs in Mathematical Sciences. University of Texas, Dallas, TX, 1987.
21. A. Cichocki and R. Unbehauen. Neural Networks forOptimization and Signal Processing. Wiley, New York, 1993.
22. A. Cichocki and R. Unbehauen. Simplified neural networksfor solving linear least squares and total least squares problems in real time. IEEE Trans. Neural Netw., 5(6):910-923, Nov. 1994.
23. J.M. Cioffi. Limited-precision effects in adaptive filtering. IEEE Trans. Circuits Syst., 34(7):821-833, July 1987.
24. G. Cirrincione. ANeural Approach to the Structure from Motion Problem. Ph.D. dissertation, LIS INPG Grenoble, Dec. 1998.
25. G. Cirrincione. TLSand constrained TLS neural networks in computer vision. 3rd InternationalWorkshop on TLS and Errors-in-Variables Modeling, Leuven/Heverlee, Belgium, Aug. 27-29, 2001.
26. G. Cirrincione. Constrainedtotal least squares for the essential/fundamental matrix estimation, a neural approach. Int. J. Comput. Vision (submitted in 2010).
27. G. Cirrincione and M. Cirrincione. Linear system identificationusing the TLS EXIN neuron. NEURAP 98, Marseille, France, Mar. 1998.
28. G. Cirrincione and M. Cirrincione. Robust total leastsquares by the nonlinear MCA EXIN neuron. Proceedings of the IEEE International Joint Symposia on Intelligence and Systems, Rockville, MD, pp. 295-300, May 1998.
29. G. Cirrincione and M. Cirrincione. A robust neuralapproach for the estimation of the essential parameters in computer vision. Int. J. Artif. Intell. Tools, 8(3), Sept. 1999.
30. G. Cirrincione, M. Cirrincione, J. Hérault, and S. Van Huffel. The MCA EXINneuron for the minor component analysis. IEEE Trans. Neural Netw., 13(1):160-187, Jan. 2002.
31. G. Cirrincione, M. Cirrincione, and S. Van Huffel. The GeTLS EXINneuron for linear regression. IJCNN, July 2000.
32. G. Cirrincione, M. Cirrincione, and S. Van Huffel. The essential/fundamental matrix estimation as a constrained total least squares problem: Theory. CVPRIP 2000, Atlantic City, NJ, Jan.-Feb. 2000.
33. G. Cirrincione, M. Cirrincione, and S. Van Huffel. The GETLS EXINneuron for linear regression. IJCNN 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference, July 24-27, 2000. Neural Netw., 6:285-289.
34. G. Cirrincione, M. Cirrincione, and S. Van Huffel. A robust neuralapproach against outliers for the structure from motion problem in computer vision. Conference on Statistics with Deficient Data, Munich, Germany, 2000.
35. G. Cirrincione, G. Ganesan, K.V.S. Hari, and S. Van Huffel. Direct and neuraltechniques for the data least squares problem. MTNS 2000, June 2000.
36. G. Cirrincione and M. Cirrincione. Linear system identificationby using the TLS EXIN neuron. Neurocomputing, 28(1-3):53-74, Oct. 1999.
37. M. Cirrincione, M. Pucci, and G. Cirrincione. Estimationof the electrical parameters of an induction motor with the TLS EXIN neuron. Proceedings of the Fourth IEEE International Caracas Conference on Devices, Circuits and Systems, Apr. 17-19, 2002, pp. I034-1 to I034-8.
38. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anew TLS based MRAS speed estimation with adaptive integration for high performance induction machine drives. Conference Record of the Industry Applications Conference, 38th IAS Annual Meeting, Vol. 1, pp. 140-151, Oct. 12-16, 2003.
39. M. Cirrincione, M. Pucci, G. Cirrincione, and G.A. Capolino. Anadaptive speed observer based on a new total least-squares neuron for induction machine drives. Conference Record of the 2004 IEEE Industry Applications Conference, 2004. 39th IAS Annual Meeting, Vol. 2, pp. 1350-1361, Oct. 3-7, 2004.
40. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anenhanced neural MRAS sensorless technique based on minor-component-analysis for induction motor drives. Proceedings of the IEEE International Symposium on Industrial Electronics, 2005, Vol. 4, pp. 1659-1666, June 20-23, 2005.
41. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Sensorlesscontrol of induction motor drives by new linear neural techniques. 12th International Power Electronics and Motion Control Conference, pp. 1820-1829, Aug. 2006.
42. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anew experimental application of least-squares techniques for the estimation of the induction motor parameters. In Conference Record of the Industry Applications Conference, 2002, 37th IAS Annual Meeting, Vol. 2, pp. 1171-1180, Oct. 13-18, 2002.
43. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anew experimental application of least-squares techniques for the estimation of the induction motor parameters. IEEE Trans. Ind. Appl., 39(5):1247-1256, Sept.-Oct. 2003.
44. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anew TLS-based MRAS speed estimation with adaptive integration for high performance induction motor drives. IEEE Trans. Ind. Appl., 40(4):1116-1137, June-Aug. 2004.
45. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Anadaptive speed observer based on a new total least-squares neuron for induction machine drives. IEEE Trans. Ind. Appl., 42(1):89-104, Jan.-Feb. 2006.
46. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Sensorlesscontrol of induction machines by a new neural algorithm: the TLS EXIN neuron. IEEE Trans. Ind. Electron., 54(1):127-149, Feb. 2007.
47. M. Cirrincione, M. Pucci, G. Cirrincione, and G.-A. Capolino. Sensorlesscontrol of induction motors by reduced order observer with MCA EXIN+ based adaptive speed estimation. IEEE Trans. Ind. Electron., 54(1):150-166, Feb. 2007.
48. P. Comon and G.H. Golub. Tracking a fewextreme singular values and vectors in signal processing. Proc. IEEE, 78:1327-1343, 1990.
49. Y. Le Cun, P.Y. Simard, and B. Pearlmutter. Automatic learning ratemaximization by on-line estimation of the Hessian's eigenvectors. In S.J. Hanson, J.D. Cowan, and C.L. Giles, eds., Advances in Neural Information Processing Systems, Vol. 5, pp. 156-163. Morgan Kaufmann, San Mateo, CA, 1993.
50. C.E. Davila. Anefficient recursive total least squares algorithm for FIR adaptive filtering. IEEE Trans. Signal Process., 42:268-280, 1994.
51. R.D. Degroat and E. Dowling. The data leastsquares problem and channel equalization. IEEE Trans. Signal Process., 41(1):407-411, Jan. 1993.
52. A.J. Van der Veen and A. Paulraj. An analytical constant modulus algorithm. IEEE Trans. Signal Process., pp. 1136-1155, May 1996.
53. K.I. Diammantaras and S.Y. Kung. An unsupervised neuralmodel for oriented principal component. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 1049-1052, 1991.
54. G. Eckart and G. Young. The approximation ofone matrix by another of lower rank. Psychometrica, 1:211-218, 1936.
55. S.E. Fahlman. Faster-learning variations on back propagation: an empirical study. In D. Touretzky, G.E. Hinton, and T.J. Sejnowski, eds., Proceedings of the 1988 Connectionist Models Summer School, pp. 38-51. Morgan Kaufmann, San Mateo, CA, 1988.
56. D.Z. Feng, Z. Bao, and L.C. Jiao. Total least meansquares algorithm. IEEE Trans. Signal Process., 46(8):2122-2130, Aug. 1998.
57. K.V. Fernando and H. Nicholson. Identification of linearsystems with input and output noise: the Koopmans-Levin method. IEE Proc. D, 132:30-36, 1985.
58. G.W. Fisher. Matrix analysis ofmetamorphic mineral assemblages and reactions. Contrib. Mineral. Petrol., 102:69-77, 1989.
59. R. Fletcher. Practical Methods ofOptimization, 2nd ed. Wiley, New York, 1987.
60. W.A. Fuller. Error Measurement Models. Wiley, New York, 1987.
61. G.G. Cirrincione, S. Van Huffel, A. Premoli, and M.L. Rastello. An iteratively re-weighted total least-squares algorithm for different variances in observations and data. In V.P. Ciarlini, M.G. Cox, E. Filipe, F. Pavese, and D. Richter, eds., Advanced Mathematical and Computational Tools in Metrology, pp. 78-86. World Scientific, Hackensack, NJ, 2001.
62. P.P. Gallo. Consistency of regressionestimates when some variables are subject to error. Commun. Stat. Theory Methods, 11:973-983, 1982.
63. K. Gao, M.O. Ahmad, and M.N. Swamy. Learning algorithm fortotal least-squares adaptive signal processing. Electron. Lett., 28(4):430-432, Feb. 1992.
64. K. Gao, M.O. Ahmad, and M.N. Swamy. A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering. IEEE Trans. Circuits Syst.-II, 41(11):718-729, Nov. 1994.
65. C.L. Giles and T. Maxwell. Learning, invariance, and generalization in high order neural networks. Appl. Opt., 26:4972-4978, 1987.
66. P.E. Gill, W. Murray, and M.H. Wright. Practical Optimization. Academic Press, New York, 1980.
67. R.D. Gitlin, J.E. Mazo, and M.G. Taylor. On the designof gradient algorithms for digitally implemented adaptive filters. IEEE Trans. Circuits Syst., 20, Mar. 1973.
68. R.D. Gitlin, H.C. Meadors, and S.B. Weinstein. The tap-leakage algorithm: an algorithm for the stable operation of a digitally implemented, fractionally adaptive spaced equalizer. Bell Syst. Tech. J., 61(8):1817-1839, Oct. 1982.
69. L.J. Gleser. Calculation and simulationin errors-in-variables regression problems. Mimeograph Ser. 78-5. Statistics Department, Purdue University, West Lafayette, IN, 1978.
70. L.J. Gleser. Estimation in amultivariate "errors in variables" regression model: large sample results. Ann. Stat., 9:24-44, 1981.
71. G.H. Golub. Some modified eigenvalueproblems. SIAM Rev., 15:318-344, 1973.
72. G.H. Golub, A. Hoffman, and G.W. Stewart. A generalization ofthe Eckart-Young-Mirsky matrix approximation theorem. Linear Algebra Appl., 88-89: 322-327, 1987.
73. G.H. Golub and R.J. Leveque. Extensions and usesof the variable projection algorithm for solving nonlinear least squares problems. Proceedings of the 1979 Army Numerical Analysis and Computers Conference, White Sands Missile Range, White Sands, NM, pp. 1-12, 1979.
74. G.H. Golub and C.F. Van Loan. An analysis ofthe total least squares problem. SIAM J. Numer. Anal., pp. 883-893, 1980.
75. G.H. Golub and C.F. Van Loan. Matrix Computations, 2nd ed. Johns Hopkins University Press, Baltimore, 1989.
76. G.H. Golub and C. Reinsch. Singular value decompositionand least squares solutions. Numer. Math., 14:403-420, 1970.
77. J.W. Griffiths. Adaptive array processing, a tutorial. IEE Proc. F, 130:3-10, 1983.
78. R. Haimi-Cohen and A. Cohen. Gradient-type algorithms for partial singular value decomposition. IEEE Trans. Pattern Anal.Machine Intell., 9(1):137-142, Jan. 1987.
79. H.R. Hall and R.J. Bernhard. Total least squaressolutions to acoustic boundary element models. In R.J. Bernhard and R.F. Keltie, eds., Proceedings of the International Symposium on Numerical Techniques in Acoustic Radiation, ASME Winter Annual Meeting, San Francisco, Vol. 6, pp. 145-152. American Society of Mechanical Engineers, New York, 1989.
80. F.R. Hampel, E.N. Ronchetti, P. Rousser, and W.A. Stachel. Robust Statistics: The Approach Based on Influence Functions. Wiley, New York, 1987.
81. M. Hassoun. Fundamentals of ArtificialNeural Networks. MIT Press, Cambridge, MA, 1995.
82. S. Haykin. Adaptive Filter Theory, 2nd ed. Prentice Hall, Englewood Cliffs, NJ, 1991.
83. S. Haykin. Neural Networks: A Comprehensive Foundation. IEEE Press, Piscataway, NJ, 1994.
84. U. Helmke and J.B. Moore. Optimization and DynamicalSystems. Communications and Control Engineering. Springer-Verlag, London, 1994.
85. M. Hestenes. Conjugate Direction Methodsin Optimization. Springer-Verlag, New York, 1980.
86. M.R. Hestenes and E. Stiefel. Methods of conjugategradients for solving linear systems. J. Res. Natl. Bur. Stand., 49(6):409-436, 1952.
87. K. Hirakawa and T.W. Parks. Image denoising usingtotal least squares. IEEE Trans. Image Process., 15:2730-2742, 2006.
88. R.R. Hocking. The analysis andselection of variables in linear regression. Biometrics, 32:1-49, 1976.
89. R.R. Hocking. Developments in linearregression methodology 1959-1982. Technometrics, 25:219-230, 1983.
90. S.D. Hodges and P.G. Moore. Data uncertainties andleast squares regression. Appl. Stat., 21:185-195, 1972.
91. P. Huber. Robust Statistics. Wiley, New York, 1981.
92. S. Van Huffel. Analysis of theTotal Least Squares Problem and Its Use in Parameter Estimation. Ph.D. dissertation. Department of Electrical Engineering, Katholieke Universiteit Leuven, Leuven, Belgium, 1987.
93. S. Van Huffel. On the significanceof nongeneric total least squares problems. SIAM J. Matrix Anal. Appl., 13(1):20-35, 1992.
94. S. Van Huffel. TLS applications inbiomedical signal processing. In S. Van Huffel, ed., Recent Advances in Total Least Squares Techniques and Errors-in-Variables Modeling. SIAM Proceedings Series. SIAM, Philadelphia, 1997.
95. S. Van Huffel and J. Vandewalle. Subset selection using the total least squares approach in collinearity problems with errors in the variables. Linear Algebra Appl., 88-89:695-714, 1987.
96. S. Van Huffel and J. Vandewalle. The partial total least squares algorithm. J. Comput. Appl. Math., 21:333-341, 1988.
97. S. Van Huffel and J. Vandewalle. Analysis and properties of the generalized total least squares problem ax = b when some or all columns of a are subject to errors. SIAM J. Matrix Anal. Appl., 10:294-315, 1989.
98. S. Van Huffel and J. Vandewalle. The Total Least Squares Problems: Computational Aspects and Analysis. Frontiers in Applied Mathematics. SIAM, Philadelphia, 1991.
99. S. Van Huffel, J. Vandewalle, and A. Haegemans. An efficient andreliable algorithm for computing the singular subspace of a matrix, associated with its smallest singular values. J. Comput. Appl. Math., 19:313-330, 1987.
100. S. Van Huffel, J. Vandewalle, M.C. De Roo, and J.L. Willems. Reliable and efficientdeconvolution technique based on total linear least squares for calculating the renal retention function. Med. Biol. Eng. Comput., 25:26-33, 1987.
101. R.A. Jacobs. Increased rates ofconvergence through learning rate adaptation. Neural Netw., 1(4):295-307, 1988.
102. C.J. Tsai, N.P. Galatsanos, and A.K. Katsaggelos. Total least squaresestimation of stereo optical flow. Proceedings of the IEEE International Conference on Image Processing, Vol. II, pp. 622-626, 1998.
103. E.M. Johannson, F.U. Dowla, and D.M. Goodman. Backpropagation learning formultilayer feedforward neural networks using the conjugate gradient method. Int. J. Neural Syst., 2(4):291-301, 1992.
104. J.H. Justice and A.A. Vassiliou. Diffraction tomography forgeophysical monitoring of hydrocarbon reservoirs. Proc. IEEE, 78:711-722, 1990.
105. G. Kelly. The influence functionin the errors in variables problem. Ann. Stat., 12:87-100, 1984.
106. R.H. Ketellapper. On estimating parametersin a simple linear errors-in-variables model. Technometrics, 25:43-47, 1983.
107. R. Klemm. Adaptive airborne MTI: an auxiliary channel approach. IEE Proc. F, 134:269-276, 1987.
108. T.C. Koopmans. Linear Regression Analysisof Economic Time Series. De Erver F. Bohn, Haarlem, The Netherlands, 1937.
109. A.H. Kramer and A. Sangiovanni-Vincentelli. Efficient parallel learningalgorithms for neural networks. In D.S. Touretzky, ed., Advances in Neural Information Processing Systems, Vol. 1, pp. 40-48, Morgan Kaufmann, San Mateo, CA, 1989.
110. T.P. Krasulina. Method of stochasticapproximation in the determination of the largest eigenvalue of the mathematical expectation of random matrices. Automat. Remote Control, 2:215-221, 1970.
111. S.Y. Kung and K.I. Diammantaras. A neural networklearning algorithm for adaptive principal component extraction. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 861-864, 1990.
112. S.Y. Kung, K.I. Diammantaras, and J.S. Taur. Adaptive principal componentextraction and application. IEEE Trans. Signal Process., 42(5):1202-1217, 1994.
113. H. Kushner and D. Clark. Stochastic Approximation Methodsfor Constrained and Unconstrained Systems. Springer-Verlag New York, 1978.
114. C. Lawson and R. Hanson. Solving Least SquaresProblems. Prentice-Hall, Englewood Cliffs, NJ, 1974.
115. E. Linsker. From basic networkprinciples to neural architecture: emergence of spatial opponent cells. Proc. Natl. Acad. Sci. USA, 83:7508-7512, 1986.
116. E. Linsker. From basic networkprinciples to neural architecture: emergence of orientation selective cells. Proc. Natl. Acad. Sci. USA, 83:8390-8394, 1986.
117. E. Linsker. From basic networkprinciples to neural architecture: emergence of orientation columns. Proc. Natl. Acad. Sci. USA, 83:8779-8783, 1986.
118. L. Ljung. Analysis of recursivestochastic algorithms. IEEE Trans. Autom. Control, 22:551-575, 1977.
119. D.G. Luenberger. Linear and NonlinearProgramming, 2nd ed. Addison-Wesley, Reading, MA, 1984.
120. F. Luo, Y. Li, and C. He. Neural network approachto the TLS linear prediction frequency estimation problem. Neurocomputing, 11:31-42, 1996.
121. F. Luo and R. Unbehauen. Applied Neural Networksfor Signal Processing. Cambridge University Press, New York, 1997.
122. F. Luo and R. Unbehauen. A minor subspaceanalysis algorithm. IEEE Trans. Neural Netw., 8(5):1149-1155, Sept. 1997.
123. F. Luo and R. Unbehauen. Comments on: A unified algorithm for principal and minor components extraction. Letter to the Editor. Neural Netw., 12:393, 1999.
124. F. Luo, R. Unbehauen, and A. Cichocki. A minor componentanalysis algorithm. Neural Netw., 10(2):291-297, 1997.
125. F.L. Luo, R. Unbehauen, and Y.D. Li. A principal componentanalysis algorithm with invariant norm. Neurocomputing, 8(2):213-221, 1995.
126. A. Madansky. The fitting ofstraight lines when both variables are subject to error. J. Am. Stat. Assoc., 54:173-205, 1959.
127. S. Makram-Ebeid, J.A. Sirat, and J.R. Viala. A rationalized backpropagationlearning algorithm. Proceedings of the International Joint Conference on Neural Networks, Vol. 2, pp. 373-380. IEEE Press, Piscataway, NJ, 1989.
128. G. Mathew and V. Reddy. Development and analysisof a neural network approach to Pisarenko's harmonic retrieval method. IEEE Trans. Signal Process., 42:663-667, 1994.
129. G. Mathew and V. Reddy. Orthogonal eigensubspace estimationusing neural networks. IEEE Trans. Signal Process., 42:1803-1811, 1994.
130. V.Z. Mesarovic, N.P. Galatsanos, and A.K. Katsaggelos. Regularized constrained totalleast squares image restoration. IEEE Trans. Image Process., 48:1096-1108, Aug. 1995.
131. L. Mirsky. Symmetric gauge functionsand unitarily invariant norms. Q. J. Math. Oxford, 11:50-59, 1960.
132. R.R. Mohler. Nonlinear Systems, Vol. I, Dynamics and Control. Prentice Hall, Englewood Cliffs, NJ, 1991.
133. M.F. Moller. A scaled conjugategradient algorithm for fast supervised learning. Neural Netw., 6:525-533, 1993.
134. M. Moonen, B. De Moor, L. Vanderberghe, and J. Vandewalle. On-and off-line identification of linear state-space models. Int. J. Control, 49:219-232, 1989.
135. B. De Moor. Mathematical Concepts andTechniques for Modelling Static and Dynamic Systems. Ph.D. dissertation, Department of Electrical Engineering, Katholieke Universiteit Leuven, Leuven, Belgium, 1988.
136. B. De Moor and J. Vandewalle. An adaptive singular value decomposition algorithm based on generalized Chebyshev recursion. In T.S. Durrani, J.B. Abbiss, J.E. Hudson, R.W. Madan, J.G. McWhirter, and T.A. Moore, eds., Proceedings of the Conference on Mathematics in Signal Processing, pp. 607-635. Clarendon Press, Oxford, UK, 1987.
137. M. Muhlich and R. Mester. The role oftotal least squares in motion analysis. In H. Burkhardt, ed., Proceedings of the European Conference on Computer Vision, pp. 305-321. Lecture Notes on Computer Science. Springer-Verlag, New York, June 1998.
138. E. Oja. A simplified neuronmodel as a principal component analyzer. J. Math. Biol., 16:267-273, 1982.
139. E. Oja. Subspace Methods ofPattern Recognition. Research Studies Press/Wiley, Letchworth, UK, 1983.
140. E. Oja. Neural networks, principal components and subspace. Int. J. Neural Syst., 1:61-68, 1989.
141. E. Oja. Principal components, minor components and linear neural networks. Neural Netw., 5:927-935, 1992.
142. E. Oja and J. Karhunen. On stochastic approximationof the eigenvectors and eigenvalues of the expectation of a random matrix. J. Math. Anal. Appl., 106:69-84, 1985.
143. E. Oja, H. Ogawa, and J. Wangviwattana. Learning in nonlinearconstrained Hebbian networks. Proceedings of the International Conference on ANNs, Espoo, Finland, pp. 737-745, 1991.
144. E. Oja and L. Wang. Neural fitting: robustness by anti-Hebbian learning. Neurocomputing, 12:155-170, 1996.
145. E. Oja and L. Wang. Robust fitting bynonlinear neural units. Neural Netw., 9(3):435-444, 1996.
146. C.C. Paige and Z. Strakos. Unifying least squares, total least squares and data least squares problems. In S. Van Huffel and P. Lemmerling, eds., Proceedings of the Third International Workshop on TLS and Errors-in-Variables Modelling, pp. 35-44. Kluwer Academic, Dordrecht, The Netherlands. 2001.
147. C.C. Paige and Z. Strakos. Scaled total leastsquares fundamentals. Numer. Math., 91:117-146, 2002.
148. Y. Pao. Adaptive Pattern Recognitionand Neural Networks. Addison-Wesley, Reading, MA, 1989.
149. B.N. Parlett. The Rayleigh quotientiteration and some generalizations for nonormal matrices. Math. Comput., 28:679-693, 1974.
150. B.N. Parlett. The Symmetric EigenvalueProblem. Englewood Cliffs, NJ, Prentice Hall, 1980.
151. K. Pearson. On lines andplanes of closest fit to points in space. Philos. Mag., 2:559-572, 1901.
152. V.F. Pisarenko. The retrieval ofharmonics from a covariance function. Geophys. J. R. Astron. Soc., 33:347-366, 1973.
153. D. Plaut, S. Nowlan, and G.E. Hinton. Experiments on Learningby Backpropagation. Technical report T.R. CMU-CS-86-126. Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA, 1986.
154. E. Polak. Computational Methods inOptimization: A Unified Approach. Academic Press, New York, 1971.
155. M.J.D. Powell. Restart procedures forthe conjugate gradient method. Math. Programming, 12:241-254, 1977.
156. A. Premoli, M.L. Rastello, and G. Cirrincione. A new approachto total least-squares techniques for metrological applications. In P. Ciarlini, M.G. Cox, F. Pavese, and D. Richter, eds., Advanced Mathematical Tools in Metrology II. Series on Advances in Mathematics for Applied Sciences, Vol. 40, pp. 206-215. World Scientific, Hackensack, NJ, 1996.
157. W.H. Press, S.A. Teukolsky, W.T. Wetterling, and B.P. Flannery. Numerical Recipes inC: The Art of Scientific Computing, 2nd ed. Cambridge University Press, New York, 1992.
158. M.A. Rahman and K.B. Yu. Total least squaresapproach for frequency estimation using linear prediction. IEEE Trans. Acoust. Speech Signal Process., 5:1440-1454, 1987.
159. J.A. Ramos. Applications of TLSand related methods in the environmental sciences. Comput. Stat. Data Anal., 2(2):1234-1267, 2007.
160. B.D. Rao. Unified treatment ofLS, TLS and truncated SVD methods using a weighted TLS framework. In S. Van Huffel, ed., Recent Advances in Total Least Squares Techniques and Errors-in-Variables Modeling, pp. 11-20. SIAM, Philadelphia, 1997.
161. H. Robbins and S. Monro. A stochastic approximationmethod. Ann. Math. Stat., 2:400-407, 1951.
162. R. Rost and J. Leuridan. A comparison ofleast squares and total least squares for multiple input estimation of frequency response functions. Paper 85-DET-105. ASME Design Engineering Division Conference and Exhibit on Mechanical Vibration and Noise, Cincinnati, OH, 1985.
163. R. Roy and T. Kailath. Total least-squares ESPRIT. Proceedings of the 21st Annual Asilomar Conference on Signals, Systems and Computers, pp. 297-301, 1987.
164. Y. Saad. Chebyshev acceleration techniquesfor solving nonsymmetric eigenvalue problems. Math. Comput., 2:567-588, 1984.
165. S. Sagara and K.Wada. On-line modified least-squares parameter estimation of linear discrete dynamic systems. Int. J. Control, 25(3):329-343, 1977.
166. T.D. Sanger. Optimal unsupervised learningin a single-layer linear feedforward neural network. Neural Netw., :459-473, 1989.
167. R. Schmidt. Multiple emitter locationand signal parameter estimation. IEEE Trans. Antennas Propag., 4:276-280, 1986.
168. H. Schneeweiss. Consistent estimation ofa regression with errors in the variables. Metrika, 23:101-115, 1976.
169. D. Shafer. Gradient vectorfields neardegenerate singularities. In Z. Nitecki and C. Robinson, eds., Global Theory of Dynamical Systems, pp. 410-417. Lecture Notes in Mathematics 819. Springer-Verlag, Berlin, 1980.
170. D.F. Shanno. Conjugate gradient methodswith inexact searches. Math. Oper. Res., (3):244-256, 1978.
171. M.T. Silvia and E.C. Tacker. Regularization of Marchenko's integral equation by total least squares. J. Acoust. Soc. Am., 72:1202-1207, 1982.
172. J.J. Sllynk. Adaptive IIR filtering. IEEE ASSP Mag., 2:4-21, Apr. 1989.
173. H. Spath. On discrete linearorthogonal LP-approximation. Z. Angew. Math. Mech., 2:354-355, 1982.
174. H. Spath. Orthogonal least squaresfitting with linear manifolds. Numer. Math., 8:441-445, 1986.
175. P. Sprent. Models in Regressionand Related Topics. Methuen, London, 1969.
176. J. Staar. Concepts for ReliableModelling of Linear Systems with Application to On-Line Identification of Multivariable State Space Descriptions. Ph.D. dissertation, Department of Electrical Engineering, Katholieke Universiteit Leuven, Leuven, Belgium, 1982.
177. G.W. Stewart. Sensitivity Coefficients forthe Effects of Errors in the Independent Variables in a Line Regression. Technical Report TR-571. Department of Computer Science, University of Maryland, College Park, MD, 1977.
178. G.W. Stewart. Matrix Algorithms, Vol. II, Eigensystems. SIAM, Philadelphia, 2001.
179. A. Stoian, P. Stoica, and S. Van Huffel. Comparative Performance Studyof Least-Squares and Total Least-Squares Yule-Walker Estimates of Autoregressive Parameters. Internal Report. Department of Automatic Control, Polytechnic Institute of Bucharest, Bucharest, Roumania, 1990.
180. W.J. Szajowski. The generation ofcorrelated Weibull clutter for signal detection problem. IEEE Trans. Aerosp. Electron. Syst., 3(5):536-540, 1977.
181. A. Taleb and G. Cirrincione. Against the convergenceof the minor component analysis neurons. IEEE Trans. Neural Netw., 0(1):207-210, Jan. 1999.
182. R.C. Thompson. Principal submatrices: IX. Interlacing inequalities forsingular values of submatrices. Linear Algebra Appl., :1-12, 1972.
183. J. Treichler. The Spectral LineEnhancer. Ph.D. dissertation, Stanford University, Stanford, CA, May 1977.
184. G. Ungerboeck. Fractional tap-spacing equalizerand consequences for clock recovery in data modems. IEEE Trans. Commun., 24:856-864, Aug. 1976.
185. T.P. Vogl, J.K. Mangis, A.K. Rigler, W.T. Zink, and D.L. Alkon. Accelerating the convergenceof the back-propagation method. Biol. Cybernet., 9:257-263, 1988.
186. L. Wang and J. Karhunen. A unified neuralbigradient algorithm for robust PCA and MCA. Int. J. Neural Syst., :53-67, 1996.
187. R.L. Watrous. Learning algorithms forconnectionist networks: applied gradient methods of nonlinear optimization. Proceedings of the IEEE First International Conference on Neural Networks, Vol. 2, pp. 619-627. IEEE, San Diego, CA, 1987.
188. G.A. Watson. Numerical methods forlinear orthogonal LP approximation. IMA J. Numer. Anal., :275-287, 1982.
189. A.R.Webb, D. Lowe, and M.D. Bedworth. A Comparison ofNon-linear Optimisation Strategies for Feed-Forward Adaptive Layered Networks. RSRE Memorandum 4157. Royal Signals and Radar Establishment, Malvern, UK, 1988.
190. J.T. Webster, R.F. Gunst, and R.L. Mason. Latent root regressionanalysis. Technometrics, 16:513-522, 1974.
191. B. Widrow and M.A. Lehr. 30 years of adaptive neural networks: perceptron, madaline, and backpropagation. Proc. IEEE, 78(9):1415-1442, Sept. 1990.
192. B. Widrow and S.D. Stearns. Adaptive Signal Processing. Prentice Hall, Englewood Cliffs, NJ, 1985.
193. J.H. Wilkinson. The Algebraic EigenvalueProblem. Clarendon Press, Oxford, UK, 1965.
194. L. Xu, A. Krzyzak, and E. Oja. Neural nets fordual subspace pattern recognition method. Int. J. Neural Syst., (3):169-184, 1991.
195. L. Xu, E. Oja, and C. Suen. Modified Hebbian learningfor curve and surface fitting. Neural Netw., :441-457, 1992.
196. X. Yang, T.K. Sarkar, and E. Arvas. A survey ofconjugate gradient algorithms for solution of extreme eigen-problems of a symmetric matrix. IEEE Trans. Acoust., Speech Signal Process., 7(10):1550-1556, Oct. 1989.
197. D. York. Least squares fittingof a straight line. Can. J. Phys., 4:1079-1086, 1966.
198. C.L. Zahm. Applications of adaptivearrays to suppress strong jammers in the presence of weak signals. IEEE Trans. Aerosp. Electron. Syst., 9:260-271, Mar. 1973.
199. F. Zhang. Matrix Theory. Springer-Verlag, New York, 1999.
200. W. Zhu, Y. Wang, Y. Yao, J. Chang, L. Graber, and R. Barbour. Iterative total leastsquaresimage reconstruction algorithm for optical tomography by the conjugate gradient method. J. Opt. Soc. Am. A, 14(4):799-807, Apr. 1997.
201. M.D. Zoltowski. Signal processing applicationsof the method of total least squares. Proceedings of the 21st Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, pp. 290-296, 1987.
202. M.D. Zoltowski and D. Stavrinides. Sensor array signalprocessing via a Procrustes rotations based eigenanalysis of the ESPRIT data pencil. IEEE Trans. Acoust. Speech Signal Process., 7:832-861, 1989.