Neural implementation of unconstrained minimum L1-norm optimization - least absolute deviation model and its application to time delay estimation

IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing

Volumn 47, Issue 11, 2000, Pages 1214-1226

  Wang, Zhishun ^a   Cheung, J Y ^b   Xia, Y S ^c   Chen, J D Z ^a  

^a UNIVERSITY OF TEXAS MEDICAL BRANCH   (United States)

^b University of Oklahoma   (United States)

^c NANJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

Author keywords

[No Author keywords available]

Indexed keywords

GAUSSIAN NOISE (ELECTRONIC); MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; PARAMETER ESTIMATION; REGRESSION ANALYSIS; SPECTRUM ANALYSIS;

AUTOREGRESSIVE MOVING AVERAGE; HIGHER ORDER SPECTRA; LEAST ABSOLUTE DEVIATION MODEL; LINEAR PREDICTOR; TIME DELAY ESTIMATION;

DIGITAL SIGNAL PROCESSING;

EID: 0034318646     PISSN: 10577130     EISSN: None     Source Type: Journal    
DOI: 10.1109/82.885129     Document Type: Article

References (38)

1. A. Cichocki and R. Unbehauen, Neural networks for solving systems of linear equations-Part II: Minimax and least absolute value problems, IEEE Trans. Circuits Syst. II, vol. 39, pp. 619-633, Sept. 1992.
2. Neural Networks for Computing, Optimization and Signal Processing. Stuttgart, Germany: Teubner-Wiley, 1993.
3. C. A. Zala, I. Barrodale, and J. S. Kennedy, High-resolution signal and noise field estimation using the LI (least absolute values) norm, IEEE J. Oceanic Eng., vol. OE-12, pp. 253-264, 1987.
4. I. Barrodale and C. A. Zala, Li and Lx curve fitting and linear programming algorithms and applications, in Numerical Algorithms, J. L. Mohamed and J. E. Walsh, Eds. Oxford, U.K.: Oxford Univ. Press, 1986, ch. 11, pp. 220-238.
5. J. W. Bandler, W. Kellerman, and K. Madsen, A nonlinear L i optimization algorithm for design, modeling, and diagnosis of networks, IEEE Trans. Circuits Syst., vol. CAS-34, pp. 174-181, Feb. 1987.
6. N. N. Abdelmalek and N. Ostu, Restoration of images with missing high-frequency components by minimizing the LI norm of the solution vector, Appl. Opt., vol. 24, pp. 1415-1420, 1986.
7. P. Bloomfield and W. L. Steiger, Least Absolute Deviations: Theory Applications and Algorithms. Boston, MA: Brikhäuser, 1983.
8. R. K. Ward, An on-line adaptation for discrete LI linear estimation, IEEE Trans. Automat. Contr., vol. AC-29, pp. 67-71, Jan. 1984.
9. S. A. Ruzinsky and E. T. Olsen, Li and Lx minimization via a variant of Karmarkar's algorithm, IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-37, pp. 245-253, Feb. 1989.
10. S. Levy, C. Walker, T. J. Ulrych, and P. K. Fullagar, A linear programming approach to the estimation of the power spectra of harmonic processes, IEEE Trans. Acoust. Speech, Signal Processing, vol. 30, pp. 675-679, Sept. 1992.
11. J. J. Hopfield and D. W. Tank, Neural computation of decisions in optimization problems, Biol. Cybern., vol. 52, pp. 141-152, 1985.
12. D. W. Tank and J. J. Hopdield, Simple neural optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit, IEEE Trans. Circuits Syst., vol. CAS-33, pp. 533-541, 1986.
13. M. P. Kennedy and L. O. Chua, Neural networks for nonlinear programming, IEEE Trans. Circuits Syst., vol. CAS-35, pp. 554-562, 1988.
14. C. Y. Maa and M. A. Shanblatt, A two-phase optimization neural network, IEEE Trans. Neural Networks, vol. 3, pp. 1003-1009, 1992.
15. S. Sudharsannan and M. Sundareshan, Exponential stability and a systematic synthesis of a neural network for quadratic minimization, Neural Networks, vol. 4, pp. 599-613, 1991.
16. X. Wu, Y. Xia, J. Li, and W. K. Chen, A high performance neural network for solving linear and quadratic programming problems, IEEE Trans. Neural Networks, vol. 7, pp. 525-529, Mar. 1996.
17. Y S. Xia, A new neural network for solving linear programming problems and its application, IEEE Trans. Neural Networks, vol. 7, pp. 525-529, 1996.
18. Y S. Xia and J. Wang, A general methodology for designing globally convergent optimization neural networks, IEEE Trans. Neural Networks, vol. 9, pp. 1331-1343, Nov. 1998.
19. A. Rodriquez-Vazquez, R. Dominquez-Castro, A. Rueda, J. L. Huertas, and E. Sanchez-Sinencio, Nonlinear switched-capacitor neural networks for optimization problems, IEEE Trans. Circuits Syst., vol. CAS-37, pp. 384-398, 1990.
20. G. C. Carter, Time delay estimation for passive sonar signal processing, IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-29, pp. 46370, 1981.
21. D. H. Johnson, The application of spectrum estimation methods to bearing estimation problems, Proc. IEEE, vol. 70, pp. 1018-1028, 1982.
22. C. H. Knapp and C. Clifford, The generalized correlation method for estimation of time delay, IEEE Trans. Acoust., Speech, Signal Processing, vol. 24, pp. 320-327, 1976.
23. X. L. Xu, A. H. Tewfik, and J. F. Greenleaf, Time delay estimation using wavelet transform for pulsed-wave ultrasound, Ann. Biomed. Eng., vol. 23, pp. 612-621, 1995.
24. J. M. Mendel, Tutorial on higher-order statistics (spectra) in signal processing and system theory: Theoretical results and some applications, Proc. IEEE, vol. 79, pp. 278-305, 1991.
25. C. L. Nikias and J. M. Mendel, Signal processing with higher-order spectra, IEEE Signal Processing Mag., vol. 10, pp. 10-37, 1993.
26. C. L. Nikias and M. R. Raghuveer, Bispectrum estimation: A digital signal processing framework, Proc. IEEE, vol. 75, pp. 869-891, 1987.
27. C. L. Nikias and R. Pan, Time delay estimation in unknown Gaussian spatially correlated noise, IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 1706-1714, 1988.
28. C. L. Nikias and A. Petropulu, Higher-Order Spectra Analysis: A Nonlinear Signal Processing Framework. Englewood Cliffs, NJ: PrenticeHall, 1993.
29. A. Swami, J. M. Mendel, and C. L. Nikias, MATLAB Higher-Order Spectral Analysis Toolbox User's Guide: The MathWorks Inc., 1998. Version 2.
30. R. K. Miller and A. N. Michel, Ordinary Differential Equations. New York: Academic, 1982.
31. D. G. Luenberger, Introduction to Linear and Nonlinear Programming. New York: Addison-Wesley, 1973.
32. J. LaSalle, Stability theory for ordinary differential equations, J. Diff. Eq., vol. 4, pp. 57-65, 1968.
33. J. LaSalle and S. Lefschetz, Stability by Lyapunov 's Direct Method with Applications. New York: Academic, 1961.
34. J. LaSalle, The Stability of Dynamical Systems. Philadelphia, PA: SIAM, 1976.
35. D. Kinderlehrer and G. Stampcchia, An Introduction to Variational Inequalities and Their Applications. New York: Academic, 1980.
36. Y Tsividis and D. Anastassiou, Switched-capacitor neural networks, Electron. Lett., vol. 23, pp. 958-959, 1987.
37. A. Cichocki, J. Ramirez-Angulo, and R. Unbehauen, Architectures for analog VLSI implementation of neural networks for solving linear equations with inequality contraints, in Proc. IEEE Int. Symp. Circuits and Systems, May 1992.
38. A. Cichocki and R. Unbehauen, Switched-capacitor neural networks of linear equations and related problems, IEEE Trans. Circuits Syst. I, vol. 39, pp. 124-138, Feb. 1992.