A new regression estimator with neural network realization

IEEE Transactions on Signal Processing

Volumn 53, Issue 2 I, 2005, Pages 672-685

  Xia, Youshen ^a   Leung, Henry ^a   Xie, Nan ^a   Bossé, Eloi ^b  

^a UNIVERSITY OF CALGARY   (Canada)

^b DEFENCE RESEARCH AND DEVELOPMENT CANADA VALCARTIER   (Canada)

Author keywords

Estimation; Global convergence; Quadratic programming; Recurrent neural network; Regression

Indexed keywords

ASYMPTOTIC STABILITY; COMPUTER SIMULATION; CONVERGENCE OF NUMERICAL METHODS; EIGENVALUES AND EIGENFUNCTIONS; MATRIX ALGEBRA; NEURAL NETWORKS; OPTIMIZATION; QUADRATIC PROGRAMMING; REGRESSION ANALYSIS; THEOREM PROVING;

GLOBAL CONVERGENCE; RECURRENT NEURAL NETWORK; REGRESSION ESTIMATOR; SIGNAL ESTIMATION;

SIGNAL PROCESSING;

EID: 13244268420     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2004.838929     Document Type: Article

References (21)

1. V. Cherkassky and E. Mulier. Learning Form Data. New York: Wiley, 1998.
2. E. S. Bradley, U. M. Fayyad, and O. L. Mangasarian, "Mathematical Programming for Data Mining: Formulations and Challenges," Comput. Sci. Dept. Univ. Wisconsin, Madison, WI, Mathematical Programming Tech. Rep. 98-01. 1998.
3. S. Haykin, Adaptive Filter Theory. Englewood Cliffs. NJ: Prentice-Hall. 1991.
4. W. Li and J. Swetits, "A newton method for convex regression, data smoothing, and quadratic programming with bounded constraints." SIAM J. Optimiz., vol. 3, pp. 466-488. 1993.
5. W. Li and J. Swetits, "A new algorithm for solving strictly convex quadratic programs," SIAM J. Optimiz., vol. 7, pp. 595-619, 1997.
6. S. P. Bradley, A. C. Hax, and T. L. Magnanti, Applied Mathematical Programming. Reading, MA: Addison-Wesley, 1977.
7. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chicester, U.K.: Wiley, 1993.
8. M. P. Kennedy and L. O. Chua. "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, pp. 554-562. May 1988.
9. S. Zhang and A. G. Constantinides. "Lagrange programming neural networks," IEEE Trans. Circuits Syst. II, vol. 39, no. 7, pp. 441-452. Jul. 1992.
10. A. Bouzerdoum and T. R. Pattison, "Neural network for quadratic optimization with bound constraints," IEEE Trans. Neural Networks vol. 4. pp. 293-304, Mar. 1993.
11. S. H. Zǎk, V. Upatising, and S. Hui, "Solving linear programming problems with neural networks: A comparative study," IEEE Trans. Neural Networks, vol. 6, pp. 94-104. Jan. 1995.
12. Y. S. Xia, "A new neural network for solving linear and quadratic programming problems." IEEE Trans. Neural Networks. vol. 7, pp. 1544-1547, Nov. 1996.
13. Y. S. Xia, "Design Methodology and Stability Analysis of Recurrent Neural Networks for Constrained Optimization," Ph.D. dissertation, Chinese Univ. Hong Kong Press, Hong Kong, 2000.
14. W. X. Zheng, "A least-squares based method for autoregressive signal in presence of noise," IEEE Trans. Circuits Syst. II, vol. 46, no. 1, pp. 81-85, Jan. 1999.
15. W. X. Zheng, "Autoregressive parameter estimation from noise data" IEEE Trans. Circuits Syst. II, vol. 47, no. 1. pp. 71-75. Jan. 2000.
16. J. S. Pang and J. C. Yao. "On a generalization of a normal map and equation." SIAM J. Conte Optimiz., vol. 33. pp. 168-184. 1995.
17. D. Kinderlehrer and G. Stampcchia. An Introduction to Variational Inequalities and Their Applications. Rome, Italy: Academic, 1980.
18. Y. S. Xia and J. Wang, "A general methodology for designing globally convergent optimization neural networks," IEEE Trans. Neural Networks, vol. 9. no. 6. pp. 1331-1343. Nov. 1998.
19. J. Wang and Y. S. Xia, "Analysis and design of primal-dual assignment networks," IEEE Trans. Neural Networks, vol. 9. pp. 183-194, Jan. 1998.
20. R. W. Cottle. J.-S. Pang, and R. E. Stone. The Linear Complementarity Problem. Boston. MA: Academic. 1992.
21. M. H. J. Gruber. Regression Estimators: A Comparative Study. San Diego. CA: Academic. 1990.