Cooperative recurrent neural networks for the constrained L1 estimator

IEEE Transactions on Signal Processing

Volumn 55, Issue 7 I, 2007, Pages 3192-3206

  Xia, Youshen ^a   Kamel, Mohamed S ^b  

^a FUZHOU UNIVERSITY   (China)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Constrained least absolute deviation (LAD) estimation; Cooperative recurrent neural networks (CRNNs); Global convergence; Linear parameter estimation

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; CONTINUOUS TIME SYSTEMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; PARAMETER ESTIMATION;

GLOBAL CONVERGENCE; LEAST ABSOLUTE DEVIATION; LEAST-SQUARE ESTIMATOR;

RECURRENT NEURAL NETWORKS;

EID: 34347377562     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.894379     Document Type: Article

References (40)

1. S. Haykin, Adeptive Filter Theory. Englewood Cliffs, NJ: Prentice-hall, 1991.
2. Y. Dodge and J. Jana, Adaptive Regression. New York: Springer, 2000.
3. 1 solution to an overdetermined linear system," SIAM J. Numer. Anal., pp. 224-241, 1978.
4. C. Zala, I. Barrodale, and J. Kennedy, "High-resolution signal and noise field estimation using the L1 (least absolute values) norm," IEEE J. Ocean. Eng., vol. OE-12, no. 1, pp. 253-264, Jan. 1987.
5. p norm estimation algorithm," IEEE Trens. Signal Process., vol. 42, no. 5, pp. 1063-1073, May 1994.
6. J. M. Chen and B. S. Chen, "System parameter estimation with input/ output noisy data and missing measurements," IEEE Trans. Signal Process., vol. 48, no. 6, pp. 1548-1558, Jun. 2000.
7. D. Erdogmus D. and J. C. Principe, "An error-entropy minimum algorithm for supervised training of nonlinear adaptive systems," IEEE Trans. Signal Process., vol. 50, no. 7, pp. 1780-1786, Jul. 2002.
8. ∞ minimization via a variant of Karmarkar's algorithm," IEEE Trans. Signal Process. vol. 37, no. 2, pp. 245-253, Feb. 1989.
9. 2 norms with application to Bayesian-estimation," IEEE Trans. Signal Process., vol. 42, no. 3, pp. 618-527, Mar. 1994.
10. 1 estimator and the Huber M-estimator," SIAM J. Optimization, vol. 8, pp. 457-475, 1998.
11. ∞ norm approximate solutions an overdetermined system of linear equations," Digit. Signal Process., vol. 12, pp. 524-560, 2002.
12. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. New York: Wiley, 1993.
13. X. S. Zhang, Neural Networks in Optimization. Norwell, MA: Kluwer, 2000.
14. K. Urahama, "Gradient projection neual network: Analog solver for linearly constrained nonlinear programming," Neural Computation, vol. 8, pp. 1061-1074, 1996.
15. E. K. P. Chong, S. Hui, and S. H. Zak, "An analysis of a class of neural networks for solving linear programming problems," IEEE Trans. Autom. Control, vol. 44, no. 11, pp. 1995-2006, Nov. 1999.
16. X. Liang and J. Wang, "A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1251-1262, Nov. 2000.
17. Y. S. Xia and J. Wang, "A general projection neural network for solving monotone variational inequality and related optimization problems," IEEE Trens. Neural Netw., vol. 15, no. 2, pp. 318-328, Mar. 2004.
18. Y. S. Xia, G. Feng, and J. Wang, "A primal-dual neural network for on-line resolving constrained kinematic redundancy," IEEE Trans. Syst., Man Cybern. B, Cybern., vol. 35, no. 1, pp. 54-64, Feb. 2005.
19. Y. S. Xia, H. Leung, N. Xie, and E. Bossé, "A new regression estimator with neural network realization," IEEE Trans. Signal Process., vol. 53, no. 2, pp. 672-685, Feb. 2005.
20. G. Auda and M. S. Kamel, "CMNN: Cooperative modular neural networks for pattern recognition," Pettern Recog. Lett., vol. 18, pp. 1391-1398, Nov. 1997.
21. G. Auda and M. S. Kamel, "CMNN: Cooperative modular neural network," Neurocomput., vol. 20, pp. 189-207, 1998.
22. T. Caelli, L. Guan, and W. Wen, "Modularity in neural computing," Proc. IEEE, vol. 87, no. 9, pp. 1497-1518, Sep. 1999.
23. M. M. Islam, X. Yao, and K. Murase, "A constructive algorithm for training cooperative neural network ensembles," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 820-834, Jul. 2003.
24. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
25. A. Bouzerdoum and T. R. Pattison, "Neural network for quadratic optimization with bound constraints," IEEE Trans. Neural Netw., vol. 4, no. 2, pp. 293-304, Mar. 1993.
26. A. Cichocki and R. Unbehauen, "Neural networks for solving systems of linear equations. II. Minimax and least absolute value problems," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 39, no. 9, pp. 619-633, Sep. 1992.
27. 1 norm optimization approach for fault diagnosis of nonlinear circuits with tolerance," IEEE Proc. Circuit Devices, vol. 148, no. 4, pp. 223-229, Aug. 2001.
28. Y. S. Xia, "Neural network for solving extended linear programming," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 803-806, May 1997.
29. 1 -norm optimization-least absolute deviation model and its applications to time delay estimation," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, no. 11, pp. 1214-1226, Nov. 2000.
30. L. Guan, "An optimal neuron evolution algorithm for constrained quadratic programming in image restoration," IEEE Trans. Syst., Man Cybern. A, Syst. Humans, vol. 26, no. 4, pp. 513-518, Jul. 1996.
31. Z. Tian, K. L. Bell, and H. L. Van Trees, "A recursive least squares implementation for LCMP beamforming under quadratic constraint," IEEE Trans. Signal Process., vol. 49, no. 6, pp. 1138-1145, Jun. 2001.
32. 1 norm estimation," IEEE Trans. Signal Process., vol. 40, no. 1, pp. 159-168, Jan. 1992.
33. M. D. Plumbley and E. Oja, "A "nonnegative PCA" algorithm for independent component analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 66-76, Jan. 2004.
34. W. X. Zheng, "Adaptive filter design subject to output envelope constraints and bounded input noise," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 50, no. 12, pp. 1023-1027, Dec. 2003.
35. W. X. Zheng, "Autoregressive parameter estimation from noise data," IEEE Trans. Circuits Syst. II, Analog, Digit. Signal Process., vol. 47, no. 1, pp. 71-75, Jan. 2000.
36. 1 -norm solutions for underdetermined source separation," IEEE Trans. Signal Process., vol. 52, no. 3, pp. 582-591, Mar. 2004.
37. M. S. Bazaraa, H. D. Sherali, and C. M. Shetty, Nonlinear Programming: Theory and Algorithms. New York: Wiley, 1993.
38. D. Kinderlehrer and G. Stampcchia, An Introduction to Variational Inequalities and Their Applications. New York: Academic, 1980.
39. P. S. Bradley, U. M. Fayyad, and O. L. Mangasarian, "Mathematical programming for data mining: Formulations and challenges," Comput. Sci. Dept., Univ. Wisconsin, Madison, WI, Math. Program. Tech. Rep. 98-01, 1998.
40. Q. Tao and T. J. Fang, "The neural network model for solving minimax problems with constraints," Control Theory Control Appl., vol. 17, no. 1, pp. 82-84, 2000, (Chinese Ed.).