A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 29, Issue 1, 1999, Pages 62-72

  Chen, C L Philip ^a,b,c   Wan, John Z ^d  

^a IEEE   (United States)

^b Wright State University   (United States)

^c AIR FORCE RESEARCH LABORATORY   (United States)

^d Elsevier and Reed Elsevier   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CHAOS THEORY; COMPUTER SIMULATION; LEARNING ALGORITHMS; LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; OPTIMIZATION; TIME SERIES ANALYSIS;

DYNAMIC STEPWISE UPDATING ALGORITHM; FLAT NEURAL NETWORKS; RAPID LEARNING;

FEEDFORWARD NEURAL NETWORKS;

EID: 0033078284     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/3477.740166     Document Type: Review

References (29)

1. P. J. Werbos, "Beyond regression: New tools for prediction and analysis in the behavioral science," Ph.D. dissertation, Harvard Univ., Cambridge, MA, Nov. 1974.
2. _, "Backpropagation through time: What it does and how to do it," Proc. IEEE, vol. 78, pp. 1550-1560, Oct. 1990.
3. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. New York: Wiley, 1992.
4. L. F. Wessels and E. Barnard, "Avoiding false local minima by proper initialization of connections," IEEE Trans. Neural Networks, vol. 3, pp. 899-905, 1992.
5. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, pp. 295-307, 1988.
6. H. Drucker and Y. le Cun, "Improving generalization performance using double backpropagation," IEEE Trans. Neural Networks, vol. 3, pp. 991-997, 1992.
7. S. J. Perantonis and D. A. Karras, "An efficient constrained learning algorithm with momentum acceleration," Neural Networks, vol. 8, no. 2, pp. 237-249, 1994.
8. D. A. Karras and S. J. Perantonis, "An efficient constrained training algorithm for feedforward networks," IEEE Trans. Neural Networks, vol. 6, pp. 1420-1434, Nov. 1995.
9. D. S. Chen and C. Jain, "A robust back propagation learning algorithm for function approximation," IEEE Trans. Neural Networks, vol. 5, pp. 467-479, May 1994.
10. Y. H. Pao and Y. Takefuji, "Functional-Link net computing, theory, system architecture, and functionalities," IEEE Comput., vol. 3, pp. 76-79, 1991.
11. Y. H. Pao, G. H. Park, and D. J. Sobajic, "Learning and generalization characteristics of the random vector functional-link net," in Neurocomputing. Amsterdam, The Netherlands: Elsevier, 1994, vol. 6, pp. 163-180.
12. B. Igelnik and Y. H. Pao, "Stochastic choice of basis functions in adaptive function approximation and the functional-link net," IEEE Trans. Neural Networks, vol. 6, pp. 1320-1329, 1995.
13. S. Chen, C. F. N. Cowan, and P. M. Grant, "Orthogonal least squares learning algorithm for radial basis function networks," IEEE Trans. Neural Networks, vol. 2, pp. 302-309, Mar. 1991.
14. D. S. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive methods," Complex Syst. 2, pp. 321-355, 1988.
15. Y. H. Pao, G. H. Park, and D. J. Sobajic, "Learning and generalization characteristics of the random vector functional-link net," in Neurocomputing. Amsterdam, The Netherlands: Elsevier, 1994, vol. 6, pp. 163-180.
16. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 4-27, 1990.
17. C. L. P. Chen, "A rapid supervised learning neural network for function interpolation and approximation," IEEE Trans. Neural Networks, vol. 7, pp. 1220-1230, Sept. 1996.
18. G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd ed. Baltimore, MD: Johns Hopkins Univ. Press, 1996.
19. M. H. Hassoun, Fundamentals of Artificial Neural Networks. Cambridge, MA: MIT Press, 1995.
20. A. Ben-Israel and T. N. E. Greville, Generalized Inverses: Theory and Applications. New York: Wiley, 1974.
21. F. H. Kishi, "On line computer control techniques and their application to re-entry aerospace vehicle control," in Advances in Control Systems Theory and Applications, C. T. Leondes, Ed. New York: Academic, 1964, pp. 245-257.
22. B. Widrow, "Generalization and information storage in networks of adaline neuron," in Self-Organizing Systems, M. C. Jovitz et al., Eds., 1962, pp. 435-461.
23. C. R. Johnson, Jr., Lectures on Adaptive Parameter Estimation. Englewood Cliffs, NJ: Prentice-Hall, 1988.
24. M. J. L. Orr, "Regularization in the selection of radial basis function centers," Neural Computat., vol. 7, pp. 606-623, 1995.
25. V. R. Vemuri and R. D. Rogers, Eds., Artificial Neural Networks: Forecasting Time Series. Los Alamitos, CA: IEEE Comput. Soc. Press, 1993.
26. A. Khotanzad, R. Hwang, A. Abaye, and D. Maratukulam, "An adaptive modular artificial neural network hourly load forecaster and its implementation at electric utilities," IEEE Trans. Power Syst., vol. 10, pp. 1716-1922, 1995.
27. S. E. Fahlman and C. Lebiere, "The cascade-correlation learning architecture," Adv. Neural Inf. Process. Syst. I, 1989.
28. A. S. Weigend and N. A. Gershenfeld Eds., Time Series Prediction, Forecasting the Future and Understanding the Past. Reading, MA: Addison-Wesley, 1994.
29. K. Chakraborty, K. Mehrotra, C. Mohan, and S. Ranka, "Forecasting the behavior of multivariate time series using neural networks," Neural Networks, vol. 5, pp. 961-970, 1992.