An improved time series prediction by applying the layer-by-layer learning method to FIR neural networks

Neural Networks

Volumn 10, Issue 9, 1997, Pages 1717-1729

  Yu, Hee Yeal ^b   Bang, Sung Yang ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b NONE

Author keywords

FIR neural network; Gradient descent learning algorithm; Lorenz equation; Mackey Glass equation; Nonlinear autoregression; Optimization layer by layer; Time series prediction

Indexed keywords

LEARNING ALGORITHMS; MATHEMATICAL MODELS; NUMERICAL METHODS; OPTIMIZATION; TIME SERIES ANALYSIS;

GRADIENT DESCENT LEARNING ALGORITHM; LORENTZ EQUATION; MACKEY GLASS EQUATION; NONLINEAR AUTOREGRESSION;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; INFORMATION SYSTEM; PRIORITY JOURNAL;

EID: 0031470161     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(97)00066-X     Document Type: Article

References (23)

1. Back, A.D., & Tsoi, A.C. (1991). FIR and IIR synapses, a new neural network architecture for time series modeling. Neural Computation, 3, 375-385.
2. Baldi, P., & Hornik, K. (1989). Neural networks and principal component analysis: learning from examples without local minima. Neural Networks, 2, 53-58.
3. Chakraborty, K., Mehrotra, K., Mohan, C.K., & Ranka, S. (1992). Forecasting the behavior of multivariate time series using neural networks. Neural Networks, 5, 961-970.
4. Connor, J.T., Martin, R.D., & Atlas, L.E. (1994). Recurrent neural networks and robust time series prediction. IEEE Trans. Neural Networks, 5(2).
5. Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function. Math. Control Signals System, 2, 303-314.
6. Day, S.D., & Davenport, M.R. (1991). Continuous-time temporal back-propagation with adaptable time delays. IEEE Trans. Neural Networks.
7. Ergezinger, S., & Thomsen, E. (1995). An accelerated learning algorithm for multilayer perceptrons: optimization layer by layer. IEEE Trans. Neural Networks, 6.
8. Funahashi, K. (1989). On the approximate realization of continuous mappings by neural networks. Neural Networks, 2, 183-192.
9. Herz, A.V.M. (1991). Global analysis of parallel analog networks with retarded feedback. Phys. Rev. A, 44, 1415-1418.
10. Kleinfeld, D. (1986). Sequential state generation by model neural networks. Proc. Natl Acad. Sci., 83, 9469-9473.
11. Lang, K.J., & Hinton, G.E. (1988). The development of the time-delay neural network architecture for speech recognition. Technical Report CMU-CS-88-152, Carnegie Mellon University, Pittsburgh, PA.
12. LeCun, Y. et al. (1989). Backpropagation applied to handwritten zip code. Neural Computation, 1, 541-551.
13. Lorenz, E.N. (1963). Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130.
14. Mozer, M.C. (1993). Neural net architectures for temporal sequence processing. In A.S. Weigend and N.A. Gershenfeld (Eds.), Time Series Prediction: Forecasting the Future and Understanding the Past. Reading: Addison-Wesley.
15. Rumelhart, D.E., Hinton, G.E., & Williams, R.J. (1986). Learning representations by back-propagating errors. Nature (London), 323, 533-536.
16. Sompolinsky, H., & Kanter, I. (1986). Temporal association in asymmetric neural networks. Phys. Rev. Lett., 57, 2861-2864.
17. Takens, F. (1981). Detecting strange attractors in turbulence. In D. A. Rand and L. S. Young (eds), Lecture notes in Math., Vol. 898. Berlin: Springer-Verlag.
18. Tang, Z., de Almeida, C., & Fishwick, P.A. (1991). Time series forecasting using neural networks vs. Box-Jenkins methodology. Simulation, 57(5), 1.
19. Waibel, A., Hanazaqa, T., Hinton, G., Shikano, K., & Lang, K. (1989). Phoneme recognition using time-delay neural networks. IEEE Trans. on Acoustics, Speech, and Signal Processing, 37(3), 328-339.
20. Wan, E.A. (1990). Temporal backpropagation for FIR neural networks. IEEE International Joint Conference on Neural Networks, 1, 575-580.
21. Wan, E.A. (1993). Time series prediction by using a connectionist network with internal delay lines. In A.S. Weigend and N.A. Gershenfeld (Eds.), Time series prediction: Forecasting the future and understanding the past. Reading: Addison-Wesley.
22. Williams, R.J., & Peng, J. (1990). An efficient gradient-based algorithm for on-line training of recurrent network trajectories. Neural Computation, 2, 490-501.
23. Williams, R.J., & Zipser, D. (1989). A learning algorithm for continually running fully recurrent neural networks. Neural Computation, 1, 270-280.