A network of autoregressive processing units for time series modeling

Applied Mathematics and Computation

Volumn 75, Issue 2-3, 1996, Pages 151-165

  Lehtokangas, Mikko ^a   Saarinen, Jukka ^a   Kaski, Kimmo ^a   Huuhtanen, Pentti ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0003064744     PISSN: 00963003     EISSN: None     Source Type: Journal    
DOI: 10.1016/0096-3003(95)00122-0     Document Type: Article

References (27)

1. G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control, Holden-Day, San Francisco, 1970.
2. H. Tong, Non-Linear Time Series, A Dynamical System Approach, Oxford University Press, Oxford, UK, 1990.
3. D. Rumelhart, G. E. Hinton, and R. J. Williams, Learning internal representations by error propagation, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. Rumelhart, J. L. McClelland and the PDF Research Group, Eds., MIT Press, Cambridge, MA, 1986, ch. 8, pp. 318-362.
4. A. S. Lapades, and R. M. Farber, Nonlinear signal processing using neural networks: prediction and system modeling, Technical Report LA-UR-87-2662, Los Alamos National Laboratory, 1987.
5. A. S. Weigend, B. A. Huberman, and D. Rumelhart, Predicting the future: a connectionist approach. Int. J. Neural Systems, 1 (3):193-209 (1990).
6. J. Moody, and C. J. Darken, Fast learning in networks of locally-tuned processing units. Neural Computation, 1:281-294 (1989).
7. S. Chen, C. F. N. Cowan, and P. M. Grant, Orthogonal least squares learning algorithm for radial basis function networks. IEEE Trans. Neural Networks, 2 (2):302-309 (1991).
8. J. Rissanen, Stochastic Complexity in Statistical Inquiry, Series in Computer Science, World Scientific Publishing, Singapore, 1989, vol. 15.
9. T. Kohonen, Self-Organization and Associative Memory, 3rd ed. Springer-Verlag, Berlin, 1989.
10. J. T. Tou, and R. C. Gonzalez, Pattern Recognition Principles, Addison-Wesley, London, 1974.
11. R. Shibata, Various model selection techniques in time series analysis, in Handbook of Statistics, E. J. Hannan, P. R. Krishnaiah, and M. M. Rao, Eds., 1985, vol. 5, pp. 179-187.
12. J. Rissanen, Modelling by shortest data description. Automatica, 14:465-471 (1978).
13. R. J. Solomonoff, A formal theory of inductive inference, Part 1: Information and Control, 7:1-22 (1964);
14. R. J. Solomonoff, A formal theory of inductive inference, Part 1: Information and Control, Part II: Information and Control, 7, 224-254 (1964).
15. A. N. Kolmogorov, Three approaches to the quantitative definition of information, Problems of Information Transmission, 1:4-7 (1965).
16. G. J. Chaitin, On the length of programs for computing finite binary sequences, J. Assoc. Comp. Mach., 13:547-569 (1966).
17. H. Akaike, On entropy maximization principle, in Applications of Statistics, P. R. Krishnaiah, Ed., North-Holland, Amsterdam, 1977, pp. 27-41.
18. J. Rissanen, A universal prior for integers and estimation by minimum description length, Ann. Statitstics, 11 (2):416-431 (1983).
19. J. Rissanen, Universal coding, information, prediction, and estimation, IEEE Trans. Information Theory, IT-30 (4):629-636 (1984).
20. J. Rissanen, Stochastic complexity and modeling, Ann. Statistics, 14 (3): 1080-1100 (1986).
21. J. Rissanen, Stochastic complexity, J. Roy. Statistical Society, (Series B) 49 (3):223-239; 252-265 (1987).
22. B. S. Clarke and A. R. Barron, Jeffreys' prior to asymptotically least favorable under entropy risk, to appear in J. Statistical Planning and Inference, (1993) (to appear)
23. J. Rissanen, Fisher information and stochastic complexity, (submitted to IEEE Trans. Information Theory, 1993)
24. J. Rissanen, Information theory and neural nets, to appear in Mathematical Perspectives on Neural Networks, P. Smolensky, M. Mozer, and D. Rumelhart, Eds., Laurence Erlbaum Associates, 1994.
25. M. Lehtokangas, J. Saarinen, P. Huuhtanen, and K. Kaski, Neural network prediction of nonlinear time series using predictive MDL principle, Proceedings of IEEE Winter Workshop on Nonlinear Digital Signal Processing, Tampere, Finland, Jan. 17-20, 1993, pp. 7.2-2.1-7.2-2.6.
26. M. Lehtokangas, J. Saarinen, P. Huuhtanen, and K. Kaski, Neural network modeling and prediction of multivariate time series using predictive MDL principle, Proceedings of International Conference on Artificial Neural Networks, ICANN-93, Amsterdam, The Netherlands, Sept. 13-16, 1993, pp. 826-829.
27. M. Lehtokangas, J. Saarinen, P. Huuhtanen, and K. Kaski, Chaotic time series modeling with optimum neural network architecture, Proceedings of International Joint Conference on Neural Networks, IJCNN-93, Nagoya, Japan, Oct. 25-29, 1993, pp. 2276-2279.