Refining accuracy of environmental data prediction by MoG neural networks

Neurocomputing

Volumn 55, Issue 3-4, 2003, Pages 521-549

  Panella, M ^a   Rizzi, A ^a   Martinelli, G ^a  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Environmental data prediction; Mixture of Gaussian neural networks; Phase space prediction; Twofold prediction

Indexed keywords

APPROXIMATION THEORY; CHAOS THEORY; COST EFFECTIVENESS; DATA REDUCTION; ENVIRONMENTAL ENGINEERING; FORECASTING; PROBLEM SOLVING;

ENVIRONMENTAL DATA SEQUENCES; PREDICTION ERRORS;

NEURAL NETWORKS;

ACCURACY; ALGORITHM; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; ENVIRONMENTAL MONITORING; INFORMATION PROCESSING; MATHEMATICAL COMPUTING; NORMAL DISTRIBUTION; PREDICTION AND FORECASTING; PRIORITY JOURNAL; TIME SERIES ANALYSIS;

EID: 0344394525     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(03)00392-8     Document Type: Article

References (60)

1. H.D.I. Abarbanel, Analysis of Observed Chaotic Data, Springer, New York, 1996.
2. H.D.I. Abarbanel, T.W. Frison, L.S. Tsimring, Obtaining order in a world of chaos, IEEE Signal Process. Mag. 15 (3) (1998) 49-65.
3. H.D.I. Abarbanel, M.B. Kennel, Local false neighbours and dynamical dimensions from observed chaotic data, Phys. Rev. E 47 (1993) 3057-3068.
4. M. Banbrook, G. Ushaw, S. McLaughlin, How to extract Lyapunov exponents from short and noisy time series, IEEE Trans. Signal Process. 45 (5) (1997) 1378-1382.
5. C.M. Bishop, Mixture density networks, Technical Report NCRG/94/004, Neural Computing Research Group, Aston University, Birmingham, UK, 1994.
6. C.M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, New York, 1995.
7. G.E.P. Box, G.M. Jenkins, Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco, CA, 1976.
8. L. Breiman, J.H. Friedman, R.A. Olshen, C.J. Stone, Classification and Regression Trees, Wadsworth, Belmont, CA, 1984.
9. R. Brown, P. Bryant, H.D.I. Abarbanel, Computing the Lyapunov spectrum of a dynamical system from an observed time series, Phys. Rev. A 43 (6) (1991) 2787-2806.
10. M. Casdagli, Nonlinear prediction of chaotic time series, Physica D 35 (1989) 335-356.
11. S. Chiu, Fuzzy model identification based on cluster estimation, J. Intell. Fuzzy Syst. 2 (3) (1994) 267-278.
12. V. Cherkassky, D. Gehring, Comparison of adaptive methods for function estimation from samples, IEEE Trans. Neural Networks 7 (4) (1996) 969-984.
13. V. Cherkassky, H. Lari-Najafi, Constrained topological mapping for nonparametric regression analysis, Neural Networks 4 (1991) 27-40.
14. C.-C. Chuang, S.-F. Su, S.-S. Chen, Robust TSK fuzzy modeling for function approximation with outliers, IEEE Trans. Fuzzy Syst. 9 (6) (2001) 810-821.
15. Gb. Cicioni, F. Masulli, Computational intelligence in hydroinformatics: a review, in: M. Marinaro, R. Tagliaferri (Eds.), Proceedings of WIRN'99, Springer, Berlin, 2000.
16. D.A. Cohn, Z. Ghahramani, M.I. Jordan, Active learning with statistical models, J. Artif. Intell. Res. 4 (1996) 129-145.
17. J.T. Connor, R.D. Martin, L.E. Atlas, Recurrent neural networks and robust time series prediction, IEEE Trans. Neural Networks 5 (1994) 240-254.
18. T.M. Cover, Estimation by the nearest neighbor rule, IEEE Trans. Inf. Theory 14 (1968) 50-55.
19. G. Cybenko, Approximation by superposition of a sigmoidal function, Math. Control Signals Syst. 2 (1989) 303-314.
20. A.P. Dempster, N.M. Laird, D.B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J. Roy. Stat. Soc. Ser. B 39 (1977) 1-38.
21. J.D. Farmer, J.J. Sidorowich, Predicting chaotic time series, Phys. Rev. Lett. 59 (8) (1987) 845-848.
22. A.M. Fraser, H.L. Swinney, Independent coordinates for strange attractors from mutual information, Phys. Rev. A 33 (2) (1986) 1134-1140.
23. J.H. Friedman, Multivariate adaptive regression splines, Ann. Stat. 19 (1991) 1-141.
24. J.H. Friedman, An overview of predictive learning and function approximation, in: V. Cherkassky, J.H. Friedman, H. Wechsler (Eds.), From Statistics to Neural Networks: Theory and Pattern Recognition Applications, NATO ASI Series F, Vol. 136, Springer, Berlin, 1994.
25. J.H. Friedman, W. Stuetzle, Projection pursuit regression, J. Am. Stat. Assoc. 76 (1981) 817-823.
26. K. Funahashi, On the approximate realization of continuous mappings by neural networks, Neural Networks 2 (1989) 183-192.
27. Z. Ghahramani, Solving inverse problems using an EM approach to density estimation, in: M.C. Mozer, P. Smolensky, D.S. Touretzky, J.L. Elman, A.S. Weigend (Eds.), Proceedings of the 1993 Connectionist Models Summer School, Erlbaum Associates, Hillsdale, NJ, 1994, pp. 316-323.
28. S. Haykin, Neural Networks, A Comprehensive Foundation, 2nd Edition, Prentice-Hall, Englewood Cliffs, NJ, 1999.
29. S. Haykin, X.B. Li, Detection of signals in chaos, Proc. IEEE 83 (1) (1995) 94-122.
30. S. Haykin, J.C. Principe, Making sense of a complex world, IEEE Signal Process. Mag. 15 (3) (1998) 66-81.
31. K. Hornik, M. Stinchcombe, H. White, Multilayer feedforward networks are universal approximators, Neural Networks 2 (1989) 359-366.
32. G. Janacek, L. Swift, Time Series Forecasting, Simulation, Applications, Ellis Horwood, Chichester, UK, 1993.
33. J.-S.R. Jang, C.-T. Sun, E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence, Prentice-Hall, Upper Saddle River, NJ, 1997.
34. M.B. Kennel, R. Brown, H.D.I. Abarbanel, Determining minimum embedding dimension using a geometrical construction, Phys. Rev. A 45 (1992) 3403-3411.
35. T. Kohonen, Self-Organization and Associative Memory, Springer, Berlin, 1989.
36. E. Kononov, Visual Recurrence Analysis (VRA), Software Version 4.2, November 15, 1999, Available from: http://pw1.netcom.com/~eugenek.
37. B. Kosko, Fuzzy systems as universal approximators, IEEE Trans. Comput. 43 (1994) 1329-1333.
38. M.C. Mackey, L. Glass, Oscillation and chaos in physiological control systems, Science 197 (1977) 287-289.
39. R. Mañé, On the dimension of the compact invariant sets of certain non-linear maps, in: D.A. Rang, L.-S. Young (Eds.), Dynamical Systems and Turbulence, Lecture Notes in Mathematics, Vol. 898, Springer, Berlin, Warwick, 1981, pp. 230-242.
40. F. Masulli, L. Studer, Time series forecasting and neural networks, in: Proceedings of IJCNN'99, Washington, DC, USA, July 10-16, 1999.
41. G.J. McLachlan, K.E. Basford, Mixture Models: Inference and Applications to Clustering, Marcel Dekker, New York, 1988.
42. M. Panella, F.M. Frattale Mascioli, A. Rizzi, G. Martinelli, Optimisation of Bayesian classifiers by using a splitting hierarchical EM algorithm, Proceedings of NC'2000, Berlin, Germany, May 23-26, 2000.
43. M. Panella, A. Rizzi, F.M. Frattale Mascioli, G. Martinelli, A Constructive EM Approach to Density Estimation for Learning, in: Proceedings of IJCNN 2001, Washington, DC, USA, Vol. 4, July 14-19, 2001, pp. 2608-2613.
44. M. Panella, A. Rizzi, F.M. Frattale Mascioli, G. Martinelli, Improved time series forecasting by a twofold neural predictor, in: Proceedings of EANN 2001, Cagliari, Italy, July 16-18, 2001, pp. 196-203.
45. M. Panella, A. Rizzi, F.M. Frattale Mascioli, G. Martinelli, Constructive MoG neural networks for pollution data forecasting, in: Proceedings of IJCNN 2002, Honolulu, Hawaii, USA, May 12-17, 2002, pp. 417-422.
46. A. Papoulis, Probability, Random Variables, and Stochastic Processes, International Edition, McGraw-Hill, New York, 1991.
47. T. Poggio, F. Girosi, Networks for approximation and learning, Proc. IEEE 78 (9) (1990) 1481-1497.
48. J.C. Principe, L. Wang, M.A. Motter, Local dynamic modeling with self-organizing maps and applications to nonlinear system identification and control, Proc. IEEE 86 (11) (1998) 2240-2258.
49. A.V. Rao, D.J. Miller, K. Rose, A. Gersho, A deterministic annealing approach for parsimonious design of piecewise regression models, IEEE Trans. Pattern Anal. Mach. Intell. 2 (2) (1999) 159-173.
50. A.N. Refenes, A. Zapranis, G. Francis, Stock performance modeling using neural networks: a comparative study with regression models, Neural Networks 7 (1994) 375-388.
51. K. Rose, Deterministic annealing for clustering, compression, classification, regression, and related optimization problems, Proc. IEEE 86 (11) (1998) 2210-2239.
52. F. Takens, Detecting strange attractors in turbulence, in: D.A. Rang, L.-S. Young (Eds.), Dynamical Systems and Turbulence, Lecture Notes in Mathematics, Vol. 898, Springer, Berlin, Warwick, 1981, pp. 366-381.
53. S. Theodoridis, K. Koutroumbas, Pattern Recognition, Academic Press, San Diego, CA, 1998.
54. A.N. Tikhonov, V.Y. Arsenio, Solutions of Ill-posed Problems, W.H. Winston, Washington, DC, 1977.
55. M. Tipping, C.M. Bishop, Mixtures of probabilistic principal component analyzers, Neural Comput. 11 (2) (1999) 443-482.
56. N. Ueda, R. Nakano, Deterministic annealing EM algorithm, Neural Networks 11 (1998) 271-282.
57. N. Ueda, R. Nakano, Z. Ghahramani, G.E. Hinton, SMEM algorithm for mixture models, Neural Comput. 12 (9) (2000) 2109-2128.
58. R. Valutard, P. You, M. Ghil, Singular-spectrum analysis: a toolkit for short, noisy chaotic signals, Physica D 58 (1992) 95-126.
59. A.S. Weigend, N.A. Gershenfeld, Time Series Prediction: Forecasting the Future and Understanding the Past, Addison-Wesley, Reading, MA, 1994.
60. H. White, Learning in artificial neural networks: a statistical perspective, Neural Comput. 1 (4) (1989) 425-464.