Local global neural networks: A new approach for nonlinear time series modeling

Journal of the American Statistical Association

Volumn 99, Issue 468, 2004, Pages 1092-1107

  Suárez Fariñas, Mayte ^a   Pedreira, Carlos E ^b   Medeiros, Marcelo C ^b,c  

^a ROCKEFELLER UNIVERSITY   (United States)

^b Department of Electrical Engineering ^*  (Brazil)

^c PONTIFICAL CATHOLIC UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Model building; Model identifiability; Neural network; Nonlinear model; Parameter estimation; Sunspot number; Time series

Indexed keywords

EID: 10844281822     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214504000001691     Document Type: Article

References (63)

1. Akaike, H. (1974), A New Look at the Statistical Model Identification, IEEE Transactions on Automatic Control, 19, 716-723.
2. Auestad, B., and Tjøstheim, D. (1990), Identification of Nonlinear Time Series: First-Order Characterization and Order Determination, Biometrika, 77, 669-687.
3. Carvalho, A. X., and Tanner, M. A. (2002a), Mixtures-of-Experts of Generalized Time Series: Consistency of the Maximum Likelihood Estimator, technical report, University of British Columbia and Northwestern University.
4. _ (2002b), Mixtures-of-Experts of Generalized Time Series: Asymptotic Normality and Model Specification, technical report, University of British Columbia and Northwestern University.
5. Chen, R. (1995), Threshold Variable Selection in Open-Loop Threshold Autoregressive Models, Journal of Time Series Analysis, 16, 461-481.
6. Chen, R., and Tsay, R. S. (1993), Functional Coefficient Autoregressive Models, Journal of the American Statistical Association, 88, 298-308.
7. Cybenko, G. (1989), Approximation by Superposition of Sigmoidal Functions, Mathematics of Control, Signals, and Systems, 2, 303-314.
8. Fan, J., and Yao, Q. (2003), Nonlinear Time Series: Nonparametric and Parametric Methods, New York: Springer-Verlag.
9. Fine, T. L. (1999), Feedforward Neural Network Methodology, New York: Springer-Verlag.
10. Funahashi, K. (1989), On the Approximate Realization of Continuous Mappings by Neural Networks, Neural Networks, 2, 183-192.
11. Gallant, A. R., and White, H. (1992), On Learning the Derivatives of an Unknown Mapping With Multilayer Feedforward Networks, Neural Networks, 5, 129-138.
12. Granger, C. W. J., and Teräsvirta, T. (1993), Modelling Nonlinear Economic Relationships, Oxford, U.K.: Oxford University Press.
13. Härdle, W. (1990), Applied Nonparametric Regression, Cambridge, U.K.: Cambridge University Press.
14. Härdle, W., Lütkepohl, H., and Chen, R. (1997), A Review of Nonparametric Time Series Analysis, International Statistical Review, 65, 49-72.
15. Heiler, S. (1999), A Survey on Nonparametric Time Series Analysis, Economics Working Papers at WUSTL 9904005, Washington University.
16. Hornik, K., Stinchombe, M., and White, H. (1989), Multi-Layer Feedforward Networks Are Universal Approximators, Neural Networks, 2, 359-366.
17. _ (1990), Universal Approximation of an Unknown Mapping and Its Derivatives Using Multi-Layer Feedforward Networks, Neural Networks, 3, 551-560.
18. Huber, P. J. (1967), The Behavior of Maximum Likelihood Estimates Under Non-Standard Conditions, in Proceedings of the Fifth Berkeley Symposium in Mathematical Statistics and Probability, Berkeley, CA: California University Press, pp. 221-223.
19. Huerta, G., Jiang, W., and Tanner, M. (2001), Mixtures of Time Series Models, Journal of Computational and Graphical Statistics, 10, 82-89.
20. _ (2003), Time Series Modeling via Hierachical Mixtures, Statistica Sinica, 13, 1097-1118.
21. Hwang, J. T. G., and Ding, A. A. (1997), Prediction Intervals for Artificial Neural Networks, Journal of the American Statistical Association, 92, 109-125.
22. Jacobs, R. A. (1990), Task Decomposition Through Computation in a Modular Connectionist Architecture, unpublished doctoral thesis, University of Massachusetts.
23. Jacobs, R. A., Jordan, M. I., Nowlan, S. J., and Hinton, G. E. (1991) Adaptive Mixtures of Local Experts, Neural Computation, 3, 79-87.
24. Jennrich, R. I. (1969), Asymptotic Properties of Non-Linear Least Squares Estimators, The Annals of Mathematical Statistics, 40, 633-643.
25. Jordan, M. I., and Jacobs, R. A. (1994), Hierarchical Mixtures of Experts and the EM Algorithm, Neural Computation, 6, 181-214.
26. Kurková, V., and Kainen, P. C. (1994), Functionally Equivalent Feedforward Neural Networks, Neural Computation, 6, 543-558.
27. Lai, T. L., and Wong, S. P.-S. (2001), Stochastic Neural Networks With Applications to Nonlinear Time Series, Journal of the American Statistical Association, 96, 968-981.
28. Leybourne, S., Newbold, P., and Vougas, D. (1998), Unit Roots and Smooth Transitions, Journal of Time Series Analysis, 19, 83-97.
29. MacKay, D. J. C. (1992a), Bayesian Interpolation, Neural Computation, 4, 415-447.
30. _ (1992b), A Practical Bayesian Framework for Backpropagation Networks, Neural Computation, 4, 448-472.
31. Medeiros, M. C., Teräsvirta, T., and Rech, G. (2002), Building Neural Network Models for Time Series: A Statistical Approach, Working Paper Series in Economics and Finance 508, Stockholm School of Economics.
32. Medeiros, M. C., and Veiga, A. (2000a), A Hybrid Linear-Neural Model for Time Series Forecasting, IEEE Transactions on Neural Networks, 11, 1402-1412.
33. _ (2000b), A Flexible Coefficient Smooth Transition Time Series Model, IEEE Transactions on Neural Networks, forthcoming.
34. _ (2002), Diagnostic Checking in a Flexible Nonlinear Time Series Model, Journal of Time Series Analysis, 24, 461-482.
35. Nowlan, S. J. (1990), Maximum Likelihood Competitive Learning, in Advances in Neural Information Processing Systems, Vol. 2, New York: Morgan Kaufmann, pp. 574-582.
36. Ozaki, T. (1982), The Statistical Analysis of Perturbed Limit Cycle Process Using Nonlinear Time Series Models, Journal of Time Series Analysis, 3, 29-41.
37. Pedreira, C. E., Pedroza, L. C., and Fariñas, M. (2001), Local-Global Neural Networks for Interpolation, in Proceedings of the 5th International Conference on Artificial Neural Networks and Genetic Algorithms, Prague, April 2001, pp. 55-58.
38. Pötscher, B. M., and Prucha, I. R. (1986), A Class of Partially Adaptive One-Step M-Estimators for the Non-Linear Regression Model With Dependent Observations, Journal of Econometrics, 32, 219-251.
39. Rech, G., Teräsvirta, T., and Tschernig, R. (2001), A Simple Variable Selection Technique for Nonlinear Models, Communications in Statistics, Part A-Theory and Methods, 30, 1227-1241.
40. Schwarz, G. (1978), Estimating the Dimension of a Model, The Annals of Statistics, 6, 461-464.
41. Sussman, H. J. (1992), Uniqueness of the Weights for Minimal Feedforward Nets With a Given Input-Output Map, Neural Networks, 5, 589-593.
42. Swanson, N. R., and White, H. (1995), A Model Selection Approach to Assesssing the Information in the Term Structure Using Linear Models and Artificial Neural Networks, Journal of Business & Economic Statistics, 13, 265-275.
43. _ (1997a), Forecasting Economic Time Series Using Flexible versus Fixed Specification and Linear versus Nonlinear Econometric Models, International Journal of Forecasting, 13, 439-461.
44. _ (1997b), A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks, Review of Economic and Statistics, 79, 540-550.
45. Tcherning, R., and Yang, L. (2000), Nonparametric Lag Selection for Time Series, Journal of Time Series Analysis, 21, 457-487.
46. Teräsvirta, T. (1994), Specification, Estimation, and Evaluation of Smooth Transition Autoregressive Models, Journal of the American Statistical Association, 89, 208-218.
47. Tjøstheim, D., and Auestad, B. (1994), Nonparametric Identification of Non-linear Time Series: Selecting Significant Lags, Journal of the American Statistical Association, 89, 1410-1419.
48. Tong, H. (1990), Non-Linear Time Series: A Dynamical Systems Approach, Oxford, U.K.: Oxford University Press.
49. Trapletti, A., Leisch, F., and Hornik, K. (2000), Stationary and Integrated Autoregressive Neural Network Processes, Neural Computation, 12, 2427-2450.
50. Tsay, R. (1989), Testing and Modeling Threshold Autoregressive Processes, Journal of the American Statistical Association, 84, 431-452.
51. van Dijk, D., Teräsvirta, T., and Franses, P. H. (2002), Smooth Transition Autoregressive Models - A Survey of Recent Developments, Econometric Reviews, 21, 1-47.
52. Vieu, P. (1995), Order Choice in Nonlinear Autoregressive Models, Statistics, 26, 307-328.
53. Weigend, A., Huberman, B., and Rumelhart, D. (1992). Predicting Sunspots and Exchange Rates With Connectionist Networks, in Nonlinear Modeling and Forecasting, eds. M. Casdagli and S. Eubank, Reading, MA: Addison-Wesley, pp. 395-432.
54. Weigend, A. S., Mangeas, M., and Srivastava, A. N. (1995), Nonlinear Gated Experts for Time Series: Discovering Regimes and Avoiding Overfitting, International Journal of Neural Systems, 6, 373-399.
55. White, H. (1981), Consequences and Detection of Misspecified Nonlinear Regression Models, Journal of the American Statistical Association, 76, 419-433.
56. _ (1990), Connectionist Nonparametric Regression: Multilayer Feedforward Networks Can Learn Arbitrary Mappings, Neural Networks, 3, 535-550.
57. _ (1994), Estimation, Inference and Specification Analysis, New York: Cambridge University Press.
58. White, H., and Domowitz, I. (1984), Nonlinear Regression With Dependent Observations, Econometrica, 52, 143-162.
59. Wong, C. S., and Li, W. K. (2000), On a Mixture Autoregressive Model, Journal of the Royal Statistical Society, Ser. B, 62, 95-115.
60. _ (2001), On a Mixture Autoregressive Conditional Heterocedastic Model, Journal of the American Statistical Association, 96, 982-995.
61. Wooldridge, J. M. (1994), Estimation and Inference for Dependent Process, in Handbook of Econometrics 4, eds. R. F. Engle and D. L. McFadden, Amsterdam: Elsevier Science, pp. 2639-2738.
62. Xia, Y., and Li, W. K. (1999), On Single-Index Coefficient Regression Models. Journal of the American Statistical Association, 94, 1275-1285.
63. Yao, Q., and Tong, H. (1994), On Subset Selection in Non-Parametric Stochastic Regression, Statistica Sinica, 4, 51-70.