Nonlinear multivariate and time series analysis by neural network methods

Reviews of Geophysics

Volumn 42, Issue 1, 2004, Pages

  Hsieh, William W ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Canonical correlation analysis; El Ni o; Neural networks; Principal component analysis; Singular spectrum analysis

Indexed keywords

ARTIFICIAL NEURAL NETWORK; DATA PROCESSING; DATA SET; EL NINO-SOUTHERN OSCILLATION; PRINCIPAL COMPONENT ANALYSIS; QUASI-BIENNIAL OSCILLATION; TIME SERIES ANALYSIS;

EID: 1842766765     PISSN: 87551209     EISSN: None     Source Type: Journal    
DOI: 10.1029/2002RG000112     Document Type: Article

References (84)

1. Aires, F., A. Chédin, and J. P. Nadal (2000), Independent component analysis of multivariate time series: Application to the tropical SST variability, J. Geophys. Res., 105(D13), 17,437-17,455.
2. Baldwin, M., et al. (2001), The quasi-biennial oscillation, Rev. Geophys., 39, 179-229.
3. Barnett, T. P., and R. Preisendorfer (1987), Origins and levels of monthly and seasonal forecast skill for United States surface air temperatures determined by canonical correlation analysis, Mon. Weather Rev., 115, 1825-1850.
4. Barnston, A. G., and C. F. Ropelewski (1992), Prediction of ENSO episodes using canonical correlation analysis, J. Clim., 5, 1316-1345.
5. Bishop, C. M. (1995), Neural Networks for Pattern Recognition, 482 pp., Clarendon, Oxford, U.K.
6. Bretherton, C. S., C. Smith, and J. M. Wallace (1992), An intercomparison of methods for finding coupled patterns in climate data, J. Clim., 5, 541-560.
7. Burnham, K. P., and D. R. Anderson (1998), Model Selection and Inference, 353 pp., Springer-Verlag, New York.
8. Cavazos, T. (1999), Large-scale circulation anomalies conducive to extreme precipitation events and derivation of daily rainfall in northeastern Mexico and southeastern Texas, J. Clim., 12, 1506-1523.
9. Cherkassky, V., and F. Mulier (1998), Learning From Data, 441 pp.; John Wiley, Hoboken, N. J.
10. Chevallier, F., J. J. Morcrette, F. Cheruy, and N. A. Scott (2000), Use of a neural-network-based long-wave radiative-transfer scheme in the ECMWF atmospheric model, Q. J. R. Meteorol. Soc., 126, 761-776.
11. Comon, P. (1994), Independent component analysis-A new concept?, Signal Process., 36, 287-314.
12. Cybenko, G. (1989), Approximation by superpositions of a sigmoidal function, Math. Control Signals Syst., 2, 303-314.
13. Del Frate, F., and G. Schiavon (1999), Nonlinear principal component analysis for the radiometric inversion of atmospheric profiles by using neural networks, IEEE Trans. Geosci. Remote Sens., 37, 2335-2342.
14. Diaz, H. F., and V. Markgraf (2000), El Niño and the Southern Oscillation: Multiscale Variability and Global and Regional Impacts, 496 pp., Cambridge Univ. Press, New York.
15. Elsner, J. B., and A. A. Tsonis (1996), Singular Spectrum Analysis, 164 pp., Plenum, New York.
16. Essenreiter, R., M. Karrenbach, and S. Treitel (2001), Identification and classification of multiple reflections with self-organizing maps, Geophys. Prospect., 49, 341-352.
17. Gardner, M. W, and S. R. Dorling (1998), Artificial neural networks (the multilayer perceptron)-A review of applications in the atmospheric sciences, Atmos. Environ., 32, 2627-2636.
18. Gemmill, W. H, and V. M. Krasnopolsky (1999), The use of SSM/ I data in operational marine analysis, Weather Forecasting, 14, 789-800.
19. Ghil, M., et al. (2002), Advanced spectral methods for climatic time series, Rev. Geophys., 40(1), 1003, doi:10.1029/ 2000RG000092.
20. Golyandina, N. E., V. V. Nekrutin, and A. A. Zhigljavsky (2001), Analysis of Time Series Structure, SSA and Related Techniques, 320 pp., Chapman and Hall, New York.
21. Hamilton, K. (1998), Dynamics of the tropical middle atmosphere: A tutorial review, Atmos. Ocean, 36, 319-354.
22. Hamilton, K., and W. W. Hsieh (2002), Representation of the QBO in the tropical stratospheric wind by nönlinear principal component analysis, J. Geophys. Res., 107(D15), 4232, doi:10.1029/ 2001JD001250.
23. Hastie, T., and W. Stuetzle (1989), Principal curves, JASA J. Am. Stat. Assoc., 84, 502-516.
24. Hastie, T., R. Tibshirani, and J. Friedman (2001), The Elements of Statistical Learning, 552 pp., Springer-Verlag, New York.
25. Haykin, S. (1999), Neural Networks: A Comprehensive Foundation, 842 pp., Prentice-Hall, Old Tappan, N. J.
26. Hoerling, M. P., A. Kumar, and M. Zhong (1997), El Niño, La Niña and the nonlinearity of their teleconnections, J. Clim., 10, 1769-1786.
27. Hollingsworth, J. L., R. M. Haberle, and J. Schaeffer (1997), Seasonal variations of storm zones on Mars, Adv. Space Res., 19, 1237-1240.
28. Holton J. R., and H.-C. Tan (1980), The influence of the equatorial quasi-biennial oscillation on the global circulation at 50 mb, J. Atmos. Sci., 37, 2200-2208.
29. Hornik, K., M. Stinchcombe, and H. White (1989), Multilayer feedforward networks are universal approximators, Neural Networks, 2, 359-366.
30. Hsieh, W. W. (2000), Nonlinear canonical correlation analysis by neural networks, Neural Networks, 13, 1095-1105.
31. Hsieh, W. W. (2001a), Nonlinear principal component analysis by neural networks, Tellus, Ser. A, 53, 599-615.
32. Hsieh, W. W. (2001b), Nonlinear canonical correlation analysis of the tropical Pacific climate variability using a neural network approach, J. Clim., 14, 2528-2539.
33. Hsieh, W. W., and K. Hamilton (2003), Nonlinear singular spectrum analysis of the tropical stratospheric wind, Q. J. R. Meteorol, Soc., 129, 2367-2382.
34. Hsieh, W. W., and B. Tang (1998), Applying neural network models to prediction and data analysis in meteorology and oceanography, Bull. Am. Meteorol. Soc., 79, 1855-1870.
35. Hsieh, W. W., and A. Wu (2002), Nonlinear multichannel singular spectrum analysis of the tropical Pacific climate variability using a neural network approach, J. Geophys. Res., 107(C7), 3076, doi:10.1029/2001JC000957.
36. Hyvärinen, A., J. Karhunen, and E. Oja (2001), Independent Component Analysis,. 504 pp., John Wiley, Hoboken, N. J.
37. Jolliffe, I. T. (2002), Principal Component Analysis, 502 pp., Springer-Verlag, New York.
38. Kaiser, H. F. (1958), The varimax criterion for analytic rotation in factor analysis, Psychometrika, 23, 187-200.
39. Kirby, M. J., and R. Miranda (1996), Circular nodes in neural networks, Neural Comp., 8, 390-402.
40. Kohonen, T. (1982), Self-organized formation of topologically correct feature maps, Biol. Cybernetics, 43, 59-69.
41. Kohonen, T. (2001), Self-Organizing Maps, 501 pp., Springer-Verlag, New York.
42. Kramer, M. A. (1991), Nonlinear principal component analysis using autoassociative neural networks, AIChE J., 37, 233-243.
43. Krasnopolsky, V. M., D. Chalikov, L. C. Breaker, and D. Rao (2000), Application of neural networks for efficient calculation of sea water density or salinity from the UNESCO equation of state, in Proceedings of the Second Conference on Artificial Intelligence, pp. 27-30, Am. Math. Soc., Providence, R. I.
44. Lai, P. L., and C. Fyfe (1999), A neural implementation of canonical correlation analysis, Neural Networks, 12, 1391-1397.
45. Lai, P. L., and C. Fyfe (2000), Kernel and non-linear canonical correlation analysis, Int. J. Neural Syst., 10, 365-377.
46. Lorenz, E. N. (1963), Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130-141.
47. Malthouse, E. C. (1998), Limitations of nonlinear PCA as performed with generic neural networks, IEEE Trans. Neural Networks, 9, 165-173.
48. Mardia, K. V., J. T. Kent, and J. M. Bibby (1979), Multivariate Analysis, 518 pp., Academic, San Diego, Calif.
49. Marzban, C. (2000), A neural network for tornado diagnosis: Managing local minima, Neural Comput. Appl., 9, 133-141.
50. McCulloch, W. S., and W. Pitts (1943), A logical calculus of the ideas immanent in neural nets, Bull. Math. Biophys., 5, 115-137.
51. Melzer, T., M. Reiter, and H. Bischof (2003), Appearance models based on kernel canonical correlation analysis, Pattern Recognit., 36, 1961-1971.
52. Monahan, A. H. (2000), Nonlinear principal component analysis by neural networks: Theory and application to the Lorenz system, J. Clim., 13, 821-835.
53. Monahan, A. H. (2001), Nonlinear principal component analysis: Tropical Indo-Pacific sea surface temperature and sea level pressure, J. Clim., 14, 219-233.
54. Monahan, A. H., J. C. Fyfe, and G. M. Flato (2000), A regime view of Northern Hemisphere atmospheric variability and change under global warming, Geophys. Res. Lett., 27, 1139-1142.
55. Monahan, A. H., L. Pandolfo, and J. C. Fyfe (2001), The preferred structure of variability of the Northern Hemisphere atmospheric circulation, Geophys. Res. Lett., 28, 1019-1022.
56. Newbigging, S. C., L. A. Mysak, and W. W. Hsieh (2003), Improvements to the nonlinear principal component analysis method, with applications to ENSO and QBO, Atmos. Ocean, 41, 291-299.
57. Philander, S. G. (1990), El Niño, La Niña, and the Southern Oscillation, 293 pp., Academic, San Diego, Calif.
58. Preisendorfer, R. W. (1988), Principal Component Analysis in Meteorology and Oceanography, 425 pp., Elsevier Sci., New York.
59. Rangarajan, G. K., and L. M. Barreto (2000), Long term variability in solar wind velocity and IMF intensity and the relationship between solar wind parameters and geomagnetic activity, Earth Planets Space, 52, 121-132.
60. Richaume, P., F. Badran, M. Crepon, C. Mejía, H. Roquet, and S. Thiria (2000), Neural network wind retrieval from ERS-1 scatterometer data, J. Geophys. Res., 105(C4), 8737-8751.
61. Richman, M. B. (1986), Rotation of principal components, J. Clim., 6, 293-335.
62. Ripley, B. D. (1996), Pattern Recognition and Neural Networks, 403 pp., Cambridge Univ. Press, New York.
63. Rojas, R. (1996), Neural Networks-A Systematic Introduction, 502 pp., Springer-Verlag, New York.
64. Rumelhart, D. E., G. E. Hinton, and R. J. Williams (1986), Learning internal representations by error propagation, in Parallel Distributed Processing, vol. 1, edited by D. E. Rumelhart, J. L. McClelland, and P. R. Group, pp. 318-362, MIT Press, Cambridge, Mass.
65. Sandham, W., and M. Leggett (2003), Geophysical Applications of Artificial Neural Networks and Fuzzy Logic, 348 pp., Kluwer Acad., Norwell, Mass.
66. Shabbar, A., and A. G. Barnston (1996), Skill of seasonal climate forecasts in Canada using canonical correlation analysis, Mon. Weather Rev., 124, 2370-2385.
67. Taner, M. T., T. Berge, J. A. Walls, M. Smith, G. Taylor, D. Dumas, and M. B. Carr (2001), Well log calibration of Kohonen-classified seismic attributes using Bayesian logic, J. Pet. Geol., 24, 405-416.
68. Tang, B. Y., W. W. Hsieh, A. H. Monahan, and F. T. Tangang (2000), Skill comparisons between neural networks and canonical correlation analysis in predicting the equatorial Pacific sea surface temperatures, J. Clim., 13, 287-293.
69. Tang, Y., and W. W. Hsieh (2002), Hybrid coupled models of the tropical Pacific-ENSO prediction, Clim. Dyn., 19, 343-353.
70. Tang, Y., and W. W. Hsieh (2003), Nonlinear modes of decadal and interannual variability of the subsurface thermal structure in the Pacific Ocean, J. Geophys. Res., 108(C3), 3084, doi:10.1029/ 2001JC001236.
71. Vapnik, V. N. (1998), Statistical Learning Theory, 736 pp., John Wiley, Hoboken, N. J.
72. Villmann, T., E. Merenyi, and B. Hammer (2003), Neural maps in remote sensing image analysis, Neural Networks, 16, 389-403.
73. von Storch, H., and F. W. Zwiers (1999), Statistical Analysis in Climate Research, 484 pp., Cambridge Univ. Press, New York.
74. Watari, S. (1996), Separation of periodic, chaotic, and random components in solar activity, Sol. Phys., 168, 413-422.
75. Woodruff, S. D., R. J. Slutz, R. L. Jenne, and P. M. Steurer (1987), A comprehensive ocean-atmosphere data set, Bull. Am. Meteorol. Soc., 68, 1239-1250.
76. Wu, A., and W. W. Hsieh (2002), Nonlinear canonical correlation analysis of the tropical Pacific wind stress and sea surface temperature, Clim. Dyn., 19, 713-722, doi:10.1007/s00382-002-0262-8.
77. Wu, A., and W. W. Hsieh (2003), Nonlinear interdecadal changes of the El Niño-Southern Oscillation, Clim. Dyn., 21, 719-730, doi:10.1007/s00382-003-0361-1.
78. Wu, A., W. W. Hsieh, and A. Shabbar (2002), Nonlinear characteristics of the surface air temperature over Canada, J. Geophys. Res., 107(D21), 4571, doi:10.1029/2001JD001090.
79. Wu, A., W. W. Hsieh, and F. W. Zwiers (2003), Nonlinear modes of North American winter climate variability detected from a general circulation model, J. Clim., 16, 2325-2339.
80. Yacoub, M., F. Badran, and S. Thiria (2001), A topological hierarchical clustering: Application to ocean color classification, in Artificial Neural Networks-ICANN 2001, International Conference, Vienna, Austria, August 21-25, 2001: Proceedings, Lect. Notes Comput. Sci., vol. 2130, edited by G. Dorffner, H. Bischof, and K. Hornik, pp. 492-499, Springer-Verlag, New York.
81. Yuval, (2000), Neural network training for prediction of climatological time series, regularized by minimization of the generalized cross validation function, Mon. Weather Rev., 128, 1456-1473.
82. Yuval (2001), Enhancement and error estimation of neural network prediction of Niño 3.4 SST anomalies, J. Clim., 14, 2150-2163.
83. Yuval, and W. W. Hsieh (2002), The impact of time-averaging on the detectability of nonlinear empirical relations, Q. J. R. Meteorol. Soc., 128, 1609-1622.
84. Yuval, and W. W. Hsieh (2003), An adaptive nonlinear MOS scheme for precipitation forecasts using neural networks, Weather Forecasting, 18, 303-310.