The SSA-MTM toolkit: Applications to analysis and prediction of time series

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 3165, Issue , 1997, Pages 216-230

  Ghil, Michael ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Prediction; Spectral analysis; Time series

Indexed keywords

APPLICATIONS; SOFT COMPUTING; SPECTRUM ANALYSIS; SPECTRUM ANALYZERS; TIME SERIES;

INDEPENDENT INVESTIGATORS; MAXIMUM-ENTROPY METHODS; PRACTICAL PROBLEMS; PREDICTION; PUBLIC DOMAINS; SINGULAR-SPECTRUM ANALYSIS; SPECTRAL ANALYSIS; SPECTRAL METHODS; TIME-SERIES PREDICTIONS; WORLDWIDE WEBS;

TIME SERIES ANALYSIS;

EID: 58749112777     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.279594     Document Type: Conference Paper

References (103)

1. IMSL, Visual Numerics, Inc., Houston, TX, 1996.
2. Mathematica 3.0, Wolfram Research, Champaign, IL, 1997.
3. Matlab, The MathWorks, Inc., Matick, MA, 1994.
4. S. Slepian, "Prolate spheroidal wave functions, Fourier analysis and uncertainty-V: The discrete case," Bell. Syst. Tech. J., 57, pp. 1371-1430, 1978.
5. D. J. Thomson, "Spectrum estimation and harmonic analysis," Proc. IEEE, 70, pp. 1055-1096, 1982.
6. D. S. Broomhead and G. P. King, "Extracting qualitative dynamics from experimental data," Physica D, 20, pp. 217-236, 1986a.
7. R. Vautard and M. Ghil, "Singular spectrum analysis in nonlinear dynamics, with applications to paleoclimatic time series," Physica D, 35, pp. 395-424, 1989.
8. D. B. Percival and A. T. Walden, Spectral Analysis for Physical Applications - Multitaper and Conventional Univariate Techniques, Cambridge University Press, 1993.
9. R. Vautard, P. Yiou and M. Ghil, "Singular-spectrum analysis: A toolkit for short, noisy chaotic signals," Physica D, 58, pp. 95-126, 1992.
10. M. Ghil and P. Yiou, "Spectral Methods: What they can and cannot do for climatic time series," in Decadal Climate Variability: Dynamics and Predictability, D. Anderson and J. Willebrand, eds., Elsevier, pp. 446-482, 1996.
11. N. Wiener, Acta Mathematica, 55, pp. 117, 1930.
12. A. Y. Khinchin, Math. Annalen, 109, pp. 604, 1934.
13. M. Ghil and C. Taricco, "Advanced Spectral Analysis Methods," in Past and Present Variability of the Solar-Terrestrial System: Measurement, Data Analysis and Theoretical Models, G. Cini Castagnoli and A. Provenzale, eds., Società Italiana di Fisica, Bologna, & IOS Press, Amsterdam, in press, 1997.
14. R. B. Blackman and J. W. Tukey, The Measurement of Power Spectra from the Point of View of Communication Engineering, Dover Publications, New York, 1958.
15. E. J. Hannan, Time Series Analysis, Methuen, New York, 1960.
16. S. L. Marple, Digital Spectral Analysis with Applications, Prentice-Hall, Englewood Cliffs, NJ, 1987.
17. J. P. Burg, Ph.D. dissertation, Department of Geophysics, Stanford Univ., California, 1975.
18. G. U. Yule, "On a Method of Investigating Periodicities in Disturbed Series," Philos. Trans. R. Soc. London, 226A, pp. 267-298, 1927.
19. G. Walker, "On Periodicity in Series of Related Terms," Proc. R. Soc. London, 131A, pp. 518-532, 1931.
20. J. P. Burg, "Maximum entropy spectral analysis," in 37th Annual International Meeting of Soc. Explor. Geophys., Oklahoma City, OK, 1967.
21. T. J. Ulrych, and T. N. Bishop, Rev. Geophys. Space Phys., 13, p. 183, 1975.
22. A. B. Baggeroer, "Confidence intervals for regression (MEM) spectral estimates," IEEE Trans. Inf. Theory, IT-22, pp. 534-545, 1976.
23. C. Penland, M. Ghil and K. M. Weickmann, "Adaptive filtering and maximum entropy spectra, with application to changes in atmospheric angular momentum," J. Geophys. Res., 96, pp. 22659-22671, 1991.
24. S. L. Marple, in Proc. 1977 IEEE Int. Conf. Acoust. Signal Process., pp.74-77, 1977.
25. M. Ghil and R. Vautard, "Interdecadal oscillations and the warming trend in global temperature time series," Nature, 350, pp. 324-327, 1991.
26. P. Yiou, J. Jouzel, S. Johnsen and Ö. E. Rögnvaldsson, "Rapid oscillations in Vostok and GRIP ice cores," Geophys. Res.Lett., 22, pp. 2179-2182, 1995.
27. M. R. Allen, P. L. Read and L. A. Smith, "Temperature oscillations?" Nature, 359, pp. 679, 1992a.
28. C. L. Keppenne and M. Ghil, "Adaptive filtering and prediction of the Southern Oscillation index," J. Geophys. Res., 97, pp. 20449-20454, 1992.
29. M. R. Allen, Interaction Between the Atmosphere and Oceans on Time Scales of Weeks to Years, Ph.D. thesis, St. John's College, Oxford, 1992.
30. M. R. Allen and L. A. Smith, "Investigating the origins and significance of low-frequency modes of climate variability," Geophys. Res. Lett., 21, pp. 883-886, 1994.
31. P. Yiou, M. Ghil, J. Jouzel, D. Paillard and R. Vautard, "Nonlinear variability of the climatic system, from singular and power spectra of late Quaternary records," Climate Dyn., 9, pp. 371-389, 1994.
32. B. M.Rasmusson, X. Wang and C. F. Ropelewski, "The biennial component of ENSO variability," J. Marine Syst., 1, pp. 71-96, 1990.
33. D. S. Broomhead and G. P. King, "On the qualitative analysis of experimental dynamical systems," in Nonlinear Phenomena and Chaos, S. Sarkar, ed., Adam Huger, Bristol, pp. 113-144, 1986b.
34. C. L. Keppenne and M. Ghil, "Adaptive filtering and prediction of noisy multivariate signals: An application to subannual variability in atmospheric angular momentum," Intl. J. Bifurcation & Chaos, 3, pp. 625-634, 1993.
35. M. D. Dettinger, M. Ghil, C. M. Strong, W. Weibel and P. Yiou, "Software expedites singular-spectrum analysis of noisy time series," Eos, Trans. AGU, 76, pp. 12, 14, 21, 1995a.
36. M. D. Dettinger, M. Ghil and C. L. Keppenne, "Interannual and interdecadal variability in United States surface-air temperatures, 1910-87," Climatic Change, 31, pp. 35-66, 1995b.
37. D. J. Thomson, "Time series analysis of Holocene climate data," Phil. Trans. Roy. Soc. London, 330A, pp. 601-616, 1990a.
38. D. J. Thomson, "Quadratic-inverse spectrum estimates: Applications to palaeoclimatology," Phil. Trans. R. Soc. London, 332A, pp. 593-597, 1990b.
39. M. Kendall and A. Stuart, The Advanced Theory of Statistics, Vol. 2 (4th Ed.), MacMillan, New York, 1979.
40. 2 levels from Vostok ice-core records," J. Geophys. Res., 96, pp. 20365-20378, 1991.
41. M. E. Mann and J. M. Lees, "Robust estimation of background noise and signal detection in climatic time series," Climatic Change, 33, pp. 409-445, 1996.
42. C. Kuo, C. Lindberg and D. J. Thomson, "Coherence established between atmospheric carbon dioxide and global temperature," Nature, 343, pp. 709-713, 1990.
43. G. E. Birchfield and M. Ghil, "Climate evolution in the Pliocene and Pleistocene from marine-sediment records and simulations: Internal variability versus orbital forcing," J. Geophys. Res., 98D, pp. 10385-10399, 1993.
44. M. E. Mann and J. Park, "Global-scale modes of surface temperature variability on interannual to century tirnescales," J. Geophys. Res., 99, pp. 25819-25833, 1994.
45. M. E. Mann, J. Park, and R. S. Bradley, "Global interdecadal and century-scale climate oscillations during the five past centuries," Nature, 378, pp. 266-270, 1995.
46. S. M. Kay, Modern Spectral Estimation - Theory and Application, Prentice-Hall, Englewood Cliffs, New Jersey, 1988.
47. D. G. Childers, ed., Modern Spectrum Analysis, IEEE Press, New York, 1978.
48. J. M. Colebrook, "Continuous plankton records: zooplankton and environment, North-East Atlantic and North Sea, 1948-1975," Oceanol. Acta, 1, pp. 9-23, 1978.
49. R. W. Preisendorfer, Principal Component Analysis in Meteorology and Oceanography, (C. D. Mobley, ed.), Elsevier, New York, 1988.
50. R. Mañe, "On the dimension of the compact invariant sets of certain nonlinear maps," in Dynamical Systems and Turbulence, D. A. Rand and L. S. Young, eds., Vol. 898 of Lecture Notes in Mathematics, Springer-Verlag, New York/Berlin, pp. 230-242, 1981.
51. F. Takens, "Detecting strange attractors in turbulence," in Dynamical Systems and Turbulence, D. A. Rand and L.-S. Young, eds., Springer-Verlag, New York, pp. 366-381, 1981.
52. E. N. Lorenz, "Deterministic noriperiodic flow," J. Atmos. Sci., 20, pp. 130-141, 1963.
53. K. Fraedrich, "Estimating the dimensions of weather and climate attractors," J. Atmos. Sci., 43, pp. 419-432, 1986.
54. P. Grassberger and I. Procaccia, "Measuring the strangeness of strange attractors," Physica D, 9, pp. 189-208, 1983.
55. T. Sauer, J. A. Yorke and M. Casdagli, "Embedology," J. Stat. Phys., 65, pp. 579-616, 1991.
56. E. N. Lorenz, Tech. Rept. Statistical Forecasting Project, Department of Meteorology, Massachusetts Institute of Technology, 1956.
57. R. Kumaresan and D. W. Tufts, "Data-adaptive principal component signal processing," in Proc. Conf. Decision & Control, IEEE, Albuquerque, pp. 949-954, 1980.
58. A. I. Mees and K. Judd, Physica D, 68, pp. 427, 1993.
59. M. Ghil and K. C. Mo, "Intraseasonal oscillations in the global atmosphere. Part I: Northern Hemisphere and tropics," J. Atmos. Sci., 48, pp. 752-779, 1991a.
60. M. Ghil and K. C. Mo, "Intraseasonal oscillations in the global atmosphere. Part II: Southern Hemisphere," J. Atmos. Sci., 48, pp. 780-790, 1991b.
61. Y. S. Unal and M. Ghil, "Interannual and interdecadal oscillation patterns in sea level," Climate Dyn., 11, pp. 255-278, 1995.
62. M. Ghil and P. Yiou, "Spectral Methods: What they can and cannot do for climatic time series," in Decadal Climate Variability: Dynamzcs and Predictability, D. Anderson and J. Willebrand, eds., Elsevier, pp. 446-482, 1996.
63. B. Efron, The Jacknife, the Bootstrap and Other Resampling Plans, SIAM, Philadelphia, PA, 1982.
64. A. D. Chave, D .J. Thomson and M. E. Ander, "On the robust estimation of power spectra, coherences, and transfer functions," J. Geophys. Res., 92, pp. 633-648, 1987.
65. D. J. Thomson and A. D. Chave, "Jackknifed error estimates for spectra, coherences, and transfer functions," in Advances in Spectrum Analysis and Array Processing, S. Haykin, ed. Englewood Cliffs, NJ, pp. 58-113, 1990.
66. P. Yiou, E. Baert and M. F. Loutre, "Spectral Analysis of Climate Data," Surveys in Geophysics, 17, pp. 619-663, 1996.
67. J. Morlet, G. Arens, I. Fourgeau and D. Giard,Geophysics, 47, pp. 203, 1982.
68. A. Grossmann, J. Morlet and T. Paul, J. Math. Phys., 26, pp. 2473, 1985.
69. G. Strang, SIAM Review, 31, pp. 614-627, 1989.
70. I. Daubechies I., IEEE Trans. Inf. Theory, 36, pp. 961, 1990.
71. M. Ghil, "Cryothermodynamics: The chaotic dynamics of paleoclimate," Physica D, 77, pp. 130-159, 1994.
72. J. Park and K. A. Maasch, "Plio-Pleistocene time evolution of the 100-kyr cycle in marine paleoclimate records," J. Geophys. Res., 98, pp. 447-461, 1993.
73. N. Jiang, J. D. Neelin and M. Ghil, "Quasi-quadrennial and quasi-biennial variability in the equatorial Pacific," Climate Dyn., 12, pp. 101-112, 1995a.
74. A. W.Robertson, C.-C. Ma, C. R. Mechoso and M. Ghil, "Simulation of the Tropical-Pacific climate with a coupled ocean-atmosphere general circulation model. Part I: The seasonal cycle," J. Climate, 8, pp. 1178-1198, 1995a.
75. A. W.Robertson, C.-C. Ma, M. Ghil and C. R. Mechoso, "Simulation of the Tropical-Pacific climate with a coupled ocean-atmosphere general circulation model. Part II: Interannual variability," J. Climate, 8, pp. 1199-1216, 1995b.
76. M. R. Allen, P. L. Read and L. A. Smith, "Temperature time-series?" Nature, 355, pp. 686, 1992b.
77. J. B. Elsner and A. A. Tsonis, "Do bidecadal oscillations exist in the global temperature record?" Nature, 353, pp. 551-553, 1991.
78. G. Plaut, M. Ghil and R. Vautard, "Interannual and interdecadal variability in 335 years of Central England temperatures," Science, 268, pp. 710-713, 1995.
79. M. R. Allen and L. A. Smith, "Optimal filtering in singular spectrum analysis," Phys. Lett., to appear, 1997.
80. F. Biondi, C. B. Lange, M. K. Hughes and W. H. Berger, "Inter-decadal signals during the last millennium (AD 1117-1992) in the varve record of Santa Barbara basin, California," Geophys. Res. Lett., 24, pp. 193-196, 1997.
81. T. M. Quinn, T. J. Crowley and F. W. Taylor, "New stable isotope results from a 173-year coral from Espiritu Santo, Vanuatu," Geophys. Res. Lett., 23, pp. 3413-3416, 1996.
82. M. Kimoto, M. Ghil and K.-C. Mo, "Spatial structure of the extratropical 40-day oscillation," in Proc. 8th Atmos. & Oceanic Waves & Stability Conf., American Meteorological Society, Boston, MA, pp. 115-116, 1991.
83. T. P. Barnett and K. Hasselmann, Rev. Geophys., 17, pp. 949, 1979.
84. B. C. Weare and J. S. Nasstrom, "Examples of Extended Empirical Orthogonal Function Analyses," Mon. Wea. Rev., 110, pp. 481-485, 1982.
85. K.-M. Lau and P. H. Chan, "Aspects of the 40-50 day oscillation during the Northern Hemisphere winter as inferred from the outgoing longwave radiation," Mon. Wea. Rev., 113, pp. 1889-1909, 1985.
86. V. Moron, R. Vautard and M. Ghil, "Trends, interdecadal and interannual oscillations in global sea-surface temperatures," Climate Dyn., sub judice, 1997.
87. G. R. Plaut and R. Vautard, "Spells of oscillations and weather regimes in the low-frequency dynamics of the Northern Hemisphere," J. Atmos. Sci., 51, pp. 210-236, 1994.
88. Allen, M. R., and A. W. Robertson, "Distinguishing modulated oscillations from colored noise in multivariate datasets," Climate Dyn., 12, pp. 775-784, 1996.
89. Ooms, M., Empirical Vector Autoregressive Modeling, Springer-Verlag, 1988.
90. K. Hasselmann, "PIPs and POPs: The reduction of complex dynamical systems using Principal Interaction and Principal Oscillation Patterns," J. Geophys. Res., 93D, pp. 11015-11021, 1988.
91. H. Von Storch, T. Bruns, I. Fischer-Bruns and K. Hasselman, "Principal oscillation pattern analysis of the 30- to 60-day oscillation in general circulation model equatorial troposphere," J. Geophys. Res., 93D, pp. 11022-11036, 1988.
92. C. Penland, Mon. Wea. Rev., 117, pp. 2165, 1989.
93. C. Penland and M. Ghil, "Forecasting Northern Hemisphere 700-mb geopotential height anomalies using empirical normal modes," Mon. Wea. Rev., 121, 2355-2372, pp. 1993.
94. C. Penland, "A stochastic model of IndoPacific sea surface temperature anomalies," Physica D, 98, pp. 534-558, 1996.
95. J.-S. Von Storch, "Multivariate statistical modeling: POP-model as a first-order approximation," in Analysis of Climate Variability, H. von Storch and A. Navarra, eds., pp. 281-297, 1995.
96. G. H, Golub and C. F. Van Loan, Matrix Computations (3rd ed.), J. Hopkins Univ. Press, Baltimore, MD, 1996.
97. S. A. Venegas, L. A. Mysak and D. N. Straub, "Correction to 'Evidence for interannual and interdecadal climate variability in the South Atlantic'," Geophys. Res. Lett., 23, pp. 3424-3430, 1996.
98. T. F. Stocker and L. A. Mysak, "Climatic fluctuations on the century time scale: A review of high-resolution proxy data and possible mechanisms," Climate Change, 20, pp. 227-250, 1992.
99. 2 and climate," Tellus, accepted, 1997.
100. M. Ghil and S. Childress, Topics in Geophysical Fluid Dynamics: Atmospheric Dynamics, Dynamo Theory and Climate Dynamics, Springer-Verlag, New York/Berlin/London/Paris/Tokyo, 1987.
101. N. Jiang, M. Ghil and D. Neelin, "Forecasts of equatorial Pacific SST anomalies by an autoregressive process using singular spectrum analysis," in Experimental Long-Lead Forecast Bulletin, Vol. 4, No. 1, pp. 24-27, National Meteorological Center, NOAA, U.S. Department of Commerce, 1995b.
102. A. Barnston, H. van den Dool, S. Zebiak, T. P.. Barnett, M. Ji, D. Rodenhuis, M. Cane, A. Leetmaa, N. Graham, C. Ropelewski, V. Kousky, E. O'Lenic and T. Livezey, "Long-lead seasonal forecasts - Where do we stand?" Bull. Amer. Met. Soc., 75, pp. 2097-2114, 1994.
103. M. Ghil and N. Jiang, "Recent forecast skill for the El Niño/Southern Oscillation," Geophys. Res. Lett., submitted, 1997.