Analysis of persistent nonstationary time series and applications

Communications in Applied Mathematics and Computational Science

Volumn 7, Issue 2, 2013, Pages 175-229

  Metzner, Philipp ^a   Putzig, Lars ^a   Horenko, Illia ^a  

^a UNIVERSITY OF LUGANO   (Switzerland)

Author keywords

Clustering; Finite element method; Nonstationary data analysis; Nonstationary time series analysis

Indexed keywords

EID: 84884311748     PISSN: 15593940     EISSN: 21575452     Source Type: Journal    
DOI: 10.2140/camcos.2012.7.175     Document Type: Article

References (76)

1. H. Akaike, A new look at the statistical model identification, IEEE Trans. Automat. Control 19 (1974), no. 6, 716-723. MR 54 #11691 Zbl 0314.62039
2. A. N. Akansu and R. A. Haddad, Multiresolution signal decomposition: transforms, subbands, and wavelets, Academic Press, Boston, 1992. MR 93m:94004 Zbl 0947.94001
3. L. E. Baum, An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes, Inequalities, III (O. Shisha, ed.), Academic Press, New York, 1972, pp. 1-8. MR 49 #6528
4. L. E. Baum and T. Petrie, Statistical inference for probabilistic functions of finite state Markov chains, Ann. Math. Stat. 37 (1966), no. 6, 1554-1563. MR 34 #2137 Zbl 0144.40902
5. C. M. Bishop, Neural networks for pattern recognition, Clarendon, Oxford, 1995. MR 97m: 68172 Zbl 0868.68096
6. F. Black, Studies of stock price volatility changes, Proceedings of the 1976 Meetings of the American Statistical Association, Business and Economics Statistics Section, American Statistical Association, Washington, DC, 1976, pp. 177-181.
7. T. Bollerslev, Generalized autoregressive conditional heteroskedasticity, J. Econometrics 31 (1986), no. 3, 307-327. MR 87j:62169 Zbl 0616.62119
8. D. Braess, Finite elements: theory, fast solvers, and applications in solid mechanics, 2nd ed., Cambridge University Press, Cambridge, 2001. MR 2001k:65002 Zbl 0976.65099
9. P. Brémaud, Markov chains: Gibbs fields, Monte Carlo simulation, and queues, Texts in Applied Mathematics, no. 31, Springer, New York, 1999. MR 2000k:60137 Zbl 0949.60009
10. U. Çelikyurt and S. Özekici, Multiperiod portfolio optimization models in stochastic markets using the mean-variance approach, Eur. J. Oper. Res. 179 (2007), no. 1, 186-202. Zbl 1163.91375
11. M. Dellnitz and O. Junge, On the approximation of complicated dynamical behavior, SIAM J. Numer. Anal. 36 (1999), no. 2, 491-515. MR 2000c:37026 Zbl 0916.58021
12. A. P. Dempster, N. M. Laird, and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J. Roy. Stat. Soc. Ser. B 39 (1977), no. 1, 1-38. MR 58 #18858 Zbl 0364.62022
13. P. Deuflhard and C. Schütte, Molecular conformation dynamics and computational drug design, Applied mathematics entering the 21st century (J. M. Hill and R. Moore, eds.), SIAM, Philadelphia, 2004, pp. 91-119. MR 2296264 Zbl 1134.92004
14. P. Deuflhard and M. Weber, Robust Perron cluster analysis in conformation dynamics, Linear Algebra Appl. 398 (2005), 161-184. MR 2005h:62166 Zbl 1070.15019
15. R. F. Engle, Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation, Econometrica 50 (1982), no. 4, 987-1007. MR 83j:62158 Zbl 0491. 62099
16. E. F. Fama, The behavior of stock-market prices, J. Bus. 38 (1965), no. 1, 34-105.
17. A. Fischer, S. Waldhausen, I. Horenko, E. Meerbach, and C. Schütte, Identification of biomolecular conformations from incomplete torsion angle observations by hidden Markov models, J. Comput. Chem. 28 (2007), no. 15, 2453-2464.
18. C. Franzke, D. Crommelin, A. Fischer, and A. J. Majda, A hidden Markov model perspective on regimes and metastability in atmospheric flows, J. Climate 21 (2008), no. 8, 1740-1757.
19. T. Gasser and H.-G. Müller, Kernel estimation of regression functions, Smoothing techniques for curve estimation (T. Gasser and M. Rosenblatt, eds.), Lecture Notes in Math., no. 757, Springer, Berlin, 1979, pp. 23-68. MR 81k:62052 Zbl 0418.62033 226
20. T. Gasser and H.-G. Müller, Estimating regression functions and their derivatives by the kernel method, Scand. J. Stat. 11 (1984), no. 3, 171-185. MR 86h:62056 Zbl 0548.62028
21. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian data analysis, 2nd ed., Chapman & Hall/CRC, Boca Raton, FL, 2004. MR 2004j:62001 Zbl 1039.62018
22. D. Giannakis and A. J. Majda, Quantifying the predictive skill in long-range forecasting, I: Coarse-grained predictions in a simple ocean model, J. Climate 25 (2011), 1793-1813
23. D. Giannakis and A. J. Majda, Quantifying the predictive skill in long-range forecasting, II: Model error in coarsegrained Markov models with application to ocean-circulation regimes, J. Climate 25 (2011), 1814-1826.
24. D. Giannakis, A. J. Majda, and I. Horenko, Information theory, model error, and predictive skill of stochastic models for complex nonlinear systems, preprint, CIMS/NYU and University of Lugano, 2011, Submitted to Physica D.
25. A. L. Gibbs and F. E. Su, On choosing and bounding probability metrics, Int. Stat. Rev. 70 (2002), no. 3, 419-435. Zbl 1217.62014
26. J. Hadamard, Sur les problèmes aux dérivées partielles et leur signification physique, Princeton Univ. Bull. 13 (1902), 49-52.
27. J. D. Hamilton, A new approach to the economic analysis of nonstationary time series and the business cycle, Econometrica 57 (1989), no. 2, 357-384. MR 996941 Zbl 0685.62092
28. A. Hoerl, Application of ridge analysis to regression problems, Chem. Eng. Prog. 58 (1962), no. 3, 54-59.
29. I. Horenko, On simultaneous data-based dimension reduction and hidden phase identification, J. Atmos. Sci. 65 (2008), no. 6, 1941-1954.
30. I. Horenko,On robust estimation of low-frequency variability trends in discrete Markovian sequences of Atmospherical Circulation Patterns, J. Atmos. Sci. 66 (2009), no. 7, 2059-2072.
31. I. Horenko, Finite element approach to clustering of multidimensional time series, SIAM J. Sci. Comput. 32 (2010), no. 1, 62-83. MR 2011b:62009 Zbl 1206.62150
32. I. Horenko, On clustering of non-stationary meteorological time series, Dyn. of Atmos. and Oceans 49 (2010), no. 2-3, 164-187.
33. I. Horenko,On identification of non-stationary factor models and its application to atmospherical data analysis, J. Atmos. Sci. 67 (2010), no. 5, 1559-1574.
34. I. Horenko, Nonstationarity in multifactor models of discrete jump processes, memory and application to cloud modeling, J. Atmos. Sci. 68 (2011), no. 7, 1493-1506.
35. I. Horenko, On analysis of nonstationary categorical data time series: dynamical dimension reduction, model selection, and applications to computational sociology, Multiscale Model. Simul. 9 (2011), no. 4, 1700-1726. MR 2861255
36. I. Horenko, E. Dittmer, A. Fischer, and C. Schütte, Automated model reduction for complex systems exhibiting metastability, Multiscale Model. Simul. 5 (2006), no. 3, 802-827. MR 2257236 Zbl 1122.60062
37. I. Horenko, E. Dittmer, and C. Schütte, Reduced stochastic models for complex molecular systems, Comput. Vis. Sci. 9 (2006), no. 2, 89-102. MR 2247687
38. I. Horenko, S. Dolaptchiev, A. Eliseev, I. Mokhov, and R. Klein, Metastable decomposition of high-dimensional meteorological data with gaps, J. Atmos. Sci. 65 (2008), no. 11, 3479-3496.
39. I. Horenko, R. Klein, S. Dolaptchiev, and C. Schütte, Automated generation of reduced stochastic weather models, I: Simultaneous dimension and model reduction for time series analysis, Multiscale Model. Simul. 6 (2007), no. 4, 1125-1145. MR 2009e:62338 Zbl 1152.62056
40. I. Horenko, J. Schmidt-Ehrenberg, and C. Schütte, Set-oriented dimension reduction: localizing principal component analysis via hidden Markov models, Computational life sciences II (M. R. Berthold, R. Glen, and I. Fischer, eds.), Lecture Notes in Comput. Sci., no. 4216, Springer, Berlin, 2006, pp. 74-85. MR 2279311
41. I. Horenko and C. Schütte, Likelihood-based estimation of multidimensional Langevin models and its application to biomolecular dynamics, Multiscale Model. Simul. 7 (2008), no. 2, 731- 773. MR 2009j:37136 Zbl 1180.35175
42. W. Huisinga, Metastability of Markovian systems: a transfer operator approach in application to molecular dynamics, Ph.D. thesis, Free University Berlin, 2001.
43. E. T. Jaynes, Information theory and statistical mechanics, Phys. Rev. (2) 106 (1957), 620-630. MR 19,335b Zbl 0084.43701
44. E. T. Jaynes, Information theory and statistical mechanics, II, Phys. Rev. (2) 108 (1957), 171-190. MR 20 #2898 Zbl 0084.43701
45. R. Kalman, A new approach to linear filtering and prediction problems, J. Basic Eng. 82 (1960), no. 1, 35-45.
46. J. N. Kapur, Maximum-entropy models in science and engineering, Wiley, New York, 1989. MR 92b:00017 Zbl 0746.00014
47. Koninklijk Nederlands Meteorologisch Instituut, http://climexp.knmi.nl/getindices.cgi?WMO=NCEPData/nino2_daily&STATION=NINO12&id=someone@somewhere&NPERYEAR=366&TYPE=i.
48. H.-M. Krolzig, Predicting Markov-switching vector autoregressive processes, preprint 2000- W31, University of Oxford, 2000.
49. D. Kulp, D. Haussler, M. G. Reese, and F. H. Eeckman, A generalized hidden Markov model for the recognition of human genes in DNA, Proceedings of the Fourth International Conference on Intelligent Systems for Molecular Biology (D. J. States, P. Agarwal, T. Gaasterland, L. Hunter, and R. Smith, eds.), AAAI Press, Menlo Park, CA, 1996, pp. 134-142.
50. C. L. Lawson and R. J. Hanson, Solving least squares problems, Prentice-Hall, Englewood Cliffs, NJ, 1974. MR 51 #2270 Zbl 0860.65028
51. C. Lee and M.-H. Yu, Protein folding and disease, J. Biochem. Molec. Biol. 38 (2005), no. 3, 275-280.
52. C. Loader, Local regression and likelihood, Springer, New York, 1999. MR 2000f:62005 Zbl 0929.62046
53. J. B. MacQueen, Some methods for classification and analysis of multivariate observations, Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, I: Statistics (L. M. Le Cam and J. Neyman, eds.), University of California Press, Berkeley, CA, 1967, pp. 281-297. MR 35 #5078 Zbl 0214.46201
54. A. J. Majda, C. L. Franzke, A. Fischer, and D. T. Crommelin, Distinct metastable atmospheric regimes despite nearly Gaussian statistics: a paradigm model, Proc. Natl. Acad. Sci. USA 103 (2006), no. 22, 8309-8314. MR 2007a:86004 Zbl 1160.86304
55. A. J. Majda and X. Wang, Non-linear dynamics and statistical theories for basic geophysical flows, Cambridge University Press, Cambridge, 2006. MR 2009e:76214 Zbl 1141.86001
56. G. McLachlan and D. Peel, Finite mixture models, Wiley, New York, 2000. MR 2002b:62025 Zbl 0963.62061
57. P. Metzner, M. Weber, and C. Schütte, Observation uncertainty in reversible Markov chains, Phys. Rev. E (3) 82 (2010), no. 3, Paper #031114. MR 2012a:60202 228
58. J.-J. Moreau, P. D. Panagiotopoulos, and G. Strang (eds.), Topics in nonsmooth mechanics, Birkhäuser, Basel, 1988.
59. National Center for Biotechnology Information, Saccharomyces cerevisiae chromosome I, complete sequence, http://www.ncbi.nlm.nih.gov/nuccore/144228165?report=graph&to=30000.
60. R. Preis, M. Dellnitz, M. Hessel, C. Schütte, and E. Meerbach, Dominant paths between almost invariant sets of dynamical systems, preprint 154, Deusche Forschungsgemeinschaft Schwerpunktprogramm, 2004.
61. W. H. Press, S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, Numerical recipes: the art of scientific computing, 3rd ed., Cambridge University Press, Cambridge, 2007. MR 2009b:65001 Zbl 1132.65001
62. J.-H. Prinz, H. Wu, M. Sarich, B. Keller, M. Senne, M. Held, J. D. Chodera, C. Schütte, and F. Noé, Markov models of molecular kinetics: generation and validation, J. Chem. Phys. 134 (2011), no. 17, Paper #174105.
63. L. Putzig, D. Becherer, and I. Horenko, Optimal allocation of a futures portfolio utilizing numerical market phase detection, SIAM J. Financial Math. 1 (2010), 752-779. MR 2011k:91171 Zbl 1198.91241
64. L. R. Rabiner, A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE 77 (1989), no. 2, 257-286.
65. C. Schütte, Conformational dynamics: modelling, theory, algorithm, and application to biomolecules, preprint SC 99-18, Konrad-Zuse-Zentrum für Informationstechnik, Berlin, 1999.
66. C. Schütte, A. Fischer, W. Huisinga, and P. Deuflhard, A direct approach to conformational dynamics based on hybrid Monte Carlo, J. Comput. Phys.(1999), no. 1, 146-168. MR 2000d:92004
67. C. Schütte and W. Huisinga, Biomolecular conformations can be identified as metastable sets of molecular dynamics, Handbook of numerical analysis, 10: Computational chemistry (C. Le Bris, ed.), North-Holland, Amsterdam, 2003, pp. 699-744. MR 2008396 Zbl 1066.81658
68. C. Schütte, F. Noé, J. Lu, M. Sarich, and E. Vanden-Eijnden, Markov state models based on milestoning, J. Chem. Phys. 134 (2011), no. 20, Paper #204105.
69. C. Schütte, F. Noé, E. Meerbach, P. Metzner, and C. Hartmann, Conformation dynamics, ICIAM 07: 6th International Congress on Industrial and Applied Mathematics (R. Jeltsch and G. Wanner, eds.), European Mathematical Society, Zürich, 2009, pp. 297-335. MR 2011k:82072 Zbl 1180.82239
70. F. Takens, Detecting strange attractors in turbulence, Dynamical systems and turbulence, Warwick 1980 (D. A. Rand and L.-S. Young, eds.), Lecture Notes in Math., no. 898, Springer, Berlin, 1981, pp. 366-381. MR 83i:58065 Zbl 0513.58032
71. A. N. Tikhonov, On the stability of inverse problems, Dokl. Akad. Nauk SSSR 39 (1943), no. 5, 195-198, In Russian; translated in C. R. .Doklady/ Acad. Sci. URSS .N.S./ 39 (1943), no. 5, 176-179. MR 5,184e Zbl 0061.23308
72. K. E. Trenberth, The definition of El Niño, Bull. Amer. Meteorol. Soc. 78 (1997), no. 12, 2771- 2777.
73. U.S. Energy Information Administration, NYMEX futures prices, http://tonto.eia.doe.gov/dnav/pet/pet_pri_fut_s1_d.htm.
74. G. Wahba, Spline models for observational data, CBMS-NSF Regional Conference Series in Applied Mathematics, no. 59, SIAM, Philadelphia, 1990. MR 91g:62028 Zbl 0813.62001
75. Yahoo Finance, Dow Jones industrial average: historical prices, http://finance.yahoo.com/q/hp?s=^DJI+Historical+Prices.
76. A. Zellner and R. A. Highfield, Calculation of maximum entropy distributions and approximation of marginal posterior distributions, J. Econometrics 37 (1988), no. 2, 195-209. MR 932140