Predicting the uncertainty of numerical weather forecasts: A review

Meteorologische Zeitschrift

Volumn 6, Issue 4, 1997, Pages 147-183

  Ehrendorfer, Martin ^a  

^a UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001633899     PISSN: 09412948     EISSN: None     Source Type: Journal    
DOI: 10.1127/metz/6/1997/147     Document Type: Review

References (290)

1. Alexander, M. A., C. Penland, 1996: Variability in a mixed layer ocean model driven by stochastic atmospheric forcing. - J. Climate 9, 2424-2442.
2. Anderson, J. L., 1996a: Selection of initial conditions for ensemble forecasts in a simple perfect model framework. - J. Atmos. Sci. 53, 22-36.
3. _ 1996b: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. - J. Climate 9, 1518-1530.
4. _ 1996c: Impacts of dynamically constrained initial conditions on ensemble forecasts. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virginia, 56-57.
5. Anderson J. L., W. F. Stern, 1996: Evaluating the potential predictive utility of ensemble forecasts in a perfect model setting. - J. Climate, 9, 260-269.
6. Anthes, R. A., 1986: The general question of predictability. - In: Ray, P. S. (Ed.), Mesoscale meteorology and forecasting, Amer. Meteorol. Soc., 636-656.
7. Arnold, L. G., 1992: Stochastic differential equations: theory and applications. - Krieger, 228 pp.
8. Arnold, V. I., 1989: Mathematical methods of classical mechanics. - Springer, 508 pp.
9. Ashford, O. M., 1985: Prophet - or professor? The life and work of Lewis Fry Richardson. - Hilger, 304 pp.
10. Balescu, R., 1975: Equilibrium and nonequilibrium statistical mechanics. - Wiley, 742 pp.
11. Barker, T. W., 1991: The relationship between spread and forecast error in extended-range forecasts. - J. Climate 4, 733-742.
12. Barkmeijer, J., 1992: Local error growth in a baroptropic model. - Tellus 44A, 314-323.
13. _ 1993: Lokal skill prediction for the ECMWF model using adjoint techniques. - Month. Weath. Rev. 121, 1262-1268.
14. _ 1995: Approximating dominant eigenvalues and eigenvectors of the local forecast error covariance matrix. - Tellus 47A, 495-501.
15. _ 1996: Constructing fast-growing perturbations for the nonlinear regime. - J. Atmos. Sci. 53, 2838-2851.
16. Barkmeijer, J., P. Houtekamer, X. Wang, 1993: Validation of a skill prediction method. - Tellus 45A, 424-434.
17. Barkmeijer, J., R. Mureau, J. Oortwijn, T. Opsteegh, 1996: Research on regional predictability at KNMI. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 247-274.
18. Baumhefner, D. P., 1985: The relationship between present large-scale forecast skill and new estimates of predictability error growth. In: Holloway G., B. J. West (Eds.), Predictability of fluid motions, American Institute of Physics, 169-180.
19. _ 1996: Numerical extended-range prediction: forecast skill using a low resolution climate model. - Month. Weath. Rev. 124, 1965-1980.
20. Berz, M., C. Bischof, G. Corliss, A. Griewank (Eds.), 1996: Computational differentiation - techniques, applications, and tools. - Society for Industrial and Applied Mathematics, 421 pp.
21. Betti, A., A. Navarra, 1995: Prediction of the evolution of the variance in a barotropic model. - J. Atmos. Sci. 52, 367-379.
22. Bishop, C. H., Z. Toth, 1996: Using ensembles to identify observations likely to improve forecasts. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, 72-74.
23. Bjerknes, V., 1904: Das Problem der Wettervorhersage, betrachtet vom Standpunkte der Mechanik und der Physik. - Meteorol. Z. 21, 1-7.
24. Boer, G. J., 1993: Systematic and random error in an extended-range forecasting experiment. - Month. Weath. Rev. 121, 173-188.
25. _ 1994: Predictability regimes in atmospheric flow. - Month. Weath. Rev. 122, 2285-2295.
26. Borges, M. D., D. L. Hartmann, 1992: Barotropic instability and optimal perturbations of observed nonzonal flows. - J. Atmos. Sci. 49, 335-354.
27. Borges, M. D., P. D. Sardeshmukh, 1995: Barotropic Rossby wave dynamics of zonally varying upper-level flows during northern winter. - J. Atmos. Sci. 52, 3779-3796.
28. _ 1997: Application of perturbation theory to the stability analysis of realistic atmospheric flows. - Tellus, 49A, 321-336.
29. Bouttier, F., 1993a: The dynamics of error covariances in a barotropic model. - Tellus 45A, 408-423.
30. _ 1993b: La prévisibilité. - La Météorologie 8, 7-17.
31. _ 1994: A dynamical estimation of forecast error covariances in an assimilation system. - Month. Weath. Rev. 122, 2376-2390.
32. _ 1996: The Kalman filter. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 221-245.
33. Branković, C., T. N. Palmer, F. Molteni, S. Tibaldi, U. Cubasch, 1990: Extended-range predictions with ECMWF models: Time-lagged ensemble forecasting. - Quart. J. Roy. Meteorol. Soc. 116, 867-912.
34. Brier, G. W., 1950: Verification of forecasts expressed in terms of probability. - Month. Weath. Rev. 78, 1-3.
35. Brooks, H. E., M. S. Tracton, D. J. Stensrund, G. DiMego, Z. Toth, 1995: Short-range ensemble forecasting (SREF): report from a workshop. - Bull. Amer. Meteorol. Soc. 76, 1617-1624.
36. Buizza, R., 1994a: Localization of optimal perturbations using a projection operator. - Quart. J. Roy. Meteorol. Soc. 120, 1647-1682.
37. _ 1994b: Sensitivity of optimal unstable structures. - Quart. J. Roy. Meteorol. Soc. 120, 429-451.
38. _ 1995a: Optimal perturbation time evolution and sensitivity of ensemble prediction to perturbation amplitude. - Quart. J. Roy. Meteorol. Soc. 121, 1705-1738.
39. _ 1995b: The impact of orographic forcing on barotropic unstable singular vectors. - J. Atmos. Sci. 52, 1457-1472.
40. _ 1996: Ensemble prediction at the European Centre for Medium-Range Weather Forecasts. - ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 20-49.
41. _ 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF ensemble prediction system. - Month. Weath. Rev. 125, 99-119.
42. Buizza, R., R. Gelaro, F. Molteni, T. N. Palmer, 1997a: The impact of increased resolution on predictability studies with singular vectors. - Quart. J. Roy. Meteorol. Soc., 123, 1007-1033.
43. Buizza, R., T. N. Palmer, 1995: The singular-vector structure of the atmospheric global circulation. - J. Atmos. Sci. 52, 1434-1456.
44. Buizza, R., T. N. Palmer, J. Barkmeijer, R. Gelaro, J. F. Mahfouf, 1996: Singular vectors, norms and large-scale condensation. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, 50-52.
45. Buizza, R., T. Petroliagis, T. Palmer, J. Barkmeijer, M. Hamrud, A. Hollingsworth, A. Simmons, N. Wedi, 1997b: Impact of model resolution and ensemble size on the performance of an ensemble prediction system. - Quart. J. Roy. Meteorol. Soc., under revision.
46. Buizza, R., J. Tribbia, F. Molteni, T. Palmer, 1993: Computation of optimal unstable structures for a numerical weather prediction model. - Tellus 45A, 388-407.
47. Cane, M. A., 1992: Tropical Pacific ENSO models: ENSO as a mode of the coupled system. - In: Trenberth, K. (Ed.), Climate System Modeling, Cambridge University Press, 583-614.
48. Chang, J.-C. J., M. Mak, 1995: Nonmodal barotropic dynamics of intraseasonal disturbances. - J. Atmos. Sci. 52, 896-914.
49. Charney, J. G., 1947: The dynamics of long waves in a baroclinic westerly current. - J. Meteorol. 4, 135-162.
50. Charney, J. G., R. Fjörtoft, J. v. Neumann, 1950: Numerical integration of the barotropic vorticity equation. - Tellus 2, 237-254.
51. Charney, J. G., R. G. Fleagle, H. Riehl, V. E. Lally, D. Q. Wark, 1966: The feasibility of a global observation and analysis experiment. - Bull. Amer. Meteorol. Soc. 47, 200-220.
52. Cohn, S. E., 1993: Dynamics of short-term univariate forecast error covariances. - Month. Weath. Rev. 121, 3123-3149.
53. Cohn, S. E., N. S. Sivakumaran, R. Todling, 1994: A fixed-lag Kalman smoother for retrospective data assimilation. -Month. Weath. Rev. 122, 2838-2867.
54. Cohn, S. E., R. Todling, 1996: Approximate data assimilation schemes for stable and unstable dynamics. - J. Meteorol. Soc. Japan 74, 63-75.
55. Colucci, S. J., D. P. Baumhefner, 1992: Initial weather regimes as predictors of numerical 30-day mean forecast accuracy. -J. Atmos. Sci. 49, 1652-1671.
56. Cooke, W. E., 1906: Forecasts and verifications in western Australia. - Month. Weath. Rev. 34, 23-24.
57. Courtier, P., et al., 1993: Variational assimilation at ECMWF. -ECMWF Research Dept. Technical Memorandum No. 194, 84 pp. [available from: European Centre for Medium-Range Weather Forecasts, Shinfield Park, Reading, Berkshire RG2 9AX, UK].
58. Courtier, P., J.-N. Thépaut, A. Hollingsworth, 1994: A strategy for operational implementation of 4D-Var, using an incremental approach. - Quart. J. Roy. Meteorol. Soc. 120, 1367-1387.
59. Dalcher, A., E. Kalnay, 1987: Error growth and predictability in operational ECMWF forecasts. - Tellus 39A, 474-491.
60. Dalcher, A., E. Kalnay, R. N. Hoffman, 1988: Medium range lagged average forecasts. - Month. Weath. Rev. 116, 402-416.
61. Dee, D. P., 1995: On-line estimation of error covariance parameters for atmospheric data assimilation. - Month. Weath. Rev. 123, 1128-1145.
62. DeGroot, S. R., P. Mazur, 1984: Non-equilibrium thermodynamics. - Dover, 510 pp.
63. DelSole, T., B. F. Farrell, 1995: A stochastically excited linear system as a model for quasigeostrophic turbulence: analytic results for one- and two-layer fluids. - J. Atmos. Sci. 52, 2531-2547.
64. _ 1996: The quasi-linear equilibration of a thermally maintained, stochastically excited jet in a quasigeostrophic model. - J. Atmos. Sci. 53, 1781-1797.
65. Drazin, P. G., W. H. Reid, 1981: Hydrodynamic stability. -Cambridge University Press, 525 pp.
66. Eady, E. T., 1949: Long waves and cyclone waves. - Tellus 1, 33-52.
67. Egger, J., 1996: Volume conservation in phase space: a fresh look at numerical integration schemes. - Month. Weath. Rev. 124, 1955-1964.
68. Ehrendorfer, M., 1989: Meteorologische Wahrscheinlichkeitsvorhersagen: Einige Aspekte. - Wetter u. Leben 41, 123-139.
69. _ 1994a: The Liouville equation and its potential usefulness for the prediction of forecast skill. Part I: Theory. - Month. Weath. Rev. 122, 703-713.
70. _ 1994b: The Liouville equation and its potential usefulness for the prediction of forecast skill. Part II: Applications. -Month. Weath. Rev. 122, 714-728.
71. Ehrendorfer, M., R. M. Errico, 1995: Mesoscale predictability and the spectrum of optimal perturbations. - J. Atmos. Sci. 52, 3475-3500.
72. Ehrendorfer, M., J. J. Tribbia, 1997: Optimal prediction of forecast error covariances through singular vectors. - J. Atmos. Sci. 54, 286-313.
73. Ehrendorfer, M., J. J. Tribbia, R. M. Errico, 1996: Mesoscale predictability: an assessment through adjoint methods. -Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 157-183.
74. Emanuel, K. A., E. N. Lorenz, R. E. Morss, 1996: Adaptive observations. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, 67-69.
75. Emmrich, P., 1996: Mittelfristige Wettervorhersage. - Promet Meteorol. Fortbildung 25, 12-25.
76. Epstein, E. S., 1969: Stochastic dynamic prediction. - Tellus 21, 739-759.
77. Errico, R. M., 1997: What is an adjoint model? - Bull. Amer. Meteorol. Soc., in press.
78. Errico, R. M., D. P. Baumhefner, 1987: Predictability experiments using a high-resolution limited-area model. - Month. Weath. Rev. 115, 488-504.
79. Errico, R. M., M. Ehrendorfer, 1995: Moist singular vectors in a primitive-equation regional model. - Preprint Volume, Tenth Conference on Atmospheric and Oceanic Waves and Stability, Big Sky, Montana, 235-238.
80. Errico, R. M., T. Vukićević, 1992: Sensitivity analysis using an adjoint of the PSU-NCAR mesoscale model. - Month. Weath. Rev. 120, 1644-1660.
81. Errico, R. M., T. Vukićević, P. Courtier, J. Derber, J.-F. Louis, 1993a: Workshop on adjoint applications in dynamic meteorology. - Bull. Amer. Meteorol. Soc. 74, 845-847.
82. Errico, R. M., T. Vukićević, K. Raeder, 1993b: Examination of the accuracy of a tangent linear model. - Tellus 45A, 462-477.
83. European Centre for Medium-Range Weather Forecasts, 1996: Fifth Workshop on Meteorological Operational Systems. -Workshop Proceedings, 321 pp.
84. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasigeostrophic model using Monte Carlo methods to forecast error statistics. - J. Geophys. Res. 99(C5), 10143-10162.
85. _ 1997: Advanced data assimilation for dtrongly nonlinear dynamics. - Month. Weath. Rev. 125, 1342-1354.
86. Evensen, G. P. J., van Leeuwen, 1996: Assimilation of Geosat altimeter data for the Agulhas current using the ensemble Kalman filter with a quasigeostrophic model. - Month. Weath. Rev. 124, 85-96.
87. Farrell, B. F., 1988: Optimal excitation of neutral Rossby waves. - J. Atmos. Sci. 45, 163-172.
88. _ 1989: Optimal excitation of baroclinic waves. - J. Atmos. Sci. 46, 1193-1206.
89. _ 1990: Small error dynamics and the predictability of atmospheric flows. - J. Atmos. Sci. 47, 2409-2416.
90. Farrell, B. F., P. J. Ioannou, 1993a: Stochastic forcing of the linearized Navier-Stokes equations. - Physics of Fluids A 5, 2600-2609.
91. _ 1993b: Stochastic dynamics of baroclinic waves. - J. Atmos. Sci. 50, 4044-4057.
92. _ 1996a: Generalized stability theory. Part I: autonomous operators. - J. Atmos. Sci. 53, 2025-2040.
93. _ 1996b: Generalized stability theory. Part II: nonautonomous operators. - J. Atmos. Sci. 53, 2041-2053.
94. Farrell, B. F., A. M. Moore, 1992: An adjoint method for obtaining the most rapidly growing perturbation to oceanic flows. -J. Physical Oceanogr. 22, 338-349.
95. Fisher, M., P. Courtier, 1995: Estimating the covariance matrices of analysis and forecast error in variational data assimilation. - ECMWF Research Dept. Technical Memorandum No. 220, 26 pp. [available from: European Centre for Medium-Range Weather Forecasts, Shinfield Park, Reading, Berkshire RG2 9AX, UK].
96. Fishman, G. S., 1996: Monte Carlo - concepts, algorithms, applications. - Springer, 698 pp.
97. Fleming, R. J., 1971a: On stochastic dynamic prediction. I. The energetics of uncertainty and the question of closure. -Month. Weath. Rev. 99, 851-872.
98. _ 1971b: On stochastic dynamic prediction. II. Predictability and utility. - Month. Weath. Rev. 99, 927-938.
99. Fortak, H., 1973: Prinzipielle Grenzen der deterministischen Vorhersagbarkeit atmosphärischer Prozesse. - Ann. Meteorol. (N. F.) 6, 111-120.
100. Fraedrich, K., 1996: Das Lorenz-Modell: Ein Paradigma für Wetter und Vorhersagbarkeit. - Promet Meteorol. Fortbildung 25, 62-79.
101. Fraedrich, K., C. Ziehmann-Schlumbohm, 1994: Predictability experiments with persistence forecasts in a red-noise atmosphere. - Quart. J. Roy. Meteorol. Soc. 120, 387-428.
102. Fraedrich, K., C. Ziehmann, 1995: Praktische Vorhersagbarkeit: Persistenz in rotem Rauschen. - Meteorol. Z., N. F. 4, 139-149.
103. Frederiksen, J. S., 1997: Adjoint sensitivity and finite-time normal mode disturbances during blocking. - J. Atmos. Sci. 54, 1144-1165.
104. Gardiner, C. W., 1990: Handbook of stochastic methods. -Springer, 442 pp.
105. Gelaro, R., R. Buizza, T. N. Palmer, E. Klinker, 1997: Sensitivity analysis of forecast errors and the construction of optimal perturbations using singular vectors. - J. Atmos. Sci., under revision.
106. Ghil, M., 1987: Dynamics, statistics and predictability of planetary flow regimes. - In: Nicolis, C., G. Nocolis (Eds.), Irreversible phenomena and dynamical systems analysis in geosciences, Reidel, 241-283.
107. Ghil, M., K. Ide, A. Bennett, P. Courtier, M. Kimoto, M. Nagata, M. Saiki, N. Sato (Eds.), 1997: Data Assimilation in Meteorology and Oceanography: Theory and Practice. Meteorol. Soc. Japan, Universal Academy Press, 386 pp.
108. Ghil, M., R. Todling, 1996: Tracking atmospheric instabilities with the Kalman filter. Part II: two-layer results. - Month. Weath. Rev. 124, 2340-2352.
109. Gibson, J. K., A. Hernandez, P. Kallberg, A. Nomura, E. Serrano, S. Uppala, 1996: Current status of the ECMWF re-analysis (ERA) project. - ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 283-290.
110. Gleeson, T. A., 1966: A causal relation for probabilities in synoptic meteorology. - J. Appl. Meteorol. 5, 365-368.
111. _ 1970: Statistical dynamical predictions. - J. Appl. Meteorol. 9, 333-344.
112. Golub, G. H., C. F. Van Loan, 1989: Matrix computations. - The Johns Hopkins University Press, 642 pp.
113. Götz, G., 1995: Predictability of nonlinear dynamical systems. -Idojaras 99, 1-32.
114. _ 1996: On the possibilities of forecasting forecast skill. -Idojaras 100, 229-246.
115. Grimes, R. G., J. G. Lewis, H. D. Simon, 1994: A shifted block Lanczos algorithm for solving sparse symmetric generalized eigenproblems. - SIAM J. Matrix Analysis and Applications 15, 228-272.
116. Hammersley, J. M., D. C. Handscomb, 1964: Monte Carlo methods. - Methuen, 178 pp.
117. Harrison, M. S. J., 1994: Ensembles, higher-resolution models and future computing power - a personal view. - Weather 49, 398-406.
118. _ 1996: Ensemble forecasting at the UK Meteorological Office. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, J21-J23.
119. Harrison, M. S. J., T. N. Palmer, D. S. Richardson, R. Buizza, T. Petroliagis, 1996: Joint ensembles from the UKMO and ECMWF models. - Proceedings 1995 ECMWF Seminar on Predictability, Vol II, 61-120.
120. Harrison, M. S. J., D. S. Richardson, K. Robertson, A. Woodcock, 1995: Medium-range ensembles using both the ECMWF T63 and unified models - an initial report. - UKMO Techn. Rep. No. 153, 25 pp.
121. Hartmann, D. L., R. Buizza, T. N. Palmer, 1995: Singular vectors: the effect of spatial scale on linear growth of disturbances. - J. Atmos. Sci. 52, 3885-3894.
122. Hartmann, D. L., T. N. Palmer, R. Buizza, 1996: Finite-time instabilities of lower-stratospheric flow. - J. Atmos. Sci. 53, 2129-2143.
123. Hasselmann, K., 1976: Stochastic climate models. Part I. Theory. - Tellus 28, 473-485.
124. Hoffmann, R. N., E. Kalnay, 1983: Lagged average forecasting, an alternative to Monte Carlo forecasting. - Tellus 35A, 100-118.
125. Houghton, J., 1991: The Bakerian Lecture 1991: The predictability of weather and climate. - Phil. Trans. R. Soc. Lond. A 337, 521-572.
126. Houtekamer, P. L., 1991: Variation of the predictability in a low order spectral model of the atmospheric circulation. -Tellus 43A, 177-190.
127. _ 1992: The quality of skill forecasts for a low-order spectral model. - Month. Weath. Rev. 120, 2993-3002.
128. _ 1993: Global and local skill forecasts. - Month. Weath. Rev. 121, 1834-1846.
129. _ 1995: The construction of optimal perturbations. - Month. Weath. Rev. 123, 2888-2898.
130. Houtekamer, P. L., J. Derome, 1994: Prediction experiments with two-member ensembles. - Month. Weath. Rev. 122, 2179-2191.
131. _ 1995: Methods for ensemble prediction. - Month. Weath. Rev. 123, 2181-2196.
132. Houtekamer, P. L., L. Lefaivre, J. Derome, 1996a: The RPN ensemble prediction system. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. II, 121-146.
133. Houtekamer, P. L., L. Lefaivre, J. Derome, H. Ritchie, H. L. Mitchell, 1996b: A system simulation approach to ensemble prediction. - Month. Weath. Rev. 124, 1225-1242.
134. Huber-Pock, F., 1996: Vorhersagbarkeit und Ensemble-Vorhersage. - ÖGM Bull. 96/2, 2-32.
135. Ide, K., P. Courtier, M. Ghil, A. C. Lorenc, 1997: Unified notation for data assimilation: operational, sequential and variational. - J. Meteorol. Soc. Japan, 75, 181-189.
136. Iyengar, G., Z. Toth, E. Kalnay, J. S. Woollen, 1996: Are the bred vectors representative of analysis errors? - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, J64-J66.
137. Järvinen, H., J.-N. Thépaut, P. Courtier, 1996: Quasi-continuous variational data assimilation - Quart. J. Roy. Meteorol. Soc. 122, 515-534.
138. Jazwinski, A. H., 1970: Stochastic processes and filtering theory. - Academic Press, 376 pp.
139. Kalnay, E., A. Dalcher, 1987: Forecasting forecast skill. - Month. Weath. Rev. 115, 349-356.
140. Kalnay, E., Z. Toth, 1996: The breeding method. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 69-82.
141. Kanamitsu, M., S. Saha, 1996: Systematic tendency error in budget calculations. - Month. Weath. Rev. 124, 1145-1160.
142. Katz, R. W., A. H. Murphy (Eds.), 1997: Economic value of weather and climate forecasts. - Cambridge University Press, 222 pp.
143. Kumar, A., M. Hoerling, M. Ji, A. Leetmaa, P. Sardeshmukh, 1996: Assessing a GCM's suitability for making seasonal predictions. - J. Climate 9, 115-129.
144. Lacarra, J.-F., O. Talagrand, 1988: Short-range evolution of small perturbations in a barotropic model. - Tellus 40A, 81-95.
145. Lanczos, C., 1950: An iteration method for the solution of the eigenvalue problem of linear differential and integral operators. - J. Res. Nat. Bureau Standards 45, 255-282.
146. Langland, R. H., R. L. Elsberry, R. M. Errico, 1995: Evaluation of physical processes in an idealized extratropical cyclone using adjoint sensitivity. - Quart. J. Roy. Meteorol. Soc. 121, 1349-1386.
147. _ 1996: Adjoint sensitivity of an idealized extratropical cyclone with moist physical processes. - Quart. J. Roy. Meteorol. Soc. 122, 1891-1920.
148. Lanzinger, A., B. Strauss, 1996: EPS evaluation at ECMWF. -ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 87-101.
149. Lasota, A., M. C. Mackey, 1994: Chaos, fractals, and noise. Stochastic aspects of dynamics. - Springer, 472 pp.
150. Legras, B., R. Vautard, 1996: A guide to Liapunov vectors. -Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 143-156.
151. Leith, C. E., 1971: Atmospheric predictability and two-dimensional turbulence. - J. Atmos. Sci. 28, 145-161.
152. _ 1974: Theoretical skill of Monte Carlo forecasts. - Month. Weath. Rev. 102, 409-418.
153. _ 1978: Objective methods for weather prediction. - Ann. Rev. Fluid Mechanics 10, 107-128.
154. _ 1983: Predictability in theory and practice. - In: Hoskins, B. J., R. P. Pearce (Eds.), Large-scale dynamical processes in the atmosphere. Academic Press, 365-383.
155. Lewis, J. M., 1996: Philip Thompson: pages from a scientist's life. - Bull. Amer. Meteorol. Soc. 77, 107-113.
156. Lin, C. C., L. A. Segel, 1988: Mathematics applied to deterministic problems in the natural sciences. - Soc. for Industrial and Applied Mathematics, 609 pp.
157. Lindley, D. V., 1987: The probability approach to the treatment of uncertainty in artificial intelligence and expert systems. - Statistical Sci. 2, 17-24.
158. Liouville, J., 1838: Note sur la théorie de la variation des constantes arbitraires. - J. Mathématiques pures et appliquées 3, 342-349.
159. Lorenz, E. N., 1963: Deterministic nonperiodic flow. - J. Atmos. Sci. 20, 130-141.
160. _ 1965: A study of the predictability of a 28-variable atmospheric model. - Tellus 17, 321-333.
161. _ 1969a: The predictability of a flow which possesses many scales of motion. - Tellus 21, 289-307.
162. _ 1969b: Atmospheric predictability as revealed by naturally occurring analogues. - J. Atmos. Sci. 26, 636-646.
163. _ 1982: Atmospheric predictability experiments with a large numerical model. - Tellus 34, 505-513.
164. _ 1984: Irregularity: a fundamental property of the atmosphere. - Tellus 21, 739-759.
165. _ 1990: Effects of analysis and model errors on routine weather forecasts. - Proceedings 1989 ECMWF Seminar on Ten years of medium-range weather forecasting, 115-128.
166. _ 1993: The essence of chaos. - University of Washington Press, 227 pp.
167. _ 1996: Predictability - a problem partly solved. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 1-18.
168. Lützen, J., 1990: Joseph Liouville 1809-1882: Master of pure and applied mathematics. - Springer, 884 pp.
169. Lynch, P., 1992: Richardson's barotropic forecast: a reappraisal. - Bull. Amer. Meteorol. Soc. 73, 35-47.
170. Madden, R. A., P. R. Julian, 1994: Observations of the 40-50-day tropical oscillation - a review. Month. Weath. Rev. 122, 814-837.
171. Ménard, R., R. Daley, 1996: The application of Kalman smoother theory to the estimation of 4DVAR error statistics. - Tellus 48A, 221-237.
172. Miyakoda, K., G. D. Hembree, R. F. Strickler, I. Shulman, 1972: Cumulative results of extended forecast experiments. Part I: Model performance for winter cases. - Month. Weath. Rev. 100, 836-855.
173. Miyakoda, K., J. Smagorinsky, R. F. Strickler, G. D. Hembree, 1969: Experimental extended predictions with a nine-level hemispheric model. - Month. Weath. Rev. 97, 1-76.
174. Molteni, F., R. Buizza, T. N. Palmer, T. Petroliagis, 1996: The ECMWF ensemble prediction system: methodology and validation. - Quart. J. Roy. Meteorol. Soc. 122, 73-119.
175. Molteni, F., T. N. Palmer, 1991: A real-time scheme for the prediction of forecast skill. - Month. Weath. Rev. 119, 1088-1097.
176. _ 1993: Predictability and finite-time instability of the northern winter circulation. - Quart. J. Roy. Meteorol. Soc. 119, 269-298.
177. Moore, A. M., B. F. Farrell, 1993: Rapid perturbation growth on spatially and temporally varying oceanic flows determined using an adjoint method: application to the Gulf stream. -J. Physical Oceanogr. 23, 1682-1702.
178. Morokoff, W. J., R. E. Caflisch, 1995: Quasi-Monte Carlo integration. - J. Computational Physics 122, 218-230.
179. Moss, F., P. V. E. McClintock (Eds.), 1989: Noise in Nonlinear Dynamical Systems. Vol. 1, Theory of Continuous Fokker-Planck Systems. - Cambridge University Press, 353 pp.
180. Mukougawa, H., M. Kimoto, S. Yoden, 1991: A relationship between local error growth and quasistationary states: case study in the Lorenz system. - J. Atmos. Sci. 48, 1231-1237.
181. Mureau, R., F. Molteni, T. N. Palmer, 1993: Ensemble prediction using dynamically conditioned perturbations. - Quart. J. Roy. Meteorol. Soc. 119, 299-323.
182. Murphy, A. H., 1994: Assessing the economic value of weather forecasts: an overview of methods, results and issues. -Meteorol. Applications 1, 69-73.
183. _ 1997: Forecast verification. - In: Katz, R. W., A. H. Murphy (Eds.), Economic value of weather and climate forecasts, Cambridge University Press, 19-74.
184. Murphy, A. H., E. S. Epstein, 1989: Skill scores and correlation coefficients in model verification. - Month. Weath. Rev. 117, 572-581.
185. Murphy, A. H., R. L. Winkler, 1984: Probability forecasting in meteorology. - J. Amer. Statistical Assoc. 79, 489-500.
186. Murphy, J. M., 1988: The impact of ensemble forecasts on predictability. - Quart. J. Roy. Meteorol. Soc. 114, 463-494.
187. _ 1990: Assessment of the practical utility of extended range ensemble forecasts. - Quart. J. Roy. Meteorol. Soc. 116, 89-125.
188. Newman, M., P. D. Sardeshmukh, 1995: A caveat concerning singular value decomposition. - J. Climate 8, 352-360.
189. Newman, M., P. D. Sardeshmukh, C. Penland, 1997: Stochastic forcing of the wintertime extratropical flow. - J. Atmos. Sci. 54, 435-455.
190. Nicolis, C., 1987: Climatic predictability and dynamical systems. - In: Nicolis, C, G. Nicolis (Eds.), Irreversible phenomena and dynamical systems analysis in geosciences, Reidel, 321-354.
191. _ 1992: Probabilistic aspects of error growth in atmospheric dynamics. - Quart. J. Roy. Meteorol. Soc. 118, 553-568.
192. Nicolis, G., 1995: Introduction to nonlinear science. - Cambridge University Press, 254 pp.
193. Nicolis, C., S. Vannitsem, J.-F. Royer, 1995: Short-range predictability of the atmosphere: mechanisms for superexponential error growth. - Quart. J. Roy. Meteorol. Soc. 121, 705-722.
194. Noble, B., J. W. Daniel, 1977: Applied linear algebra. - Prentice-Hall, 477 pp.
195. Oortwijn, J., J. Barkmeijer, 1995: Perturbations that optimally trigger weather regimes. - J. Atmos. Sci. 52, 3932-3944.
196. Paegle, J., E. Robl, 1977: The time behavior of the probability density function of some simplified atmospheric flows. -J. Atmos. Sci. 34, 979-990.
197. Palmer, T. N., 1988: Medium and extended range predictability and stability of the Pacific/North American mode. - Quart. J. Roy. Meteorol. Soc. 114, 691-713.
198. _ 1993: Extended-range atmospheric prediction and the Lorenz model. - Bull. Amer. Meteorol. Soc. 74, 49-65.
199. _ 1996: Predictability of the atmosphere and oceans: from days to decades. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. I, 83-141.
200. Palmer, T. N., D. E. T. Anderson, 1994: The prospects for seasonal forecasting - a review paper. - Quart. J. Roy. Meteorol. Soc. 120, 755-793.
201. Palmer, T. N., S. Tibaldi, 1988: On the prediction of forecast skill. - Month. Weath. Rev. 116, 2453-2480.
202. Parker, T. S., L. O. Chua, 1989: Practical numerical algorithms for chaotic systems. - Springer, 348 pp.
203. Penland, C., 1989: Random forcing and forecasting using principal oscillation pattern analysis. - Month. Weath. Rev. 117, 2165-2185.
204. Penland, C., L. Matrosova, 1994: A balance condition for stochastic numerical models with application to the El Nino-Southern Oscillation. - J. Climate 7, 1352-1372.
205. Penland, C., P. Sardeshmukh, 1995a: Error and sensitivity analysis of geophysical eigensystems. - J. Climate 8, 1988-1998.
206. _ 1995b: The optimal growth of tropical sea surface temperature anomalies. - J. Climate 8, 1999-2024.
207. Petroliagis, T., R. Buizza, A. Lanzinger, T. N. Palmer, 1997: Potential of the ECMWF ensemble prediction system in cases of extreme weather events. - Meteorol. Applications., 4, 69-84.
208. Pires, C., R. Vautard, O. Talagrand, 1996: On extending the limits of variational assimilation in nonlinear chaotic systems. -Tellus 48A, 96-121.
209. Pitcher, E. J., 1977: Application of stochastic dynamic prediction to real data. - J. Atmos. Sci. 34, 3-21.
210. Pragér, T., T. Vukićević, J.-N. Thépaut, J.-F. Louis, P. Gauthier, R. M. Errico, J. Derber, P. Courtier, 1995: Second workshop on adjoint applications in dynamic meteorology. - Bull. Amer. Meteorol. Soc. 76, 375-379.
211. Rabier, F., P. Courtier, O. Talagrand, 1992: An application of adjoint models to sensitivity analysis. - Beitr. zur Physik d. Atmosphäre 65, 177-192.
212. Rabier, F., E. Klinker, P. Courtier, A. Hollingsworth, 1996: Sensitivity of forecast errors to initial conditions. - Quart. J. Roy. Meteorol. Soc. 122, 121-150.
213. Richardson, D. S., M. S. J. Harrison, 1996: The use of ensemble forecasting techniques at the UK Meteorological Office, now and in the future. - ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 74-80.
214. Richardson, D. S., M. S. J. Harrison, K. B. Robertson, A. P. Woodcock, 1996: Joint medium-range ensembles using UKMO, ECMWF and NCEP ensemble systems. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, J26-J27.
215. Richardson, L. F., 1922: Weather prediction by numerical process. - Cambridge University Press.
216. Risken, H., 1989: The Fokker-Planck equation. - Springer, 472 pp.
217. Ritchie, H., C. Temperton, A. Simmons, M. Hortal, T. Davies, D. Dent, M. Hamrud, 1995: Implementation of the semi-Lagrangian method in a high-resolution version of the ECMWF forecast model. - Month. Weath. Rev. 123, 489-514.
218. Royer, J. F., 1993: Review of recent advances in dynamical extended range forecasting for the extratropics. - In: Shukla, J. (Ed.), Prediction of interannual climate variations, Springer, 49-69.
219. Saha, S., 1992: Response of the NMC MRF model to systematic-error correction within integration. - Month. Weath. Rev. 120, 345-360.
220. Salmon, R., G. Holloway, M. C. Hendershott, 1976: The equilibrium statistical mechanics of simple quasi-geostrophic models. - J. Fluid Mechanics 75, 691-703.
221. Sardeshmukh, P. D., M. Newman, M. D. Borges, 1997: Free barotropic Rossby wave dynamics of the wintertime low-frequency flow. - J. Atmos. Sci. 54, 5-23.
222. Schubert, S., M. Suarez, J.-K. Schemm, E. Epstein, 1992: Dynamically stratified Monte Carlo forecasting. - Month. Weath. Rev. 120, 1077-1088.
223. Sendov, B., A. Andreev, 1994: Approximation and interpolation theory. - In: Ciarlet, P. G., J. L. Lions (Eds.), Handbook of Numerical Analysis, Vol. III, Elsevier, 406-421.
224. Shukla, J., 1985: Predictability. - In: Saltzman, B., S. Manabe (Eds.), Issues in atmospheric and oceanic modeling, Part B, Advances in Geophysics, 28, Academic Press, 87-122.
225. Simmons, A. J., R. Mureau, T. Petroliagis, 1995: Error growth and estimates of predictability from the ECMWF forecasting system. - Quart. J. Roy. Meteorol. Soc. 121, 1739-1771.
226. Simon, H., 1984: The Lanczos algorithm with partial reorthogonalization. - Math. Comp. 42, 115-136.
227. Smagorinsky, J., 1969: Problems and promises of deterministic extended range forecasting. - Bull. Amer. Meteorol. Soc. 50, 286-311.
228. Snyder, C., 1996: Summary of an informal workshop on adaptive observations and FASTEX. - Bull. Amer. Meteorol. Soc. 77, 953-961.
229. Soize, C., 1994: The Fokker-Planck equation for stochastic dynamical systems and its explicit steady state solutions. -World Scientific, 321 pp.
230. Stewart, D. A., 1994: Predictability of low-frequency planetary waves in a simple low-resolution model. - Month. Weath. Rev. 122, 405-423.
231. Stewart, I., 1989: Does God play dice? The mathematics of chaos. - Basil Blackwell, 317 pp.
232. Strang, G., 1986: Introduction to applied mathematics. -Wellesley-Cambridge Press, 758 pp.
233. Stratonovich, R. L., 1992: Nonlinear nonequilibrium thermodynamics I. - Springer, 361 pp.
234. Strauss, B., A. Lanzinger, 1996a: Validation of the ECMWF ensemble prediction system. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. II, 157-166.
235. _ 1996b: Verification of the ensemble prediction system (EPS). - ECMWF Newsletter 72, 9-15.
236. Stroe, R., J. F. Royer, 1993: Comparison of different error growth formulas and predictability estimation in numerical extended-range forecasts. - Ann. Geophysicae 11, 296-316.
237. Szunyogh, I., E. Kalnay, Z. Toth, 1997: A comparison of Lyapunov and optimal vectors in a low resolution GCM. -Tellus, 49A, 200-227.
238. Talagrand, O., 1989: Four-dimensional variational assimilation. - Proceedings 1988 ECMWF Seminar on Data assimilation and the use of satellite data, Vol. II, 1-30.
239. Tanguay, M., P. Bartello, P. Gauthier, 1995: Four-dimensional data assimilation with a wide range of scales. - Tellus 47A, 974-997.
240. Tennekes, H., A. P. M. Baede, J. D. Opsteegh, 1987: Forecasting forecast skill. - Proceedings ECMWF Workshop on Predictability in the Medium and Extended Range, 277-302.
241. Thacker, W. C., 1990: Large least-square problems and the need for automating the generation of adjoint codes. - Lectures in Applied Mathematics 26, 645-677.
242. Thépaut, J.-N., P. Courtier, G. Belaud, G. Lemaître, 1996: Dynamical structure functions in a four-dimensional variational assimilation: a case study. - Quart. J. Roy. Meteorol. Soc. 122, 535-561.
243. Thépaut, J.-N., R. N. Hoffman, P. Courtier, 1993: Interactions of dynamics and observations in four-dimensional variational assimilation. - Month. Weath. Rev. 121, 3393-3414.
244. Thompson, P. D., 1957: Uncertainty of initial state as a factor in the predictability of large scale atmospheric flow patterns. - Tellus 9, 275-295.
245. _ 1961: Numerical weather analysis and prediction. -Macmillan, 170 pp.
246. _ 1969: Reduction of analysis error through constraints of dynamical consistency. - J. Appl. Meteorol., 8, 738-742.
247. _ 1972: Some exact statistics of two-dimensional viscous flow with random forcing. - J. Fluid Mechanics 55, 711-717.
248. _ 1983: Equilibrium statistics of two-dimensional viscous flows with arbitrary random forcing. - Physics of Fluids 26, 3461-3470.
249. _ 1985a: A review of the predictability problem. - In: Holloway, G., B. J. West (Eds.), Predictability of fluid motions, American Institute of Physics, 1-10.
250. _ 1985b: Moment closures for equilibrium statistics of randomly-forced triads. - J. Atmos. Sci. 42, 631-638.
251. _ 1985c: A statistical-hydrodynamical approach to problems of climate and its evolution. - Tellus 37A, 1-13.
252. _ 1985d: Prediction of probable errors of predictions. -Month. Weath. Rev. 113, 248-259.
253. _ 1986a: Probability distribution of modal amplitudes in interacting triads with arbitrary random forcing. - J. Atmos. Sci. 43, 1517-1524.
254. _ 1986b: A simple approximate method of stochastic-dynamic prediction for small initial errors and short range. - Month. Weath. Rev. 114, 1709-1715.
255. _ 1987a: Oral history. - Interview by J. Tribbia, A. Kasahara, 52 pp. [Available from the National Center for Atmospheric Research, P. O. Box 3000, Boulder, CO 80307, U.S.A.]
256. _ 1987b: The maturing of the science. - Bull. Amer. Meteorol. Soc. 68, 631-637.
257. _ 1988: Stochastic-dynamic prediction of three-dimensional quasi-geostrophic flow. - J. Atmos. Sci. 45, 2669-2679.
258. Tibaldi, S., T. N. Palmer, C. Branković, U. Cubasch, 1990: Extended-range predictions with ECMWF models: influence of horizontal resolution on systematic error and forecast skill. - Quart. J. Roy. Meteorol. Soc. 116, 835-866.
259. Todling, R., S. E. Cohn, 1994: Suboptimal schemes for atmospheric data assimilation based on the Kalman filter. -Month. Weath. Rev. 122, 2530-2557.
260. Toth, Z., E. Kalnay, 1993: Ensemble forecasting at NMC: the generation of perturbations. - Bull. Amer. Meteorol. Soc. 74, 2317-2330.
261. _ 1996a: Ensemble forecasting at NCEP. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. II, 39-60.
262. _ 1996b: Climate ensemble forecasts: how to create them? Idojaras 100, 247-256.
263. _ 1997: Ensemble forecasting at NCEP and the breeding method. - Month. Weath. Rev., 125, in press.
264. Toth, Z., E. Kalnay, S. Tracton, R. Wobus, J. Irwin, 1996a: A synoptic evaluation of the NCEP ensemble. - ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 50-73.
265. _ 1997: A synoptic evaluation of the NCEP ensemble. - Weather and Forecasting, 12, 140-153.
266. Toth, Z., I. Szunyogh, E. Kalnay, 1996b: Singular, Lyapunov and bred vectors in ensemble forecasting. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, 53-55.
267. Tracton, M. S., E. Kalnay, 1993: Operational ensemble prediction at the National Meteorological Center: practical aspects. -Weather and Forecasting 8, 379-398.
268. Tracton, M. S., K. Mo, W. Chen, E. Kalnay, R. Kistler, G. White, 1989: Dynamic extended range forecasting (DERF) at the National Meteorological Center: practical aspects. -Month. Weath. Rev. 117, 1604-1635.
269. Trevisan, A., 1995: Statistical properties of predictability from atmospheric analogs and the existence of multiple flow regimes. - J. Atmos. Sci. 52, 3577-3592.
270. Trevisan, A., R. Legnani, 1995: Transient error growth and local predictability: a study in the Lorenz system. - Tellus 47A, 103-117.
271. Tribbia, J. J., 1991: The problem of predicting forecast skill: current status and prospects for the future. - Extended Abstracts Submitted to the ICTP/WMO International Technical Conference on Long-Range Weather Forecasting Research, Trieste, Italy, World Meteorological Organization, 283-286.
272. _ 1997: Weather prediction. - In: Katz, R. W., A. H. Murphy (Eds.), Economic value of weather and climate forecasts, Cambridge University Press, 1-18.
273. Tribbia, J. J., R. A. Anthes, 1987: Scientific basis of modern weather prediction. - Science 237, 493-499.
274. Tribbia, J. J., D. P. Baumhefner, 1988a: The reliability of improvements in deterministic short-range forecasts in the presence of initial state and modeling deficiencies. - Month. Weath. Rev. 116, 2276-2288.
275. _ 1988b: Estimates of the predictability of low-frequency variability with a spectral general circulation model. - J. Atmos. Sci. 45, 2306-2317.
276. _ 1993: On the problem of prediction beyond the deterministic range. - In: Shukla, J. (Ed.), Prediction of interannual climate variations, Springer, 251-265.
277. Tribbia, J. J., P. Gent, H.-L. Lee, 1996: ENSO predictability and prediction studies at NCAR. - Proceedings 1995 ECMWF Seminar on Predictability, Vol. II, 253-259.
278. Urban, B., 1993: A method to determine the theoretical maximum error growth in atmospheric models. - Tellus 45A, 270-280.
279. Van den Dool, H. M., 1994: Searching for analogues, how long must we wait? - Tellus 46A, 314-324.
280. Van Kampen, N. G., 1992: Stochastic processes in physics and chemistry. - North Holland, 465 pp.
281. Vannitsem, S., C. Nicolis, 1997: Lyapunov vectors and error growth patterns in a T21L3 quasi-geostrophic model. - J. Atmos. Sci., 54, 347-361.
282. Von Myrbach, O., 1913: Verläßlichkeit von Wetterprognosen (Ein Vorschlag). - Meteorol. Z. 30, 496-497.
283. Vukićević, T., 1993: Possibility of skill forecast based on the finite-time dominant linear solutions for a primitive equation regional forecast model. - J. Atmos. Sci. 50, 1777-1791.
284. Watkins, D. S., 1993: Some perspectives on the eigenvalue problem. - SIAM Rev. 35, 430-471.
285. Wilks, D. S., T. M. Hamill, 1995: Potential economic value of ensemble-based surface weather forecasts. - Month. Weath. Rev. 123, 3565-3575.
286. Wilson, L. J., 1996: Verification of weather element forecasts from an ensemble prediction system. - ECMWF Workshop Proceedings, Fifth Workshop on Meteorological Operational Systems, 114-126.
287. Wobus, R. L., E. Kalnay, 1995: Three years of operational prediction of forecast skill at NMC. Month. Weath. Rev. 123, 2132-2148.
288. Yoden, S., M. Nomura, 1993: Finite-time Lyapunov stability analysis and its applications to atmospheric predictability. - J. Atmos. Sci. 50, 1531-1543.
289. Zhu, Y., G. Iyengar, Z. Toth, S. Tracton, T. Marchok, 1996: Objective evaluation of the NCEP global ensemble forecasting system. - Preprint Volume, Eleventh Conference on Numerical Weather Prediction, Norfolk, Virgina, J79-J82.
290. Ziehmann-Schlumbohm, C., K. Fraedrich, L. A. Smith, 1995: Ein internes Vorhersagbarkeitsexperiment im Lorenz-Modell. - Meteorol. Z., N. F. 4, 16-21.