Evaluation of data reduction algorithms for real-time analysis

Weather and Forecasting

Volumn 25, Issue 3, 2010, Pages 837-851

  Lazarus, Steven M ^a   Splitt, Michael E ^a   Lueken, Michael D ^b   Ramachandran, Rahul ^c   Li, Xiang ^c   Movva, Sunil ^c   Graves, SARA J ^c   Zavodsky, Bradley T ^d  

^a FLORIDA INSTITUTE OF TECHNOLOGY   (United States)

^b CLIMATE PREDICTION CENTER   (United States)

^c UNIVERSITY OF ALABAMA IN HUNTSVILLE   (United States)

^d NASA MARSHALL SPACE FLIGHT CENTER   (United States)

Author keywords

Data assimilation; Data mining

Indexed keywords

AIRS DATA; ANALYSIS SYSTEM; ATMOSPHERIC INFRARED SOUNDERS; COMPUTATIONAL REQUIREMENTS; DATA ANALYSIS; DATA APPLICATION; DATA ASSIMILATION; DATA REGIONS; DATA SETS; DATA-REDUCTION ALGORITHMS; FORECAST MODEL; HOMOGENEOUS REGIONS; INITIAL CONDITIONS; INTELLIGENT ALGORITHMS; INTELLIGENT METHOD; MOISTURE PROFILES; OBSERVATION ERRORS; REAL TIME ANALYSIS; REGIONS OF INTEREST; RETENTION RATE; SYNTHETIC AND REAL DATA; SYNTHETIC DATASETS; SYNTHETIC EXPERIMENTS; THINNING ALGORITHM;

ADAPTIVE ALGORITHMS; DATA MINING; DATA PROCESSING; INFRARED DEVICES; INFRARED INSTRUMENTS; STATISTICS; WEATHER FORECASTING;

DATA REDUCTION;

ALGORITHM; DATA ASSIMILATION; DATA MINING; REAL TIME; WEATHER FORECASTING;

EID: 77955590145     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/2010WAF2222296.1     Document Type: Article

References (36)

1. Anderson, J. L., B. Wyman, S. Zhang, and T. Hoar, 2005: Assimilation of surface pressure observations using an ensemble filter in an idealized global atmospheric prediction system. J. Atmos. Sci., 62, 2925-2938.
2. Aumann, H. H., and Coauthors, 2003: AIRS/AMSU/HSB on the Aqua mission: Design, science objectives, data products, and processing systems. IEEE Trans. Geosci. Remote Sens., 41, 253-264.
3. Bergman, K. H., and W. D. Bonner, 1976: Analysis error as a function of observation density for satellite temperature soundings with spatially correlated errors. Mon. Wea. Rev., 104, 1308-1316.
4. Bondarenko, V., T. Ochotta, and D. Saupe, 2007: The interaction between model resolution, observation resolution and observations density in data assimilation: A two-dimensional study. Preprints, 11th Symp. on Integrated Observing and Assimilation Systems for the Atmosphere, Oceans, and Land Surface, San Antonio, TX, Amer. Meteor. Soc., P5.19. [Available online at http://ams.confex.com/ams/pdfpapers/117655.pdf.]
5. Brewster, K., 1996: Implementation of a Bratseth analysis scheme including Doppler radar. Preprints, 15th Conf. on Weather Analysis and Forecasting, Boston, MA, Amer. Meteor. Soc., 596-598.
6. DiMego, G. J., 1988: The National Meteorological Center regional analysis system. Mon. Wea. Rev., 116, 977-1000.
7. Dudhia, J., J. Klemp, W. C. Skamarock, D. Dempsey, Z. I. Janjic, S. G. Benjamin, and J. M. Brown, 1998: A collaborative effort towards a future community mesoscale model. Preprints, 12th Conf. on Numerical Weather Prediction, Phoenix, AZ, Amer. Meteor. Soc., 42-43.
8. Dyn, N., M. S. Floater, and A. Iske, 2002: Adaptive thinning for bivariate scattered data. J. Comput. Appl. Math., 145, 505-517.
9. Efron, B., and R. Tibshirani, 1993: An Introduction to the Bootstrap. Chapman and Hall, 456 pp.
10. Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99, 10 143-10 162.
11. Eyre, J. R., 1990: The information content of data from satellite sounding systems: A simulation study. Quart. J. Roy. Meteor. Soc., 116, 401-434.
12. Gao, J., M. Xue, K. Brewster, and K. K. Droegemeier, 2004: A three-dimensional variational data analysis method with recursive filter for Doppler radars. J. Atmos. Oceanic Technol., 21, 457-469.
13. Hayden, C. M., and R. J. Purser, 1995: Recursive filter objective analysis of meteorological fields: Applications to NESDIS operational processing. J. Appl. Meteor., 34, 3-15.
14. Huang, X., 2000: Variational analysis using spatial filters. Mon. Wea. Rev., 128, 2588-2600.
15. Koch, S. E., M. des Jardin, and P. J. Kocin, 1983: An interactive Barnes objective map analysis scheme for use with satellite and conventional data. J. Climate Appl. Meteor., 22, 1487-1503.
16. Langland, R. H., and Coauthors, 1999: The North Pacific Experiment (NORPEX-98): Targeted observations for improved North American weather forecasts. Bull. Amer. Meteor. Soc., 80, 1363-1384.
17. Lazarus, S. M., C. M. Ciliberti, J. D. Horel, and K. A. Brewster, 2002: Near-real-time applications of a mesoscale analysis system to complex terrain. Wea. Forecasting, 17, 971-1000.
18. Liu, Z.-Q., and F. Rabier, 2003: The potential of high-density observations for numerical weather prediction: A study with simulated observations. Quart. J. Roy. Meteor. Soc., 129, 3013-3035.
19. Lorenc, A. C., 1981: A global three-dimensional multivariate statistical interpolation scheme. Mon. Wea. Rev., 109, 701-721.
20. Lorenc, A. C., 1986: Analysis methods for numerical weather prediction. Quart. J. Roy. Meteor. Soc., 112, 1177-1194.
21. Ochotta, T., C. Gebhardt, D. Saupe, and W. Wergen, 2005: Adaptive thinning of atmospheric observations in data assimilation with vector quantization and filtering methods. Quart. J. Roy. Meteor. Soc., 131, 3427-3437.
22. Ochotta, T., C. Gebhardt, V. Bondarenko, D. Saupe, and W. Wergen, 2007: On thinning methods for data assimilation of satellite observations. Preprints, 23rd Int. Conf. on Interactive Information Processing Systems (IIPS), San Antonio, TX, Amer. Meteor. Soc., 2B.3. [Available online at http://ams.confex.com/ams/pdfpapers/118511.pdf.]
23. Peckham, G., 1974: The information content of remote measurements of the atmospheric temperature by satellite IR radiometry and optimum radiometer configurations. Quart. J. Roy. Meteor. Soc., 100, 406-419.
24. Purser, R. J., D. F. Parrish, and M. Masutani, 2000: Meteorological observational data compression; An alternative to conventional "superobbing." NCEP Office Note 430, 12 pp. [Available online at http://www.emc.ncep.noaa.gov/mmb/papers/purser/on430.pdf.]
25. Purser, R. J., W.-S. Wu, D. F. Parrish, and N. M. Roberts, 2003: Numerical aspects of the application of recursive filters to variational filters to variational statistical analysis. Part I: Spatially homogeneous and isotropic Gaussian covariances. Mon. Wea. Rev., 131, 1524-1535.
26. Rabier, F., and Coauthors, 2008: Anupdateon THORPEX-related research in data assimilation and observing strategies. Nonlinear Processes Geophys., 15, 81-94.
27. Renard, R. J., and L. C. Clarke, 1965: Experiments in numerical objective frontal analysis. Mon. Wea. Rev., 93, 547-556.
28. Rodgers, C. D., 1976: Retrieval of atmospheric temperature and composition from remote measurements of thermal radiation. Rev. Geophys. Space Phys., 14, 609-624.
29. Shannon, C. E., 1948: A mathematical theory of communication. Bell Syst. Tech. J., 27, 379-423.
30. Skamarock, W. C., J. B. Klemp, J. Dudhia, D. O. Gill, D. M. Barker, W. Wang, and J. G. Powers, 2005: A description of the Advanced Research WRF version 2. NCAR Tech Note NCAR/TN-468+STR, 88 pp. [Available online at http://box.mmm.ucar.edu/wrf/users/docs/arw_v2.pdf.]
31. Snyder, C., 1996: Summary of an informal workshop on adaptive observations and FASTEX. Bull. Amer. Meteor. Soc., 77, 953-961.
32. Susskind, J., C. Barnet, J. Blaisdell, L. Irdell, F. Keita, L. Kouvaris, G. Molnar, and M. Chahine, 2006: Accuracy of geophysical parameters derived from Atmospheric Infrared Sounder/Advanced Microwave Sounding Unit as a function of fractional cloud cover. J. Geophys. Res., 111, D09S17, doi:10.1029/2005JD006272.
33. Tobin, D. C., and Coauthors, 2006: ARM site atmospheric state best estimates for AIRS temperature and water vapor retrieval validation. J. Geophys. Res., 111, D09S14, doi:10.1029/2005JD006103.
34. Trapp, R. J., and C. A. Doswell III, 2000: Radar data objective analysis. J. Atmos. Oceanic Technol., 17, 105-120.
35. Xu, Q., 2007: Measuring information content from observations for data assimilation: Relative entropy versus Shannon entropy difference. Tellus, 59A, 198-209.
36. Xu, Q., L. Wei, and S. Healy, 2009: Measuring information content from observations for data assimilations: Connection between different measures and application to radar scan design. Tellus, 61A, 144-153.