Analog sky condition forecasting based on a k-nn algorithm

Weather and Forecasting

Volumn 25, Issue 5, 2010, Pages 1463-1478

  Hall, Timothy J ^a   Thessin, Rachel N ^a   Bloy, Greg J ^a   Mutchler, Carl N ^a  

^a AEROSPACE CORPORATION   (United States)

Author keywords

Cloud cover; Forecasting techniques; Probability forecasts; Short range prediction

Indexed keywords

CLEAR SKY; CLOUD COVER; DATA ASSIMILATION SYSTEMS; FORECAST INTERVAL; FORECASTING TECHNIQUES; HISTORICAL DATABASE; K-NEAREST NEIGHBORS (K-NN) ALGORITHMS; K-NN ALGORITHM; METEOROLOGICAL VARIABLES; MODEL ANALYSIS; PROBABILITY FORECASTS; RELATIVE OPERATING CHARACTERISTICS; SHORT-RANGE PREDICTION; SKY CONDITION; TARGET TYPE;

DATA PROCESSING; SATELLITE IMAGERY; TIME SERIES; WEATHER SATELLITES;

WEATHER FORECASTING;

ALGORITHM; CLEAR SKY; CLOUD COVER; DATA ASSIMILATION; FORECASTING METHOD; NEAREST NEIGHBOR ANALYSIS; PROBABILITY; SATELLITE IMAGERY; WEATHER FORECASTING;

UNITED STATES;

EID: 78149287295     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/2010WAF2222372.1     Document Type: Article

References (57)

1. Aha, D. W., 1992: Tolerating noisy, irrelevant, and novel attributes in instance-based learning algorithms. Int. J. Man-Mach. Stud., 36, 267-287.
2. Aha, D. W., 1998: Feature weighting for lazy learning algorithms. Feature Extraction, Construction, and Selection: A Data Mining Perspective, H. Liu and H. Motoda, Eds., Kluwer, 13-29.
3. Andersson, E., C. Cardinali, M. Fisher, E. Holm, L. Isaksen, Y. Tremolet, and A. Hollinsworth, 2004: Developments in ECMWF's 4D-Var system. Preprints, Symp. on Forecasting the Weather and Climate of the Atmosphere and Ocean/20th Conf. on Weather Analysis and Forecasting/16th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., J1.4. [Available online at http://ams.confex.com/ams/pdfpapers/74521.pdf.]
4. AWS, 1961: The use of persistence in forecasting. AWS Sci Services Rev., 3,14-15.
5. Bankert, R. L., and M. Hadjimichael, 2007: Data mining numerical model output for single-station cloud-ceiling forecast algorithms. Wea. Forecasting, 22,1123-1131.
6. Bellman, R. E., 1961: Adaptive Control Processes. Princeton University Press, 273 pp.
7. Beyer, K., J. Goldstein, R. Ramakrishnan, and U. Shaft, 1999: When is "nearest neighbor" meaningful? Proc. Seventh Int. Conf. on Database Theory, Jerusalem, Israel, Association for Computing Machinery, 217-235.
8. Black, T. L., 1994: The new NMC mesoscale Eta Model: Description and forecast examples. Wea. Forecasting, 9, 265-278.
9. Blanchard, D. O., and R. E. Lopez, 1985: Spatial patterns of convection in south Florida. Mon. Wea. Rev., 113,1282-1299.
10. Bradley, A. P., 1997: The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognita., 30,1145-1159.
11. Breiman, L., 2001: Random forests. Mach. Learn., 45, 5-32.
12. Breiman, L., J. H. Friedman, R. A. Olshen, and C. J. Stone, 1998: Classification and Regression Trees. Chapman and Hall, 368 pp.
13. Combs, C. L., W. Blier, W. Strach, and M. DeMaria, 2004: Exploring the timing of fog formation and dissipation over San Francisco Bay area using satellite cloud composites. Preprints, 13th Conf. on Satellite Meteorology and Oceanography, Norfolk, VA, Amer. Meteor. Soe, P4.12. [Available online at http://ams.confex.com/ams/pdfpapers/78778.pdf.]
14. Connell, B. H, K. Gould, and J. F. W. Purdom, 2001: High-resolution GOES-8 visible and infrared cloud frequency composites over northern Florida during the summers 1996-1999. Wea. Forecasting, 16,713-724.
15. Dallaville, J. P., and V. J. Dagostaro, 1995: The accuracy of ceiling and visibility forecasts produced by the National Weather Service. Preprints, Sixth Conf. on Aviation Weather Systems, Dallas, TX, Amer. Meteor. Soc, 213-218.
16. Doswell, C A., Ill, R. Davies-Jones, and D. L. Keller, 1990: On summary measures of skill in rare event forecasting based on contingency tables. Wea. Forecasting, 5, 576-585.
17. Egan, J. P., 1975: Signal Detection Theory and ROC Analysis. Academic Press, 277 pp.
18. Enger, I., L. J. Reed, and J. E. MacMonegle, 1962: An evaluation of 2-7-hr aviation terminal-forecasting techniques. Federal Aviation Agency Interim Rep. Tech. Publ. 20, Travelers Research Center Inc., 43 pp.
19. Fix, E., and J. L. Hodges Jr., 1951: Discriminatory analysis; non-parametric discrimination: Consistency properties. USAF School of Aviation Medicine Tech. Rep. 21-49-004(4), Randolph Field, TX, 24 pp.
20. Friedman, J. H, 1994: Flexible metric nearest neighbor classification technical report. Dept. of Statistics, Stanford University, Tech. Rep. 113, 32 pp.
21. Fukunaga, K., 1990: Introduction to Statistical Pattern Recognition. Academic Press, 592 pp.
22. German, K. E., and P. Hicks Jr., 1981: Air Weather Service ceiling and visibility verification. Bull. Amer. Meteor. Soc., 62,785-790.
23. Girodo, M., R. W. Mueller, and D. Heinemann, 2006: Influence of three-dimensional cloud effects on satellite derived solar irradiance estimation-First approaches to improve the Heliosat methods. Sol. Energy, 80,1145-1159.
24. Glickman, T. S., Ed., 2000: Glossary of Meteorology. 2nd ed. Amer. Meteor. Soc, 855 pp.
25. Hall, T. J., D. L. Reinke, and T. H. Vonder Haar, 1998: Forecasting applications of high-resolution satellite cloud composite climatologies. Wea. Forecasting, 13,16-23.
26. Hansen, B., 2007: A fuzzy logic-based analog forecasting system for ceiling and visibility. Wea. Forecasting, 22,1319-1330.
27. Harvey, L. O., Jr., K. R. Hammond, C. M. Lusk, and E. F. Mross, 1992: The application of signal detection theory to weather forecasting behavior. Mon. Wea. Rev., 120, 863-883.
28. Jedlovec, G. J., S. L. Haines, and F. J. LaFontaine, 2008: Spatial and temporal varying thresholds for cloud detection in GOES imagery. IEEE Trans. Geosci. Remote Sens., 46, 1-13.
29. Johns, M. V., 1961: An empirical Bayes approach to nonparametric two-way classification. Studies in Item Analysis and Prediction, H. Soloman, Ed., Stanford University Press, 221-232.
30. Keller, J. M., M. R. Gray, and J. S. Givens Jr., 1985: A fuzzy k-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern., 15, 580-585.
31. Kelly, F. P., 1988: Spatial and temporal short range total cloud cover estimation by metric analysis of composite imagery. Ph.D. dissertation, Colorado State University, Fort Collins, CO, 152 pp.
32. Kharin, V. V., and F. W. Zwiers, 2003: On the ROC score of probability forecasts. J. Climate, 16, 4145-4150.
33. Kopp, T. J., M. M. Wonsick, L. E. Cantrell, and F. D. Bieker, 1997: ADVCLD: Air Force Global Weather Center's updated cloud forecast model. Preprints, Cloud Impacts on DOD Operations and Systems Conf., Newport, RI, Phillips Laboratory (AFMC) PL-TR-97-2112, 1107-1110.
34. Leyton, S. M., and J. M. Fritsch, 2003: Short-term probabilistic forecasts of ceiling and visibility utilizing high-density surface weather observations. Wea. Forecasting, 18, 891-902.
35. Martin, D. E., 1972: Climatic presentations for short-range forecasting period based on even occurrence and reoccurrence profiles. J. Appl. Meteor., 11, 1212-1223.
36. Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291-303.
37. Mason, S. J., and N. E. Graham, 2002: Areas beneath the relative operating characteristic (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation. Quart. J. Roy. Meteor. Soc., 128, 2145-2166.
38. McCabe, J. T., 1968: Estimating conditional probability and persistence. U.S. Air Force Tech. Rep. 208, 20 pp.
39. McGranaghan, M., T. Ortmeyer, D. Crudele, T. Key, J. Smith, and P. Barker, 2008: Renewable systems interconnection study: Advanced grid planning and operations. Sandia National Laboratories Rep. SAND2008-0944 P, 122 pp.
40. Murphy, A. H, 1977: The value of climatological, categorical and probabilistic forecasts in the cost-loss ratio situation. Mon. Wea. Rev., 105, 803-816.
41. Murphy, A. H, 1992: Climatology, persistence, and their linear combination as standards of reference in skill scores. Wea. Forecasting, 17, 692-698.
42. Murphy, A. H, and M. Ehrendorfer, 1987: On the relationship between the accuracy and value of forecasts in the cost-loss ratio situation. Wea. Forecasting, 2, 243-251.
43. Olson, R. H, 1965: On the use of Bayes' theorem in estimating false alarm rates. Mon. Wea. Rev., 93, 557-558.
44. Peterson, W. W., T. G Birdsall, and W. C Fox, 1954: The theory of signal detectability. Trans. IRE Prof. Group Inf. Theory, 2-4, 171-212.
45. Quinlan, J. R., 1986: Induction of decision trees. Mach. Learn., 1, 81-106.
46. Reinke, D. L., J. M. Forsythe, J. A. Kankiewicz, K. R. Dean, C L. Combs, and T. H. Vonder Haar, 2003: Development and applications of regional cloud products from the CHANCES global cloud database. Preprints, 12th Conf. on Satellite Meteorology and Oceanography, Long Beach, CA, Amer. Meteor. Soe., P1.2. [Available online at http://ams.confex.com/ams/pdfpapers/52805.pdf.]
47. Restivo, J. S., 1966: Persistence probability. Fourth Weather Wing Tech. Paper 66-1, 34 pp.
48. Restivo, J. S., and F. R. Hartranft, 1970: The value of static and trend persistence in the one-hour prediction of ceiling and visibility. Fourth Weather Wing, Tech. Rep., Ent AFB, CO, 122 pp.
49. Sartor, J. D., 1957: A systematic approach to local objective forecast studies. The Rand Corporation Rep. P-912, 26 pp.
50. Thompson, J. C, 1962: Economic gains from scientific advances and operational improvements in meteorological prediction. J. Appl. Meteor., 1, 13-17.
51. Tonooka, H., 2001: An atmospheric correction algorithm for thermal infrared multispectral data over land-A water-vapor scaling method. IEEE Trans. Geosci. Remote Sens., 39, 682-692.
52. Van den Dool, H. M., 1994: Searching for analogues, how long must we wait? Tellus, 46, 314-324.
53. Vislocky, R. L., and J. M. Fritsch, 1997: An automated, observation-based system for short-term prediction of ceiling and visibility. Wea. Forecasting, 12, 31-43.
54. Wettschereck, D., 1994: A study of distance-based machine learning algorithms. Ph.D. dissertation, Oregon State University, 173 pp.
55. Wettschereck, D., D. W. Aha, and T. Mohri, 1997: A review of empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif Intell. Rev., 11, 273-314.
56. Wiener, G, P. H Herzegh, R. Bateman, and B. Chorbajian, 2004: Utilizing site-based data mining in national ceiling and visibility forecasting. Preprints, 11th Conf. on Aviation, Range, and Aerospace Meteorology, Hyannis, MA, Amer. Meteor. Soe, P10.1. [Available online at http://ams.confex.com/ams/pdfpapers/81633.pdf.].
57. Witten, I. H., and E. Frank, 2005: Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, 560 pp.