Enhancing understanding and improving prediction of severe weather through spatiotemporal relational learning

Machine Learning

Volumn 95, Issue 1, 2014, Pages 27-50

  McGovern, Amy ^a   Gagne II, David J ^b   Williams, John K ^c   Brown, Rodger A ^d   Basara, Jeffrey B ^b  

^a University of Oklahoma   (United States)

^b UNIVERSITY OF OKLAHOMA   (United States)

^c NATIONAL CENTER FOR ATMOSPHERIC RESEARCH   (United States)

^d NATIONAL SEVERE STORMS LABORATORY   (United States)

Author keywords

Severe weather; Spatiotemporal; Statistical relational learning

Indexed keywords

FORECASTING; LEARNING ALGORITHMS; PRECIPITATION (METEOROLOGY); TORNADOES;

EMBEDDED MACHINES; EMPIRICAL PREDICTIVE MODELS; MACHINE LEARNING TECHNIQUES; RELATIONAL LEARNING; SEVERE WEATHER; SPATIO-TEMPORAL RELATIONSHIPS; SPATIOTEMPORAL; STATISTICAL RELATIONAL LEARNING;

LEARNING SYSTEMS;

EID: 84897108709     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-013-5343-x     Document Type: Article

References (73)

1. Allen, J. F. (1991). Time and time again: the many ways to represent time. International Journal of Intelligent Systems, 6(4), 341-355.
2. Benjamin, S., Devenyi, D., Smirnova, T., Weygandt, S. S., Brown, J. M., Peckham, S., Brundage, K. J., Smith, T. L., Grell, G. A., & Schlatter, T. W. (2006). From the 13-km RUC to the rapid refresh. In AMS 12th conference on aviation, range, and aerospace meteorology, Atlanta, GA, paper 9.1.
3. Blockeel, H., & De Raedt, L. (1998). Top-down induction of first order logical decision trees. Artificial Intelligence, 101(1-2), 285-297.
4. Bluestein, H. B. (1993). Synoptic-dynamic meteorology in midlatitudes. In Observations and theory of weather systems, vol. 2, London: Oxford University Press.
5. Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5-32.
6. Brier, G. W. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78, 1-3.
7. Brown, R. A., Lemon, L. R., & Burgess, D. W. (1978). Tornado detection by pulsed Doppler radar. Monthly Weather Review, 106, 29-38.
8. Clark, A. J., Weiss, S. J., Kain, J. S., Jirak, I. L., Coniglio, M. C., Melick, C. J., Siewert, C., Sobash, R. A., Marsh, P. T., Dean, A. R., Xue, M., Kong, F., Thomas, K. W., Wang, Y., Brewster, K., Gao, J., Wang, X., Du, J., Novak, D. R., Barthold, F. E., Bodner, M. J., Levit, J. J., Entwistle, C. B., Jensen, T. L., & Correia, J. C. (2012). An overview of the 2010 hazardous weather testbed experimental forecast program spring experiment. Bulletin of the American Meteorological Society, 139, 55-74.
9. Cova, T., & Goodchild, M. (2002). Extending geographical representation to include fields of spatial objects. International Journal of Geographical Information Science, 16(6), 509-532.
10. Davies-Jones, R. (2008). Can a descending rain curtain in a supercell instigate tornadogenesis barotropically? Journal of the Atmospheric Sciences, 65, 2469-2497.
11. Davies-Jones, R. P. (1986). Tornado dynamics. In E. Kessler (Ed.), Thunderstorm morphology and dynamics (pp. 197-236). Norman: University of Oklahoma Press.
12. Eichenbaum, H. (2003). Historical overview of turbulence accidents and case study analysis. Br-m021/080-1, MCR Federal Inc, MCR Federal Inc., 175 Middlesex Turnpike, Bedford, MA 01730.
13. FAA (2012). FAA Aeronautical Information Manual. Federal Aviation Administration. www.faa.gov/air-traffic/publications/atpubs/aim.
14. Fast, A., Friedland, L., Maier, M., Taylor, B., Jensen, D., Goldberg, H., & Komoroske, K. (2007). Relational data pre-processing techniques for improved securities fraud detection. In Proceedings of the 13th international conference on knowledge discovery and data mining (pp. 941-949).
15. Fern, A., Getoor, L., & Milch, B. (2006). SRL2006: Open problems in statistical relational learning. http://www.cs.umd.edu/projects/srl2006/.
16. Gagne, D. J. II, McGovern, A., Basara, J., & Brown, R. A. (2012). Tornadic supercell environments analyzed using surface and reanalysis data: a spatiotemporal relational data mining approach. Journal of Applied Meteorology and Climatology, 51, 2203-2217.
17. Getoor, L. & Taskar, B. (Eds.) (2007). Introduction to statistical relational learning. Adaptive computation and machine learning series. Cambridge: MIT Press.
18. Glickman, T. (2000). Glossary of meteorology. American Meteorological Society.
19. Goodchild, M., Yuan, M., & Cova, T. (2007). Towards a general theory of geographic representation in GIS. International Journal of Geographical Information Science, 21(3), 239-260.
20. Hansen, A. W., & Kuipers, W. J. A. (1965). On the relationship between the frequency of rain and various meteorological parameters. Mededelingen En Verhandelingen, 81, 2-15.
21. Hocker, J., & Basara, J. (2008). A geographic information systems-based analysis of supercells across Oklahoma from 1994-2003. Journal of Applied Meteorology and Climatology, 47, 1518-1538.
22. Jensen, D., & Getoor, L. (2003). IJCAI 2003 workshop on learning statistical models from relational data. http://kdl.cs.umass.edu/srl2003/.
23. Johns, R. H., & Doswell, C. A. III (1992). Severe local storms forecasting. Weather and Forecasting, 7, 588-612.
24. Johnson, R. A., Chawla, N. V., & Hellmann, J. J. (2012). Species distribution modeling and prediction: a class imbalance problem. In Proceedings of the conference on intelligent data understanding (CIDU). pp 8 pages, electronically published.
25. Kaplan, M. L., Charney, J. J., Waight, K. T. III, Lux, K. M., Cetola, J. D., Huffman, A. W., Riordan, A. J., Slusser, S. D., Kiefer, M. T., Suffern, P. S., & Lin, Y. L. (2006). Characterizing the severe turbulence environments associated with commercial aviation accidents: a real-time turbulence model (rttm) designed for the operational prediction of hazardous aviation turbulence environments. Meteorology and Atmospheric Physics, 94(1-4), 235-270.
26. Keogh, E., Wei, L., Xi, X., Lee, S. H., & Vlachos, M. (2006). Lb-keogh supports exact indexing of shapes under rotation invariance with arbitrary representations and distance measures. In Proceedings of the 32nd international conference on very large data bases, VLDB endowment, VLDB '06 (pp. 882-893).
27. Klemp, J. B., & Rotunno, R. (1983). A study of the tornadic region within a supercell thunderstorm. Journal of the Atmospheric Sciences, 40(2), 359-377.
28. Lane, T. P., Sharman, R. D., Trier, S. B., Fovell, R. G., & Williams, J. K. (2012). Recent advances in the understanding of near-cloud turbulence. Bulletin of the American Meteorological Society, 93, 499-515.
29. Lemon, L. R., & Doswell, C. A. III (1979). Severe thunderstorm evolution and mesocyclone structure as related to tornadogenesis. Monthly Weather Review, 107, 1184-1197.
30. Lubber, M. (2012). Wild weather a new normal and insurance companies must act. In Forbes magazine. http://www.forbes.com/sites/mindylubber/2012/08/30/ wild-weather-a-new-normal-and-insurance-companies-must-act/.
31. Markowski, P. M., Straka, J. M., & Rasmussen, E. N. (2003). Tornadogenesis resulting from the transport of circulation by a downdraft: idealized numerical simulation. Journal of the Atmospheric Sciences, 60(6), 295-823.
32. Mason, I. (1982). A model for assessment of weather forecasts. Australian Meteorological Magazine, 30, 291-303.
33. McGovern, A., Hiers, N., Collier, M., Gagne, D. J. II, & Brown, R. A. (2008). Spatiotemporal relational probability trees. In Proceedings of the 2008 IEEE international conference on data mining, Pisa, Italy (pp. 935-940).
34. McGovern, A., Supinie, T., Gagne, D. J. II, Troutman, N., Collier, M., Brown, R. A., Basara, J., & Williams, J. (2010). Understanding severe weather processes through spatiotemporal relational random forests. In Proceedings of the 2010 NASA conference on intelligent data understanding (pp. 213-227).
35. McGovern, A., Gagne, D. J. II, Troutman, N., Brown, R. A., Basara, J., & Williams, J. (2011). Using spatiotemporal relational random forests to improve our understanding of severe weather processes. Statistical Analysis and Data Mining, 4(4), 407-429.
36. McGovern, A., Troutman, N., Brown, R. A., Williams, J. K., & Abernethy, J. (2013). Enhanced spatiotemporal relational probability trees and forests. Data Mining and Knowledge Discovery, 26(2), 398-433.
37. McPherson, R. A., Fiebrich, C. A., Crawford, K. C., Elliott, R. L., Kilby, J. R. Grimsley, D. L., Martinez, J. E., Basara, J. B., Illston, B. G., Morris, D. A., Kloesel, K. A., Stadler, S. J., Melvin, A. D., Sutherland, A. J., Shrivastava, H., Carlson, J. D., Wolfinbarger, J. M., Bostic, J. P., & Demko, D. B., (2007). Statewide monitoring of the mesoscale environment: A technical update on the Oklahoma Mesonet. Journal of Atmospheric and Oceanic Technology, 24, 301-321.
38. Miller, R. C. (1967). Notes on analysis and severe-storm forecasting procedures of the Military Weather Warning Center. Air Weather Service Technical Report 200, USAF, Scott Air Force Base, IL.
39. Moller, A. R., Doswell, C. A. III, Foster, M. P., & Woodall, G. R. (1994). The operational recognition of supercell thunderstorm environments and storm structures. Weather and Forecasting, 9, 327-347.
40. Mueen, A., Keogh, E., & Young, N. (2011). Logical-shapelets: an expressive primitive for time series classification. In Proceedings of ACM SIGKDD (pp. 1154-1162).
41. Murphy, A. H. (1973). A new vector partition of the probability score. Journal of Applied Meteorology, 12, 595-600.
42. Neville, J., & Jensen, D. (2007). Relational dependency networks. Journal of Machine Learning Research, 8, 653-692.
43. Neville, J., Jensen, D., Friedland, L., & Hay, M. (2003). Learning relational probability trees. In Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 625-630).
44. Neville, J., Şimşek, Ö., Jensen, D., Komoroske, J., Palmer, K., & Goldberg, H. (2005). Using relational knowledge discovery to prevent securities fraud. In Proceedings of the 11th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 449-458).
45. Niculescu-Mizil, A., & Caruana, R. (2005). Obtaining calibrated probabilities from boosting. In Proceedings of the 21st conference on uncertainty in artificial intelligence (UAI '05). Melno Park: AUAI Press.
46. Osada, R., Funkhouser, T., Chazelle, B., & Dobkin, D. (2002). Shape distributions. ACM Transactions on Graphics, 21(4), 807-832.
47. Peirce, C. S. (1884). The numerical measure of the success of predictions. Science, 4, 453-454.
48. Provost, F. J., & Domingos, P. (2003). Tree induction for probability-based ranking. Machine Learning, 52, 199-215.
49. Quinlan, J. R. (1986). Induction of decision trees. Machine Learning, 1, 81-106.
50. Quinlan, J. R. (1993). C4.5: programs for machine learning. San Mateo: Morgan Kaufmann.
51. Raghavan, S., Mooney, R. J., & Ku, H. (2012). Learning to "read between the lines" using Bayesian logic programs. In Proceedings of the 50th annual meeting of the association for computational linguistics (ACL-2012) (pp. 349-358).
52. Ramon, J., Francis, T., & Blockeel, H. (2002). Learning a go heuristic with TILDE. In Revised papers from the second international conference on computers and games (pp. 151-169). London: Springer.
53. Rasmussen, E. N. (2003). Refined supercell and tornado forecast parameters. Weather and Forecasting 18:530-535.
54. Rotunno, R. (1993). Supercell thunderstorm modeling and theory. In The tornado: its structure, dynamics, prediction, and hazards. Geophysical monograph (Vol. 79, pp. 57-73). Washington: American Geophysical Union.
55. Schaefer, J. T. (1990). The critical success index as an indicator of warning skill. Weather and Forecasting, 5(4), 570-575.
56. Schultz, D. M. (2010). How to research and write effective case studies in meteorology. E-Journal of Severe Storms Meteorology, 5, 1-18.
57. Sharan, U., & Neville, J. (2007). Exploiting time-varying relationships in statistical relational models. In Proceedings of the 1st SNA-KDD workshop, 13th ACM SIGKDD conference on knowledge discovery and data mining.
58. Sharan, U., & Neville, J. (2008). Temporal-relational classifiers for prediction in evolving domains. In Proceedings of the IEEE international conference on data mining.
59. Sharman, R., Tebaldi, C., Wiener, G., & Wolff, J. (2006). An integrated approach to mid- and upper-level turbulence forecasting. Weather and Forecasting, 21, 268-287.
60. Simmons, K. M., & Sutter, D. (2011). Economic and societal impacts of tornadoes. American Meteorological Society
61. Skamarock, W. C., & Klemp, J. B. (2008). A time-split nonhydrostatic atmospheric model for research and NWP applications. Journal of Computational Physics, 227, 2465-2485.
62. Snook, N., & Xue, M. (2008). Effects of microphysical drop size distribution on tornadogenesis in supercell thunderstorms. Geophysical Research Letters, 35(24), L24, 803.
63. Stensrud, D. J., Xue, M., Wicker, L. J., Kelleher, K. E., Foster, M. P., Schaefer, J. T., Schneider, R. S., Benjamin, S. G., Weygandt, S. S., Ferree, J. T., & Tuell, J. P. (2009). Convective-scale warn on forecast system: a vision for 2020. Bulletin of the American Meteorological Society, 90, 1487-1499.
64. Thompson, R. L., Mead, C. M., & Edwards, R. (2007). Effective storm-relative helicity and bulk shear in supercell thunderstorm environments. Weather and Forecasting, 22, 102-115.
65. Wagstaff, K. (2012). Machine learning that matters. In Proceedings of the twenty-ninth international conference on machine learning (pp. 529-536).
66. Wandishin, M. S., Pettegrew, B. P., Petty, M. A., & Mahoney, J. L. (2011). Quality assessment report graphical turbulence guidance, version 2.5. Tech. rep, United States. National Oceanic and Atmospheric Administration, Earth System Research Laboratory, Global Systems Division. http://purl.fdlp.gov/GPO/ gpo15528.
67. Weiss, G. M., & Provost, F. (2003). Learning when training data are costly: the effect of class distribution on tree induction. The Journal of Artificial Intelligence Research, 19, 315-354.
68. Wicker, L. J., & Wilhelmson, R. B. (1995). Simulation and analysis of tornado development and decay within a three-dimensional supercell thunderstorm. Journal of the Atmospheric Sciences, 52(15), 2675-2703.
69. Wilks, D. S. (2011). International geophysics series: Vol. 100. Statistical methods in the atmospheric sciences (3rd ed.). Amsterdam: Elsevier.
70. Williams, J. K. (2013) Using random forests to diagnose aviation turbulence. Machine Learning. doi: 10.1007/s10994-013-5346-7
71. Williams, J. K., Sharman, R., Craig, J., & Blackburn, G. (2008). Remote detection and diagnosis of thunderstorm turbulence. In Proceedings of SPIE, remote sensing applications for aviation weather hazard detection and decision support (Vol. 7088).
72. Ye, L., & Keogh, E. (2009). Time series shapelets: a new primitive for data mining. In Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining (pp. 947-956).
73. Zadrozny, B., & Elkan, C. (2002). Transforming classifier scores into accurate multiclass probability estimates. In Proceedings of the eighth ACM SIGKDD international conference on knowledge discovery and data mining (pp. 694-699). New York: ACM. doi: 10.1007/s10994-013-5343-x.