What's Strange About Recent Events (WSARE): An algorithm for the early detection of disease outbreaks

Journal of Machine Learning Research

Volumn 6, Issue , 2005, Pages 1961-1998

  Wong, Weng Keen ^a   Moore, Andrew ^b   Cooper, Gregory ^c   Wagner, Michael ^c  

^a Oregon State University   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Anomaly detection; Applications; Bayesian networks; Biosurveillance; Syndromic surveillance

Indexed keywords

COMBINATORIAL MATHEMATICS; DISEASE CONTROL; HEALTH CARE; TIME SERIES ANALYSIS;

ANOMALY DETECTION; BAYESIAN NETWORKS; BIOSURVEILLANCE; SYNDROMIC DETECTION;

ALGORITHMS;

EID: 29144530575     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (62)

1. 45 CFR Parts 160 through 164, April 2003. Available at http://www.hhs.gov/ocr/combinedregtext.pdf.
2. Charu C. Aggarwal. A framework for diagnosing changes in evolving data streams. In Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, pages 575-586, New York, NY, 2003. ACM Press.
3. Stephen D. Bay and Michael J. Pazzani. Detecting change in categorical data: Mining contrast sets. In Knowledge Discovery and Data Mining, pages 302-306, 1999.
4. Yoav Benjamini and Yosef Hochberg. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B., 57:289-300, 1995.
5. Chris M. Bishop. Novelty detection and neural network validation. IEEE Proceedings - Vision, Image and Signal Processing, 141(4):217-222, August 1994.
6. Carlo E. Bonferroni. Teoria statistica delle classi e calcolo delle probabilità. Pubblicazioni del R Istituto Superiore di Scienze Economiche e Commerciali di Firenze, 8:3-62, 1936.
7. George E. P. Box and Gwilym M. Jenkins. Time series analysis: Forecasting and control. Holden-Day, San Francisco, 1976.
8. Stephen E. Brossette, Alan P. Sprague, J. Michael Hardin, Ken B. Waites, Warren T. Jones, and Stephen A. Moser. Association rules and data mining in hospital infection control and public health surveillance. Journal of the American Medical Informatics Association, 5:373-381, 1998.
9. David L. Buckeridge, Howard Burkom, Murray Campbell, William R. Hogan, and Andrew W. Moore. Algorithms for rapid outbreak detection: a research synthesis. Biomedical Informatics, 38(2):99-113, 2005.
10. Serdar Cabuk, Carla E. Bradley, and Clay Shields. IP covert timing channels: design and detection. In Proceedings of the 11th ACM conference on Computer and Communications Security, pages 178-187, New York, NY, 2004. ACM Press.
11. Keewhan Choi and Stephen B. Thacker. An evaluation of influenza mortality surveillance, 1962-19791. time series forecasts of expected pneumonia and influenza deaths. American Journal of Epidemiology, 113(3):215-226, 1981.
12. Gregory F. Cooper, Denver H. Dash, John D. Levander, Weng-Keen Wong, William R. Hogan, and Michael M. Wagner. Bayesian biosurveillance of disease outbreaks. In Max Checkering and Joseph Halpern, editors, Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence, pages 94-103, Banff, Alberta, Canada, 2004. AUAI Press.
13. Eleazar Eskin. Anomaly detection over noisy data using learned probability distributions. In Proceedings of the 2000 International Conference on Machine Learning (ICML-2000), Palo Alto, CA, July 2000.
14. Tom Fawcett and Foster Provost. Adaptive fraud detection. Data Mining and Knowledge Discovery, 1(3):291-316, 1997.
15. Tom Fawcett and Foster Provost. Activity monitoring: Noticing interesting changes in behavior. In Chaudhuri and Madigan, editors, Proceedings on the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 53-62, San Diego, CA, 1999. URL citeseer.nj.nec.com/fawcett99activity.html.
16. Anna Goldenberg, Galit Shmueli, and Rich Caruana. Using grocery sales data for the detection of bio-terrorist attacks. Submitted to Statistics in Medicine, 2003.
17. Anna Goldenberg, Galit Shmueli, Richard A. Caruana, and Stephen E. Fienberg. Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales. Proceedings of the National Academy of Sciences, 99(8):5237-5240, April 2002. http://www.pnas.org/cgi/doi/10.1073/pnas.042117499.
18. Phillip Good. Permutation Tests - A Practical Guide to Resampling Methods for Testing Hypotheses. Springer-Verlag, New York, 2nd edition, 2000.
19. Greg Hamerly and Charles Elkan. Bayesian approaches to failure prediction for disk drives. In Proceedings of the eighteenth international conference on machine learning, pages 202-209. Morgan Kaufmann, San Francisco, CA, 2001.
20. William R. Hogan, Gregory F. Cooper, Garrick L. Wallstrom, and Michael M. Wagner. The Bayesian aerosol release detector. In Proceedings of the Third National Syndromic Surveillance Conference [CD-ROM], Boston, MA, 2004. Fleetwood Multimedia, Inc.
21. Geoff Hulten, Laurie Spencer, and Pedro Domingos. Mining time-changing data streams. In Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 97-106, San Francisco, CA, 2001. ACM Press. URL citeseer.ist.psu.edu/hulten01mining.html.
22. Lori Hutwagner, William Thompson, G. Matthew Seeman, and Tracee Treadwell. The bioterrorism preparedness and response early aberration reporting system (EARS). Journal of Urban Health, 80(2):i89-i96, 2003.
23. Zalman Kaufman, Erica Cohen, Tamar Peled-Leviatan, Hanna Lavi, Gali Aharonowitz, Rita Dichtiar, Michal Bromberg, Ofra Havkin, Yael Shalev, Rachel Marom, Varda Shalev, Joshua Shemer, and Manfred S Green. Evaluation of syndromic surveillance for early detection of bioterrorism using a localized, summer outbreak of Influenza B. In Proceedings of the Third National Syndromic Surveillance Conference [CD-ROM], Boston, MA, 2004. Fleetwood Multimedia Inc. Poster Presentation.
24. th ACM Conference on Computer and Communication Security (CCS '03), pages 251-261, Washington, DC, October 2003. ACM Press.
25. Martin Kulldorff. A spatial scan statistic. Communications in Statistics: Theory and Methods, 26 (6):1481-1496, 1997.
26. Martin Kulldorff. Spatial scan statistics: models, calculations, and applications. In J. Glaz and N. Balakrishnan, editors, Scan Statistics and Applications, pages 303-322. Birkhauser, Boston, MA, 1999.
27. Martin Kulldorff. Prospective time periodic geographical disease surveillance using a scan statistic. Journal of the Royal Statistical Society, Series A, 164:61-72, 2001.
28. Martin Kulldorff, Lan Huang, and Linda Pickle. An elliptic spatial scan statistic and its application to breast cancer mortality data in the northeastern united states. In Proceedings of the National Syndromic Surveillance Conference, 2002.
29. Terran Lane and Caria E. Brodley. Temporal sequence learning and data reduction for anomaly detection. ACM Transactions on Information and System Security, 2:295-331, 1999.
30. Wenke Lee, Salvatore J. Stolfo, and Kui W. Mok. Adaptive intrusion detection: A data mining approach. Artificial Intelligence Review, 14(6):533-567, 2000. URL citeseer.ist.psu.edu/lee00adaptive.html.
31. Junshui Ma and Simon Perkins. Online novelty detection on temporal sequences. In Proceedings on the ninth ACM SIGKDD international conference on knowledge discovery and data mining, pages 613-618, New York, NY, 2003. ACM Press.
32. Oded Maron and Andrew W. Moore. The racing algorithm: Model selection for lazy learners. Artificial Intelligence Review, 11(1-5):193-225, 1997.
33. Roy A. Maxion and Kymie M.C. Tan. Anomaly detection in embedded systems. IEEE Trans. Comput., 51(2): 108-120, 2002. ISSN 0018-9340.
34. Christopher J. Miller, Christopher Genovese, Robert C. Nichol, Larry Wasserman, Andrew Connolly, Daniel Reichart, Andrew Hopkins, Jeff Schneider, and Andrew Moore. Controlling the false-discovery rate in astrophysical data analysis. The Astronomical Journal, 122:3492-3505, Dec 2001.
35. Douglas C. Montgomery. Introduction to Statistical Quality Control. John Wiley and Sons, Inc., 4th edition, 2001.
36. Andrew Moore and Mary Soon Lee. Cached sufficient statistics for efficient machine learning with large datasets. Journal of Artificial Intelligence Research, 8:67-91, March 1998.
37. Andrew Moore and Weng-Keen Wong. Optimal reinsertion: A new search operator for accelerated and more accurate Bayesian network structure learning. In T. Fawcett and N. Mishra, editors, Proceedings of the 20th International Conference on Machine Learning, pages 552-559, Menlo Park, CA, August 2003. AAAI Press.
38. Andrew W. Moore, Gregory F. Cooper, Rich Tsui, and Michael M. Wagner. Summary of biosurveillance-related technologies. Technical report, Realtime Outbreak and Disease Surveillance Laboratory, University of Pittsburgh, 2003. Available at http://www.autonlab.org/autonweb/showPaper.jsp?ID=moore-biosurv.
39. Farzad Mostashari and Jessica Hartman. Syndromic surveillance: a local perspective. Journal of Urban Health, 80(2):i1-i7, 2003.
40. Daniel B. Neill and Andrew W. Moore. A fast multi-resolution method for detection of significant spatial disease clusters. In Sebastian Thrun, Lawrence Saul, and Bernhard Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
41. Daniel B. Neill, Andrew W. Moore, Francisco Pereira, and Tom Mitchell. Detecting significant multidimensional spatial clusters. In Lawrence K. Saul, Yair Weiss, and Léon Bottou, editors, Advances in Neural Information Processing Systems 17. MIT Press, Cambridge, MA, 2005.
42. E. S. Page. Continuous inspection schemes. Biometrika, 41(1):100-115, 1954.
43. Clifton Phua, Damminda Alahakoon, and Vincent Lee. Minority report in fraud detection: classification of skewed data. ACM SIGKDD Explorations Newsletter Special issue on learning from imbalanced datasets, 6(1):50-59, 2004.
44. Real-time Outbreak Detection System, 2004. Online at http://www.health.pitt.edu/rods/default.htm.
45. Ben Y. Reis and Kenneth D. Mandl. Time series modeling for syndromic surveillance. BMC Medical Informatics and Decision Making, 3(2), 2003. http://www.biomedcentral.com/1472-6947/3/2.
46. S. W. Roberts. Control chart tests based on geometric moving averages. Technometrics, 1:239-250, 1959.
47. Robert E. Serfling. Methods for current statistical analysis of excess pneumonia-influenza deaths. Public Health Reports, 78:494-506, 1963.
48. Ajit P. Singh. What to do when you don't have much data: Issues in small sample parameter learning in Bayesian Networks. Master's thesis, Dept. of Computing Science, University of Alberta, 2004.
49. Daniel M. Sosin. Draft framework for evaluating syndromic surveillance systems. Journal of Urban Health, 80(2):i8-i13, 2003.
50. Fu-Chiang Tsui, Michael M. Wagner, Virginia Dato, and Chung-Chou Ho Chang. Value of ICD-9-coded chief complaints for detection of epidemics. In S Bakken, editor, Journal of the American Medical Informatics Association, Supplement i ssue on the Proceedings of the Annual Fall Symposium of the American Medical Inf ormatics Association, pages 711-715. Hanley and Belfus, Inc. 2001.
51. Tim van Allen. Handling uncertainty when you're handling uncertainty: Model selection and error bars for belief networks. Master's thesis, Dept. of Computing Science, University of Alberta, 2000.
52. Tim van Allen, Russell Greiner, and Peter Hooper. Bayesian error-bars for belief net inference. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence, Aug 2001.
53. Christina Warrender, Stephanie Forrest, and Barak Pearlmutter. Detecting intrusions using system calls: Alternative data models. In Proceedings of the 1999 IEEE Symposium on Security and Privacy, pages 133-145. IEEE Computer Society, 1999.
54. Laurence Watier, Sylvia Richardson, and Bruno Hubert. A time series construction of an alert threshold with application to s. bovismorbificans in france. Statistics in Medicine, 10:1493-1509, 1991.
55. G. David Williamson and Ginner Weatherby Hudson. A monitoring system for detecting aberrations in public health surveillance reports. Statistics in Medicine, 18:3283-3298, 1999.
56. Weng-Keen Wong. Data mining for early disease outbreak detection. PhD thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, 2004.
57. Weng-Keen Wong, Andrew Moore, Gregory Cooper, and Michael Wagner. Bayesian network anomaly pattern detection for disease outbreaks. In Tom Fawcett and Nina Mishra, editors, Proceedings of the Twentieth International Conference on Machine Learning, pages 808-815, Menlo Park, California, August 2003. AAAI Press.
58. Weng-Keen Wong, Andrew W. Moore, Gregory Cooper, and Michael Wagner. Rule-based anomaly pattern detection for detecting disease outbreaks. In Proceedings of the 18th National Conference on Artificial Intelligence, pages 217-223. MIT Press, 2002.
59. Yiming Yang, Tom Pierce, and Jiame Carbonell. A study on retrospective and on-line event detection. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 28-36, New York, NY, 1998. ACM Press.
60. Jian Zhang, Zoubin Ghahramani, and Yiming Yang. A probabilistic model for online document clustering with application to novelty detection. In Lawrence K. Saul, Yair Weiss, and Léon Bottou, editors, Advances in Neural Information Processing Systems 17. MIT Press, Cambridge, MA, 2005.
61. Jun Zhang, Fu-Chiang Tsui, Michael M. Wagner, and William R. Hogan. Detection of outbreaks from time series data using wavelet transform. In Proc AMIA Fall Symp, pages 748-752. Omni Press CS, 2003.
62. Yunyue Zhu and Dennis Shasha. Efficient elastic burst detection in data streams. In Proceedings of the ninth ACM SIGKDD international conference on knowledge discovery and data mining, pages 336-345, New York, NY, 2003. ACM Press.