Understanding Detection Performance in Public Health Surveillance: Modeling Aberrancy-detection Algorithms

Journal of the American Medical Informatics Association

Volumn 15, Issue 6, 2008, Pages 760-769

  Buckeridge, David L ^a   Okhmatovskaia, Anna ^a   Tu, Samson ^b   O'Connor, Martin ^b   Nyulas, Csongor ^b   Musen, Mark A ^b  

^a MCGILL UNIVERSITY   (Canada)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; COMPUTER PROGRAM; DISEASE SURVEILLANCE; ELECTRONIC MEDICAL RECORD; PUBLIC HEALTH SERVICE; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS;

ALGORITHMS; DISEASE OUTBREAKS; HUMANS; MODELS, THEORETICAL; POPULATION SURVEILLANCE; SOFTWARE;

EID: 54449093612     PISSN: 10675027     EISSN: None     Source Type: Journal    
DOI: 10.1197/jamia.M2799     Document Type: Article

References (45)

1. Lombardo J.S., Buckeridge D.L., and Lombardo J.S. Disease surveillance: A public health informatics approach (2007), John Willey & Sons, Hoboken, NJ
2. Wagner M.M., Moore A.W., and Aryel R.M. Handbook of biosurveillance (2006), Elsevier, Burlington, MA
3. Heffernan R., Mostashari F., Das D., et al. New York City Syndromic Surveillance System. Sydromic Surveillance: Reports from a National Conference (2003), CDC, New York, NY 25-27
4. Lombardo J., Burkom H., Elbert E., et al. A systems overview of the Electronic Surveillance System for the Early Notification of Community-Based Epidemics (ESSENCE II). J Urban Health 80 (2003) i32-i42
5. Loonsk J.W. BioSense-a national initiative for early detection and quantification of public health emergencies. MMWR. Morbidity and Mortality Weekly Report 53 Suppl (2004) 53-55
6. Hutwagner L. The bioterrorism preparedness and response Early Aberration Reporting System (EARS). J Urban Health 80 (2003) 89-96
7. Le Strat Y. Overview of temporal Surveillance. In: AB L., and K K. (Eds). Spatial and syndromic surveillance for public health (2005), Wiley, Chichester 13-18
8. Helfenstein U. Box-Jenkins modelling in medical research. Stat Meth Med Res 5 (1996) 3-22
9. Reis B.Y., Pagano M., and Mandl K.D. Using temporal context to improve biosurveillance. Proc Nat Acad Sci U.S.A 100 (2003) 1961-1965
10. Hutwagner L.C., Maloney E.K., Bean N.H., Slutsker L., and Martin S.M. Using laboratory-based surveillance data for prevention: an algorithm for detecting Salmonella outbreaks. Emerg Infect Dis 3 (1997) 395-400
11. Page E. Continuous inspection schemes. Biometrika 41 (1954) 100-115
12. Kulldorff M. A spatial scan statistic. Communications in Statistics. Theory and Methods 26 (1997) 1481-1496
13. Kulldorff M., Athas W.F., Feurer E.J., Miller B.A., and Key C.R. Evaluating cluster alarms: a space-time scan statistic and brain cancer in Los Alamos, New Mexico. Am J Pub Health 88 (1998) 1377-1380
14. Kleinman K., and Abrams A. Metrics for assessing the performance of spatial surveillance. Stat Methods Med Res 15 5 (2006) 445-464 Oct
15. Buckeridge D.L. Outbreak detection through automated surveillance: A review of the determinants of detection. J Biomed Inform 40 (2007) 370-379
16. Burkom H. Alerting algorithms for biosurveillance. In: JS L., and DL B. (Eds). Disease surveillance: A public health informatics approach (2007), Wiley, Hoboken, NJ 143-192
17. Henning KJ. Overview of Syndromic Surveillance: What is Syndromic Surveillance? Morbidity and Mortality Weekly Report l2004;53(Suppl):5-11.
18. United States Government Accountability Office. Information Technology. Federal Agencies Face Challenges in Implementing Initiatives to Improve Public Health Infrastructure (2005), United States Government Accountability Office
19. Hutwagner L., Browne T., Seeman M.G., and Fleischauer A.T. Comparing aberration detection methods with simulated data. Emerg Infect Dis 11 (2005) 314-316
20. Teutsch S.M., and Churchill R.E. Principles and practice of public health surveillance (2000), Oxford University Press, New York
21. Buckeridge D.L., Thompson M.W., Babin S., and Sikes M.L. Evaluating automated surveillance systems. In: JS L., and DL B. (Eds). Disease surveillance: A public health informatics approach (2007), Wiley, Hoboken, NJ 399-424
22. Centers for Disease Control and Prevention. Updated guidelines for evaluating public health surveillance systems: recommendations from the guidelines working group. MMWR. Morbidity and Mortality Weekly Report 50 (2001) 1-35
23. Jackson M.L., Baer A., Painter I., and Duchin J. A simulation study comparing aberration detection algorithms for syndromic surveillance. BMC Med Inform Decis Mak 7 (2007)
24. Murphy S.P., and Burkom H. Recombinant temporal aberration detection algorithms for enhanced biosurveillance. J Am Med Inform Assoc 15 (2008) 77-86
25. Shmueli G., and Fienberg S.E. Current and potential statistical methods for monitoring multiple data streams for biosurveillance. In: AG W., GD W., and DH O. (Eds). Statistical Methods in Counterterrorism (2006), Springer, New York 109-140
26. Sonesson C., and Bock D. A review and discussion of prospective statistical surveillance in public health. J Royal Stat Soc: Series A 166 (2003) 5-21
27. Wong W.-K., and Moore A. Classical time-series methods for biosurveillance. In: MM W., A M., and RM A. (Eds). Handbook of biosurveillance (2006), Elsevier, Burlington, MA
28. Burkom H.S., Murphy S.P., and Shmueli G. Automated time series forecasting for biosurveillance. Stat Med 26 (2007) 4202-4218
29. Chandrasekaran B., and Johnson T.R. Generic tasks and task structures: History, critique and new directions. In: JM D., and JP K. (Eds). Second generation expert systems (1993), Springer-Verlag, Berlin 232-272
30. Fensel D., Motta E., Benjamins R.V., et al. The Unified Problem-solving Method Development Language UPML. Knowledge Inform Syst 5 (2002) 83-131
31. Steels L. Components of expertise. AI Magazine 11 (1990) 30-49
32. Wielinga B.J., Schriber A.T., and Breuker J. KADS: a modelling approach to knowledge engineering. Knowledge Acquis 4 (1992) 5-53
33. Chandrasekaran B., Johnson T.R., and Smith J.W. Task-structure analysis for knowledge modeling. Comm ACM 35 (1992) 124-137
34. Benjamins R., and Jansweijer W. Toward a competence theory of diagnosis. IEEE Expert: Intelligent Systems and Their Applications 9 (1994) 43-52
35. Chandrasekaran B. Design problem solving: A task analysis. AI Mag 11 (1990) 59-71
36. Hackos J.T., and Redish J.C. User and task analysis for interface design (1998), John Wiley & Sons
37. Buckeridge D.L., Musen M.A., Switzer P., and Crubézy M. An analytic framework for space-time aberrancy detection in public health surveillance data. AMIA Annu Symp (2003) 120-124
38. Crubézy M., O'Connor M., Buckeridge D.L., Pincus Z., and Musen M.A. Ontology-centered syndromic surveillance for bioterrorism. IEEE Intelligent Systems 20 (2005) 26-35
39. Gennari J.H., and Ackerman M. Extra-Technical Information for Method Libraries. KAW'99: Twelfth Workshop on Knowledge Acquisition, Modeling and Management (1999) Banff, Canada
40. Shewhart W.A. Statistical method from the viewpoint of quality control (1939), The Graduate School of the Department of Agriculture, Washington DC [reprinted by Dover: Toronto, 1986]
41. Web Ontology Language (OWL). http://www.w3.org/2004/OWL/ Accessed September 11, 2008
42. Bellifemine F.L., Caire G., and Greenwood D. Developing multi-agent systems with JADE (2007), John Wiley & Sons
43. R Development Core Team. R: A language and environment for statistical computing (2006), R Foundation for Statistical Computing, Vienna, Austria
44. Siegrist D., and Pavlin J. Bio-ALIRT biosurveillance detection algorithm evaluation. MMWR. Morbidity and Mortality Weekly Report 53 Suppl (2004) 152-158
45. Buckeridge D.L., Okhmatovskaia A., Tu S.W., O'Connor M., Nyulas C., and Musen M.A. Predicting outbreak detection in public health surveillance: Quantitative analysis to enable evidence-based method selection. AMIA Annu Symp (2008) Washington, DC; p. To appear.