Google flu trends spatial variability validated against emergency department influenza-related visits

Journal of Medical Internet Research

Volumn 18, Issue 6, 2016, Pages

  Klembczyk, Joseph Jeffrey ^a   Jalalpour, Mehdi ^b   Levin, Scott ^a   Washington, Raynard E ^c   Pines, Jesse M ^d   Rothman, Richard E ^a   Dugas, Andrea Freyer ^a  

^a JOHNS HOPKINS UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b Cleveland State University   (United States)

^c AGENCY FOR HEALTHCARE RESEARCH AND QUALITY   (United States)

^d GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

Emergency department; Google flu trends; Influenza; Infoveillance; Surveillance

Indexed keywords

ADOLESCENT; ADULT; AGED; EPIDEMIOLOGICAL MONITORING; FEMALE; HOSPITAL EMERGENCY SERVICE; HUMAN; INFLUENZA, HUMAN; INTERNET; MALE; MIDDLE AGED; SEARCH ENGINE; SEASON; SPATIAL ANALYSIS; STATISTICAL MODEL; TIME FACTOR; TRENDS; UNITED STATES; UTILIZATION; VALIDATION STUDY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; EMERGENCY SERVICE, HOSPITAL; EPIDEMIOLOGICAL MONITORING; FEMALE; HUMANS; INFLUENZA, HUMAN; INTERNET; LINEAR MODELS; MALE; MIDDLE AGED; SEARCH ENGINE; SEASONS; SPATIAL ANALYSIS; TIME FACTORS; UNITED STATES; YOUNG ADULT;

EID: 84977575167     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.5585     Document Type: Article

References (46)

1. Centers for Disease Control and Prevention. Seasonal influenza. 2011. URL: http://www.cdc.gov/flu/about/qa/disease.htm [accessed 2016-01-28] [WebCite Cache ID 6erU01w1f]
2. Thompson WW, Shay DK, Weintraub E, Brammer L, Bridges CB, Cox NJ, et al. Influenza-associated hospitalizations in the United States. JAMA 2004 Sep 15;292(11):1333-1340. [doi: 10.1001/jama.292.11.1333] [Medline: 15367555]
3. Thompson WW, Shay DK, Weintraub E, Brammer L, Cox N, Anderson LJ, et al. Mortality associated with influenza and respiratory syncytial virus in the United States. JAMA 2003 Jan 8;289(2):179-186. [Medline: 12517228]
4. McDonnell WM, Nelson DS, Schunk JE. Should we fear "flu fear" itself? Effects of H1N1 influenza fear on ED use. Am J Emerg Med 2012 Feb;30(2):275-282. [doi: 10.1016/j.ajem.2010.11.027] [Medline: 21208765]
5. Institute of Medicine Committee on the Future of Emergency Care in the U.S. Health System. The future of emergency care in the United States health system. Ann Emerg Med 2006 Aug;48(2):115-120. [doi: 10.1016/j.annemergmed.2006.06.015] [Medline: 16857459]
6. Glaser CA, Gilliam S, Thompson WW, Dassey DE, Waterman SH, Saruwatari M, et al. Medical care capacity for influenza outbreaks, Los Angeles. Emerg Infect Dis 2002 Jun;8(6):569-574 [FREE Full text] [doi: 10.3201/eid0806.010370] [Medline: 12023911]
7. Schull MJ, Mamdani MM, Fang J. Community influenza outbreaks and emergency department ambulance diversion. Ann Emerg Med 2004 Jul;44(1):61-67. [doi: 10.1016/S0196064403013167] [Medline: 15226710]
8. Osterholm MT. Preparing for the next pandemic. N Engl J Med 2005 May 5;352(18):1839-1842. [doi: 10.1056/NEJMp058068] [Medline: 15872196]
9. Bernstein SL, Aronsky D, Duseja R, Epstein S, Handel D, Hwang U, Society for Academic Emergency Medicine Emergency Department Crowding Task Force. The effect of emergency department crowding on clinically oriented outcomes. Acad Emerg Med 2009 Jan;16(1):1-10 [FREE Full text] [doi: 10.1111/j.1553-2712.2008.00295.x] [Medline: 19007346]
10. Pines JM, Hollander JE, Localio AR, Metlay JP. The association between emergency department crowding and hospital performance on antibiotic timing for pneumonia and percutaneous intervention for myocardial infarction. Acad Emerg Med 2006 Aug;13(8):873-878 [FREE Full text] [doi: 10.1197/j.aem.2006.03.568] [Medline: 16766743]
11. Pines JM, Pollack CV, Diercks DB, Chang AM, Shofer FS, Hollander JE. The association between emergency department crowding and adverse cardiovascular outcomes in patients with chest pain. Acad Emerg Med 2009 Jul;16(7):617-625 [FREE Full text] [doi: 10.1111/j.1553-2712.2009.00456.x] [Medline: 19549010]
12. Pines JM, Shofer FS, Isserman JA, Abbuhl SB, Mills AM. The effect of emergency department crowding on analgesia in patients with back pain in two hospitals. Acad Emerg Med 2010 Mar;17(3):276-283 [FREE Full text] [doi: 10.1111/j.1553-2712.2009.00676.x] [Medline: 20370760]
13. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [doi: 10.1038/nature07634] [Medline: 19020500]
14. Dugas AF, Hsieh Y, Levin SR, Pines JM, Mareiniss DP, Mohareb A, et al. Google Flu Trends: correlation with emergency department influenza rates and crowding metrics. Clin Infect Dis 2012 Feb 15;54(4):463-469 [FREE Full text] [doi: 10.1093/cid/cir883] [Medline: 22230244]
15. Thompson LH, Malik MT, Gumel A, Strome T, Mahmud SM. Emergency department and 'Google flu trends' data as syndromic surveillance indicators for seasonal influenza. Epidemiol Infect 2014 Nov;142(11):2397-2405. [doi: 10.1017/S0950268813003464] [Medline: 24480399]
16. Araz OM, Bentley D, Muelleman RL. Using Google Flu Trends data in forecasting influenza-like-illness related ED visits in Omaha, Nebraska. Am J Emerg Med 2014 Sep;32(9):1016-1023. [doi: 10.1016/j.ajem.2014.05.052] [Medline: 25037278]
17. Dugas AF, Jalalpour M, Gel Y, Levin S, Torcaso F, Igusa T, et al. Influenza forecasting with Google Flu Trends. PLoS One 2013;8(2):e56176 [FREE Full text] [doi: 10.1371/journal.pone.0056176] [Medline: 23457520]
18. Pervaiz F, Pervaiz M, Abdur RN, Saif U. FluBreaks: early epidemic detection from Google flu trends. J Med Internet Res 2012;14(5):e125 [FREE Full text] [doi: 10.2196/jmir.2102] [Medline: 23037553]
19. Shaman J, Karspeck A. Forecasting seasonal outbreaks of influenza. Proc Natl Acad Sci USA 2012 Dec 11;109(50):20425-20430 [FREE Full text] [doi: 10.1073/pnas.1208772109] [Medline: 23184969]
20. Preis T, Moat HS. Adaptive nowcasting of influenza outbreaks using Google searches. R Soc Open Sci 2014 Oct;1(2):140095 [FREE Full text] [doi: 10.1098/rsos.140095] [Medline: 26064532]
21. Olson DR, Konty KJ, Paladini M, Viboud C, Simonsen L. Reassessing Google Flu Trends data for detection of seasonal and pandemic influenza: a comparative epidemiological study at three geographic scales. PLoS Comput Biol 2013;9(10):e1003256 [FREE Full text] [doi: 10.1371/journal.pcbi.1003256] [Medline: 24146603]
22. Cook S, Conrad C, Fowlkes AL, Mohebbi MH. Assessing Google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS One 2011;6(8):e23610 [FREE Full text] [doi: 10.1371/journal.pone.0023610] [Medline: 21886802]
23. Agency for Healthcare Research and Quality. September. 2014. Healthcare Cost and Utilization Project (HCUP) Overview of the State Emergency Department Databases URL: http://www.hcup-us.ahrq.gov/db/state/sedddist/SEDD-Introduction. jsp [accessed 2016-01-28] [WebCite Cache ID 6erUqnDGv]
24. Rubinson L, Mutter R, Viboud C, Hupert N, Uyeki T, Creanga A, et al. Impact of the fall 2009 influenza A(H1N1)pdm09 pandemic on US hospitals. Med Care 2013 Mar;51(3):259-265. [doi: 10.1097/MLR.0b013e31827da8ea] [Medline: 23295577]
25. Google Flu Trends. 2014. URL: https://www.google.org/flutrends/about/data/flu/historic/us-historic-v2.txt [accessed 2014-06-05] [WebCite Cache ID 6erVyQWjb]
26. United States Census Bureau. United States Census Bureau Quick Facts. 2010. Washington: GPO URL: http://www. census.gov/quickfacts/[accessed 2016-06-15] [WebCite Cache ID 6iIRvTQTF]
27. United States Census Bureau; Small Area Health Insurance Estimates. 2008. Washington: GPO URL: http://www.census.gov/did/www/sahie/data/20082013/index.html [accessed 2016-01-28] [WebCite Cache ID 6erWFeNES]
28. Centers for Medicare and Medicaid. Medicare Geographic Variation. 2008. URL: http://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/Medicare-Geographic-Variation/[accessed 2016-06-15] [WebCite Cache ID 6iIS48vSo]
29. Federal Communications Commission. 2008. County Data on Internet Access Services URL: https://www.fcc.gov/general/form-477-county-data-internet-access-services [accessed 2016-01-28] [WebCite Cache ID 6erWq9Ncw]
30. United States Census Bureau. American Community Survey 2007-2009. 2009. URL: http://factfinder.census.gov/[WebCite Cache ID 6erWzT3ik]
31. Bureau of Labor Statistics. 2008. Unemployment County Data URL: http://www.bls.gov/lau/[accessed 2016-01-28] [WebCite Cache ID 6erXY8Dbh]
32. American Hospital Association. 2010. AHA Survey (via Area Health Resource File) URL: http://ahrf.hrsa.gov/download. htm [accessed 2016-01-28] [WebCite Cache ID 6erXf84tQ]
33. Centers for Disease Control. 2008. WONDER Online Database URL: http://wonder.cdc.gov/nasa-pm.html [accessed 2016-01-28] [WebCite Cache ID 6erXoCJVV]
34. Weather Underground. Historical Weather. URL: http://www.wunderground.com/weather/api [accessed 2016-01-28] [WebCite Cache ID 6erY0WjcK]
35. Legates DR, Willmott CJ. Mean seasonal and spatial variability in global surface air temperature. Theor Appl Climatol 1990;41(1-2):11-21. [doi: 10.1007/BF00866198]
36. Leys C, Ley C, Klein O, Bernard P, Licata L. Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology 2013 Jul;49(4):764-766. [doi: 10.1016/j.jesp.2013.03.013]
37. Martinez W, Martinez A. Computational Statistics Handbook with MATLAB, Second Edition (Chapman & Hall/Crc Computer Science & Data Analysis). Boca Raton, FL: Chapman & Hall/CRC; 2007.
38. Bertakis KD, Azari R, Helms LJ, Callahan EJ, Robbins JA. Gender differences in the utilization of health care services. J Fam Pract 2000 Feb;49(2):147-152. [Medline: 10718692]
39. Green CA, Pope CR. Gender, psychosocial factors and the use of medical services: a longitudinal analysis. Soc Sci Med 1999 May;48(10):1363-1372. [Medline: 10369437]
40. DeNavas-Walt C, Proctor B, Smith J. Income, Poverty, and Health Insurance Coverage in the United States. Washington, DC: U.S. Census Bureau; 2013. URL: https://www.census.gov/prod/2013pubs/p60-245.pdf [accessed 2016-06-15] [WebCite Cache ID 6iISt2zWB]
41. Newton MF, Keirns CC, Cunningham R, Hayward RA, Stanley R. Uninsured adults presenting to US emergency departments: assumptions vs data. JAMA 2008 Oct 22;300(16):1914-1924. [doi: 10.1001/jama.300.16.1914] [Medline: 18940978]
42. Asplin BR, Rhodes K V, Levy H, Lurie N, Crain AL, Carlin BP, et al. Insurance status and access to urgent ambulatory care follow-up appointments. JAMA 2005 Sep 14;294(10):1248-1254. [doi: 10.1001/jama.294.10.1248] [Medline: 16160133]
43. Tang N, Stein J, Hsia RY, Maselli JH, Gonzales R. Trends and characteristics of US emergency department visits, 1997-2007. JAMA 2010 Aug 11;304(6):664-670 [FREE Full text] [doi: 10.1001/jama.2010.1112] [Medline: 20699458]
44. Schuur JD, Venkatesh AK. The growing role of emergency departments in hospital admissions. N Engl J Med 2012 Aug 2;367(5):391-393. [doi: 10.1056/NEJMp1204431] [Medline: 22784039]
45. Lowen AC, Mubareka S, Steel J, Palese P. Influenza virus transmission is dependent on relative humidity and temperature. PLoS Pathog 2007 Oct 19;3(10):1470-1476 [FREE Full text] [doi: 10.1371/journal.ppat.0030151] [Medline: 17953482]
46. Sloan C, Moore ML, Hartert T. Impact of pollution, climate, and sociodemographic factors on spatiotemporal dynamics of seasonal respiratory viruses. Clin Transl Sci 2011 Feb;4(1):48-54 [FREE Full text] [doi: 10.1111/j.1752-8062.2010.00257.x] [Medline: 21348956]