Combining Search, Social Media, and Traditional Data Sources to Improve Influenza Surveillance

PLoS Computational Biology

Volumn 11, Issue 10, 2015, Pages

  Santillana, Mauricio ^a,b,c   Nguyen, André T ^a   Dredze, Mark ^d   Paul, Michael J ^e   Nsoesie, Elaine O ^f,g   Brownstein, John S ^b,c  

^a HARVARD UNIVERSITY   (United States)

^b BOSTON CHILDREN S HOSPITAL   (United States)

^c HARVARD MEDICAL SCHOOL   (United States)

^d Johns Hopkins University   (United States)

^e UNIVERSITY OF COLORADO   (United States)

^f UNIVERSITY OF WASHINGTON   (United States)

^g UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SEARCH ENGINES; SOCIAL NETWORKING (ONLINE);

DATA-SOURCE; ENSEMBLE APPROACHES; GOOGLE+; MACHINE-LEARNING; MICRO-BLOG; MULTIPLE DATA SOURCES; NOWCAST; REAL- TIME; SOCIAL MEDIA; TIME HORIZONS;

FORECASTING;

ACCURACY; ADAPTIVE BOOSTING; ARTICLE; CONTROLLED STUDY; CROWDSOURCING; DECISION TREE; DISEASE ACTIVITY; DISEASE SURVEILLANCE; FLU LIKE SYNDROME; HUMAN; INFLUENZA; INTERMETHOD COMPARISON; MACHINE LEARNING; PREDICTION; REGRESSION ANALYSIS; SOCIAL MEDIA; STACKED LINEAR REGRESSION; SUPPORT VECTOR MACHINE; UNITED STATES; AUTOMATED PATTERN RECOGNITION; CONTROLLED VOCABULARY; DATA MINING; DATABASE MANAGEMENT SYSTEM; FACTUAL DATABASE; HEALTH SURVEY; INFLUENZA, HUMAN; NATURAL LANGUAGE PROCESSING; PREVALENCE; PROCEDURES; RISK ASSESSMENT; SEARCH ENGINE; SEASON; STATISTICS AND NUMERICAL DATA;

DATA MINING; DATABASE MANAGEMENT SYSTEMS; DATABASES, FACTUAL; HUMANS; INFLUENZA, HUMAN; MACHINE LEARNING; NATURAL LANGUAGE PROCESSING; PATTERN RECOGNITION, AUTOMATED; POPULATION SURVEILLANCE; PREVALENCE; RISK ASSESSMENT; SEARCH ENGINE; SEASONS; SOCIAL MEDIA; UNITED STATES; VOCABULARY, CONTROLLED;

EID: 84946026274     PISSN: 1553734X     EISSN: 15537358     Source Type: Journal    
DOI: 10.1371/journal.pcbi.1004513     Document Type: Article

References (43)

1. Lipsitch M, Finelli L, Heffernan RT, Leung GM, Redd S, Improving the evidence base for decision making during a pandemic: the example of 2009 influenza A/H1N1. Biosecurity and bioterrorism: biodefense strategy, practice, and science. 2011; 9(2), 89–115.
2. WHO (2015) Influenza (Seasonal), Fact Sheet Number 211. Available at http://www.who.int/mediacentre/factsheets/fs211/en/index.html.
3. Cobb L, Krishnamurthy A, Mandel J, and Beezley JD. Bayesian tracking of emerging epidemics using ensemble optimal statistical interpolation. Spatial and spatio-temporal epidemiology. 2014; 10: 39–48.
4. Yang W, Karspeck A, Shaman J, Comparison of filtering methods for the modeling and retrospective forecasting of influenza epidemics." PLoS computational biology. 2014; 10, no. 4: e1003583. doi: 10.1371/journal.pcbi.1003583 24762780
5. Yang W, Lipsitch M, Sham Inference of seasonal and pandemic influenza transmission dynamics using ‘big’ surveillance data. Proceedings of the National Academy of Sciences. 2015;112(9): 2723–2728.
6. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L, Detecting influenza epidemics using search engine query data. Nature. 2009; 457, 1012–1014 doi: 10.1038/nature07634 19020500
7. Scarpino SV, Dimitrov NB, Meyers LA, Optimizing provider recruitment for influenza surveillance networks. PLoS Comput Biol. 2012; 8, no. 4: e1002472. doi: 10.1371/journal.pcbi.1002472 22511860
8. Polgreen PM, Chen Y, Pennock DM, Nelson FD, Weinstein RA, Using internet searches for influenza surveillance. Clinical Infectious Diseases. 2008; 47(11):1443–1448. doi: 10.1086/593098 18954267
9. Yuan Q, Nsoesie EO, Lv B, Peng G, Chunara R, Brownstein JS, Monitoring influenza epidemics in China with search query from Baidu. PLoS One 2013; 8:e64323. doi: 10.1371/journal.pone.0064323 23750192
10. Signorini A, Segre AM, Polgreen PM, The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS ONE 2011; 6, e19467. doi: 10.1371/journal.pone.0019467 21573238
11. Paul MJ, Dredze M, Broniatowski D, Twitter Improves Influenza Forecasting. PLoS currents. 2014; 6.
12. Chen L, Tozammel Hossain KSM, Butler P, Ramakrishnan N, and Prakash BA. Flu Gone Viral: Syndromic Surveillance of Flu on Twitter using Temporal Topic Models. IEEE International Conference In Data Mining (ICDM), 2014; pp. 755–760. IEEE,.
13. McIver DJ, Brownstein JS, Wikipedia usage estimates prevalence of influenza-like illness in the United States in near real-time. PLoS Comput. Biol. 2014;10, e1003581 doi: 10.1371/journal.pcbi.1003581 24743682
14. Generous N, Fairchild G, Deshpande A, Del Valle SY, Priedhorsky R, Global disease monitoring and forecasting with wikipedia. PLoS computational biology. 2014; 10(11), e1003892 doi: 10.1371/journal.pcbi.1003892 25392913
15. Crawley AW Flu near you: Comparing crowd-sourced reports of influenza-like illness to the CDC outpatient influenza-like illness surveillance network, October 2012 to March 2014. In 2014 CSTE Annual Conference. Cste, 2014.
16. Smolinski MS, Crawley AW, Baltrusaitis K, Chunara R, Olsen JM, Wojick O, et al. Flu Near You: Crowdsourced Symptom Reporting Spanning Two Influenza Seasons. American Journal of Public Health. 2015; e1–e7.
17. Santillana M, Nsoesie EO, Mekaru SR, Scales D, Brownstein JS, Using Clinicians’ Search Query Data to Monitor Influenza Epidemics. Clinical Infectious Diseases. 2014; 59 (10): 1446–1450 doi: 10.1093/cid/ciu647 25115873
18. Butler D, When Google got flu wrong. Nature. 2013; 494(7436):155. doi: 10.1038/494155a 23407515
19. Cook S, Conrad C, Fowlkes AL, Mohebbi MH, Assessing Google flu trends performance in the United States during the 2009 influenza virus A (H1N1) pandemic. PLoS ONE. 2011; 6, e23610. doi: 10.1371/journal.pone.0023610 21886802
20. Olson DR, Konty KJ, Paladini M, Viboud C, Simonsen L, Reassessing Google flu trends data for detection of seasonal and pandemic influenza: a comparative epidemiological study at three geographic scales. PLoS Comput. Biol. 2013; 9, e1003256. doi: 10.1371/journal.pcbi.1003256 24146603
21. Lazer DM, Kennedy R, King L, Vespigniani A, The parable of Google flu: traps in big data analysis. Science. 2014; 343, 1203–1205. doi: 10.1126/science.1248506 24626916
22. Santillana M, Zhang DW, Althouse BM, Ayers JW, What can digital disease detection learn from (an external revision to) Google flu trends? Am. J. Prev. Med. 2014; 47, 341–347. doi: 10.1016/j.amepre.2014.05.020 24997572
23. Davidson M, Haim DA, Radin JM, Using Networks to Combine Big Data and Traditional Surveillance to Improve Influenza Predictions. Sci. Rep. 2015; 5
24. Yang S, Santillana M, and Kou SC. ARGO: a model for accurate estimation of influenza epidemics using Google search data. 2015. arXiv preprint arXiv:1505.00864.
25. Lamb A, Paul MJ, and Dredze M. Separating Fact from Fear: Tracking Flu Infections on Twitter. HLT-NAACL. 2013.
26. Broniatowski DA, Paul MJ, Dredze M, National and local influenza surveillance through twitter: An analysis of the 2012–2013 influenza epidemic. PloS one. 2013; 8(12), e83672. doi: 10.1371/journal.pone.0083672 24349542
27. Dredze M, Cheng R, Paul M, and Broniatowski D. HealthTweets.org: A Platform for Public Health Surveillance using Twitter. AAAI Workshop on the World Wide Web and Public Health Intelligence, 2014.
28. Copeland P, Romano R, Zhang T, Hecht G, Zigmond D, Stefansen C, Google disease trends: an update. Int Soc Negl Trop Dis. 2013; 3.
29. Stefansen C, Google Flu Trends gets a brand new engine. Google Research Blog. 2014.
30. Friedman J, Hastie T, Tibshirani R, The elements of statistical learning. 2009; Vol. 2, No. 1. New York: springer.
31. Breiman L, Stacked regressions. Machine Learning.1996; 24, 49–64.
32. Smola A, Vapnik V, Support vector regression machines. Advances in neural information processing systems. 1997; 9: 155–161.
33. Freund Y, Schapire RE, A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences.1997; 55.1: 119–139.
34. Brownstein JS, and Mandl KD. Reengineering real time outbreak detection systems for influenza epidemic monitoring. In AMIA Annual Symposium Proceedings. American Medical Informatics Association. 2006; Vol. 2006, p. 866.
35. Olson DR, Heffernan RT, Paladini M, Konty K, Weiss D, Mostashari F, Monitoring the impact of influenza by age: emergency department fever and respiratory complaint surveillance in New York City. PLoS Med. 2007; 4(8), e247. 17683196
36. Viboud C, Charu V, Olson D, Ballesteros S, Gog J, Khan F, et al. Demonstrating the use of high-volume electronic medical claims data to monitor local and regional influenza activity in the US. PLOS One. 2014; 9(7): e102429. doi: 10.1371/journal.pone.0102429 25072598
37. Paolotti D, Carnahan A, Colizza V, Eames K, Edmunds J, Gomes G, et al. Web-based participatory surveillance of infectious diseases: the Influenzanet participatory surveillance experience. Clinical Microbiology and Infection. 2014; 20(1), 17–21. doi: 10.1111/1469-0691.12477 24350723
38. Dalton C, Durrheim D, Fejsa J, Francis L, Carlson S, d'Espaignet ET, et al. Flutracking: a weekly Australian community online survey of influenza-like illness in 2006, 2007 and 2008. Commun Dis Intell Q Rep. 2009; 33(3): 316–22. 20043602
39. Chan EH, Sahai V, Conrad C, Brownstein JS, Using Web search query data to monitor dengue epidemics: a new model for neglected tropical disease surveillance. PLoS Negl Trop Dis. 2011; 5:e1206 doi: 10.1371/journal.pntd.0001206 21647308
40. Madoff LC, Fisman DN, Kass-Hout T, A new approach to monitoring dengue activity. PLoS Negl Trop Dis. 2011; 5:e1215. doi: 10.1371/journal.pntd.0001215 21647309
41. Gluskin RT, Johansson M, Santillana M, Brownstein JS, Evaluation of Internet-based dengue query data: Google Dengue Trends. PLoS neglected tropical diseases. 2014; 8.2: e2713.
42. Ocampo AJ, Chunara R, Brownstein JS, Using search queries for malaria surveillance, Thailand. Malaria journal. 2013; 12.1: 390.
43. Nagar R, Yuan Q, Freifeld CC, Santillana M, Nojima A, Chunara R, et al. A Case Study of the New York City 2012–2013 Influenza Season With Daily Geocoded Twitter Data From Temporal and Spatiotemporal Perspectives. Journal of medical Internet research. 2014; 16 (10) http://rsos.royalsocietypublishing.org/lookup/external-ref?access_num=21573238&link_type=MED&atom=%2Froyopensci%2F1%2F2%2F140095.atom