Age-related differences in the accuracy of web query-based predictions of Influenza-Like Illness

PLoS ONE

Volumn 10, Issue 5, 2015, Pages

  Domnich, Alexander ^a   Panatto, Donatella ^a,b   Signori, Alessio ^a   Lai, Piero Luigi ^a,b   Gasparini, Roberto ^a,b   Amicizia, Daniela ^a,b  

^a UNIVERSITY OF GENOA   (Italy)

^b Interuniversity Research Centre on Influenza and Viral Infections (CIRI IV)   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ACCURACY; ADULT; AGE; AGED; ARTICLE; ATTITUDE TO ILLNESS; CONTROLLED STUDY; DISEASE SURVEILLANCE; FLU LIKE SYNDROME; HUMAN; INTERNET; MORBIDITY; PREDICTION; WEB QUERY; ADOLESCENT; CHILD; INFANT; INFLUENZA, HUMAN; ITALY; MIDDLE AGED; NEWBORN; PRESCHOOL CHILD; REPRODUCIBILITY; SEARCH ENGINE; TIME FACTOR; YOUNG ADULT;

ADOLESCENT; ADULT; AGE FACTORS; AGED; CHILD; CHILD, PRESCHOOL; HUMANS; INFANT; INFANT, NEWBORN; INFLUENZA, HUMAN; INTERNET; ITALY; MIDDLE AGED; MORBIDITY; REPRODUCIBILITY OF RESULTS; SEARCH ENGINE; TIME FACTORS; YOUNG ADULT;

EID: 84943642162     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0127754     Document Type: Article

References (61)

1. Fauci AS. Seasonal and pandemic influenza preparedness: science and countermeasures. J Infect Dis. 2006; 194(Suppl 2):S73-S76. PMID: 17163392
2. Fowlkes A, Dasgupta S, Chao E., Lemmings J, Goodin K Harris M, et al. Estimating influenza incidence and rates of influenza-like illness in the outpatient setting. Influenza Other Respir Viruses. 2013; 7: 694-700. doi: 10.1111/irv.12014 PMID: 22984820
3. Olson DR, Heffernan RT, Paladini M, Konty K., Weiss D, Mostashari F. Monitoring the impact of influenza by age: emergency department fever and respiratory complaint surveillance in New York City. PLoS Med. 2007; 4: e247. Available: http://www.plosmedicine.org/article/info%3Adoi%2F10.1371%2Fjournal.pmed.0040247. PMID: 17683196
4. Glatman-Freedman A., Portelli I, Jacobs S.K., Mathew JI, Slutzman JE, Goldfrank LR, et al Attack rates assessment of the 2009 pandemic H1N1 influenza A in children and their contacts: a systematic review and meta-analysis. PLoS One. 2012; 7: e50228. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0050228. doi: 10.1371/journal.pone.0050228 PMID: 23284603
5. Gasparini R, Bonanni P, Amicizia D., Bella A, Donatelli I, Cristina M.L., et al. Influenza epidemiology in Italy two years after the 2009-2010 pandemic: need to improve vaccination coverage. Hum Vaccin Immunother. 2013; 9: 561-567. PMID: 23292210
6. Viboud C, Boëlle PY, Cauchemez S., Lavenu A, Valleron AJ, Flahault A, et al Risk factors of influenza transmission in households. Br J Gen Pract. 2004; 54: 684-689. PMID: 15353055
7. Brownstein JS, Kleinman KP, Mandl KD Identifying pediatric age groups for influenza vaccination using a real-time regional surveillance system. Am J Epidemiol. 2005; 162:686-693. PMID: 16107568
8. Glass LM, Glass RJ Social contact networks for the spread of pandemic influenza in children and teenagers. BMC Public Health. 2008; 8: 61. Available: http://www.biomedcentral.com/1471-2458/8/61. doi: 10.1186/1471-2458-8-61 PMID: 18275603
9. Schanzer D, Vachon J, Pelletier L. Age-specific differences in influenza A epidemic curves: do children drive the spread of influenza epidemics? Am J Epidemiol. 2011; 174:109-117. doi: 10.1093/aje/kwr037 PMID: 21602300
10. Chowell G, Bertozzi SM, Colchero M.A., Lopez-Gatell H, Alpuche-Aranda C, Hernandez M., et al. Severe respiratory disease concurrent with the circulation of H1N1 influenza. N Engl J Med. 2009; 361: 674-679. doi: 10.1056/NEJMoa0904023 PMID: 19564633
11. Ansaldi F, Orsi A, Altomonte F., Bertone G, Parodi V, Carloni R., et al. Emergency department syndromic surveillance system for early detection of 5 syndromes: a pilot project in a reference teaching hospital in Genoa, Italy. J PrevMed Hyg. 2008; 49:131-135. PMID: 19350960
12. Elliot A. Syndromic surveillance: the next phase of public health monitoring during the H1N1 influenza pandemic? EuroSurveill. 2009; 14: pii = 19391. Available: http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=19391.
13. Zhou XC, Shen HB. Notifiable infectious disease surveillance with data collected by search engine. J Zhejiang Univ-Sci C. 2010; 11: 241-248.
14. Althouse BM, Ng YY, Cummings DA Prediction of dengue incidence using search query surveillance. PLoS NeglTrop Dis. 2011; 5: e1258. Available: http://www.plosntds.org/article/info%3Adoi%2F10.1371%2Fjournal.pntd.0001258. doi: 10.1371/journal.pntd.0001258 PMID: 21829744
15. Domnich A, Arbuzova EK, Signori A, Amicizia D., Panatto D, Gasparini R. Demand-based web surveillance of sexually transmitted infections in Russia. Int J Public Health. 2014; 59: 841-849. doi: 10.1007/s00038-014-0581-7 PMID: 25012799
16. Seifter A, Schwarzwalder A, Geis K, Aucott J. The utility of "Google Trends" for epidemiological research: Lyme disease as an example. Geospatial Health. 2010; 4:135-137. PMID: 20503183
17. Ginsberg J, Mohebbi MH, Patel R.S., Brammer L., Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009; 457:1012-1014. doi: 10.1038/nature07634 PMID: 19020500
18. Olson DR, Konty KJ, Paladini M, Viboud C., Simonsen L. Reassessing Google Flu Trends datafordetection of seasonal and pandemic influenza: a comparative epidemiological study at three geographic scales. PLoS Comput Biol. 2013; 9: e1003256. Available: http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1003256. doi: 10.1371/journal.pcbi.1003256 PMID: 24146603
19. Eysenbach G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annu Symp Proc. 2006: 244-248. PMID: 17238340
20. Polgreen PM, Chen Y, Pennock DM, Nelson FD. Using internet searches for influenza surveillance. Clin Infect Dis. 2008; 47:1443-1448. doi: 10.1086/593098 PMID: 18954267
21. Ortiz JR, Zhou H, Shay D.K., Neuzil KM, Fowlkes AL, Goss CH. Monitoring influenza activity in the United States: a comparison of traditional surveillance systems with Google Flu Trends. PLoS One. 2011; 6: e18687. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0018687. doi: 10.1371/journal.pone.0018687 PMID: 21556151
22. Cho S, Sohn CH, Jo MW, Shin SY, Lee JH, Ryoo SM, et al. Correlation between national influenza surveillance data and google trends in South Korea. PLoS One. 2013; 8: e81422. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0081422. doi: 10.1371/journal.pone.0081422 PMID: 24339927
23. Hulth A, Rydevik G, Linde A. Web queries as a source for syndromic surveillance. PLoS One. 2009; 4: e4378. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0004378. doi: 10.1371/journal.pone.0004378 PMID: 19197389
24. Kang M, Zhong H, He J., Rutherford S, Yang F. Using Google Trends for influenza surveillance in South China. PLoS One. 2013; 8: e55205. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0055205. doi: 10.1371/journal.pone.0055205 PMID: 23372837
25. Yuan Q, Nsoesie EO, Lv B, Peng G., Chunara R, Brownstein GS. Monitoring influenza epidemics in china with search query from Baidu. PLoS One. 2013; 8: e64323. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0064323. doi: 10.1371/journal.pone.0064323 PMID: 23750192
26. Santos JC, Matos S. Analysing Twitterand web queries forflu trend prediction. Theor Biol Med Model. 2014; 11: S6. Available: http://www.tbiomed.com/content/11/S1/S6. doi: 10.1186/1742-4682-11-S1-S6 PMID: 25077431
27. Broniatowski DA, Paul MJ, Dredze M. National and local influenza surveillance through Twitter: an analysis of the 2012-2013 influenza epidemic. PLoS One. 2013; 8: e83672. Available: http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0083672. doi: 10.1371/journal.pone.0083672 PMID: 24349542
28. McIver DJ, Brownstein JS Wikipedia usage estimates prevalence of influenza-like illness in the United States in near real-time. PLoS Comput Biol. 2014; 10: e1003581. Available: http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1003581. doi: 10.1371/journal.pcbi.1003581 PMID: 24743682
29. Nagar R, Yuan Q, Freifeld C.C., Santillana M, Nojima A, Chunara R. A case study of the New York city 2012-2013 influenza season with daily geocoded twitter data from temporal and spatiotemporal perspectives. J Med Internet Res. 2014; 16: e236. Available: http://www.jmir.org/2014/10/e236. doi: 10. 2196/jmir.3416 PMID: 25331122
30. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res. 2009; 11: e11. Available: http://www.jmir.org/2009/1/e11/. doi: 10.2196/jmir.1157 PMID: 19329408
31. Santillana M, Zhang DW, Althouse BM, Ayers JW. What can digital disease detection learn from (an external revision to) google flu trends? Am J Prev Med. 2014; 47: 341-347. doi: 10.1016/j.amepre.2014.05.020 PMID: 24997572
32. Cook AR, Chen MI, Pin Lin RT. Internet search limitations and pandemic influenza, Singapore. Emerg Infect Dis. 2010; 16:1647-1649. doi: 10.3201/eid1610.100840 PMID: 20875307
33. Butler D. When Google got flu wrong. Nature. 2013; 494:155-156. doi: 10.1038/494155a PMID: 23407515
34. Lazer D, Kennedy R, King G, Vespignani A. Big data. The parable of Google Flu: traps in big data analysis. Science. 2014; 343:1203-1205. doi: 10.1126/science.1248506 PMID: 24626916
35. Fox S, Duggan M. Health Online 2013. Available: http://www.pewinternet.org/2013/01/15/health-online-2013/.
36. Dugas AF, Hsieh YH, Levin S.R., Pines JM, Mareiniss DP, Mohareb A, et al Google Flu Trends: correlation with emergency department influenza rates and crowding metrics. Clin Infect Dis. 2012; 54: 463-469. doi: 10.1093/cid/cir883 PMID: 22230244
37. Inter-University Centre for Research on Influenza and other Transmissible Infections (CIRI-IT). Available: http://www.cirinet.it/jm/en/.
38. Lai PL, Panatto D, Gasparini R. A pharmacoeconomic appraisal of the strategy to tackle the H1N1v(A/California/07/09) pandemic in Italy: relevance of the CIRI-IV surveillance system. J Prev Med Hyg. 2011; 52:142-143. PMID: 22010545
39. Fox J. Time-series regression and generalized least squares. Appendix to: an R and S-PLUS companion to applied regression; 2002. Available: http://cran.r-project.org/doc/contrib/Fox-Companion/appendix-timeseries-regression.pdf
40. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2014. Available: http://www.R-project.org/.
41. Cohen RA, Adams PF Use of the Internet for health information: United States, 2009. NCHS data brief, no 66. Hyattsville, MD: National Center for Health Statistics; 2011. Available: http://www.cdc.gov/nchs/data/databriefs/db66.pdf.
42. Amicizia D, Domnich A, Gasparini R, Bragazzi NL, Lai PL, Panatto D. An overview of current and potential use of information and communication technologies for immunization promotion among adolescents. Hum Vaccin Immunother. 2013; 9: 2634-2642. doi: 10.4161/hv.26010 PMID: 23954845
43. Paolotti D, Gioannini C, Colizza V., Vespignani A. Internet-based monitoring system for influenza-like illness: H1N1 surveillance in Italy. Proceedings of the 3rd International ICST Conference on Electronic Healthcare for the 21st century. Casablanca 13-15 December 2010. Available: https://influenzanet.eu/media/docs/publications/influweb-ehealth2010submitted.pdf.
44. Debin M, Turbelin C, Blanchon T., Bonmarin I, Falchi A, Hanslik T., et al. Evaluating the feasibility and participants' representativeness of an online nationwide surveillance system for influenza in France. PLoS One. 2013; 8: e73675. Available: http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0073675. doi: 10.1371/journal.pone.0073675 PMID: 24040020
45. Skranes LP, Løhaugen GCC, Gro CC, Botngârd A, Skranes J. Internet use among mothers of young children in Norway-a survey of Internet habits and perceived parental competence when caring for a sick child. J Public Health. 2014; 22: 43-31.
46. Bernhardt JM, Felter EM Online pediatric information seeking among mothers of young children: results from a qualitative study using focus groups. J Med Internet Res. 2004; 6: e7. Available: http://www.jmir.org/2004/1/e7/. PMID: 15111273
47. Wainstein BK, Sterling-Levis K, Baker S.A., Taitz J., Brydon M. Use of the Internet by parents of paediatric patients. J Paediatr Child Health. 2006; 42: 528-532. PMID: 16925539
48. Khoo K, Bolt P, Babl F.E., Jury S., Goldman RD. Health information seeking by parents in the Internet age. J Paediatr Child Health. 2008; 44: 419-423 doi: 10.1111/j.1440-1754.2008.01322.x PMID: 18564080
49. Sim NZ, Kitteringham L, Spitz L., Pierro A, Kiely E, Drake D., et al. Information on the World Wide Web- how useful is it for parents? J Pediatr Surg. 2007; 42: 305-312. PMID: 17270540
50. Jayasundara K, Soobiah C, Thommes E., Tricco AC, Chit A. Natural attack rate of influenza in unvaccinated children and adults: a meta-regression analysis. BMC Infect Dis. 2014; 14: 670. Available: http://www.biomedcentral.com/content/pdf/s12879-014-0670-5.pdf. doi: 10.1186/s12879-014-0670-5 PMID: 25495228
51. Influenzanet. Available: https://www.influenzanet.eu/en/.
52. Influweb. Available: https://www.influweb.it/.
53. Purcell K, Brenner J, Rainie L. Search engine use 2012. Available: http://www.pewinternet.org/files/old-media/Files/Reports/2012/PIPSearchEngineUse2012.pdf.
54. Lazer DM, Kennedy R, King G., Vespignani A. Google Flu trends still appears sick: an evaluation of the 2013-2014 flu season. Available: http://gking.harvard.edu/files/gking/files/ssrn-id24085602.pdf.
55. Milinovich GJ, Williams GM, Clements A.C., Hu W. Internet-based surveillance systems for monitoring emerging infectious diseases. Lancet Infect Dis. 2014; 14:160-168. doi: 10.1016/S1473-3099(13) 70244-5 PMID: 24290841
56. Bernardo TM, Rajic A, Young I., Robiadek K, Pham MT, Funk JA Scoping review on search queries and social media for disease surveillance: a chronology of innovation. J Med Internet Res. 2013; 15: e147. Available: http://www.jmir.org/2013/7/e147/. doi: 10.2196/jmir.2740 PMID: 23896182
57. Eysenbach G. Infodemiology and infoveillance tracking online health information and cyberbehavior for public health. Am J Prev Med. 2011; 40: S154-S158. doi: 10.1016/j.amepre.2011.02.006 PMID: 21521589
58. National Institute of health. Influnet. Available: http://www.iss.it/iflu/.
59. Google trends. How to type your search term. Available: https://support.google.com/trends/answer/4359582?hl=en-GB&reftopic=4365599.
60. de Lange M.M., Meijer A, Friesema IH, Donker GA, Koppeschaar CE, Hooiveld M, et al. Comparison of five influenza surveillance systems during the 2009 pandemic and their association with media attention. BMC Public Health. 2013; 13: 881. Available: http://www.biomedcentral.com/1471-2458/13/881. doi: 10.1186/1471-2458-13-881 PMID: 24063523
61. Signorelli C, Odone A, Conversano M., Bonanni P. Deaths after Fluad flu vaccine and the epidemic of panic in Italy. BMJ. 2015; 350: h116. Available: http://www.bmj.com/content/350/bmj.h116. doi: 10. 1136/bmj.h116 PMID: 25589037