Advances in nowcasting influenza-like illness rates using search query logs

Scientific Reports

Volumn 5, Issue , 2015, Pages

  Lampos, Vasileios ^a,b   Miller, Andrew C ^b,c   Crossan, Steve ^b   Stefansen, Christian ^b  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b GOOGLE   (United Kingdom)

^c HARVARD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HEALTH SURVEY; HUMAN; INFLUENZA, HUMAN; INTERNET; PROCEDURES; REGRESSION ANALYSIS; RESPIRATORY TRACT INFECTIONS; SEARCH ENGINE; SEASON; STATISTICS AND NUMERICAL DATA; THEORETICAL MODEL; UNITED STATES;

HUMANS; INFLUENZA, HUMAN; INTERNET; MODELS, THEORETICAL; POPULATION SURVEILLANCE; REGRESSION ANALYSIS; RESPIRATORY TRACT INFECTIONS; SEARCH ENGINE; SEASONS; UNITED STATES;

EID: 84938513272     PISSN: None     EISSN: 20452322     Source Type: Journal    
DOI: 10.1038/srep12760     Document Type: Article

References (44)

1. Cha, M., Kwak, H., Rodriguez, P., Ahn, Y.-Y. & Moon, S. I Tube, You Tube, Everybody Tubes: Analyzing the World's Largest User Generated Content Video System. In Proc. of the 7th ACM SIGCOMM Conference on Internet Measurement, IMC '07, 1-14 (ACM, San Diego, California, USA 2007).
2. Kwak, H., Lee, C., Park, H. & Moon, S. What is Twitter, a Social Network or a News Media? In Proc. of the 19th International Conference on World Wide Web, WWW '10, 591-600 (ACM, Raleigh, North Carolina, USA 2010).
3. Choi, H. & Varian, H. R. Predicting the Present with Google Trends. Economic Record 88, 2-9 (2012).
4. Tumasjan, A., Sprenger, T. O., Sandner, P. G. & Welpe, I. M. Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment. In Proc. of 4th International AAAI Conference on Weblogs and Social Media, ICWSM '10, 178-185 (AAAI, Washington, DC, USA 2010).
5. O'Connor, B., Balasubramanyan, R., Routledge, B. R. & Smith, N. A. From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series. In Proc. of the 4th International AAAI Conference on Weblogs and Social Media, ICWSM '10, 122-129 (AAAI, Washington, DC, USA 2010).
6. Bollen, J., Mao, H. & Zeng, X. Twitter mood predicts the stock market. Journal of Computational Science 2, 1-8 (2011).
7. Goel, S., Hofman, J. M., Lahaie, S., Pennock, D. M. & Watts, D. J. Predicting consumer behavior with Web search. PNAS 107, 17486-17490 (2010).
8. Scott, S. L. & Varian, H. R. Predicting the Present with Bayesian Structural Time Series. Inter J Math Model Num Opt 5, 4-23 (2014).
9. Polgreen, P. M., Chen, Y., Pennock, D. M., Nelson, F. D. & Weinstein, R. A. Using Internet Searches for Influenza Surveillance. Clin Infect Dis 47, 1443-1448 (2008).
10. Lampos, V. & Cristianini, N. Tracking the flu pandemic by monitoring the Social Web. In Proc. of the 2nd International Workshop on Cognitive Information Processing CIP '10, 411-416 (IEEE, Elba Island, Italy 2010).
11. Johnson, H. A. et al. Analysis of Web access logs for surveillance of influenza. Stud Health Technol Inform 107, 1202-1206 (2004).
12. Eysenbach, G. Infodemiology and Infoveillance: Framework for an Emerging Set of Public Health Informatics Methods to Analyze Search, Communication and Publication Behavior on the Internet. J Med Internet Res. 11, e11 (2009).
13. Ginsberg, J. et al. Detecting influenza epidemics using search engine query data. Nature 457, 1012-1014 (2009).
14. Culotta, A. Towards Detecting Influenza Epidemics by Analyzing Twitter Messages. In Proc. of the 1st Workshop on Social Media Analytics 115-122 (ACM, Washington, DC, USA 2010).
15. Lampos, V. & Cristianini, N. Nowcasting Events from the Social Web with Statistical Learning. ACM Trans Intell Syst Technol 3, 72:1-72:22 (2012).
16. Lamb, A., Paul, M. J. & Dredze, M. Separating Fact from Fear: Tracking Flu Infections on Twitter. In Proc. of of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT '13, 789-795 (ACL, Atlanta, Georgia, USA 2013).
17. Paul, M. J. & Dredze, M. Discovering Health Topics in Social Media Using Topic Models. PLoS ONE 9, e103408 (2014).
18. Cook, S., Conrad, C., Fowlkes, A. L. & Mohebbi, M. H. Assessing Google Flu Trends Performance in the United States during the 2009 Influenza Virus A (H1N1) Pandemic. PLoS ONE 6, e23610 (2011).
19. Olson, D. R., Konty, K. J., Paladini, M., Viboud, C. & Simonsen, L. Reassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales. PLoS Comput Biol 9, e1003256 (2013).
20. Lazer, D., Kennedy, R., King, G. & Vespignani, A. The Parable of Google Flu: Traps in Big Data Analysis. Science 343, 1203-1205 (2014).
21. Dixon, M. & Wiener, G. TITAN: Thunderstorm identification, tracking, analysis, and nowcasting-A radar-based methodology. J Atmos Oceanic Technol 10, 785-797 (1993).
22. Giannone, D., Reichlin, L. & Small, D. Nowcasting: The real-time informational content of macroeconomic data. J Monet Econ 55, 665-676 (2008).
23. Culotta, A. Lightweight methods to estimate influenza rates and alcohol sales volume from Twitter messages. Lang Resour Eval 47, 217-238 (2013).
24. Hastie, T., Tibshirani, R. & Friedman, J. The Elements of Statistical Learning (Springer, 2009).
25. Tibshirani, R. Regression shrinkage and selection via the lasso. J Roy Stat Soc B Met 58, 267-288 (1996).
26. Zhao, P. & Yu, B. On Model Selection Consistency of Lasso. J Mach Learn Res 7, 2541-2563 (2006).
27. Zou, H. & Hastie, T. Regularization and variable selection via the elastic net. J Roy Stat Soc B Met 67, 301-320 (2005).
28. Lampos, V., Aletras, N., Preotiuc-Pietro, D. & Cohn, T. Predicting and Characterising User Impact on Twitter. In Proc. of the 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL '14, 405-413 (ACL, Gotheburg, Sweden 2014).
29. Cohn, T., Preotiuc-Pietro, D. & Lawrence, N. Gaussian Processes for Natural Language Processing. In Proc. of the 52nd Annual Meeting of the Association for Computational Linguistics: Tutorials ACL '14, 1-3 (ACL, Baltimore, Maryland, USA, 2014).
30. Rasmussen, C. E. & Williams, C. K. I. Gaussian Processes for Machine Learning (MIT Press, 2006).
31. Matérn, B. Spatial Variation (Springer, 1986).
32. Lloyd, S. Least squares quantization in PCM. IEEE Trans Inf Theory 28, 129-137 (1982).
33. Arthur, D. & Vassilvitskii, S. K-means+ + : The Advantages of Careful Seeding. In Proc. of the 18th Annual ACM-SIAM Symposium on Discrete Algorithms SODA '07, 1027-1035 (SIAM, New Orleans, Louisiana, USA, 2007).
34. Manning, C. D., Raghavan, P. & Schütze, H. Introduction to Information Retrieval (Cambridge University Press, 2008).
35. Santillana, M., Zhang, D. W., Althouse, B. M. & Ayers, J. W. What can digital disease detection learn from (an external revision to) Google Flu Trends? Am J Prev Med. 47, 341-347 (2014).
36. Preis, T. & Moat, H. S. Adaptive nowcasting of influenza outbreaks using Google searches. Roy Soc Open Sci 1 (2014).
37. Paul, M. J., Dredze, M. & Broniatowski, D. Twitter Improves Influenza Forecasting. PLoS Currents Outbreaks 1 (2014).
38. Hamilton, J. D. Time Series Analysis vol. 2 (Princeton University Press, 1994).
39. Hyndman, R. J. & Khandakar, Y. Automatic Time Series Forecasting: The forecast Package for R. J Stat Softw 27, 1-22 (2008).
40. Broniatowski, D. A., Paul, M. J. & Dredze, M. National and Local Influenza Surveillance through Twitter: An Analysis of the 2012-2013 Influenza Epidemic. PLoS ONE 8, e83672 (2013).
41. O'Hara, B. & Caswell, K. Health Status, Health Insurance, and Medical Services Utilization: 2010. Curr Pop Rep. 70-133 (2012).
42. Daihai, H. et al. Global Spatio-temporal Patterns of Influenza in the Post-pandemic Era. Sci Rep. 5 (2015).
43. Kitsak, M. et al. Identification of influential spreaders in complex networks. Nature Phys. 6, 888-893 (2010).
44. Pinto, P. C., Thiran, P. & Vetterli, M. Locating the Source of Diffusion in Large-Scale Networks. Phys Rev Lett 109, 068702 (2012).