Analyzing information seeking and drug-safety alert response by health care professionals as new methods for surveillance

Journal of Medical Internet Research

Volumn 17, Issue 8, 2015, Pages

  Callahan, Alison ^a   Pernek, Igor ^b   Stiglic, Gregor ^c   Leskovec, Jure ^d   Strasberg, Howard R ^e   Shah, Nigam Haresh ^a  

^a STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b Research Studios Austria   (Austria)

^c UNIVERSITY OF MARIBOR   (Slovenia)

^d Stanford University   (United States)

^e Wolters Kluwer Health   (United States)

Author keywords

Data mining; Drug safety surveillance; Information seeking behavior; Internet log analysis; Physicians

Indexed keywords

ADVERSE DRUG REACTION; FEASIBILITY STUDY; FOOD AND DRUG ADMINISTRATION; HEALTH CARE PERSONNEL; HUMAN; INFORMATION SEEKING; INTERNET; PHYSICIAN; QUESTIONNAIRE; SAFETY; SEARCH ENGINE; UNITED STATES;

DRUG-RELATED SIDE EFFECTS AND ADVERSE REACTIONS; FEASIBILITY STUDIES; HEALTH PERSONNEL; HUMANS; INFORMATION SEEKING BEHAVIOR; INTERNET; PHYSICIANS; SAFETY; SEARCH ENGINE; SURVEYS AND QUESTIONNAIRES; UNITED STATES; UNITED STATES FOOD AND DRUG ADMINISTRATION;

EID: 84940656019     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.4427     Document Type: Article

References (38)

1. Fox S. Pew Research Center. Washington, DC: Pew Internet & American Life Project; 2011 May 12. The social life of health information URL: http://www.pewinternet.org/2011/05/12/the-social-life-of-health-information-2011/ [accessed 2015-03-11] [WebCite Cache ID 6WxPUyoVr]
2. Fox S, Duggan M. Pew Research Center. Washington, DC: Pew Internet & American Life Project; 2013 Jan 15. Health online 2013 URL: http://www.pewinternet.org/2013/01/15/health-online-2013/ [accessed 2015-03-10] [WebCite Cache ID 6WxPbiHqx]
3. Masters K. For what purpose and reasons do doctors use the Internet: a systematic review. Int J Med Inform 2008 Jan;77(1):4-16. [doi: 10.1016/j.ijmedinf.2006.10.002] [Medline: 17137833]
4. Clarke MA, Belden JL, Koopman RJ, Steege LM, Moore JL, Canfield SM, et al. Information needs and information-seeking behaviour analysis of primary care physicians and nurses: a literature review. Health Info Libr J 2013 Sep;30(3):178-190. [doi: 10.1111/hir.12036] [Medline: 23981019]
5. Google/Manhattan Research. 2012 Jun. Screen to script: the doctor's digital path to treatment URL: https://www. thinkwithgoogle.com/research-studies/the-doctors-digital-path-to-treatment.html [accessed 2015-03-11] [WebCite Cache ID 6WxWKrYXP]
6. Kourouthanassis PE, Mikalef P, Ioannidou M, Pateli A. Exploring the online satisfaction gap of medical doctors: an expectation-confirmation investigation of information needs. Adv Exp Med Biol 2015;820:217-228. [doi: 10.1007/978-3-319-09012-2-15] [Medline: 25417027]
7. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [doi: 10.1038/nature07634] [Medline: 19020500]
8. McIver DJ, Brownstein JS. Wikipedia usage estimates prevalence of influenza-like illness in the United States in near real-time. PLoS Comput Biol 2014 Apr;10(4):e1003581 [FREE Full text] [doi: 10.1371/journal.pcbi.1003581] [Medline: 24743682]
9. Ofran Y, Paltiel O, Pelleg D, Rowe JM, Yom-Tov E. Patterns of information-seeking for cancer on the internet: an analysis of real world data. PLoS One 2012;7(9):e45921 [FREE Full text] [doi: 10.1371/journal.pone.0045921] [Medline: 23029317]
10. Harsha AK, Schmitt JE, Stavropoulos SW. Know your market: use of online query tools to quantify trends in patient information-seeking behavior for varicose vein treatment. J Vasc Interv Radiol 2014 Jan;25(1):53-57. [doi: 10.1016/j.jvir.2013.09.015] [Medline: 24286941]
11. Althouse BM, Allem J, Childers MA, Dredze M, Ayers JW. Population health concerns during the United States' Great Recession. Am J Prev Med 2014 Feb;46(2):166-170. [doi: 10.1016/j.amepre.2013.10.008] [Medline: 24439350]
12. Ayers JW, Althouse BM, Allem J, Rosenquist JN, Ford DE. Seasonality in seeking mental health information on Google. Am J Prev Med 2013 May;44(5):520-525. [doi: 10.1016/j.amepre.2013.01.012] [Medline: 23597817]
13. White RW, Horvitz E. From health search to healthcare: explorations of intention and utilization via query logs and user surveys. J Am Med Inform Assoc 2014;21(1):49-55 [FREE Full text] [doi: 10.1136/amiajnl-2012-001473] [Medline: 23666794]
14. Yom-Tov E, White RW, Horvitz E. Seeking insights about cycling mood disorders via anonymized search logs. J Med Internet Res 2014;16(2):e65 [FREE Full text] [doi: 10.2196/jmir.2664] [Medline: 24568936]
15. Schuster NM, Rogers MA, McMahon LF. Using search engine query data to track pharmaceutical utilization: a study of statins. Am J Manag Care 2010 Aug;16(8):e215-e219 [FREE Full text] [Medline: 20690788]
16. White RW, Harpaz R, Shah NH, DuMouchel W, Horvitz E. Toward enhanced pharmacovigilance using patient-generated data on the internet. Clin Pharmacol Ther 2014 Aug;96(2):239-246 [FREE Full text] [doi: 10.1038/clpt.2014.77] [Medline: 24713590]
17. Chisholm R, Finnell JT. Emergency department physician internet use during clinical encounters. AMIA Annu Symp Proc 2012;2012:1176-1183 [FREE Full text] [Medline: 23304394]
18. Kritz M, Gschwandtner M, Stefanov V, Hanbury A, Samwald M. Utilization and perceived problems of online medical resources and search tools among different groups of European physicians. J Med Internet Res 2013;15(6):e122 [FREE Full text] [doi: 10.2196/jmir.2436] [Medline: 23803299]
19. Mickan S, Tilson JK, Atherton H, Roberts NW, Heneghan C. Evidence of effectiveness of health care professionals using handheld computers: a scoping review of systematic reviews. J Med Internet Res 2013;15(10):e212 [FREE Full text] [doi: 10.2196/jmir.2530] [Medline: 24165786]
20. Samwald M, Kritz M, Gschwandtner M, Stefanov V, Hanbury A. Physicians searching the web for medical question answering: a European survey and local user studies. Stud Health Technol Inform 2013;192:1103. [Medline: 23920877]
21. UpToDate. URL: http://www.uptodate.com/home [accessed 2015-08-05] [WebCite Cache ID 6aaPtW2AH]
22. Bonis PA, Pickens GT, Rind DM, Foster DA. Association of a clinical knowledge support system with improved patient safety, reduced complications and shorter length of stay among Medicare beneficiaries in acute care hospitals in the United States. Int J Med Inform 2008 Nov;77(11):745-753. [doi: 10.1016/j.ijmedinf.2008.04.002] [Medline: 18565788]
23. Isaac T, Zheng J, Jha A. Use of UpToDate and outcomes in US hospitals. J Hosp Med 2012 Feb;7(2):85-90. [doi: 10.1002/jhm.944] [Medline: 22095750]
24. Santillana M, Nsoesie EO, Mekaru SR, Scales D, Brownstein JS. Using clinicians' search query data to monitor influenza epidemics. Clin Infect Dis 2014 Nov 15;59(10):1446-1450. [doi: 10.1093/cid/ciu647] [Medline: 25115873]
25. Bhat S, Bevans M, Sengupta S. Measuring users' Web activity to evaluate and enhance advertising effectiveness. J Advert 2013 May 31;31(3):97-106. [doi: 10.1080/00913367.2002.10673679]
26. Danaher PJ, Mullarkey GW, Essegaier S. Factors affecting Web site visit duration: a cross-domain analysis. J Mark Res 2006 May;43(2):182-194. [doi: 10.1509/jmkr.43.2.182]
27. Lependu P, Iyer SV, Fairon C, Shah NH. Annotation analysis for testing drug safety signals using unstructured clinical notes. J Biomed Semantics 2012;3 Suppl 1:S5 [FREE Full text] [doi: 10.1186/2041-1480-3-S1-S5] [Medline: 22541596]
28. Lependu P, Liu Y, Iyer S, Udell MR, Shah NH. Analyzing patterns of drug use in clinical notes for patient safety. AMIA Jt Summits Transl Sci Proc 2012;2012:63-70 [FREE Full text] [Medline: 22779054]
29. Leskovec J, Backstrom L, Kleinberg J. Meme-tracking and the dynamics of the news cycle. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '09). New York, NY: ACM; 2009 Presented at: 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '09); 2009; Paris, France p. 497-506.
30. Suen C, Huang S, Eksombatchai C, Sosic R, Leskovec J. NIFTY: a system for large scale information flow tracking and clustering. In: Proceedings of the 22nd International Conference on World Wide Web (WWW '13). Geneva, Switzerland: International World Wide Web Conferences Steering Committee; 2013 Presented at: 22nd International Conference on World Wide Web (WWW '13); May 13-17, 2013; Rio de Janeiro, Brazil p. 1237-1248.
31. Spinn3r. URL: http://spinn3r.com/ [accessed 2015-03-11] [WebCite Cache ID 6WxPiH8Nx]
32. White RW, Tatonetti NP, Shah NH, Altman RB, Horvitz E. Web-scale pharmacovigilance: listening to signals from the crowd. J Am Med Inform Assoc 2013 May 1;20(3):404-408 [FREE Full text] [doi: 10.1136/amiajnl-2012-001482] [Medline: 23467469]
33. Odgers DJ, Harpaz R, Callahan A, Stiglic G, Shah NH. Analyzing search behavior of healthcare professionals for drug safety surveillance. Pac Symp Biocomput 2015;20:306-317 [FREE Full text] [Medline: 25592591]
34. Harpaz R, Odgers D, Gaskin G, DuMouchel W, Winnenburg R, Bodenreider O, et al. A time-indexed reference standard of adverse drug reactions. Sci Data 2014 Nov 11;1:140043 [FREE Full text] [doi: 10.1038/sdata.2014.43] [Medline: 25632348]
35. Göker A, He D. Analysing Web search logs to determine session boundaries for user-oriented learning. In: Brusilovsky P, Stock O, Strapparava C, editors. Adaptive Hypermedia and Adaptive Web-Based Systems. Berlin, Germany: Springer Berlin Heidelberg; 2000:319-322.
36. Murray GC, Lin J, Chowdhury A. Identification of user sessions with hierarchical agglomerative clustering. In: Proceedings of the American Society for Information Science and Technology Annual Meeting. 2007 Oct Presented at: American Society for Information Science and Technology Annual Meeting; October 19-24, 2007; Milwaukee, WI p. 1-9. [doi: 10.1002/meet.14504301312]
37. Bulter D. Nature.: Nature Publishing Group; 2013 Feb 13. When Google got flu wrong URL: http://www.nature.com/news/ when-google-got-flu-wrong-1.12413 [accessed 2015-03-11] [WebCite Cache ID 6WxPnZ7ph]
38. Lazer D, Kennedy R, King G, Vespignani A. Big data. The parable of Google Flu: traps in big data analysis. Science 2014 Mar 14;343(6176):1203-1205. [doi: 10.1126/science.1248506] [Medline: 24626916]