Beyond Dr. Google: The evidence on consumer-facing digital tools for diagnosis

Diagnosis

Volumn 5, Issue 3, 2018, Pages 95-105

  Millenson, Michael L ^a,b   Baldwin, Jessica L ^c,d   Zipperer, Lorri ^e   Singh, Hardeep ^c,d  

^a Health Quality Advisors LLC   (United States)

^b NORTHWESTERN UNIVERSITY   (United States)

^c MICHAEL E DEBAKEY VETERANS AFFAIRS MEDICAL CENTER   (United States)

^d BAYLOR COLLEGE OF MEDICINE   (United States)

^e Zipperer Project Management   (United States)

Author keywords

consumerism; crowdsourcing; diagnostic error; digital health; evidence based medicine; health apps; health information technology; mHealth; patient engagement

Indexed keywords

ALGORITHM; ALZHEIMER DISEASE; COMPUTER ASSISTED DIAGNOSIS; CROWDSOURCING; DEPRESSION; DERMATOLOGY; DIAGNOSTIC ACCURACY; DIAGNOSTIC ERROR; DIGITAL IMAGING; EMERGENCY HEALTH SERVICE; EVIDENCE BASED MEDICINE; HAND SURGERY; HUMAN; IMAGE PROCESSING; KNEE PAIN; MEDICAL INFORMATICS; NEUROLOGY; ORTHOPEDICS; OTORHINOLARYNGOLOGY; PEER REVIEW; PREDICTIVE VALUE; PRIORITY JOURNAL; REVIEW; RHEUMATOID ARTHRITIS; RHEUMATOLOGY; SENSITIVITY AND SPECIFICITY; SEXUALLY TRANSMITTED DISEASE; UROLOGY; CONSUMER HEALTH INFORMATION; DIRECT-TO-CONSUMER ADVERTIZING; FEMALE; MALE; MOBILE APPLICATION; PROCEDURES; STANDARDS; STATISTICS AND NUMERICAL DATA; TRENDS;

ALGORITHMS; CONSUMER HEALTH INFORMATION; CROWDSOURCING; DIAGNOSTIC ERRORS; DIRECT-TO-CONSUMER ADVERTISING; EVIDENCE-BASED MEDICINE; FEMALE; HUMANS; INTERNET ACCESS; MALE; MOBILE APPLICATIONS; TRIAGE;

EID: 85057255503     PISSN: 21948011     EISSN: 2194802X     Source Type: Journal    
DOI: 10.1515/dx-2018-0009     Document Type: Review

References (63)

1. Improving Diagnosis in Health Care. National Academies of Sciences, Engineering and Medicine. 2015. Available at: http://iom. nationalacademies.org/Reports/2015/Improving-Diagnosis-in-Healthcare.aspx. Accessed: 14 Jun 2016.
2. Fox S, Duggan M. Health Online 2013. 2013. Available at: http://www.pewinternet.org/2013/01/15/health-online-2013/. Accessed: 12 Jul 2017.
3. Brabham DC, Ribisl KM, Kirchner TR, Bernhardt JM. Crowdsourcing applications for public health. Am J Prev Med 2014;46:179-87.
4. O'Reilly T. What is Web 2.0. 2005. Available at: http://www. oreilly.com/pub/a/web2/archive/what-is-web-20.html. Accessed: 15 Dec 2017.
5. Research2guidance. The mHealth App Market is Getting Crowded. 2016. Available at: https://research2guidance.com/ mhealth-app-market-getting-crowded-259000-mhealth-appsnow/. Accessed: 4 Sep 2017.
6. Jutel A, Lupton, D. Digitizing diagnosis: a review of mobile applications in the diagnostic process. Diagnosis 2015;2: 89-96.
7. Singh H, Graber M, Onakpoya I, Schiff GD, Thompson MJ. The global burden of diagnostic errors in primary care. BMJ Qual Saf 2016;26:484-94.
8. McCartney M. How do we know whether medical apps work? Br Med J 2013;346:f1811.
9. Administration USFD. Mobile Medical Applications. Available at: https://www.fda.gov/medicaldevices/digitalhealth/mobilemedicalapplications/ default.htm. Accessed: 15 Dec 2017.
10. Comstock J. In past editorials, Trump's FDA pick advocated hands-off approach for health apps. 2017. Available at: http:// www.mobihealthnews.com/content/past-editorials-trumps-fdapick-advocated-hands-approach-health-apps. Accessed: 15 Dec 2017.
11. AMA Wire. Medical innovations and digital snake oil: AMA CEO speaks out. 2016. Available at: https://wire.ama-assn.org/ life-career/medical-innovation-and-digital-snake-oil-ama-ceospeaks-out. Accessed: 15 Dec 2017.
12. Aitken M, Lyle J. Patient Adoption of mHealth: Use, Evidence and Remaining Barriers to Mainstream Acceptance. Parsippany, NY: IMS Institute for Healthcare Informatics. 2015. https://pascaleboyerbarresi. files.wordpress.com/2015/03/iihi-patient-adoption- of-mhealth.pdf. Accessed: 12 July 2017.
13. American Medical Association. Report 6 of the Council on Medical Service (I-16). Integration of mobile health applications and devices into practice. 2016. https://www.ama-assn.org/ sites/default/files/media-browser/public/about-ama/councils/ Council%20Reports/council-on-medical-service/interim-2016-council-on-medical-service-report-6.pdf. Accessed: 12 July 2017.
14. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Social Res Methodol 2005;8:19-32.
15. Fiordelli M, Diviani N, Schulz PJ. Mapping mHealth research: a decade of evolution. J Med Internet Res 2013;15:e95.
16. TechTarget. Computing Fundamentals. 2007. Available at: http://searchmobilecomputing.techtarget.com/definition/app. Accessed: 12 Jul 2017.
17. Cooke A, Smith D, Booth A. Beyond PICO: the SPIDER tool for qualitative evidence synthesis. Qual Health Res 2012;22: 1435-43.
18. Bender JL, Yue RY, To MJ, Deacken L, Jadad AR. A lot of action, but not in the right direction: systematic review and content analysis of smartphone applications for the prevention, detection, and management of cancer. J Med Internet Res 2013;15:e287.
19. Bhattacharyya M. Studying the Reality of Crowd-Powered Healthcare. Paper presented at: AAAI HCOMP2015.
20. Brewer AC, Endly DC, Henley J, Amir M, Sampson BP, Moreau JF, et al. Mobile applications in dermatology. JAMA Dermatol 2013;149:1300-4.
21. Brouard B, Bardo P, Bonnet C, Mounier N, Vignot M, Vignot S. Mobile applications in oncology: is it possible for patients and healthcare professionals to easily identify relevant tools? Ann Med 2016;48:509-15.
22. Cheng J, Manoharan M, Lease M, Zhang Y. Is there a Doctor in the Crowd? Diagnosis Needed! (for less than $5). Paper presented at: iConference 2015.
23. Gibbs J, Gkatzidou V, Tickle L, Manning SR, Tilakkumar T, Hone K, et al. 'Can you recommend any good STI apps?' A review of content, accuracy and comprehensiveness of current mobile medical applications for STIs and related genital infections. Sex Transm Infect 2017;93:234-5.
24. Juusola JL, Quisel TR, Foschini L, Ladapo JA. The impact of an online crowdsourcing diagnostic tool on health care utilization: a case study using a novel approach to retrospective claims analysis. J Med Internet Res 2016;18:e127.
25. Kassianos AP, Emery JD, Murchie P, Walter FM. Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review. Br J Dermatol 2015;172:1507-18.
26. Lupton D, Jutel A. 'It's like having a physician in your pocket!' A critical analysis of self-diagnosis smartphone apps. Soc Sci Med 2015;133:128-35.
27. Meyer AN, Longhurst CA, Singh H. Crowdsourcing diagnosis for patients with undiagnosed illnesses: an evaluation of crowdmed. J Med Internet Res 2016;18:e12.
28. Patel S, Madhu E, Boyers LN, Karimkhani C, Dellavalle R. Update on mobile applications in dermatology. Dermatol Online J 2015;21.
29. Pereira-Azevedo N, Carrasquinho E, Cardoso de Oliveira E, Cavadas V, Osorio L, Fraga A, et al. mHealth in urology: a review of experts' involvement in app development. PLoS One 2015;10:e0125547.
30. Robillard JM, Illes J, Arcand M, Beattie BL, Hayden S, Lawrence P, et al. Scientific and ethical features of English-language online tests for Alzheimer's disease. Alzheimers Dement (Amst) 2015;1:281-8.
31. Rodin A, Shachak A, Miller A, Akopyan V, Semenova N. Mobile apps for eye care in Canada: an analysis of the iTunes store. JMIR Mhealth Uhealth 2017;5:e84.
32. Shen N, Levitan MJ, Johnson A, Bender JL, Hamilton-Page M, Jadad AA, et al. Finding a depression app: a review and content analysis of the depression app marketplace. JMIR Mhealth Uhealth 2015;3:e16.
33. Bisson LJ, Komm JT, Bernas GA, Fineberg MS, Marzo JM, Rauh MA, et al. How accurate are patients at diagnosing the cause of their knee pain with the help of a web-based symptom checker? Orthop J Sports Med 2016;4:2325967116630286.
34. Dorairaj JJ, Healy GM, McInerney A, Hussey AJ. Validation of a melanoma risk assessment smartphone application. Dermatol Surg 2017;43:299-302.
35. Farmer SE, Bernardotto M, Singh V. How good is Internet selfdiagnosis of ENT symptoms using Boots WebMD symptom checker? Clin Otolaryngol 2011;36:517-8.
36. Ferrero NA, Morrell DS, Burkhart CN. Skin scan: a demonstration of the need for FDA regulation of medical apps on iPhone. J Am Acad Dermatol 2013;68:515-6.
37. Hageman MG, Anderson J, Blok R, Bossen JK, Ring D. Internet self-diagnosis in hand surgery. Hand (NY) 2015;10:565-9.
38. Luger TM, Houston TK, Suls J. Older adult experience of online diagnosis: results from a scenario-based think-aloud protocol. J Med Internet Res 2014;16:e16.
39. Maier T, Kulichova D, Schotten K, Astrid R, Ruzicka T, Berking C, et al. Accuracy of a smartphone application using fractal image analysis of pigmented moles compared to clinical diagnosis and histological result. J Eur Acad Dermatol Venereol 2015;29:663-7.
40. Nabil R, Bergman W, KuKutsh NA. Poor agreemenet between a mobile phone application for the analysis of skin lesions and the clinical diagnosis of the dermatologist, a pilot study. Br J Dermatol 2017;177:583-4.
41. Ngoo A, Finnane A, McMeniman E, Tan JM, Janda M, Soyer HP. Efficacy of smartphone applications in high-risk pigmented lesions. Australas J Dermatol 2017;1-8. [Epub ahead of print].
42. Powley L, McIlroy G, Simons G, Raza K. Are online symptoms checkers useful for patients with inflammatory arthritis? BMC Musculoskelet Disord 2016;17:362.
43. Semigran HL, Linder JA, Gidengil C, Mehrotra A. Evaluation of symptom checkers for self diagnosis and triage: audit study. Br Med J 2015;351:h3480.
44. Semigran HL, Levine DM, Nundy S, Mehrotra A. Comparison of physician and computer diagnostic accuracy. JAMA Intern Med 2016;176:1860-61.
45. Thissen M, Udrea A, Hacking M, von Braunmuehl T, Ruzicka T. mHealth app for risk assessment of pigmented and nonpigmented skin lesions-a study on sensitivity and specificity in detecting malignancy. Telemed J E Health 2017;23:948-54.
46. Wolf JA, Moreau JF, Patton TJ, Winger DG, Ferris LK. Prevalence and impact of health-related internet and smartphone use among dermatology patients. Cutis 2015;95:323-8.
47. Chapman M. A health app's AI took on human doctors to triage patients. 2016. Available at: https://motherboard.vice.com/en- us/article/z43354/a-health-apps-ai-took-on-human-doctors-totriage-patients. Accessed: 12 Jul 2017.
48. Shah V, Hemang K, Pandya MD. Smartphones for visual function testing. 2015. Available at: https://www.retinalphysician.com/ issues/2015/may-2015/smartphones-for-visual-function-testing. Accessed: 18 Dec 2017.
49. Husain I. Self-diagnosis app study scrutinized the wrong way. 2015. Available at: https://www.imedicalapps.com/author/iltifat/#. Accessed: 12 Jul 2017.
50. Middleton K, Butt M, Hammerla N, Hamblin S, Mheta K, Parsa A. Sorting out symptoms: design and evaluation of the 'Babylon Check' automated triage system. 2016. Available at: https:// arxiv.org/abs/1606.02041. Accessed: 12 Jul 2017.
51. Lee L. Portable vision testing kit puts an eye doctor in your smartphone. 2016. Available at: https://newatlas.com/eyequepersonal-vision-tracker/47148/. Accessed: 18 Dec 2017.
52. Hagan P. Can an app really help you spot a risky mole? SkinVision can help you 'be your own doctor' by finding irregularities. 2016. Available at: http://www.dailymail.co.uk/health/ article-3845614/Can-app-really-help-spot-risky-mole-SkinVision-help-doctor-finding-irregularities.html. Accessed: 18 Dec 2017.
53. McCartney M. Margaret McCartney: innovation without sufficient evidence is a disservice to all. Br Med J 2017;358:j3980.
54. Fraser HS, Clamp S, Wilson CJ. Limitations of study on symptom checkers. JAMA Intern Med 2017;177:740-1.
55. Dietvorst BJ, Simmons JP, Massey C. Algorithm aversion: people erroneously avoid algorithms after seeing them err. J Exp Psychol Gen 2015;144:114-26.
56. Mandl KD, Bourgeois FT. The evolution of patient diagnosis: from art to digital data-driven science. J Am Med Assoc 2017;318:1859-60.
57. National Alliance on Mental Illness. Google partners with NAMI to shed light on clinical depression. 2017. Available at: https:// www.nami.org/About-NAMI/NAMI-News/2017/Google-Partners-with-NAMI-to-Shed-Light-on-Clinica. Accessed: 12 Jul 2017.
58. Morse J. So how worried should we be about Apple's Face ID? 2017. Available at: http://mashable.com/2017/09/14/applefaceid-privacy-concerns/#oL77nLsigiqV. Accessed: 8 Dec 2017.
59. Grundy QH, Wang Z, Bero LA. Challenges in assessing mobile health app quality: a systematic review of prevalent and innovative methods. Am J Prev Med 2016;51:1051-9.
60. Graber ML, Mathew A. Performance of a web-based clinical diagnosis support system for internists. J Gen Intern Med 2008;23(Suppl 1):37-40.
61. Meyer AN, Thompson PJ, Khanna A, Desai S, Mathews BK, Yousef E, et al. Evaluating a mobile application for improving clinical laboratory test ordering and diagnosis. J Am Med Inform Assoc 2018;25:841-7.
62. Riches N, Panagioti M, Alam R, Cheraghi-Sohi S, Campbell S, Esmail A, et al. The effectiveness of electronic differential diagnoses (ddx) generators: a systematic review and metaanalysis. PLoS One 2016;11:e0148991.
63. Sepucha KR, Abhyankar P, Hoffman AS, Bekker HL, LeBlanc A, Levin CA, et al. Standards for UNiversal reporting of patient Decision Aid Evaluation studies: the development of SUNDAE checklist. BMJ Qual Saf 2018;27:380-8.