Toward clinical digital phenotyping: a timely opportunity to consider purpose, quality, and safety

npj Digital Medicine

Volumn 2, Issue 1, 2019, Pages

  Huckvale, Kit ^a   Venkatesh, Svetha ^b   Christensen, Helen ^a,c  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b DEAKIN UNIVERSITY   (Australia)

^c Mindgardens Neuroscience Network   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL RESEARCH; CONDITION MONITORING; DIAGNOSIS; MAGNETIC RESONANCE IMAGING; SAFETY ENGINEERING;

CLINICAL PRACTICES; DIAGNOSTIC PROCESS; INTERVENTION MODELS; PERSONAL ELECTRONIC DEVICES; PHENOTYPING; QUALITY AND SAFETIES; RESEARCH INTERESTS; RESEARCH NEEDS; SAFETY BARRIERS; SMART PHONES;

PATIENT TREATMENT;

BIPOLAR DISORDER; CLINICAL PRACTICE; COMPUTER SCIENTIST; CONSUMER; DRINKING BEHAVIOR; FEASIBILITY STUDY; HARM REDUCTION; HEALTH CARE COST; HEALTH CARE ORGANIZATION; HUMAN; LIMIT OF QUANTITATION; MACHINE LEARNING; MOOD DISORDER; PERSONALIZED MEDICINE; PHENOTYPE; PRIMARY MEDICAL CARE; PRIORITY JOURNAL; REVIEW; RISK FACTOR; SUICIDE;

EID: 85089606001     PISSN: None     EISSN: 23986352     Source Type: Journal    
DOI: 10.1038/s41746-019-0166-1     Document Type: Review

References (122)

1. Torous, J., Kiang, M. V., Lorme, J. & Onnela, J. P. New tools for new research in psychiatry: a scalable and customizable platform to empower data driven smartphone research. Jmir Mental Health 3, e16 (2016).
2. Mohr, D. C., Zhang, M. & Schueller, S. M. Personal sensing: understanding mental health using ubiquitous sensors and machine learning. in Annual Review of Clinical Psychology. Vol 13. (Widiger, T. & Cannon, T.D. eds.) 23–47 (Annual Reviews, 2017).
3. Onnela, J.-P. & Rauch, S. L. Harnessing smartphone-based digital phenotyping to enhance behavioral and mental health. Neuropsychopharmacology 41, 1691–1696 (2016).
4. Raballo, A. Digital phenotyping: an overarching framework to capture our extended mental states. Lancet Psychiatry 5, 194–195 (2018).
5. Insel, T. R. Digital phenotyping: technology for a new science of behavior. JAMA 318, 1215–1216 (2017).
6. Bickman, L., Lyon, A. R. & Wolpert, M. Achieving precision mental health through effective assessment, monitoring, and feedback processes: introduction to the special issue. Adm. Policy Ment. Health Ment. Health Serv. Res. 43, 271–276 (2016).
7. Morris, Z. S., Wooding, S. & Grant, J. The answer is 17 years, what is the question: understanding time lags in translational research. J. R. Soc. Med. 104, 510–520 (2011).
8. Glasgow, R. E. & Emmons, K. M. How can we increase translation of research into practice? Types of evidence needed. Annu. Rev. Public Health 28, 413–433 (2007).
9. Mathes, T., Jacobs, E., Morfeld, J.-C. & Pieper, D. Methods of international health technology assessment agencies for economic evaluations- a comparative analysis. BMC Health Serv. Res. 13, 371 (2013).
10. Place, S. et al. Behavioral indicators on a mobile sensing platform predict clinically validated psychiatric symptoms of mood and anxiety disorders. J. Med. Internet Res. 19, e75 (2017).
11. Faherty, L. J. et al. Movement patterns in women at risk for perinatal depression: use of a mood-monitoring mobile application in pregnancy. J. Am. Med. Inform. Assoc. 24, 746–753 (2017).
12. Palmius, N. et al. Detecting bipolar depression from geographic location data. IEEE Trans. Biomed. Eng. 64, 1761–1771 (2017).
13. Ashok, C. K., Karunanidhi, S. & Narayanan, R. Validation of stress assessment using mobile phone. J. Psychosoc. Res. 11, 479–488 (2016).
14. Gjoreski, M., Gjoreski, H., Lustrek, M. & Gams, M. Automatic detection of perceived stress in campus students using smartphones. in Proc. 2015 International Conference on Intelligent Environments (Weber, M. et al. eds.) 132–135 (IEEE, Prague, 2015).
15. Sano, A. Measuring college students' sleep, stress, mental health and wellbeing with wearable sensors and mobile phones. Diss. Abstr. Intl.: Sect. B: Sci. Engi. 78, 117–120 (2017).
16. Sano, A. et al. Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones. in Proc. 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks. (IEEE, Cambridge, 2015).
17. Sano, A. et al. Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: Observational study. J. Med Internet Res 20, e210 (2018).
18. Weissman, M. M. et al. Cross-national epidemiology of major depression and bipolar disorder. JAMA 276, 293–299 (1996).
19. Truong, A. L. et al. Smartphone and online usage-based evaluation in teens (SOLVD-TEEN): can an app help teens and their parents with depression? J. Am. Acad. Child Adolesc. Psychiatry 56, S216 (2017).
20. Godlewska, B. R. et al. Predicting treatment response in depression: the role of anterior cingulate cortex. Int. J. Neuropsychopharmacol. 21, 988–996 (2018).
21. Rush, A. J. et al. STAR*D: revising conventional wisdom. CNS drugs 23, 627–647 (2009).
22. Mundt, J. C., Vogel, A. P., Feltner, D. E. & Lenderking, W. R. Vocal acoustic biomarkers of depression severity and treatment response. Biol. psychiatry 72, 580–587 (2012).
23. Gruenerbl, A. et al. Using smart phone mobility traces for the diagnosis of depressive and manic episodes in bipolar patients. in Proc. 5th Augmented Human International Conference 38 31–38:38 (ACM, Kobe, 2014).
24. Faurholt-Jepsen, M. et al. Behavioral activities collected through smartphones and the association with illness activity in bipolar disorder. Int. J. Methods Psychiatr. Res. 25, 309–323 (2016).
25. Faurholt-Jepsen, M. et al. Smartphone data as objective measures of bipolar disorder symptoms. Psychiatry Res. 217, 124–127 (2014).
26. Stange, J. et al. Convergence of active and passive assessments of affective instability in predicting the prospective course of bipolar disorder: the bi affect study. Neuropsychopharmacology 43(Supplement 1), S164 (2017).
27. Zulueta, J. et al. Predicting mood disturbance severity in bipolar subjects with mobile phone keystroke dynamics and metadata. Biol. Psychiatry 81, S195–S196 (2017).
28. Faurholt-Jepsen, M. et al. Smartphone data as an electronic biomarker of illness activity in bipolar disorder. Bipolar Disord. 17, 715–728 (2015).
29. Faurholt-Jepsen, M. et al. Voice analysis as an objective state marker in bipolar disorder. Transl. Psychiatry 6, e856 (2016).
30. Tohen, M., Waternaux, C. M. & Tsuang, M. T. Outcome in mania. A 4-year prospective follow-up of 75 patients utilizing survival analysis. Arch. Gen. psychiatry 47, 1106–1111 (1990).
31. Perry, A., Tarrier, N., Morriss, R., McCarthy, E. & Limb, K. Randomised controlled trial of efficacy of teaching patients with bipolar disorder to identify early symptoms of relapse and obtain treatment. BMJ (Clin. Res. ed.) 318, 149–153 (1999).
32. Biskin, R. S. The lifetime course of borderline personality disorder. Can. J. psychiatry Rev. Can. de. Psychiatr. 60, 303–308 (2015).
33. Nicholas, J., Boydell, K. & Christensen, H. Beyond symptom monitoring: consumer needs for bipolar disorder self-management using smartphones. Eur. Psychiatry 44, 210–216 (2017).
34. Morriss, R. K. et al. Interventions for helping people recognise early signs of recurrence in bipolar disorder. Cochrane Database Syst. Rev. 2007, CD004854 (2007).
35. Faurholt-Jepsen, M., Frost, M., Bardram, J. E. & Kessing, L. V. Smartphone based treatment in bipolar disorder. Eur. Psychiatry 33(Supplement), S32–S33 (2016).
36. Faurholt-Jepsen, M., Bauer, M. & Kessing, L.V. Smartphone-based objective monitoring in bipolar disorder: status and considerations. Intl. J. Bipolar Disord. 6, 6 (2018).
37. Faurholt-Jepsen, M. et al. Reducing the rate and duration of Re-ADMISsions among patients with unipolar disorder and bipolar disorder using smartphone-based monitoring and treatment - the RADMIS trials: study protocol for two randomized controlled trials. Trials 18, 277 (2017).
38. Roxburgh, A., Dobbins, T., Degenhardt, L. & Peacock, A. Opioid, amphetamine, and cocaine-induced deaths in Australia: August 2018. (National Drug and Alcohol Research Centre, UNSW, Sydney, 2018).
39. Nandakumar, R., Gollakota, S. & Sunshine, J. E. Opioid overdose detection using smartphones. Sci. Transl. Med. 11, eaau8914 (2019).
40. Giglio, R. E., Li, G. & DiMaggio, C. J. Effectiveness of bystander naloxone administration and overdose education programs: a meta-analysis. Inj. Epidemiol. 2, 10 (2015).
41. Russolillo, A., Moniruzzaman, A. & Somers, J. M. Methadone maintenance treatment and mortality in people with criminal convictions: a population-based retrospective cohort study from Canada. PLOS Med. 15, e1002625 (2018).
42. Byrnes, H. F. et al. Brief report: using global positioning system (GPS) enabled cell phones to examine adolescent travel patterns and time in proximity to alcohol outlets. J. Adolesc. 50, 65–68 (2016).
43. Byrnes, H. F. et al. Association of environmental indicators with teen alcohol use and problem behavior: Teens' observations vs. objectively-measured indicators. Health Place 43, 151–157 (2017).
44. Byrnes, H. F. et al. Tracking adolescents with global positioning system-enabled cell phones to study contextual exposures and alcohol and marijuana use: a pilot study. J. Adolesc. Health 57, 245–247 (2015).
45. Byrnes, H. F. et al. Using GPS-EMA techniques to examine contextual exposures in activity spaces vs residential areas: relations with teen AOD and problem behavior. Alcohol.: Clin. Exp. Res. 41, 171A (2017).
46. Byrnes, H. F. et al. Presence and characteristics of alcohol outlets perceived during daily travels: relationswith teen alcohol use, attitudes, and access. Alcohol.: Clin. Exp. Res. 42, 54A (2018).
47. Boyle, S. C. The social mindfeed project: using objective assessment methods to better understand the nature of social-media based peer alcohol influence. Alcohol.: Clin. Exp. Res. 42, 280A (2018).
48. Bae, S., Chung, T., Ferreira, D., Dey, A. K. & Suffoletto, B. Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: Implications for just-in-time adaptive interventions. Addict. Behav. 83, 42–47 (2018).
49. Santani, D. et al. DrinkSense: characterizing youth drinking behavior using smartphones. Ieee Trans. Mob. Comput. 17, 2279–2292 (2018).
50. O'Dea, B., Larsen, M., Batterham, P., Calear, A. & Christensen, H. Talking suicide on Twitter: linguistic style and language processes of suicide-related posts. Eur. Psychiatry 33, S274 (2016).
51. O'Dea, B., Larsen, M. E., Batterham, P. J., Calear, A. L. & Christensen, H. A linguistic analysis of suicide-related Twitter posts. Crisis 38, 319–329 (2017).
52. O'Dea, B. et al. Detecting suicidality on Twitter. Internet Interv. 2, 183–188 (2015).
53. WHO. Preventing suicide: a global imperative, (Stylus Publishing, 2014).
54. Canuso, C. M. et al. Efficacy and safety of intranasal esketamine for the rapid reduction of symptoms of depression and suicidality in patients at imminent risk for suicide: results of a double-blind, randomized, placebo-controlled study. Am. J. psychiatry 175, 620–630 (2018).
55. Vahabzadeh, A., Sahin, N. & Kalali, A. Digital suicide prevention: can technology become a game-changer? Innov. Clin. Neurosci. 13, 16–20 (2016).
56. Wilson, S. T. et al. Heart rate variability and suicidal behavior. Psychiatry Res 240, 241–247 (2016).
57. Wang, T., Azad, T. & Rajan, R. The emerging influence of digital biomarkers on healthcare. (Rock Health, San Francisco, 2016).
58. Torous, J., Staples, P. & Onnela, J.-P. Realizing the potential of mobile mental health: new methods for new data in psychiatry. Curr. Psychiatry Rep. 17, 61 (2015).
59. Kamath, J. et al. Prediction of clinical depression using smartphone sensory data. Neuropsychopharmacology 41, S536–S537 (2016).
60. Saeb, S. et al. The relationship between clinical, momentary, and sensor-based assessment of depression. in Proc. 2015 9th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) 229–232 (ICST Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, 2015).
61. Frank, E. et al. Sensing depression: Using smartphone sensors to predict changes in depression severity. Neuropsychopharmacology 43, S346 (2017).
62. Saeb, S. et al. Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: an exploratory study. J. Med. Internet Res. 17, e175 (2015).
63. Farhan, et al. Behavior vs. Introspection: refining prediction of clinical depression via smartphone sensing data. in Proc. 2016 IEEE Wireless Health (WH) 1–8 (IEEE, Bethesda, 2016).
64. Aung, H. et al. Continuous behavioral data as a depression biomarker. Neuropsychopharmacology 41, S488–S489 (2016).
65. Saeb, S., Lattie, E. G., Schueller, S. M., Kording, K. P. & Mohr, D. C. The relationship between mobile phone location sensor data and depressive symptom severity. PeerJ 4, e2537 (2016).
66. Barnett, I. et al. Relapse prediction in schizophrenia through digital phenotyping: a pilot study. Neuropsychopharmacology 43, 1660–1666 (2018).
67. American Psychiatric Association. Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association, Washington, DC, 2013).
68. McDermott, L. M. & Ebmeier, K. P. A meta-analysis of depression severity and cognitive function. J. Affect. Disord. 119, 1–8 (2009).
69. Rock, P. L., Roiser, J. P., Riedel, W. J. & Blackwell, A. D. Cognitive impairment in depression: a systematic review and meta-analysis. Psychol. Med. 44, 2029–2040 (2014).
70. Lee, R. S. C., Hermens, D. F., Porter, M. A. & Redoblado-Hodge, M. A. A meta-analysis of cognitive deficits in first-episode major depressive disorder. J. Affect. Disord. 140, 113–124 (2012).
71. Cha, D. S. et al. Perceived sleep quality predicts cognitive function in adults with major depressive disorder independent of depression severity. Ann. Clin. psychiatry: Off. J. Am. Acad. Clin. Psychiatr. 31, 17–26 (2019).
72. Vicent-Gil, M. et al. Cognitive predictors of illness course at 12 months after first-episode of depression. Eur. Neuropsychopharmacol. 28, 529–537 (2018).
73. Bortolato, B., Carvalho, A. F. & McIntyre, R. S. Cognitive dysfunction in major depressive disorder: a state-of-the-art clinical review. CNS Neurol. Disord. drug targets 13, 1804–1818 (2014).
74. Roiser, J. P., Elliott, R. & Sahakian, B. J. Cognitive mechanisms of treatment in depression. Neuropsychopharmacology 37, 117–136 (2012).
75. Dawson, E. L. et al. Executive functioning at baseline prospectively predicts depression treatment response. Prim. Care Companion J. Clinical Psychiatry 19, 16m01949 (2017).
76. John, A., Patel, U., Rusted, J., Richards, M. & Gaysina, D. Affective problems and decline in cognitive state in older adults: a systematic review and meta-analysis. Psychol. Med. 49, 353–365 (2019).
77. Simon, G. E. & Perlis, R. H. Personalized medicine for depression: can we match patients with treatments? Am. J. psychiatry 167, 1445–1455 (2010).
78. Kolla, B. P., Mansukhani, S. & Mansukhani, M. P. Consumer sleep tracking devices: a review of mechanisms, validity and utility. Expert Rev. Med. Devices 13, 497–506 (2016).
79. Williams, L. M. et al. The ENGAGE study: integrating neuroimaging, virtual reality and smartphone sensing to understand self-regulation for managing depression and obesity in a precision medicine model. Behav. Res. Ther. 101, 58–70 (2018).
80. Bagot, K. S. et al. Current, future and potential use of mobile and wearable technologies and social media data in the ABCD study to increase understanding of contributors to child health. Dev. Cogn. Neurosci. 32, 121–129 (2018).
81. Faurholt-Jepsen, M. et al. Objective smartphone data as a potential diagnostic marker of bipolar disorder. Aust. N.Z. J. Psychiatry 53, 119–128 (2019).
82. Dobrow, M. J., Hagens, V., Chafe, R., Sullivan, T. & Rabeneck, L. Consolidated principles for screening based on a systematic review and consensus process. CMAJ: Can. Med. Assoc. J.=J. de. l'Assoc. Med. Can. 190, E422–E429 (2018).
83. Lewinsohn, P. M., Klein, D. N. & Seeley, J. R. Bipolar disorder during adolescence and young adulthood in a community sample. Bipolar Disord. 2, 281–293 (2000).
84. Vickers, A. J., Van Calster, B. & Steyerberg, E. W. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ (Clin. Res. ed.) 352, i6 (2016).
85. Dagum, P. Digital biomarkers of cognitive function. npj Digital Med. 1, 10 (2018).
86. Sheridan, K. Mindstrong's mood-predicting app is shadowed by questions over evidence. STAT https://www.statnews.com/2018/10/04/mindstrong-questions-over-evidence/ (2018).
87. Adams, W. R. High-accuracy detection of early Parkinson's Disease using multiple characteristics of finger movement while typing. PLOS ONE 12, e0188226 (2017).
88. Stocchi, F., Vacca, L. & Radicati, F. G. How to optimize the treatment of early stage Parkinson's disease. Transl. Neurodegener. 4, 4–4 (2015).
89. Hustad, E., Skogholt, A. H., Hveem, K. & Aasly, J. O. The accuracy of the clinical diagnosis of Parkinson disease. The HUNT study. J. Neurol. 265, 2120–2124 (2018).
90. Schrag, A., Ben-Shlomo, Y. & Quinn, N. How valid is the clinical diagnosis of Parkinson's disease in the community? J. Neurol., Neurosurg. Psychiatry 73, 529–534 (2002).
91. Pagan, F. L. Improving outcomes through early diagnosis of Parkinson's disease. Am. J. Manag. care 18, S176–182 (2012).
92. Goldman, J. G. et al. Cognitive impairment in Parkinson’s disease: a report from a multidisciplinary symposium on unmet needs and future directions to maintain cognitive health. npj Park.'s. Dis. 4, 19 (2018).
93. Institute of Medicine. Crossing the quality chasm: a new health system for the 21st century. National Academy Press, Washington, DC, USA, 2001).
94. Demain, S. et al. Living with, managing and minimising treatment burden in long term conditions: a systematic review of qualitative research. PLOS ONE 10, e0125457–e0125457 (2015).
95. Dennison, L., Morrison, L., Conway, G. & Yardley, L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J. Med. Internet Res. 15, e86 (2013).
96. Bauer, M. et al. Ethical perspectives on recommending digital technology for patients with mental illness. Int. J. bipolar Disord. 5, 6–6 (2017).
97. Huckvale, K., Torous, J. & Larsen, M. E. Assessment of the data sharing and privacy practices of smartphone apps for depression and smoking cessation. JAMA Netw. Open 2, e192542–e192542 (2019).
98. Nicholas, J. et al. The role of data type and recipient in individuals’ perspectives on sharing passively collected smartphone data for mental health: Cross-sectional questionnaire study. JMIR Mhealth Uhealth 7, e12578 (2019).
99. Torous, J., Rodriguez, J. & Powell, A. The new digital divide for digital biomarkers. Digit. Biomark. 1, 87–91 (2017).
100. StatCounter. Mobile operating system market share in Australia - January 2019. http://gs.statcounter.com/os-market-share/mobile/australia (2019).
101. Challen, R. et al. Artificial intelligence, bias and clinical safety. BMJ Qual. Saf. 28, 231–237 (2019).
102. Klare, B. F., Burge, M. J., Klontz, J. C., Bruegge, R. W. V. & Jain, A. K. Face recognition performance: role of demographic information. IEEE Trans. Inf. Forensics Secur. 7, 1789–1801 (2012).
103. Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G. & Chin, M. H. Ensuring fairness in machine learning to advance health equity. Ann. Intern. Med. 169, 866–872 (2018).
104. Adkins, E. C. et al. Exploring the potential of technology-based mental health services for homeless youth: A qualitative study. Psychol. Serv. 14, 238–245 (2017).
105. Holmes, E. A. et al. The Lancet Psychiatry Commission on psychological treatments research in tomorrow's science. Lancet Psychiatry 5, 237–286 (2018).
106. Deady, M. et al. eHealth interventions for the prevention of depression and anxiety in the general population: a systematic review and meta-analysis. BMC Psychiatry 17, 310–310 (2017).
107. Do, H. P. et al. Which eHealth interventions are most effective for smoking cessation? A systematic review. Patient Prefer. adherence 12, 2065–2084 (2018).
108. Kitsiou, S., Paré, G., Jaana, M. & Gerber, B. Effectiveness of mHealth interventions for patients with diabetes: an overview of systematic reviews. PLOS ONE 12, e0173160 (2017).
109. Jeminiwa, R. et al. Impact of eHealth on medication adherence among patients with asthma: a systematic review and meta-analysis. Respir. Med. 149, 59–68 (2019).
110. Carbo, A. et al. Mobile technologies for managing heart failure: a systematic review and meta-analysis. Telemed. e-Health 24, 958–968 (2018).
111. Wahle, F., Kowatsch, T., Fleisch, E., Rufer, M. & Weidt, S. Mobile sensing and support for people with depression: a pilot trial in the wild. JMIR MHealth UHealth 4, e111 (2016).
112. Weidt, S., Wahle, F., Rufer, M., Horni, A. & Kowatsch, T. MOSS—mobile sensing and support detection of depressive moods with an app and help those affected. Ther. Umsch. 72, 553–555 (2015).
113. McCrone, P. et al. Cost-effectiveness of computerised cognitive-behavioural therapy for anxiety and depression in primary care: randomised controlled trial. Br. J. psychiatry: J. Ment. Sci. 185, 55–62 (2004).
114. Torous, J., Nicholas, J., Larsen, M. E., Firth, J. & Christensen, H. Clinical review of user engagement with mental health smartphone apps: evidence, theory and improvements. Evid. Based Ment. Health 21, 116–119 (2018).
115. Hoi, S.C., Sahoo, D., Lu, J. & Zhao, P. Online learning: a comprehensive survey. in arXiv preprint arXiv:1802.02871. (2018).
116. Ho, F. Y.-Y., Yeung, W.-F., Ng, T. H.-Y. & Chan, C. S. The efficacy and cost-effectiveness of stepped care prevention and treatment for depressive and/or anxiety disorders: a systematic review and meta-analysis. Sci. Rep. 6, 29281–29281 (2016).
117. Shahriari, B., Swersky, K., Wang, Z., Adams, R. P. & Freitas, Nd Taking the human out of the loop: a review of bayesian optimization. Proc. IEEE 104, 148–175 (2016).
118. Faurholt-Jepsen, M. et al. Daily electronic monitoring of subjective and objective measures of illness activity in bipolar disorder using smartphones-the MONARCA II trial protocol: a randomized controlled single-blind parallel-group trial. BMC Psychiatry 14, 309 (2014).
119. Allen, N. et al. UK Biobank: current status and what it means for epidemiology. Health Policy Technol. 1, 123–126 (2012).
120. Collins, R. What makes UK Biobank special? Lancet (Lond., Engl.) 379, 1173–1174 (2012).
121. Huckvale, K., Wang, C. J., Majeed, A. & Car, J. Digital health at fifteen: more human (more needed). BMC Med. 17, 62 (2019).
122. Alanazi, H. O., Abdullah, A. H. & Qureshi, K. N. A critical review for developing accurate and dynamic predictive models using machine learning methods in medicine and health care. J. Med. Syst. 41, 69 (2017).