Challenges in Assessing Mobile Health App Quality: A Systematic Review of Prevalent and Innovative Methods

American Journal of Preventive Medicine

Volumn 51, Issue 6, 2016, Pages 1051-1059

  Grundy, Quinn H ^a   Wang, Zhicheng ^a   Bero, Lisa A ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

CONSENSUS DEVELOPMENT; CONSUMER; CONTENT ANALYSIS; DATA EXTRACTION; HUMAN; META ANALYSIS; QUALITY CONTROL; SCIENTIST; SEARCH ENGINE; SYNTHESIS; SYSTEMATIC REVIEW; HEALTH PROMOTION; MOBILE APPLICATION; STANDARDS;

HEALTH PROMOTION; MOBILE APPLICATIONS;

EID: 84996598140     PISSN: 07493797     EISSN: 18732607     Source Type: Journal    
DOI: 10.1016/j.amepre.2016.07.009     Document Type: Review

References (53)

1. 1 Huckvale, K., Prieto, J., Tilney, M., Benghozi, P.-J., Car, J., Unaddressed privacy risks in accredited health and wellness apps: a cross-sectional systematic assessment. BMC Med, 13(1), 2015, 214, 10.1186/s12916-015-0444-y.
2. 2 research2guidance. mHealth App Developer Economics 2015. 2015, research2guidance, Berlin.
3. 3 U.S. Food and Drug Administration (FDA). Mobile Medical Applications: Guidance for Industry and Food and Drug Administration Staff. 2015, U.S. FDA, Silver Spring, MD.
4. 4 Therapeutic Goods Administration. Regulation of medical software and mobile medical “apps.” www.tga.gov.au/node/4316. Published 2013. Accessed October 22, 2015.
5. 5 European Commission. Manual on Borderline and Classification in the Community Regulatory Framework for Medical Devices. 2015, European Commission, Brussels.
6. 6 de la Vega, R., Miro, J., mHealth: a strategic field without a solid scientific soul. A systematic review of pain-related apps. PLoS One, 9(7), 2014, e101312, 10.1371/journal.pone.0101312.
7. 7 Buijink, A.W., Visser, B.J., Marshall, L., Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med 18:3 (2013), 90–92, 10.1136/eb-2012-100885.
8. 8 Neubeck, L., Lowres, N., Benjamin, E.J., Freedman, S.B., Coorey, G., Redfern, J., The mobile revolution—using smartphone apps to prevent cardiovascular disease. Nat Rev Cardiol 12:6 (2015), 350–360, 10.1038/nrcardio.2015.34.
9. 9 BinDhim, N.F., Hawkey, A., Trevena, L., A systematic review of quality assessment methods for smartphone health apps. Telemed J E Health 21:2 (2015), 97–104, 10.1089/tmj.2014.0088.
10. 10 IDC Research Inc. Smartphone OS market share, 2015 Q2. www.idc.com/prodserv/smartphone-os-market-share.jsp. Published 2015. Accessed October 16, 2015.
11. 11 Tan A. How to Choose the Best Platform for Your Mobile App. Published February 9, 2015. http://blog.smaato.com/how-to-choose-the-best-platform-for-your-mobile-app. Accessed October 16, 2015.
12. 12 Apple Inc. iTunes Connect developer guide. https://developer.apple.com/library/ios/documentation/LanguagesUtilities/Conceptual/iTunesConnect_Guide/Chapters/About.html#//apple_ref/doc/uid/TP40011225-CH1-SW1. Published 2015. Accessed December 14, 2015.
13. 13 Google Play. Launch checklist. http://developer.android.com/distribute/tools/launch-checklist.html. Published 2015. Accessed December 14, 2015.
14. 14 Huckvale, K., Adomaviciute, S., Prieto, J.T., Leow, M.K.-S., Car, J., Smartphone apps for calculating insulin dose: a systematic assessment. BMC Med 13:1 (2015), 1–10, 10.1186/s12916-015-0314-7.
15. 15 Google Play. Core app quality. http://developer.android.com/distribute/essentials/quality/core.html. Published 2015. Accessed December 14, 2015.
16. 16 Apple Inc. App review. https://developer.apple.com/support/app-review/. Published 2015. Accessed December 14, 2015.
17. 17 Stoyanov, S.R., Hides, L., Kavanagh, D.J., Zelenko, O., Tjondronegoro, D., Mani, M., Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR mHealth uHealth, 3(1), 2015, e27, 10.2196/mhealth.3422.
18. 18 Direito, A., Dale, L.P., Shields, E., Dobson, R., Whittaker, R., Maddison, R., Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques?. BMC Public Health, 14, 2014, 646, 10.1186/1471-2458-14-646.
19. 19 Perez S. Apple's app store gets a smarter search engine. TechCrunch. Published November 13, 2015. https://techcrunch.com/2015/11/13/app-store-search-just-got-smarter/. Accessed December 14, 2015.
20. 20 Rampton J. The beginner's guide to app store optimization. Forbes Tech. Published October 16, 2015. http://www.forbes.com/sites/johnrampton/2015/10/16/the-beginners-guide-to-app-store-optimization/#40daa33f19ed. Accessed December 14, 2015.
21. 21 Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., Group, T.P., Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med, 62009, 2009, e1000097, 10.1371/journal.pmed.1000097.
22. 22 Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration; 2011: www.cochrane-handbook.org. Accessed April 3.
23. 23 Wurzer, P., Parvizi, D., Lumenta, D.B., et al. Smartphone applications in burns. Burns 41:5 (2015), 977–989, 10.1016/j.burns.2014.11.010.
24. 24 van Mechelen, D.M., van Mechelen, W., Verhagen, E.A., Sports injury prevention in your pocket?! Prevention apps assessed against the available scientific evidence: a review. Br J Sports Med 48:11 (2014), 878–882, 10.1136/bjsports-2012-092136.
25. 25 Lister, C., West, J.H., Cannon, B., Sax, T., Brodegard, D., Just a fad? Gamification in health and fitness apps. JMIR Serious Games, 2(2), 2014, e9, 10.2196/games.3413.
26. 26 Mobasheri, M.H., Johnston, M., King, D., Leff, D., Thiruchelvam, P., Darzi, A., Smartphone breast applications—what's the evidence?. Breast 23:5 (2014), 683–689, 10.1016/j.breast.2014.07.006.
27. 27 Knight, E., Stuckey, M.I., Prapavessis, H., Petrella, R.J., Public health guidelines for physical activity: is there an app for that? A review of Android and Apple app stores. JMIR mHealth and uHealth, 3(2), 2015, 10.2196/mhealth.4003 e43–e43.
28. 28 Lalloo, C., Jibb, L.A., Rivera, J., Agarwal, A., Stinson, J.N., “There's a pain app for that”: Review of patient-targeted smartphone applications for pain management. Clin J Pain 31:6 (2015), 557–563, 10.1097/AJP.0000000000000171.
29. 29 Cowan, L.T., Van Wagenen, S.A., Brown, B.A., et al. Apps of steel: are exercise apps providing consumers with realistic expectations?: A content analysis of exercise apps for presence of behavior change theory. Health Educ Behav 40:2 (2013), 133–139, 10.1177/1090198112452126.
30. 30 Reynoldson, C., Stones, C., Allsop, M., et al. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med 15:6 (2014), 898–909, 10.1111/pme.12327.
31. 31 Williams, J.P., Schroeder, D., Popular glucose tracking apps and use of mHealth by Latinos with diabetes: review. JMIR mHealth uHealth, 3(3), 2015, 10.2196/mhealth.3986.
32. 32 Basilico, A., Marceglia, S., Bonacina, S., Pinciroli, F., Advising patients on selecting trustful apps for diabetes self-care. Comp Biol Med 71 (2016), 86–96, 10.1016/j.compbiomed.2016.02.005.
33. 33 Xu, W., Liu, Y., mHealthApps: a repository and database of mobile health apps. JMIR mHealth uHealth, 3(1), 2015, e28, 10.2196/mhealth.4026.
34. 34 Bardus, M., van Beurden, S.B., Smith, J.R., Abraham, C., A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act, 13(1), 2016, 35, 10.1186/s12966-016-0359-9.
35. 35 Lee, H., Sullivan, S.J., Schneiders, A.G., et al. Smartphone and tablet apps for concussion road warriors (team clinicians): a systematic review for practical users. Br J Sports Med 49:8 (2015), 499–505, 10.1136/bjsports-2013-092930.
36. 36 Plaza, I., Demarzo, M.M.P., Herrera-Mercadal, P., García-Campayo, J., Mindfulness-based mobile applications: literature review and analysis of current features. JMIR mHealth uHealth, 15(11), 2013, 10.2196/mhealth.2733.
37. 37 Huckvale, K., Morrison, C., Ouyang, J., Ghaghda, A., Car, J., The evolution of mobile apps for asthma: an updated systematic assessment of content and tools. BMC Med, 13, 2015, 58, 10.1186/s12916-015-0303-x.
38. 38 Ubhi, H.K., Kotz, D., Michie, S., et al. Comparative analysis of smoking cessation smartphone applications available in 2012 versus 2014. Addict Behav 58 (2016), 175–181, 10.1016/j.addbeh.2016.02.026.
39. 39 Jutel, A., Lupton, D., Digitizing diagnosis: a review of mobile applications in the diagnostic process. Diagnosis (Berl) 2:2 (2015), 89–96, 10.1515/dx-2014-0068.
40. 40 Lupton, D., Jutel, A., “It's like having a physician in your pocket!” A critical analysis of self-diagnosis smartphone apps. Soc Sci Med 133 (2015), 128–135, 10.1016/j.socscimed.2015.04.004.
41. 41 Zahry, N.R., Cheng, Y., Peng, W., Content analysis of diet-related mobile apps: a self-regulation perspective. Health Comm. In press. Online, March 3, 2016, 10.1080/10410236.2015.1072123.
42. 42 Azar, K.M., Lesser, L.I., Laing, B.Y., et al. Mobile applications for weight management: theory-based content analysis. Am J Prev Med 45:5 (2013), 583–589, 10.1016/j.amepre.2013.07.005.
43. 43 Davis, S.F., Ellsworth, M.A., Payne, H.E., Hall, S.M., West, J.H., Nordhagen, A.L., Health behavior theory in popular calorie counting apps: a content analysis. JMIR mHealth uHealth, 4(1), 2016, e19, 10.2196/mhealth.4177.
44. 44 Hoeppner, B.B., Hoeppner, S.S., Seaboyer, L., et al. How smart are smartphone apps for smoking cessation? A content analysis. Nicotine Tob Res 18:5 (2016), 1025–1031, 10.1093/ntr/ntv117.
45. 45 Hundert, A.S., Huguet, A., McGrath, P.J., Stinson, J.N., Wheaton, M., Commercially available mobile phone headache diary apps: a systematic review. JMIR mHealth uHealth, 2(3), 2014, e36, 10.2196/mhealth.3452.
46. 46 Gan, K.O., Allman-Farinelli, M., A scientific audit of smartphone applications for the management of obesity. Aust N Z J Public Health 35:3 (2011), 293–294, 10.1111/j.1753-6405.2011.00707.x.
47. 47 Nicholas, J., Larsen, M.E., Proudfoot, J., Christensen, H., Mobile apps for bipolar disorder: a systematic review of features and content quality. JMIR mHealth uHealth, 17(8), 2015, e198, 10.2196/jmir.4581.
48. 48 Lupton, D., Apps as artefacts: towards a critical perspective on mobile health and medical apps. Societies, 4(4), 2014, 606, 10.3390/soc4040606.
49. 49 Ouhbi, S., Luis Fernandez-Aleman, J., Rivera Pozo, J., El Bajta, M., Toval, A., Idri, A., Compliance of blood donation apps with mobile OS usability guidelines. J Med Syst, 39, 2015, 63, 10.1007/s10916-015-0243-1.
50. 50 Scott, K., Gome, G., Richards, D., Caldwell, P.Y., How trustworthy are apps for maternal and child health?. Health Technol (Berl) 4:4 (2015), 329–336, 10.1007/s12553-015-0099-x.
51. 51 App Annie. App Annie Index Market Q1 2015. 2015, App Annie, San Francisco, CA.
52. 52 Orland K. Pay to rank: gaming the app store in the age of Flappy Bird. Ars Technica. Published February 11, 2014. http://arstechnica.com/gaming/2014/02/pay-to-rank-gaming-the-app-store-in-the-age-of-flappy-bird/. Accessed December 24, 2015.
53. 53 Krieger, W.H., Medical apps: public and academic perspectives. Perspect Biol Med 56:2 (2013), 259–273, 10.1353/pbm.2013.0013.