Factors influencing usability of a smartphone app to reduce excessive alcohol consumption: Think aloud and interview studies

Frontiers in Public Health

Volumn 5, Issue APR, 2017, Pages

  Crane, David ^a   Garnett, Claire ^a   Brown, Jamie ^a   West, Robert ^a   Michie, Susan ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Alcohol; App; Digital health; Interview study; mHealth; Qualitative; Think aloud

Indexed keywords

EID: 85032335909     PISSN: None     EISSN: 22962565     Source Type: Journal    
DOI: 10.3389/FPUBH.2017.00039     Document Type: Article

References (105)

1. World Health Organization. Global Status Report on Alcohol and Health, 2014. (2014). Available from: http://apps.who.int/iris/handle/10665/112736
2. Public Health England. Alcohol Treatment in England 2012-13. (2013). Available from: http://www.nta.nhs.uk/uploads/alcohol2012-13.pdf
3. Anderson P, Baumberg B. Alcohol in Europe A Public Health Perspective. Drugs: Education, Prevention, and Policy. London (2006). Available from: http://informahealthcare.com/doi/abs/10.1080/09687630600902477
4. Rehm J, Mathers C, Popova S, Thavorncharoensap M, Teerawattananon Y, Patra J. Global burden of disease and injury and economic cost attributable to alcohol use and alcohol-use disorders. Lancet (2009) 373(9682):2223-33. doi: 10.1016/S0140-6736(09)60746-7
5. Kaner EFS, Beyer F, Dickinson HO, Pienaar ED, Campbell F, Schlesinger C, et al. Effectiveness of brief alcohol interventions in primary care populations. Cochrane Database Syst Rev (2007) 2:CD004148. doi:10.1002/14651858.CD004148.pub3
6. Purshouse RC, Brennan A, Rafia R, Latimer NR, Archer RJ, Angus CR, et al. Modelling the cost-effectiveness of alcohol screening and brief interventions in primary care in England. Alcohol Alcohol (2013) 48(2):180-8. doi:10.1093/alcalc/ags103
7. Angus C, Latimer N, Preston L, Li J, Purshouse R. What are the implications for policy makers? A systematic review of the cost-effectiveness of screening and brief interventions for alcohol misuse in primary care. Front Psychiatry (2014) 5:114. doi:10.3389/fpsyt.2014.00114
8. Brown J, West R, Angus C, Beard E, Brennan A, Drummond C, et al. Comparison of brief interventions in primary care on smoking and excessive alcohol consumption: a population survey in England. Br J Gen Pract (2016) 66(642):e1-9. doi:10.3399/bjgp16X683149
9. Kaner E. Brief alcohol intervention: time for translational research. Addiction (2010) 105(6):960-1. doi:10.1111/j.1360-0443.2009.02848.x
10. Heather N, Dallolio E, Hutchings D, Kaner E, White M. Implementing routine screening and brief alcohol intervention in primary health care: a Delphi survey of expert opinion. J Subst Use (2004) 9(2):68-85. doi:10.1080/14659890410001665014
11. Taylor CB, Luce KH. Computer-and Internet-based psychotherapy interventions. Curr Dir Psychol Sci (2003) 12(1):18-22. doi:10.1111/1467-8721.01214
12. Marlatt G. Harm reduction: come as you are. Addict Behav (1996) 21(6):779-88. doi:10.1016/0306-4603(96)00042-1
13. Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med (2007) 33(4):336-45. doi:10.1016/j.amepre.2007.05.007
14. Cugelman B, Thelwall M, Dawes P. Online interventions for social marketing health behavior change campaigns: a meta-analysis of psychological architectures and adherence factors. J Med Internet Res (2011) 13(1):e17. doi:10.2196/jmir.1367
15. Eysenbach G. The law of attrition. J Med Internet Res (2005) 7:e11. doi:10.2196/jmir.7.1.e11
16. Helander E, Kaipainen K, Korhonen I, Wansink B. Factors related to sustained use of a free mobile app for dietary self-monitoring with photography and peer feedback: retrospective cohort study. J Med Internet Res (2014) 16(4):e109. doi:10.2196/jmir.3084
17. Hoch D. App Retention Improves -Apps Used Only Once Declines to 20%. (2014). Available from: http://localytics.com; http://info.localytics.com/blog/app-retention-improves
18. Nones P. Marketing fail? Too many mobile apps are deleted within days of downloading. Nones Notes. (2014). Available from: http://nonesnotes.com/2014/01/06/marketing-fail-too-many-mobile-apps-are-deleted-within-days-of-downloading/
19. Baker TB, Gustafson DH, Shah D. How can research keep up with eHealth? Ten strategies for increasing the timeliness and usefulness of Ehealth research. J Med Internet Res (2014) 16(2):e36. doi:10.2196/jmir.2925
20. van Gemert-Pijnen JEWC, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res (2011) 13(4):e111. doi:10.2196/jmir.1672
21. O'Brien HL. The influence of hedonic and utilitarian motivations on user engagement: the case of online shopping experiences. Interact Comput (2010) 22(5):344-52. doi:10.1016/j.intcom.2010.04.001
22. Jordan PW. Human factors for pleasure in product use. Appl Ergon (1998) 29(1):25-33. doi:10.1016/S0003-6870(97)00022-7
23. Kim YH, Kim DJ, Wachter K. A study of mobile user engagement (MoEN): engagement motivations, perceived value, satisfaction, and continued engagement intention. Decis Support Syst (2013) 56:361-70. doi:10.1016/j.dss.2013.07.002
24. Hassenzahl M, Platz A, Burmester M, Lehner K. Hedonic and ergonomic quality aspects determine a software's appeal. Proc SIGCHI Conf Hum Factors Comput Syst -CHI '00. (Vol. 2), New York, NY: ACM Press (2000). p. 201-8. Available from: http://portal.acm.org/citation.cfm?doid=332040.332432
25. Bargas-avila JA, Hornbaek K. Old wine in new bottles or novel challenges? A critical analysis of empirical studies of user experience. Proc SIGCHI Conf Hum Factors Comput Syst. (2011). p. 2689-98. Available from: http://portal.acm.org/citation.cfm?doid=1978942.1979336
26. Law EL-C. The measurability and predictability of user experience. Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems -EICS '11; New York: ACM (2011). p. 1-10. doi:10.1145/1996461.1996485
27. van der Heijden H. User Acceptance of Hedonic Information Systems. MIS Q (2004). p. 695-704.
28. Ghani JA, Deshpande SP. Task characteristics and the experience of optimal flow in human-computer interaction. J Psychol (1994) 128(4):381-91. doi:10.1080/00223980.1994.9712742
29. Webster J, Ho H. Audience engagement in multimedia presentations. ACM SIGMIS Database (1997) 28(2):63-77. doi:10.1145/264701.264706
30. Hedegaard S, Simonsen JG. Extracting usability and user experience information from online user reviews. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems -CHI '13; New York: ACM (2013). p. 2089-98. doi:10.1145/2470654.2481286
31. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med (2016) 51(5):833-42. doi:10.1016/j.amepre.2016.06.015
32. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res (2015) 17(1):e30. doi:10.2196/jmir.4055
33. Goh KN, Chen YY, Lai FW, Daud SC, Sivaji A, Soo ST. A comparison of usability testing methods for an E-commerce website: a case study on a Malaysia online gift shop. 2013 10th International Conference on Information Technology: New Generations. IEEE (2013). p. 143-50. Available from: http://ieeexplore.ieee.org/articleDetails.jsp?arnumber=6614302
34. Eveland WP, Dunwoody S. Examining information processing on the World Wide Web using think aloud protocols. Media Psychol (2000) 2(3):219-44. doi:10.1207/S1532785XMEP0203_2
35. Ericsson KA, Simon HA. Verbal reports as data. Psychol Rev (1980) 87(3):215-51. doi:10.1037/0033-295X.87.3.215
36. Nielsen J. Estimating the number of subjects needed for a thinking aloud test. Int J Hum Comput Stud (1994) 41(3):385-97. doi:10.1006/ijhc.1994.1065
37. Faulkner L. Beyond the five-user assumption: benefits of increased sample sizes in usability testing. Behav Res Methods Instrum Comput (2003) 35(3):379-83. doi:10.3758/BF03195514
38. Lew P, Olsina L. Relating user experience with MobileApp quality evaluation and design. Lect Notes Comput Sci (2013) 8295:253-68. doi:10.1007/978-3-319-04244-2_23
39. Zapata BC, Fernández-Alemán JL, Idri A, Toval A. Empirical studies on usability of mHealth apps: a systematic literature review. J Med Syst (2015) 39(2):1. doi:10.1007/s10916-014-0182-2
40. Nayebi F, Desharnais J-M, Abran A. The state of the art of mobile application usability evaluation. 2012 25th IEEE Can Conf Electr Comput Eng. (2012). p. 1-4. Available from: http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htm?arnumber=6334930
41. Michie S, Whittington C, Hamoudi Z, Zarnani F, Tober G, West R. Identification of behaviour change techniques to reduce excessive alcohol consumption. Addiction (2012) 107(8):1431-40. doi:10.1111/j.1360-0443.2012.03845.x
42. Kaner EFS, Beyer FR, Brown J, Crane D, Garnett C, Hickman M, et al. Personalised digital interventions for reducing hazardous and harmful alcohol consumption in community-dwelling populations. Cochrane Database Syst Rev (2015) (1):CD011479. doi:10.1002/14651858.CD011479
43. Baharuddin R, Singh D, Razali R. Usability dimensions for mobile applications -a review. Res J Appl Sci Eng Technol (2013) 5(6):2225-31.
44. Nielsen Norman Group. Mobile Website and Application Usability, Nielsen Norman Group Report. Available from: http://www.nngroup.com/reports/mobile-website-and-application-usability/
45. Lobo D, Kaskaloglu K, Kim CY, Herbert S. Web usability guidelines for smartphones: a synergic approach. Int J Infor Elec Eng (2011) 1(1):33-7. doi:10.7763/ijiee.2011.v1.5
46. Coursaris CK, Kim DJ. A meta-analytical review of empirical mobile usability studies. J Usabilitiy Stud (2011) 6(3):117-71.
47. Milward J, Khadjesari Z, Fincham-Campbell S, Deluca P, Watson R, Drummond C. User preferences for content, features, and style for an app to reduce harmful drinking in young adults: analysis of user feedback in app stores and focus group interviews. JMIR mHealth uHealth (2016) 4(2):e47. doi:10.2196/mhealth.5242
48. Dulin PL, Gonzalez VM, Campbell K. Results of a pilot test of a self-administered smartphone-based treatment system for alcohol use disorders: usability and early outcomes. Subst Abus (2014) 35(2):168-75. doi:10.1080/08897077.2013.821437
49. Bernhardt JM, Usdan S, Mays D, Arriola KJ, Martin RJ, Cremeens J, et al. Alcohol assessment using wireless handheld computers: a pilot study. Addict Behav (2007) 32(12):3065-70. doi:10.1016/j.addbeh.2007.04.012
50. Gajecki M, Berman AH, Sinadinovic K, Rosendahl I, Andersson C. Mobile phone brief intervention applications for risky alcohol use among university students: a randomized controlled study. Addict Sci Clin Pract (2014) 9(1):11. doi:10.1186/1940-0640-9-11
51. Hasin DS, Aharonovich E, Greenstein E. HealthCall for the smartphone: technology enhancement of brief intervention in HIV alcohol dependent patients. Addict Sci Clin Pract (2014) 9:5. doi:10.1186/1940-0640-9-5
52. Stoddard J, Augustson E. Smokers who use Internet and smokers who don't: data from the Health Information and National Trends Survey (HINTS). Nicotine Tob Res (2006) 8(1):77-85. doi:10.1080/14622200601039147
53. Parker RM, Ratzan SC, Lurie N. Health literacy: a policy challenge for advancing high-quality health care. Health Aff (2003) 22(4):147-53. doi:10.1377/hlthaff.22.4.147
54. Boland VC, Stockings EA, Mattick RP, McRobbie H, Brown J, Courtney RJ. The methodological quality and effectiveness of technology-based smoking cessation interventions for disadvantaged groups: a systematic review and meta-analysis. Nicotine Tob Res (2016) ntw391. doi:10.1093/ntr/ntw391
55. Laing BY, Mangione CM, Tseng C-H, Leng M, Vaisberg E, Mahida M, et al. Effectiveness of a smartphone application for weight loss compared with usual care in overweight primary care patients: a randomized, controlled trial. Ann Intern Med (2014) 161(10 Suppl):S5-12. doi:10.7326/M13-3005
56. Kauer SD, Reid SC, Crooke AHD, Khor A, Hearps SJC, Jorm AF, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res (2012) 14(3):e67. doi:10.2196/jmir.1858
57. Grittner U, Kuntsche S, Graham K, Bloomfield K. Social inequalities and gender differences in the experience of alcohol-related problems. Alcohol Alcohol (2012) 47(5):597-605. doi:10.1093/alcalc/ags040
58. Beard E, Brown J, West R, Holmes J, Kaner E, Meier P, et al. Characterising the alcohol harm paradox: a population-based survey of adults in England. Lancet (2015) 386:S23. doi:10.1016/S0140-6736(15)00861-2
59. Brown J, Michie S, Geraghty AWA, Miller S, Yardley L, Gardner B, et al. A pilot study of StopAdvisor: a theory-based interactive internet-based smoking cessation intervention aimed across the social spectrum. Addict Behav (2012) 37(12):1365-70. doi:10.1016/j.addbeh.2012.05.016
60. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med (1998) 158(16):1789-95. doi:10.1001/archinte.158.16.1789
61. Garnett C. Development and Evaluation of a Theory-and Evidence-Based Smartphone App to Help Reduce Excessive Alcohol Consumption. University College London (2017).
62. Crane D. Development and Evaluation of a Smartphone App to Reduce Excessive Alcohol Consumption: Self-Regulatory Factors. University College London (2017).
63. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol (2006) 3(2):77-101. doi:10.1191/1478088706qp063oa
64. Yardley L, Miller S, Teasdale E, Little P. Using mixed methods to design a web-based behavioural intervention to reduce transmission of colds and flu. J Health Psychol (2011) 16(2):353-64. doi:10.1177/1359105310377538
65. Cafazzo JA, Casselman M, Hamming N, Katzman DK, Palmert MR. Design of an mHealth app for the self-management of adolescent type 1 diabetes: a pilot study. J Med Internet Res (2012) 14(3):e70. doi:10.2196/jmir.2058
66. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res (2013) 15(4):e86. doi:10.2196/jmir.2583
67. Morrison L, Moss-Morris R, Michie S, Yardley L. Optimizing engagement with Internet-based health behaviour change interventions: comparison of self-assessment with and without tailored feedback using a mixed methods approach. Br J Health Psychol (2013) 19(4):839-55. doi:10.1111/bjhp.12083
68. Davis FD. Perceived ease of use, and user acceptance of information technology. MIS Q (1989) 13(3):319-40. doi:10.2307/249008
69. Lyles CR, Harris LT, Le T, Flowers J, Tufano J, Britt D, et al. Qualitative evaluation of a mobile phone and web-based collaborative care intervention for patients with type 2 diabetes. Diabetes Technol Ther (2011) 13(5):563-9. doi:10.1089/dia.2010.0200
70. Rabin C, Bock B. Desired features of smartphone applications promoting physical activity. Telemed J E Health (2011):801-3. doi:10.1089/tmj.2011.0055
71. Kim J, Park H-A. Development of a health information technology acceptance model using consumers' health behavior intention. J Med Internet Res (2012) 14(5):e133. doi:10.2196/jmir.2143
72. O'Brien HL, Toms EG. What is user engagement? A conceptual framework for defining user engagement with technology. J Am Soc Inf Sci Tec (2008) 59(6):938-55. doi:10.1002/asi.20801
73. Thomas JG, Wing RR. Health-e-call, a smartphone-assisted behavioral obesity treatment: pilot study. JMIR Mhealth and Uhealth (2013) 1(1):e3. doi:10.2196/mhealth.2164
74. Eysenbach G, Kohler C. How do consumers search for and appraise health information on the World Wide Web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ (2002) 324(7337):573-7. doi:10.1136/bmj.324.7337.573
75. Krug S. Don't Make Me Think! A Common Sense Approach to Web Usability. India: Pearson Education (2005).
76. Krebs P, Duncan DT. Health app use among us mobile phone owners: a national survey. JMIR mHealth uHealth (2015) 3(4):e101. doi:10.2196/mhealth.4924
77. Atkinson NL, Gold RS. The promise and challenge of ehealth interventions. Am J Health Behav (2002) 26(6):494-503. doi:10.5993/AJHB.26.6.10
78. Gelso CJ, Carter JA. The relationship in counseling and psychotherapy: components, consequences, and theoretical antecedents. Couns Psychol (1985) 13(2):155-243. doi:10.1177/0011000085132001
79. Lambert MJ, Barley DE. Research summary on the therapeutic relationship and psychotherapy outcome. Psychother Theory Res Pract Train (2001) 38(4):357-61. doi:10.1037/0033-3204.38.4.357
80. Dishman RK. Determinants of participation in physical activity. In: Bouchard C, Shephard RJ, Stevens T, Sutton JR, McPherson BD, editors. Exercise, Fitness and Health: A Consensus of Current Knowledge. Champaign, IL: Human Kinetics Publishers (1990). p. 78-101.
81. Tsai AG. Systematic review: an evaluation of major commercial weight loss programs in the United States. Ann Intern Med (2005) 142(1):56. doi:10.7326/0003-4819-142-1-200501040-00012
82. Hughes JR, Keely J, Naud S. Shape of the relapse curve and long-term abstinence among untreated smokers. Addiction (2004) 99(1):29-38. doi:10.1111/j.1360-0443.2004.00540.x
83. Moos RH, Moos BS. Rates and predictors of relapse after natural and treated remission from alcohol use disorders. Addiction (2006) 101(2):212-22. doi:10.1111/j.1360-0443.2006.01310.x
84. Shiffman S, Hickcox M, Paty JA, Gnys M, Kassel JD, Richards TJ. The abstinence violation effect following smoking lapses and temptations. Cognit Ther Res (1997) 21(5):497-523. doi:10.1023/A:1021853301255
85. Muraven M, Collins RL, Morsheimer ET, Shiffman S, Paty JA. The morning after: limit violations and the self-regulation of alcohol consumption. Psychol Addict Behav (2005) 19(3):253-62. doi:10.1037/0893-164X.19.3.253
86. Wrosch C, Scheier MF, Miller GE, Schulz R, Carver CS. Adaptive self-regulation of unattainable goals: goal disengagement, goal reengagement, and subjective well-being. Pers Soc Psychol Bull (2003) 29:1494-508. doi:10.1177/0146167203256921
87. Carver CS, Scheier MF. Chapter 1: Self-regulation of action and affect. In: Vohs KD, Baumeister RF, editors. Handbook of Self-Regulation, Second Edition: Research, Theory, and Applications. New York: Guilford Press (2010). p. 3-21.
88. Skinner BF. The behavior of organisms: an experimental analysis. Psychol Rec (1938):486. Available from: http://opensiuc.lib.siu.edu/tpr/vol47/iss4/5/
89. Thorndike EL. The law of effect. Am J Psychol (1927) 39(1/4):212-22. doi:10.2307/1415413
90. Rothman AJ. Toward a theory-based analysis of behavioral maintenance. Health Psychol (2000) 19:64-9. doi:10.1037/0278-6133.19.Suppl1.64
91. Tang J, Abraham C, Stamp E, Greaves C. How can weight-loss app designers' best engage and support users? A qualitative investigation. Br J Health Psychol (2015) 20(1):151-71. doi:10.1111/bjhp.12114
92. McCurdie T, Taneva S, Casselman M, Yeung M, McDaniel C, Ho W, et al. mHealth consumer apps: the case for user-centered design. Biomed Instrum Technol (2012) 46:49-56. doi:10.2345/0899-8205-46.s2.49
93. Boswell W. Why Users Uninstall Apps. Intel Developer Zone (2013). Available from: https://software.intel.com/en-us/blogs/2013/11/14/why-users-uninstall-apps
94. VentureBeat. Five Reasons Users Uninstall Mobile Apps. (2013). Available from: http://venturebeat.com/2013/06/03/five-reasons-users-uninstall-mobile-apps/
95. Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. J Med Internet Res (2014) 16(8):e9. doi:10.2196/games.3413
96. Direito A, Dale LP, Shields E, Dobson R, Whittaker R, Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health (2014) 14(1):646. doi:10.1186/1471-2458-14-646
97. Edwards EA, Lumsden J, Rivas C, Steed L, Edwards LA, Thiyagarajan A, et al. Gamification for health promotion: systematic review of behaviour change techniques in smartphone apps. BMJ Open (2016) 6(10):e012447. doi:10.1136/bmjopen-2016-012447
98. Fogg B. Persuasive technology: using computers to change what we think and do. Ubiquity (2002). doi:10.1145/764008.763957
99. Crane D, Garnett C, Brown J, West R, Michie S. Behavior change techniques in popular alcohol reduction apps: content analysis. J Med Internet Res (2015) 17(5):e118. doi:10.2196/jmir.4060
100. O'Connell C. 23% of Users Abandon an App After One Use. (2016). Available from: http://localytics.com; http://info.localytics.com/blog/23-of-users-abandon-an-app-after-one-use
101. Germaine Satia. Mobile Onboarding: A Beginner's Guide. Smashing Magazine (2014). Available from: https://www.smashingmagazine.com/2014/08/mobile-onboarding-beginners-guide/
102. Schwartz B. The Paradox of Choice: Why More Is Less. New York: Harper Perennial (2005).
103. Ghahramani N, Lendel I, Haque R, Sawruk K. User satisfaction with computerized order entry system and its effect on workplace level of stress. J Med Syst (2009) 33(3):199-205. doi:10.1007/s10916-008-9180-6
104. Jaspers MW, Steen T, van den Bos C, Geenen M. The think aloud method: a guide to user interface design. Int J Med Inform (2004) 73(11-12):781-95. doi:10.1016/j.ijmedinf.2004.08.003
105. Orne MT. Demand characteristics and the concept of quasi-controls 1. In: Rosenthal R, Rosnow RL, editors. Artifacts in Behavioral Research (2009) p. 110-37. doi:10.1093/acprof:oso/9780195385540.003.0005