Measuring the Usability of Mobile Applications for Phones and Tablets

International Journal of Human-Computer Interaction

Volumn 31, Issue 8, 2015, Pages 518-529

  Kortum, Philip ^a   Sorber, Mary ^b  

^a RICE UNIVERSITY   (United States)

^b CISCO SYSTEMS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DRILLING PLATFORMS; TELEPHONE SETS;

DESIGN DECISIONS; GENERAL CLASS; MOBILE PLATFORM; PHONE PLATFORMS; SYSTEM USABILITY SCALE (SUS); USABILITY OF MOBILE APPLICATIONS;

USABILITY ENGINEERING;

EID: 84938379307     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2015.1064658     Document Type: Article

References (55)

1. C.Z.Acemyan,, P.Kortum,, & J.Shafer, (2012). Does the voting environment affect perceived system usability and trust? The relationship between DRE placement within a polling station and voters perceptions of usability, trust, and preference. Paper presented at the 9th Houston Human Factors and Ergonomics Conference, Houston, TX.
2. A.Bangor,, P.Kortum,, & J.A.Miller, (2008). The System Usability Scale (SUS): An empirical evaluation. International Journal of Human-Computer Interaction, 24, 574–594. doi:10.1080/10447310802205776
3. A.Bangor,, P.Kortum,, & J.A.Miller, (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4, 114–123.
4. D.Ben-Zeev,, S.M.Kaiser,, C.J.Brenner,, M.Begale,, J.Duffecy,, & D.C.Mohr, (2013). Development and usability testing of FOCUS: A smartphone system for self-management of schizophrenia. Psychiatric Rehabilitation Journal, 36, 289–296. doi:10.1037/prj0000019
5. S.Borsci,, S.Federici,, & M.Lauriola, (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processing, 10, 193–197.
6. J.Brooke, (1996). SUS: A ‘quick and dirty’ usability scale. In P.W.Jordan, B.Thomas, B.A.Weerdmeester, & I.L.McClelland (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor and Francis.
7. M.D.Byrne,, K.K.Greene,, & S.P.Everett, (2007). Usability of voting systems: Baseline data for paper, punch cards, and lever machines. In Proceedings of the SIGCHI conference on human Factors in Computing Systems (pp. 171–180). New York, NY: ACM. doi:10.1145/1240624.1240653
8. B.A.Campbell,, C.C.Tossell,, M.D.Byrne,, & P.Kortum, (2014). Toward more usable electronic voting: Testing the usability of a smartphone voting system. Human Factors, 56, 973–985. doi:10.1177/0018720813519266
9. J.P.Chin,, V.A.Diehl,, & K.L.Norman, (1988). Development of an instrument measuring user satisfaction of the human–computer interface. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (pp. 213–218). New York, NY: ACM. doi:10.1145/57167.57203
10. A.Çöltekin,, B.Heil,, S.Garlandini,, & S.I.Fabrikant, (2009). Evaluating the effectiveness of interactive map interface designs: A case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36, 5–17. doi:10.1559/152304009787340197
11. C.K.Coursaris,, & D.J.Kim, (2011). A meta-analytical review of empirical mobile usability studies. Journal of Usability Studies, 6, 117–171.
12. F.D.Davis, (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 319–340.
13. M.R.Davis,, & T.O.Ellis, (1964). The RAND tablet: A man-machine graphical communication device. In Proceedings of the October 27-29, 1964, fall joint computer conference, part I (pp. 325–331). New York, NY: ACM.
14. eMarketer. (2015). 2 billion consumers worldwide to get smart(phones) by 2016. Retrieved from http://www.emarketer.com/Article/2-Billion-Consumers-Worldwide-Smartphones-by-2016/1011694
15. R.E.Evans,, & P.Kortum, (2010). The impact of voice characteristics on user response in an interactive voice response system. Interacting with Computers, 22, 606–614. doi:10.1016/j.intcom.2010.07.001
16. K.Finstad, (2006). The System Usability Scale and non-native English speakers. Journal of Usability Studies, 1, 185–188.
17. Flurry Analytics. (2013). The history of app pricing, and why most apps are free. Retrieved from http://www.flurry.com/bid/99013/The-History-of-App-Pricing-And-Why-Most-Apps-Are-Free#.U8WlaPldV8E
18. R.Harrison,, D.Flood,, & D.Duce, (2013). Usability of mobile applications: Literature review and rationale for a new usability model. Journal of Interaction Science, 1, 1–16. doi:10.1186/2194-0827-1-1
19. ISO. (1998). Ergonomic requirements for office work with visual display terminal (VDT’s) – Part 11: guidance on usability (ISO 9241-11(E)). Geneva, Switzerland: International Organization for Standardization.
20. T.Kallio,, & A.Kaikkonen, (2005). Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies, 1, 4–16.
21. E.Kangas,, & T.Kinnunen, (2005). Applying user-centered design to mobile application development. Communications of the ACM, 48(7), 55–59. doi:10.1145/1070838.1070866
22. L.Kascak,, C.B.Rébola,, R.Braunstein,, & J.Sanford, (2013). Mobile application concept development for remote patient monitoring. In IEEE International Conference on Healthcare Informatics (pp. 545–550). New York, NY: IEEE. doi:10.1109/ICHI.2013.85
23. J.Kirakowski,, & B.Cierlik, (1998). Measuring the usability of websites. In Proceedings of the Human Factors and Ergonomics Society (pp. 424–428). Santa Monica, CA: HFES. doi:10.1177/154193129804200405
24. J.Kirakowski,, & M.Corbett, (1993). SUMI: The Software Usability Measurement Inventory. British Journal of Educational Technology, 24, 210–212. doi:10.1111/j.1467-8535.1993.tb00076.x
25. M.Kluge,, & H.Asche, (2012). Validating a smartphone-based pedestrian navigation system prototype. In Proceedings of the 12th international conference on computational science and its applications ICCSA’12 (pp. 386–396). Salvador de Bahia, Brazil: Springer. doi:10.1007/978-3-642-31075-1_29
26. P.Kortum,, & A.Bangor, (2013). Usability ratings for everyday products measured with the System Usability Scale (SUS). International Journal of Human Computer Interaction, 29, 67–76. doi:10.1080/10447318.2012.681221
27. P.Kortum,, & M.Johnson, (2013). The relationship between levels of user experience with a product and perceived system usability. In Proceedings of the Human Factors and Ergonomics Society (pp. 197–201). Santa Monica, CA: HFES. doi:10.1177/1541931213571044
28. J.R.Lewis, (1991). An after-scenario questionnaire for usability studies: Psychometric evaluation over three trials. ACM SIGCHI Bulletin, 23(4), 79. doi:10.1145/126729.1056077
29. J.R.Lewis, (1992). Psychometric evaluation of the Post-Study System Usability Questionnaire: The PSSUQ. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (pp. 1259–1260). Santa Monica, CA: HFES. doi:10.1177/154193129203601617
30. J.R.Lewis, (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human‐Computer Interaction, 7, 57–78. doi:10.1080/10447319509526110
31. J.R.Lewis,, & J.Sauro, (2009). The factor structure of the System Usability Scale. In Human-centered design (pp. 94–103). Berlin, Germany: Springer. doi:10.1007/978-3-642-02806-9_12
32. J.R.Lewis,, B.S.Utesch,, & D.E.Maher, (2013). UMUX-LITE: When there’s no time for the SUS. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2099–2102). New York, NY: ACM. doi:10.1145/2470654.2481287
33. A.Lund, (2001). Measuring usability with the USE questionnaire. Usability Interface: The Usability SIG Newsletter of the Society for Technical Communications, 8(2).
34. K.D.Lutes,, K.Chang,, & I.M.Baggili, (2006). Diabetic e-management system (DEMS). In Proceedings of the Third International Conference on Information Technology: New Generations (pp. 619–624). Las Vegas, NV: IEEE. doi:10.1109/ITNG.2006.53
35. A.Marcus, (2005). User interface design’s return on investment: Examples and statistics. In R.G.Bias & D.J.Mayhew (Eds.), Cost justifying usability: An update for the Internet age (pp. 17–36). Amsterdam, the Netherlands: Elsevier.
36. S.McLellan,, A.Muddimer,, & S.C.Peres, (2012). The effect of experience on System Usability Scale ratings. Journal of Usability Studies, 7, 56–67.
37. H.Müller,, J.Gove,, & J.Webb, (2012). Understanding tablet use: A multi-method exploration. In Proceedings of the 14th international conference on human–computer interaction with mobile devices and services (pp. 1–10). New York, NY: ACM. doi:10.1145/2371574.2371576
38. A.W.Ng,, H.W.Lo,, & A.H.Chan, (2011). Measuring the usability of safety signs: A use of system usability scale (SUS). In Proceedings of the International MultiConference of Engineers and Computer Scientists (Vol. 2, pp. 1296–1301). Hong Kong: IAENG.
39. Nielsen, J. (1999). Graceful degradation of scalable Internet services, WAP: Wrong approach to portability. Retrieved from http://www.useit.com/alertbox/991031.html
40. Nielsen Newswire. (2014). Smartphones: So many apps, so much time. Retrieved from http://www.nielsen.com/us/en/insights/news/2014/smartphones-so-many-apps–so-much-time.html
41. Pew Research. (2014). Mobile technology fact sheet. Retrieved from http://www.pewinternet.org/fact-sheets/mobile-technology-fact-sheet/
42. C.Phillips,, & B.Chaparro, (2009). Visual appeal vs. usability: Which one influences user perceptions of a website more? Usability News, 11(2), 1–9.
43. A.Rahmati,, C.Tossell,, C.Shepard,, P.Kortum,, & L.Zhong, (2012). Exploring iPhone usage: The influence of socioeconomic differences on smartphone adoption, usage and usability. In Proceedings of the 14th international conference on Human-Computer Interaction with Mobile Devices and Services (pp. 11–20). New York, NY: ACM. doi:10.1145/2371574.2371577
44. G.Robertson,, M.Czerwinski,, P.Baudisch,, B.Meyers,, D.Robbins,, G.Smith,, & D.Tan, (2005). The large-display user experience. IEEE Computer Graphics and Applications, 25(4), 44–51. doi:10.1109/MCG.2005.88
45. Y.S.Ryu,, & T.L.Smith-Jackson, (2006). Reliability and validity of the Mobile Phone Usability Questionnaire (MPUQ). Journal of Usability Studies, 2, 39–53.
46. J.Sauro,, & J.R.Lewis, (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1609–1618). New York, NY: ACM.
47. J.Sauro,, & J.R.Lewis, (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2215–2224). New York, NY: ACM.
48. N.Schmitt,, & D.M.Stults, (1985). Factors defined by negatively keyed items: The result of careless respondents? Applied Psychological Measurement, 9, 367–373.
49. C.A.Schriesheim, (1981). The effect of grouping or randomizing items on leniency response bias. Educational and Psychological Measurement, 41, 401–411.
50. P.E.Spector,, P.T.Van Katwyk,, M.T.Brannick,, & P.Y.Chen, (1997). When two factors don’t reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659–677.
51. Statista. (2014). Number of apps available in leading app stores as of July 2014. Retrieved from http://www.statista.com/statistics/276623/number-of-apps-available-in-leading-app-stores/
52. V.Venkatesh,, & F.D.Davis, (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46, 186–204.
53. V.Venkatesh,, M.G.Morris,, G.B.Davis,, & F.D.Davis, (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27, 425–478.
54. J.Wenburg,, & W.Wilmont, (1973). The personal communication process. New York, NY: Wiley and Sons.
55. D.Zhang,, & B.Adipat, (2005). Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction, 18, 293–308. doi:10.1207/s15327590ijhc1803_3