Measuring Perceived Usability: The CSUQ, SUS, and UMUX

International Journal of Human-Computer Interaction

Volumn 34, Issue 12, 2018, Pages 1148-1156

  Lewis, James R ^a  

^a IBM   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ERBIUM COMPOUNDS; GRADING; SURVEYS;

GRADING SCALE; PERCEIVED USABILITY; SECONDARY RESEARCHES; STATISTICALLY SIGNIFICANT DIFFERENCE; SYSTEM USABILITY; SYSTEM USABILITY SCALE (SUS); USER EXPERIENCE;

USABILITY ENGINEERING;

EID: 85041105800     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2017.1418805     Document Type: Article

References (42)

1. Bangor, A., Kortum, P. T., & Miller, J. T., (2008). An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction, 24, 574–594.
2. Bangor, A., Kortum, P. T., & Miller, J. T., (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123.
3. Berkman, M. I., & Karahoca, D., (2016). Re-assessing the usability metric for user experience (UMUX) scale. Journal of Usability Studies, 11(3), 89–109.
4. Borsci, S., Federici, S., Gnaldi, M., Bacci, S., & Bartolucci, F., (2015). Assessing user satisfaction in the era of user experience: An exploratory analysis of SUS, UMUX and UMUX-LITE. International Journal of Human-Computer Interaction., 31, 484–495.
5. Borsci, S., Federici, S., & Lauriola, M., (2009). On the dimensionality of the system usability scale: A test of alternative measurement models. Cognitive Processes, 10, 193–197.
6. Brooke, J., (1996). SUS: A “quick and dirty” usability scale. In P., Jordan, B., Thomas, & B., Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
7. Brooke, J., (2013). SUS: A retrospective. Journal of Usability Studies, 8(2), 29–40.
8. Chen, J. C., (1991). Response-order effects in Likert-type scales. Educational and Psychological Measurement, 51, 531–540.
9. Chin, J. P., Diehl, V. A., & Norman, K. L., (1988). Development of an instrument measuring user satisfaction of the human–Computer interface. In E. Soloway, D. Frye, & S. B. Sheppard (Eds.), Proceedings of CHI 1988 (pp. 213–218). Washington, DC: Association for Computing Machinery.
10. Cliff, N., (1987). Analyzing multivariate data. San Diego, CA: Harcourt, Brace, Jovanovich.
11. Davis, D., (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13, 319–339.
12. Diefenbach, S., Kolb, N., & Hassenzahl, M., (2014). The “Hedonic” in human-computer interaction: History, contributions, and future research directions. In Proceedings of the 2014 Conference on Designing Interactive Systems - DIS 14 (pp. 305–314), New York, NY: Association for Computing Machinery.
13. Erdinç, O., & Lewis, J. R., (2013). Psychometric evaluation of the T-CSUQ: The Turkish version of the computer system usability questionnaire. International Journal of Human-Computer Interaction, 29(5), 319–326.
14. Finstad, K., (2006). The system usability scale and non-native English speakers. Journal of Usability Studies, 1(4), 185–188.
15. Finstad, K., (2010). The usability metric for user experience. Interacting with Computers, 22, 323–327.
16. Finstad, K., (2013). Response to commentaries on “The usability metric for user experience”. Interacting with Computers, 25, 327–330.
17. Grier, R. A., Bangor, A., Kortum, P. T., & Peres, S. C., (2013). The system usability scale: Beyond standard usability testing. In Proceedings of the Human Factors and Ergonomics Society (pp. 187–191), Santa Monica, CA: Human Factors and Ergonomics Society.
18. ISO. (1998). Ergonomic requirements for office work with visual display terminals (VDTs), Part 11, Guidance on usability (ISO 9241-11:1998E). Geneva, Switzerland: Author.
19. Kirakowski, J., & Dillon, A., (1988). The computer user satisfaction inventory (CUSI): Manual and scoring key. Cork, Ireland: Human Factors Research Group, University College of Cork.
20. Kortum, P., & Sorber, M., (2015). Measuring the usability of mobile applications for phones and tablets. International Journal of Human-Computer Interaction, 31(8), 518–529.
21. Lewis, J. R., (1990). Psychometric evaluation of a post-study system usability questionnaire: The PSSUQ (Tech. Report 54.535). Boca Raton, FL: International Business Machines Corp.
22. Lewis, J. R., (1992). Psychometric evaluation of the post-study system usability questionnaire: The PSSUQ. In Proceedings of the Human Factors Society 36th Annual Meeting (pp. 1259–1263, Santa Monica, CA: Human Factors Society.
23. Lewis, J. R., (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57–78.
24. Lewis, J. R., (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human-Computer Interaction, 14, 463–488.
25. Lewis, J. R., (2012). Usability testing. In G., Salvendy (Ed.), Handbook of human factors and ergonomics (4th ed., pp. 1267–1312). New York, NY: John Wiley.
26. Lewis, J. R., (2014). Usability: Lessons learned… and yet to be learned. International Journal of Human-Computer Interaction, 30, 663–684.
27. Lewis, J. R., Brown, J., & Mayes, D. K., (2015). Psychometric evaluation of the EMO and the SUS in the context of a large-sample unmoderated usability study. International Journal of Human-Computer Interaction, 31(8), 545–553.
28. Lewis, J. R., & Sauro, J., (2009). The factor structure of the system usability scale. In M., Kurosu (Ed.), Human centered design (pp. 94–103). Heidelberg, Germany: Springer-Verlag.
29. Lewis, J. R., & Sauro, J., (2017). Revisiting the factor structure of the system usability scale. Journal of Usability Studies, 12(4), 183–192.
30. Lewis, J. R., Utesch, B. S., & Maher, D. E., (2013). UMUX-LITE—When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery.
31. Lewis, J. R., Utesch, B. S., & Maher, D. E., (2015). Measuring perceived usability: The SUS, UMUX-LITE, and AltUsability. International Journal of Human-Computer Interaction, 31(8), 496–505.
32. Nunnally, J. C., (1978). Psychometric theory. New York, NY: McGraw-Hill.
33. O’Connor, B. P., (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instrumentation, and Computers, 32, 396–402.
34. Sauro, J., & Lewis, J. R., (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of CHI 2009 (pp. 1609–1618). Boston, MA: Association for Computing Machinery.
35. Sauro, J., & Lewis, J. R., (2011). When designing usability questionnaires, does it hurt to be positive?. In Proceedings of CHI 2011 (pp. 2215–2223). Vancouver, Canada: ACM.
36. Sauro, J., & Lewis, J. R., (2016). Quantifying the user experience: Practical statistics for user research (2nd ed.). Cambridge, MA: Morgan Kaufmann.
37. Schmitt, N., (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8(4), 350–353.
38. Tractinsky, N., (2017). The usability construct: A dead end? Human-Computer Interaction. doi:10.1080/07370024.2017.1298038
39. Tullis, T. S., & Albert, B., (2008). Measuring the user experience: Collecting, analyzing, and presenting usability metrics. Burlington, MA: Morgan Kaufmann.
40. Tullis, T. S., & Stetson, J. N., (2004). A comparison of questionnaires for assessing website usability. Paper presented at the Usability Professionals Association Annual Conference, UPA, Minneapolis, MN. Retrieved September 13, 2017 from, https://www.researchgate.net/publication/228609327_A_Comparison_of_Questionnaires_for_Assessing_Website_Usability
41. Weng, L., & Cheng, C., (2000). Effects of response order on Likert-type scales. Educational and Psychological Measurement, 60(6), 908–924.
42. Whiteside, J., Bennett, J., & Holtzblatt, K., (1988). Usability engineering: Our experience and evolution. In M., Helander (Ed.), Handbook of human-computer interaction (pp. 791–817). Amsterdam: North-Holland.