Critical review of 'the usability metric for user experience'

Interacting with Computers

Volumn 25, Issue 4, 2013, Pages 320-324

  Lewis, James R ^a  

^a IBM   (United States)

Author keywords

perceived usability; psychometric evaluation; satisfaction; standardized questionnaire; System Usability Scale; Usability Metric for User Experience

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; SURVEYS; USABILITY ENGINEERING;

PERCEIVED USABILITY; PSYCHOMETRIC EVALUATION; SATISFACTION; STANDARDIZED QUESTIONNAIRE; SYSTEM USABILITY;

USER EXPERIENCE;

EID: 84879219926     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1093/iwc/iwt013     Document Type: Review

References (29)

1. Bangor, A., Kortum, P.T. and Miller, J.T. (2008) An empirical evaluation of the System Usability Scale. Int. J. Hum. Comput. Interact., 24, 574-594.
2. Bangor, A., Kortum, P.T. and Miller, J.T. (2009) Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Studies, 4, 114-123.
3. Barnette, J.J. (2000) Effects of stem and Likert response option reversals on survey internal consistency: if you feel the need, there is a better alternative to using those negatively worded stems. Educ. Psychol. Meas., 60, 361-370.
4. Borsci, S., Federici, S. and Lauriola, M. (2009) On the dimensionality of the System Usability Scale: a test of alternative measurement models. Cogn. Process., 10, 193-197.
5. Cliff, N. (1987) Analyzing Multivariate Data. Harcourt Brace Jovanovich, San Diego.
6. Coovert, M.D. and McNelis, K. (1988) Determining the number of common factors in factor analysis: a review and program. Educ. Psychol. Meas., 48, 687-693.
7. Davis, D. (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q., 13, 319-339.
8. DeVellis, R.F. (2003) Scale Development: Theory and Applications. Sage Publications, Thousand Oaks, CA.
9. Finstad, K. (2006) The System Usability Scale and non-native English speakers. J. Usability Stud., 1, 185-188.
10. Finstad, K. (2010a) Response interpolation and scale sensitivity: evidence against 5-point scales. J. Usability Stud., 5, 104-110.
11. Finstad, K. (2010b) The Usability Metric for User Experience. Interact. Comput., 22, 323-327.
12. ISO 9241-11. (1998) Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs). Part 11: Guidance on Usability.
13. Landauer, T.K. (1997) Behavioral Research Methods in Human-Computer Interaction. In Helander, M., Landauer, K.T. and Prabhu, P. (eds), Handbook of Human-Computer Interaction (2nd edn), pp. 203-227. Elsevier, Amsterdam, Netherlands.
14. Lewis, J.R. (2002) Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int. J. Hum. Comput. Interact., 14, 463-488.
15. Lewis, J.R. and Sauro, J. (2009) The Factor Structure of the System Usability Scale. InKurosu, M. (ed.), Human Centered Design, HCII 2009, pp. 94-103. Springer, Heidelberg, Germany.
16. Nunnally, J.C. (1978) Psychometric Theory. McGraw-Hill, NewYork.
17. Pilotte, W.J. and Gable, R.K. (1990) The impact of positive and negative item stems on the validity of a computer anxiety scale. Educ. Psychol. Meas., 50, 603-610.
18. Sauro, J. (2011)APractical Guide to the System Usability Scale (SUS): Background, Benchmarks & Best Practices. Measuring Usability LLC, Denver, CO.
19. Sauro, J. and Dumas, J.S. (2009) Comparison of Three One-question, Post-task Usability Questionnaires. In Proceedings of CHI 2009, Boston, MA, pp. 1599-1608. ACM, Boston.
20. Sauro, J. and Lewis, J.R. (2009) Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of CHI 2009, Boston, MA, pp. 1609-1618. ACM, Boston.
21. Sauro, J. and Lewis, J.R. (2011) When designing usability questionnaires, does it hurt to be positive? In Proceedings of CHI 2011, Vancouver, BC, Canada, pp. 2215-2223. ACM, Vancouver, Canada.
22. Sauro, J. and Lewis, J.R. (2012) Quantifying the User Experience: Practical Statistics for User Research. Morgan-Kauffman, Waltham, MA.
23. Schmitt, N. (1996) Uses and abuses of coefficient alpha. Psychol. Assessment, 8, 350-353.
24. Schmitt, N. and Stuits, D. (1985) Factors defined by negatively keyed items: the result of careless respondents? Appl. Psych. Meas., 9, 367-373.
25. Schriesheim, C.A. and Hill, K.D. (1981) Controlling acquiescence response bias by item reversals: the effect on questionnaire validity. Educ. Psychol. Meas., 41, 1101-1114.
26. Stewart, T.J. and Frye, A.W. (2004) Investigating the use of negatively-phrased survey items in medical education settings: Common wisdom or common mistake? Acad. Med., 79(10 Suppl.), S1-S3.
27. Tabachnik, B.G. and Fidell, L.S. (1989) Using Multivariate Statistics (2nd edn). Harper Collins, NewYork.
28. Tedesco, D.P. and Tullis, T.S. (2006) A comparison of methods for eliciting post-task subjective ratings in usability testing. Paper presented at the Usability Professionals Association Annual Conference. UPA, Broomfield, CO.
29. Yu, C.H. (2001) An introduction to computing and interpreting Cronbach coefficient alpha in SAS. In Proceedings of SUGI 26, Paper 246-26.Long Beach, CA. SAS Institute, Cary, NC.