The Relationship Between System Effectiveness and Subjective Usability Scores Using the System Usability Scale

International Journal of Human-Computer Interaction

Volumn 30, Issue 7, 2014, Pages 575-584

  Kortum, Philip ^a   Peres, S Camille ^b  

^a RICE UNIVERSITY   (United States)

^b TEXAS A AND M HEALTH SCIENCE CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN COMPUTER INTERACTION; USER INTERFACES;

LABORATORY AND FIELD STUDIES; LABORATORY STUDIES; POSITIVE CORRELATIONS; PRODUCTS AND SERVICES; SYSTEM EFFECTIVENESS; SYSTEM USABILITY SCALE (SUS); USABILITY ASSESSMENT; USABILITY MEASURES;

USABILITY ENGINEERING;

EID: 84901282676     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2014.904177     Document Type: Article

References (34)

1. Andre, A., & Wickens, C. (1995). When users want what's not best for them. Ergonomics in Design: The Quarterly of Human Factors Applications, 3(4), 10-14.
2. Bangor, A., Kortum, P., & Miller, J. T. (2008). An empirical evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 6, 574-594.
3. Borsci, S., Federici, S., & Lauriola, M. (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processing, 10, 193-197.
4. Brooke, J. (1996). SUS: A quick and dirty usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, & I. L. McClelland (Eds.), Usability evaluation in industry (pp. 189-194). London, UK: Taylor & Francis.
5. Card, S. K., Moran, T. P., & Newell, A. (1980). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23, 396-410.
6. Choy, J. Y., Lam, S. Y., & Lee, T. C. (2012). Service quality, customer satisfaction and behavioral intentions: review of the literature and conceptual model development. International Journal of Academic Research, 4(3), 5-17.
7. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
8. Everett, S. P., Byrne, M. D., & Greene, K. K. (2006). Measuring the usability of paper ballots: Efficiency, effectiveness, and satisfaction. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 2547-2551.
9. Frøkjær, E., Hertzum, M., & Hornbæk, K. (2000). Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? Proceedings of the SIGCHI conference on Human factors in computing systems, 345-352.
10. Giese, J. L., & Cote, J. A. (2000). Defining consumer satisfaction. Academy of Marketing Science Review, 1, 1-22.
11. Goodwin, N. C. (1987) Functionality and Usability. Communications of the ACM, 30, 229-233.
12. Horan, T. A., Abhichandani, T., & Rayalu, R. (2006). Assessing user satisfaction of e-government services: Development and testing of quality-in-use satisfaction with advanced traveler information systems (ATIS). System Sciences, 2006. HICSS'06. Proceedings of the 39th Annual Hawaii International Conference, 4, 83b.
13. Hornbæk, J., & Law, E. L (2007). Meta-Analysis of correlations among usability measures. Proceedings of the ACM Conference on Human Factors in Computing Systems CHI 2007, 617-626.
14. ISO. (1998). Ergonomic requirements for office work with visual display terminal (VDT's)-Part 11: Guidance on usability (ISO 9241-11(E)). Geneva, Switzerland.
15. Jones, A. A. (2012). The Impact of website navigational usability characteristics on user frustration and performance metrics. (Unpublished doctoral dissertation). Athens, Ohio: Ohio University.
16. Kieras, D., & John, B. (1994). The GOMS family of analysis techniques: Tools for design and evaluation (CMU-HCII-94-106). Pittsburgh, PA: Carnegie-Mellon University.
17. Kirakowski, J., & Corbett, M. (1993). SUMI: The Software Measurement Inventory. British Journal of Educational Technology, 24, 210-212.
18. Kirakowski, J., Claridge, N., & Whitehand, R. (1998). Human centered measures of success in web design. Proceedings of the 4th Conference on Human Factors and the Web. Retrieved from http://www.research.att.com/conf/hfweb/proceedings/kirakowski/index.html
19. Kortum, P. & Acemyan, C.Z. (2013). How low can you go? Is the System Usability Scale range restricted? Journal of Usability Studies, 9, 14-24.
20. Kortum, P., & Bangor, A. (2013). Usability ratings for everyday products measured with the System Usability Scale (SUS). International Journal of Human-Computer Interaction, 29, 1-10.
21. Kortum, P., & Johnson, M. (2013). The relationship between levels of user experience with a product and perceived system usability. Proceedings of the Human Factors and Ergonomics Society. Santa Monica, CA: Human Factors and Ergonomics Society.
22. Lewis, J. (1995). IBM Computer Satisfaction Questionnaires: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7, 57-78.
23. Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. Proceedings of the 1st International Conference on Human Centered Design: Held as Part of HCI International 2009 (94-103). San Diego, CA: HCI International.
24. Lund, A. (2001). Measuring usability with the USE Questionnaire. Usability Interface: The usability SIG newsletter of the Society for Technical Communications, 8. Retrieved from http://www.stcsig.org/usability/newsletter/0110_measuring_with_use.html
25. Nakamichi, N., Shima, K., Sakai, M., & Matsumoto, K. I. (2006). Detecting low usability web pages using quantitative data of users' behavior. In Proceedings of the 28th International Conference on Software Engineering, 569-576.
26. Nielsen, J. (2001). Success rate: The simplest usability metric. Usability Alertbox. http://www.nngroup.com/articles/success-rate-the-simplest-usability-metric/
27. Nielsen, J., & Levy, J. (1994). Measuring usability: Preference vs. performance. Communications of the ACM, 37(4), 66-75.
28. Peterson, R. A., & Wilson, W. R. (1992). Measuring customer satisfaction: Fact and artifact. Journal of the Academy of Marketing Science, 20, 61-71.
29. Sauro, J. (2011). A practical guide to the System Usability Scale. Denver, CO: CreateSpace.
30. Sauro, J., & Lewis, J. R. (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1609-1618.
31. Sonderegger, A., & Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics 41, 403-410.
32. Vatrapu, R., & Pérez-Quiñones, M. A. (2006). Culture and usability evaluation: The effects of culture in structured interviews. Journal of Usability Studies, 1, 156-170.
33. Venkatesh, V., & Morris, M. G. (2000). Why don't men ever stop to ask for directions? Gender, social influence, and their role in technology acceptance and usage behavior. MIS Quarterly, 24, 115-139.
34. Yeo, A. (1998). Cultural effects in usability assessment. CHI 98 Conference Summary on Human Factors in Computing Systems, 74-75.