Psychometric Evaluation of the EMO and the SUS in the Context of a Large-Sample Unmoderated Usability Study

International Journal of Human-Computer Interaction

Volumn 31, Issue 8, 2015, Pages 545-553

  Lewis, James R ^a   Brown, Joshua ^b   Mayes, Daniel K ^b  

^a IBM   (United States)

^b State Farm Mutual Automobile Insurance Company   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

REGRESSION ANALYSIS; RELIABILITY; USABILITY ENGINEERING;

FACTOR STRUCTURE; HIGH RELIABILITY; MULTI-FACTOR; ONLINE SURVEYS; PERCEIVED USABILITY; PSYCHOMETRIC PROPERTIES; SYSTEM USABILITY SCALE (SUS); USABILITY STUDIES;

SURVEYS;

EID: 84938345445     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2015.1064665     Document Type: Article

References (20)

1. B.Albert,, T.Tullis,, & D.Tedesco, (2010). Beyond the usability lab: Conducting large-scale online user experience studies. Burlington, MA: Morgan Kaufmann.
2. M.S.Andreasen,, H.V.Nielsen,, S.O.Schrøder,, & J.Stage, (2007). What happened to remote usability testing? An empirical study of three methods. In Proceedings of CHI 2007 (pp. 1405–1414). San Jose, CA: Association for Computing Machinery.
3. A.Bangor,, P.T.Kortum,, & J.T.Miller, (2008). An empirical evaluation of the System Usability Scale. International Journal of Human–Computer Interaction, 24, 574–594.
4. S.Borsci,, S.Federici,, M.Gnaldi,, S.Bacci,, & F.Bartolucci, (this issue). Assessing user satisfaction in the era of user experience: An exploratory analysis of SUS, UMUX and UMUX-LITE. International Journal of Human–Computer Interaction, XX, xx–xx.
5. S.Borsci,, S.Federici,, & M.Lauriola, (2009). On the dimensionality of the System Usability Scale: A test of alternative measurement models. Cognitive Processes, 10, 193–197.
6. J.Brooke, (1996). SUS: A “quick and dirty” usability scale. In P.Jordan, B.Thomas, & B.Weerdmeester (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
7. P.Kortum,, & S.C.Peres, (2014). The relationship between system effectiveness and subjective usability scores using the System Usability Scale. International Journal of Human–Computer Interaction, 30, 575–584.
8. J.R.Lewis, (2012). Usability testing. In G.Salvendy (Ed.), Handbook of human factors and ergonomics (pp. 1267–1312). New York, NY: Wiley.
9. J.R.Lewis, (2014). Usability: Lessons learned … and yet to be learned. International Journal of Human–Computer Interaction, 30, 663–684.
10. J.R.Lewis,, & D.K.Mayes, (2014). Development and psychometric evaluation of the Emotional Metric Outcomes (EMO) questionnaire. International Journal of Human–Computer Interaction, 30, 685–702.
11. J.R.Lewis,, & J.Sauro, (2009). The factor structure of the System Usability Scale. In M.Kurosu (Ed.), Human centered design (pp. 94–103). Heidelberg, Germany: Springer-Verlag.
12. J.R.Lewis,, B.S.Utesch,, & D.E.Maher, (2013). UMUX-LITE—When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: Association for Computing Machinery.
13. E.McFadden,, D.R.Hager,, C.J.Elie,, & J.M.Blackwell, (2002). Remote usability evaluation: Overview and case studies. International Journal of Human–Computer Interaction, 14, 489–502.
14. J.C.Nunnally, (1978). Psychometric theory. New York, NY: McGraw-Hill.
15. J.Sauro,, & J.R.Lewis, (2009). Correlations among prototypical usability metrics: Evidence for the construct of usability. In Proceedings of CHI 2009 (pp. 1609–1618). Boston, MA: Association for Computing Machinery.
16. J.Sauro,, & J.R.Lewis, (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of CHI 2011 (pp. 2215–2223). Vancouver, Canada: Association for Computing Machinery.
17. J.Sauro,, & J.R.Lewis, (2012). Quantifying the user experience: Practical statistics for user research. Waltham, MA: Morgan Kaufmann.
18. T.Tullis,, S.Fleischman,, M.McNulty,, C.Cianchette,, & M.Bergel, (2002). An empirical comparison of lab and remote usability testing of web sites. In Proceedings of the Usability Professionals Association (pp. 1–8). Chicago, IL: Usability Professionals Association.
19. R.West,, & K.R.Lehman, (2006). Automated summative usability studies: An empirical evaluation. In Proceedings of CHI 2006 (pp. 631–639). Montreal, Canada: Association for Computing Machinery.
20. M.Zviran,, C.Glezer,, & I.Avni, (2006). User satisfaction from commercial web sites: The effect of design and use. Information Management, 43, 157–178.