Assessing User Satisfaction in the Era of User Experience: Comparison of the SUS, UMUX, and UMUX-LITE as a Function of Product Experience

International Journal of Human-Computer Interaction

Volumn 31, Issue 8, 2015, Pages 484-495

  Borsci, Simone ^a   Federici, Stefano ^b   Bacci, Silvia ^b   Gnaldi, Michela ^b   Bartolucci, Francesco ^b  

^a Imperial College of London ^*  (United Kingdom)

^b UNIVERSITY OF PERUGIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BUDGET CONTROL; HUMAN COMPUTER INTERACTION; SURVEYS;

AMOUNT OF INTERACTION; BUDGET CONSTRAINT; COMPUTER INTERACTION; MEASUREMENTS OF; PRODUCT EXPERIENCE; USER SATISFACTION;

USER EXPERIENCE;

EID: 84938335644     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2015.1064648     Document Type: Article

References (39)

1. S.Bacci,, F.Bartolucci,, & M.Gnaldi, (2014). A class of multidimensional latent class IRT models for ordinal polytomous item responses. Communications in Statistics – Theory and Methods, 43, 787–800. doi:10.1080/03610926.2013.827718
2. A.Bangor,, P.T.Kortum,, & J.T.Miller, (2008). An empirical evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 24, 574–594. doi:10.1080/10447310802205776
3. F.Bartolucci, (2007). A class of multidimensional IRT models for testing unidimensionality and clustering items. Psychometrika, 72, 141–157. doi:10.1007/s11336-005-1376-9
4. F.Bartolucci,, S.Bacci,, & M.Gnaldi, (2014). MultiLCIRT: An R package for multidimensional latent class item response models. Computational Statistics & Data Analysis, 71, 971–985. doi:10.1016/j.csda.2013.05.018
5. S.Borsci,, S.Federici,, & M.Lauriola, (2009). On the dimensionality of the System Usability Scale (SUS): A test of alternative measurement models. Cognitive Processing, 10, 193–197. doi:10.1007/s10339-009-0268-9
6. S.Borsci,, J.Kuljis,, J.Barnett,, & L.Pecchia, (2014). Beyond the user preferences: Aligning the prototype design to the users’ expectations. Human Factors and Ergonomics in Manufacturing & Service Industries. doi:10.1002/hfm.20611
7. S.Borsci,, M.Kurosu,, S.Federici,, & M.L.Mele, (2013). Computer systems experiences of users with and without disabilities: An evaluation guide for professionals. Boca Raton, FL: CRC Press. doi:10.1201/b15619-1
8. J.Brooke, (1996). SUS: A “quick and dirty” usability scale. In P.W.Jordan, B.Thomas, B.A.Weerdmeester, & I.L.McClelland (Eds.), Usability evaluation in industry (pp. 189–194). London, UK: Taylor & Francis.
9. N.Cliff, (1987). Analyzing multivariate data. San Diego, CA: Harcourt Brace Jovanovich.
10. A.Dix,, J.Finlay,, G.D.Abowd,, & R.Beale, (2003). Human–computer interaction. Harlow, UK: Pearson Education.
11. K.Finstad, (2010). The usability metric for user experience. Interacting with Computers, 22, 323–327. doi:10.1016/j.intcom.2010.04.004
12. K.Finstad, (2013). Response to commentaries on “The Usability Metric for User Experience.” Interacting with Computers, 25, 327–330. doi:10.1093/iwc/iwt005
13. L.A.Goodman, (1974). Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika, 61, 215–231. doi:10.1093/biomet/61.2.215
14. M.Hassenzahl, (2005). The thing and I: Understanding the relationship between user and product. In M.Blythe, K.Overbeeke, A.Monk, & P.Wright (Eds.), Funology: From usability to enjoyment (Vol. 3, pp. 31–42). Berlin, Germany: Springer. doi:10.1007/1-4020-2967-5_4
15. M.Hassenzahl,, & N.Tractinsky, (2006). User experience—A research agenda. Behaviour & Information Technology, 25, 91–97. doi:10.1080/01449290500330331
16. M.Hassenzahl,, A.Wiklund-Engblom,, A.Bengs,, S.Hägglund,, & S.Diefenbach, (2015). Experience-Oriented and Product-Oriented Evaluation: Psychological Need Fulfillment, Positive Affect, and Product Perception. International Journal of Human-Computer Interaction, 31, 530–544.
17. ISO 9241-11:1998 Ergonomic requirements for office work with visual display terminals – Part 11: Guidance on usability.
18. ISO 9241-210:2010 Ergonomics of human-system interaction – Part 210: Human-centred design for interactive systems.
19. P.T.Kortum,, & A.Bangor, (2012). Usability ratings for everyday products measured with the System Usability Scale. International Journal of Human–Computer Interaction, 29, 67–76. doi:10.1080/10447318.2012.681221
20. P.T.Kortum,, & M.Johnson, (2013). The relationship between levels of user experience with a product and perceived system usability. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57, 197–201. doi:10.1177/1541931213571044
21. C.Lallemand,, G.Gronier,, & V.Koenig, (2015). User experience: A concept without consensus? Exploring practitioners’ perspectives through an international survey. Computers in Human Behavior, 43, 35–48. doi:10.1016/j.chb.2014.10.048
22. P.F.Lazarsfeld,, & N.W.Henry, (1968). Latent structure analysis. Boston, MA: Houghton, Mifflin.
23. S.Lee,, & R.J.Koubek, (2012). Users’ perceptions of usability and aesthetics as criteria of pre- and post-use preferences. European Journal of Industrial Engineering, 6, 87–117. doi:10.1504/EJIE.2012.044812
24. J.R.Lewis, (2006). Usability testing. In G.Salvendy (Ed.), Handbook of human factors and ergonomics (pp. 1275–1316). New York, NY: Wiley & Sons.
25. J.R.Lewis, (2013). Critical review of “The Usability Metric for User Experience.” Interacting with Computers, 25, 320–324. doi:10.1093/iwc/iwt013
26. J.R.Lewis, (2014). Usability: Lessons learned … and yet to be learned. International Journal of Human-Computer Interaction, 30, 663–684. doi:10.1080/10447318.2014.930311
27. J.R.Lewis,, & J.Sauro, (2009). The factor structure of the System Usability Scale. In M.Kurosu (Ed.), Human centered design (Vol. 5619, pp. 94–103). Berlin, Germany: Springer. doi:10.1007/978-3-642-02806-9/12
28. J.R.Lewis,, B.S.Utesch,, & D.E.Maher, (2013). UMUX-LITE: When there’s no time for the SUS. In Proceedings of CHI 2013 (pp. 2099–2102). Paris, France: ACM. doi:10.1145/2470654.2481287
29. G.Lindgaard,, & C.Dudek, (2003). What is this evasive beast we call user satisfaction? Interacting with Computers, 15, 429–452. doi:10.1016/S0953-5438(02)00063-2
30. S.McLellan,, A.Muddimer,, & S.C.Peres, (2012). The effect of experience on System Usability Scale ratings. Journal of Usability Studies, 7, 56–67.
31. M.L.Nering,, & R.Ostini, (2010). Handbook of polytomous item response theory models. New York, NY: Taylor & Francis.
32. H.Petrie,, & N.Bevan, (2009). The evaluation of accessibility, usability, and user experience. In C.Stephanidis (Ed.), The universal access handbook (pp. 299–314). Boca Raton, FL: CRC Press.
33. J.Sauro, (2011). Does prior experience affect perceptions of usability? Retrieved from http://www.measuringusability.com/blog/prior-exposure.php
34. J.Sauro,, & J.R.Lewis, (2011). When designing usability questionnaires, does it hurt to be positive? In Proceedings of CHI 2011 (pp. 2215–2223). Vancouver, Canada: ACM. doi:10.1145/1978942.1979266
35. J.Sauro,, & J.R.Lewis, (2012). Quantifying the user experience: Practical statistics for user research. Burlington, MA: Morgan Kaufmann.
36. G.Schwarz, (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. doi:10.2307/2958889
37. N.Tractinsky, (1997). Aesthetics and apparent usability: Empirically assessing cultural and methodological issues. In Proceedings of CHI 1997 (pp. 115–122). Atlanta, GA: Association for Computing Machinery. doi:10.1145/258549.258626
38. W.van der Linden,, & R.K.Hambleton, (1997). Handbook of modern item response theory. New York, NY: Springer.
39. M.Zviran,, C.Glezer,, & I.Avni, (2006). User satisfaction from commercial web sites: The effect of design and use. Information & Management, 43, 157–178. doi:10.1016/j.im.2005.04.002