User experience evaluation methods: Current state and development needs

NordiCHI 2010: Extending Boundaries - Proceedings of the 6th Nordic Conference on Human-Computer Interaction

Volumn , Issue , 2010, Pages 521-530

  Vermeeren, Arnold P O S ^a   Law, Effie Lai Chong ^b   Roto, Virpi ^c   Obrist, Marianna ^d   Hoonhout, Jettie ^e   Väänänen Vainio Mattila, Kaisa ^c,f  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

^c NOKIA RESEARCH CENTER   (United States)

^d UNIVERSITY OF SALZBURG   (Austria)

^e PHILIPS RESEARCH LABORATORIES   (Netherlands)

^f TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Evaluation method; Methodological development needs; User experience

Indexed keywords

ESSENTIAL CHARACTERISTIC; EVALUATION METHOD; LITERATURE REVIEWS; METHODOLOGICAL DEVELOPMENT NEEDS; ONLINE SURVEYS; SPECIAL INTEREST GROUPS; USER EXPERIENCE;

KNOWLEDGE MANAGEMENT; PRODUCT DESIGN; PRODUCT DEVELOPMENT;

HUMAN COMPUTER INTERACTION;

EID: 78650149573     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1868914.1868973     Document Type: Conference Paper

References (27)

1. ENGAGE, Report on the evaluation of generative tools and methods for 'emotional design'. Deliverable D15.3. EU project Engage 520998 (2006).
2. Ganglbauer, E., Schrammel, J., Deutsch, S., and Tscheligi, M. Applying Psychophysiological Methods for Measuring User Experience: Possibilities, Challenges and Feasibility. Workshop on User Experience Evaluation Methods in Product Development. August 25, 2009. Uppsala, Sweden.
3. Gaver, B., Dunne, T., and Pacenti, E. Design: Cultural probes. Interactions 6, 1 (Jan. 1999), 21-29.
4. Green, W., Dunn, G., and Hoonhout, J. Developing the scale adoption framework for evaluation (SAFE). In: Proc. of the 5th COST294-MAUSE Open Workshop "Meaningful Measures: Valid Useful User Experience Measurement (VUUM)", Iceland June 2008. Also published in the ACM Library.
5. Hassenzahl, M., and Tractinsky, N., User Experience - a research agenda. In: Behavior & Information Technology, 25(2), (2006) pp. 91-97.
6. Hassenzahl, M. 2008. User experience (UX): towards an experiential perspective on product quality. In Proc. of the 20th international Conference of the Association Francophone D'interaction Homme-Machine. IHM '08, vol. 339. (2008) ACM, New York, NY, 11-15.
7. Hoonhout, H.C.M. Let the game tester do the talking: think aloud and interviewing to learn about the game experience, In: Isbister, K., Schaffer, N. (eds.), Game Usability: Advice from the Experts for Advancing the Player Experience, San Fransisco, CA: Morgan Kaufmann Publishers, (2008) 65-77.
8. th January, 2008.
9. ISO DIS 9241-210:2010. Ergonomics of human system interaction - Part 210: Human-centred design for interactive systems (formerly known as 13407). International Standardization Organization (ISO). Switzerland.
10. Isomursu M, Tähti, M., Väinämö, S., and Kuutti, K. Experimental evaluation of five methods for collecting emotions in field settings with mobile applications. International Journal of Human-Computer Studies, Volume 65(4), April 2007, pp. 404-418.
11. Isomursu, M. (2008). User experience evaluation with experimental pilots. In: Väänänen-Vainio-Mattila, K.; Roto, V.; Hassenzahl, M. Now Let's Do It in Practice: User Experience Evaluation Methods in Product Development, Workshop at CHI2008 (2008).
12. Jordan, P. Designing Pleasurable Products. (2000) Taylor & Francis, London.
13. Karapanos, E., Zimmerman, J., Forlizzi, J., and Martens, J. User experience over time: an initial framework. In Proc. CHI '09. (2009) ACM, New York, NY, 729-738.
14. Kaye, J. Evaluating experience-focused HCI. In CHI '07 Extended Abstracts on Human Factors in Computing Systems CHI '07. (2007) ACM, New York, NY, 1661-1664.
15. Kujala, S., and Väänänen-Vainio-Mattila, K. Value of Information Systems and Products: Understanding the Users' Perspective and Values, Journal of Information Technology Theory and Application (JITTA), 9, 4, 2009.
16. Law, E., Roto, V., Hassenzahl, M., Vermeeren, A., and Kort, J. (2009). Understanding, Scoping and Defining User eXperience: A Survey Approach. Proc. CHI'09, ACM SIGCHI conference on Human Factors in Computing Systems.
17. Law, E., Scapin, D., Cockton, G., Stary, M., and Winckler, M. Maturation of Usability Evaluation Methods: Retrospect and Prospect. COST294-MAUSE Closing Conference Proceedings (2009). http://141.115.28.2/cost294/upload/533.pdf
18. Lewin, K. Field theory in social science; selected theoretical papers. D. Cartwright (ed.). (1951) New York: Harper & Row.
19. Mäkelä, A., Fulton Suri, J. Supporting Users' Creativity: Design to Induce Pleasurable Experiences. Proc. of the Int. Conf. on Affective Human Factors Design, (2001) pp. 387-394.
20. Monahan, K., Lahteenmaki, M., McDonald, S., and Cockton, G. 2008. An investigation into the use of field methods in the design and evaluation of interactive systems. In Proc. of the 22nd British HCI Group Annual Conf. on HCI 2008: People and Computers Xxii: Culture, Creativity, interaction -Volume 1. (2008) British Computer Society, Swinton, UK, 99-108.
21. Nisbett, R.E. and Wilson, T., Telling more than we can know: verbal reports on mental processes. Psychological Review, 1977, 84(3), 231-259.
22. Obrist, M., Roto, V., and Väänänen-Vainio-Mattila, K. User Experience Evaluation - Do You Know Which Method to Use? Special Interest Group in CHI2009 Conference, Boston, USA, 5-9 April, 2009.
23. Roto, V., Väänänen-Vainio-Mattila, K., Law, E., and Vermeeren, A. User Experience Evaluation Methods in Product Development. Workshop in INTERACT'09, August 25, 2009. Uppsala, Sweden.
24. Shami, N. S., Hancock, J. T., Peter, C., Muller, M., and Mandryk, R. Measuring affect in HCI: going beyond the individual. In CHI '08 Extended Abstracts on Human Factors in Computing Systems. CHI '08. (2008) ACM, New York, NY, 3901-3904.
25. Stone, D., Jarrett, C., Woodroffe, M., and Minocha, S. User Interface Design and Evaluation (The Morgan Kaufmann Series in Interactive Technologies). (2005) Morgan Kaufmann.
26. Tullis, T., and Albert, B. Measuring the User Experience. Collecting, Analyzing, and Presenting Usability Metrics. (2008) Morgan Kaufmann.
27. Väänänen-Vainio-Mattila, K., Roto, V., and Hassenzahl, M. Now Let's Do It in Practice: User Experience Evaluation Methods in Product Development. In Extended Abstract of CHI 2008, ACM Press (2008), pp. 3961-3964.