Evaluating user experience of adaptive digital educational games with Activity Theory

International Journal of Human Computer Studies

Volumn 70, Issue 7, 2012, Pages 478-497

  Law, Effie Lai Chong ^a   Sun, Xu ^b  

^a UNIVERSITY OF LEICESTER   (United Kingdom)

^b UNIVERSITY OF NOTTINGHAM NINGBO CHINA   (China)

Author keywords

Activity Theory; Adaptivity; Breakdowns; Contradictions; Digital educational game; Downstream utility; Usability; User experience

Indexed keywords

ACTIVITY THEORY; ADAPTIVITY; BREAKDOWNS; CONTRADICTIONS; DOWNSTREAM UTILITY; EDUCATIONAL GAME; USABILITY; USER EXPERIENCE;

ACTIVITY COEFFICIENTS; INTERACTIVE COMPUTER GRAPHICS; LEARNING SYSTEMS; RATING;

HUMAN COMPUTER INTERACTION;

EID: 84862819390     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2012.01.007     Document Type: Article

References (80)

1. A. Abrahão, N. Juristo, E.L.-C. Law, and J. Stage Interplay between usability and software development Journal of Systems and Software 83 11 2010 2015 2018
2. D. Albert, and J. Lukas Knowledge Spaces: Theories, Empirical Research, Applications 1999 Lawrence Erlbaum Associates Mahwah, NJ
3. L. Bannon, and V. Kaptelinin From human-computer interaction to computer-mediated activity C. Stephanidis, User Interfaces For All: Concepts, Methods, and Tools 2000 Erlbaum Mahwah, NJ 183 202
4. S. Barab, S. Schatz, and R. Scheckler. Using activity theory to conceptualize online community and using online community to conceptualize activity theory Mind, Culture, and Activity 11 1 2000 25 47
5. P. Barr, J. Noble, and R. Riddle Video game values: human-computer interaction and games Interacting with Computers 19 2007 180 195 (Pubitemid 46162199)
6. Battarbee, K.; 2003. Co-experience: the social user experience. In: Proceedings of the CHI03. Extended Abstracts.
7. R. Bellamy Designing educational technology: computer-mediated change B. Nardi, Context and Consciousness: Activity Theory and Human-Computer Interaction 1996 MIT Press Cambridge 123 145
8. Benedikte, S.A.; Janne, J.J.; Mikael, B.S.; 2005. Comparisons of think-aloud and constructive interaction in usability testing with children. In: Proceedings of the Interaction with Children and Design, Boulder, Colorado, pp. 9-16.
9. R. Bernhaupt Evaluating User Experience in Games: Concepts and Methods 2010 Springer Verlag London
10. Blas, D.N.; Paolini, P.; Poggi, C.; 2005. Educational benefits: testing and evaluation of a collaborative 3D world. In: Proceedings of the ED-MEDIA, pp. 1002-1011.
11. Blin, F.; 2005. Call and the Development of Learner Autonomy: An Activity Theoretical Study. Doctoral Dissertation. The Open University, UK.
12. S. Bodker Through the Interface: A Humanistic Activity Approach to User Interface Design 1991 Lawrence Erlbaum Associates
13. J. Brine, and M. Franken Students perceptions of a selected aspect of a computer mediated academic writing program: an activity theory analysis Australasian Journal of Educational Technology 22 1 2006 21 38
14. Burrow, A.; More, G.; 2005. Architectural designers and the interactive audience. In: Proceedings of the Interactive Entertainment, Sydney, Australia.
15. J. Coleman Learning through games I.E. Avedon, B. Sutton-Smith, The Study of Games 1971 John Wiley New York 322 329
16. H.M. Collins, and S. Yearley Epistemological chicken A. Pickering, Science as Practice and Culture 1992 Chicago University Press Chicago 301 326
17. M. Csikszentmihalyi Flow. The Psychology of Optimal Experience 1990 Harper & Row New York
18. De Freitas, S.; 2006. Learning in immersive worlds: a review of game-based learning. JISC. Accessible online at: 〈 http://www.jisc.ac.uk/ eli-outcomes.html 〉.
19. D. Diaper, and G. Lindgaard West meets East: adapting activity theory for HCI & CSCW applications? Interacting with Computers 20 2008 240 246
20. Dickey, M.D.; 2006. Ninja looting for instructional design: the design challenges of creating a game based learning environment. In: Proceedings of the SIGGRAPH. ACM.
21. M.J. Dondlinger Educational video game design: a review of the literature Journal of Applied Educational Technology 4 2007 1
22. Y. Engeström Learning by Expanding: An Activity-Theoretical Approach to Developmental Research 1987 Orienta-Konsultit Helsinki
23. Y. Engeström Developmental studies of work as a testbench of activity theory: The case of primary care medical practice S. Chaiklin, J. Lave, Understanding Practice: Perspectives on Activity and Context 1993 Cambridge University Press Cambridge, MA 64 103
24. Y. Engeström Enriching activity theory without shortcuts Interacting with Computers 20 2008 256 259 (Pubitemid 351253769)
25. Ermi, L.; Mayra, F.; 2005. Fundamental components of the gameplay experience: analyzing immersion. In: de Castell, S.; Jenson, J. (Eds.), Changing Views: Worlds in Play.
26. B.J. Gajadhar, Y.A.W. de Kort, and W.A. IJsselsteijn Shared fun is doubled fun: player enjoyment as a function of social setting P. Markopoulos, B. de Ruyter, W. IJsselsteijn, D. Rowland, Proceedings of the Second International Conference on Fun and Games 2008 Springer New York 106 117
27. Garzotto, F.; 2007. Investigating the educational effectiveness of multiplayer online games for children. In: Proceedings of the Interaction Design and Children, Aalborg, Denmark.
28. G. Gay, R. Rieger, and T. Bennington Using mobile computing to enhance field study T. Koschmann, R. Hall, N. Miyake, CSCL2: Carrying Forward the Conversation 2001 Erlbaum Mahwah, NJ
29. J.P. Gee What Video Games have to Teach Us about Learning and Literacy 2003 Palgrave MacMillan New York
30. González, V.; 2006. The Nature of Managing Multiple Activities in the Workplace. Doctoral Dissertation in Information and Computer Science. University of California, Irvine.
31. J. Hartmann, A. Sutcliffe, and A. Antonella De Towards a theory of user judgment of aesthetics and user interface quality ACM Transactions on Computer-Human Interaction (TOCHI) 15 4 2008 1 30
32. M. Hassenzahl, and N. Tractinsky User experience - a research agenda Behaviour and Information Technology 25 2 2006 91 97 (Pubitemid 43065340)
33. M. Hassenzahl, S. Diefenbach, and A. Göritz Needs, affect, and interactive products - facets of user experience Interacting with Computers 22 2010 353 362
34. K. Hornbæk, and J. Stage The interplay between usability evaluation and user interaction design International Journal Human-Computer Interaction 21 2 2006 117 123 (Pubitemid 44832308)
35. IJsselstein, W.; van der Hoogen, W.; Klimmt, C.; de Kort, Y.; Lindley, C.; Mathiak, K. Poels, K.; Ravaja, N.; Turpeinen, M.; Vorderer, P.; 2008. Measuring the experience of digital game enjoyment. In: Proceedings of the Measuring Behavior 2008. Noldus Information Technology BV, Maastricht, Wageningen, The Netherlands.
36. K. Isbister, and N. Schaffer Game Usability: Advice from the Experts for Advancing the Player Experience 2008 Morgan Kaufmann Burlington, MA
37. K. Isssroff, and E. Scanlon Using technology in higher education: an activity theory perspective Journal of Computer Assisted Learning 18 1 2002 77 83 (Pubitemid 36836975)
38. Jarvinen, A.; Helio, S.; Mayra, F.; 2002. Communication and community in digital entertainment services. Retrieved from Hypermedia Laboratory Net Series 2: 〈 http://tampub.uta.fi/tup/951-44-5432-4.pdf 〉.
39. B.E. John, and M.M. Mashyna Evaluating a multimedia authoring tool Journal of the American. Society for Information Science 48 11 1997 1004 1022 (Pubitemid 127601732)
40. V. Kaptelinin Computer-mediated activity: functional organs in social and developmental contexts B. Nardi, Context and Consciousness: Activity Theory and Human-Computer Interaction 1996 MIT Cambridge, MA 45 68
41. V. Kaptelinin, and B.A. Nardi Acting with Technology: Activity Theory and Interaction Design Cambridge, MA 2006 MIT Press
42. Kickmeier-Rust, M.D.; Hockemeyer, C.; Albert, D.; Augustin, T.; 2008. Micro-adaptive, non-invasive assessment in educational games. In: Proceedings of the Digital Game and Intelligent Toy Enhanced Learning, November 17-19, Banff, Canada, pp. 135-138.
43. J.M. Keller Motivational design of instruction C.M. Reigeluth, Instructional-Design Theories and Models: An Overview of their Current Status 1983 Lawrence Erlbaum Associates Hillsdale, NJ
44. Kiili, K.; 2005. Educational Game Design: Experiential Gaming Model Revised. Available online at: 〈 http://amc.pori.tut.fi/publications/ EducationalGameDesign.pdf 〉.
45. Kuikkaniemi, K.; Laitinen, T.; Turpeinen, M.; Saari, T.; Kosunen, I.; Ravaja, N.; 2010. The influence of implicit and explicit biofeedback in first-person shooter games. In: Proceedings of the CHI 2010. ACM, pp. 859-868.
46. K. Kuutti Activity theory as a potential framework for human-computer interaction research B.A. Nardi, Context and Consciousness 1995 MIT Press Cambridge, MA 17 44
47. Kuutti, K.; 2010. Where are the Ionians of user experience research? In: Proceedings of the NordiCHI 2010, 16-20 October, Iceland.
48. E.L.-C. Law Evaluating the downstream utility of user tests and examining the developer effect: a case study International Journal of Human-Computer Interaction 21 2 2006 147 172 (Pubitemid 44832310)
49. Law, E.; Abrahao, S.; Stage, J.; 2010. Proceedings of the Workshop on Interplay between User Experience Evaluation and Software Development (I-UxSED11), in conjunction with NordiCHI 2010, 17 October 2010, Reykjavik, Iceland 〈 http://ceur-ws.org/Vol-656/ 〉.
50. Law, E.; Mattheiss, M.; Kickmeier-Rust, M.; Albert, D.; 2010. Vicarious learning with a digital educational game: eye-tracking and survey-based approach. In: Proceedings of the USAB 2010, 4-5 November, Austria.
51. Law, E.; Roto, V.; Hassenzahl, M.; Vermeeren, A.; Kort, J.; 2009. Understanding, Scoping and Defining User eXperience: a survey approach. In: Proceedings of the CHI09, Boston.
52. E. Law, and P. van Schaik Modelling user experience - an agenda for research and practice Interacting with Computers 22 5 2010 313 322
53. J. Law, and J. Hassard Actor Network Theory and After 1999 Blackwell and the Sociological Review Oxford
54. N. Lee, and S. Brown Otherness and the Actor Network: The Undiscovered Continent American Behavioural Scientist 36 1994 772 790
55. A. Leontiev Activity, Consciousness, and Personality 1978 Prentice-Hall Englewood Cliffs, NJ
56. Magoulas, G.D.; Chen, S.Y.; Papanikolaou, K.A.; 2003. Integrating layered and heuristic evaluation for adaptive learning environments. In: Proceedings of the User Modeling UM2003, Pittsburgh, USA, pp. 5-14.
57. T. Marsh Vicarious experience: staying there connected with and through our own and other characters S. Williams, Gaming as Culture 2005 196 213
58. McDonald, J.; Timonen, J.; 2009. How could pedagogy make a choice between personalized learning systems? In: Proceedings of the Authoring of Adaptive and Adaptable Hypermedia.
59. L.E. Nacke, A. Drachen, and S. Goebel Methods for evaluating gameplay experience in a serious gaming context International Journal of Computer Science in Sport 2010 9
60. B.A. Nardi Studying context: a comparison of activity theory, situated action models, and distributed cognition B.A. Nardi, Context and Consciousness 1996 MIT Press Cambridge, MA 69 102
61. Mie Norgaard, and Kasper Hornbæk Exploring the value of usability feedback formats International Journal Human-Computer Interaction 25 1 2009 49 74
62. M. Oliver, and C. Pelletier Activity theory and learning from digital games: developing an analytical methodology D. Buckingham, R. Willett, Digital Generations: Children, Young People, and New Media 2006 Erlbaum 67 88
63. Pagulayan, R.; Steury, K.R.; Fulton, B.; Romero, R.L.; 2004. Designing for fun: user-testing case studies. In: Blythe, M.; Overbeeke, K.; Monk, A.F.; Wright, P.C. (Eds.), Funology: From Usability to Enjoyment. Kluwer Academic, Norwell, MA, pp. 137-150.
64. R. Pagulayan, K.R. Steury, B. Fulton, and R.L Romero Designing for fun: user-testing case studies M. Blythe, K. Overbeeke, A.F. Monk, P.C. Wright, Funology: From Usability to Enjoyment 2004 Kluwer Academic Norwell, MA 137 150
65. Poels, K.; de Kort, Y.A.W.; IJsselsteijn, W.A.; 2007. It is always a lot of fun! Exploring dimensions of digital game experience using focus group methodology. In: Proceedings of the Future Play 2007, Toronto, Canada.
66. J.L. Powell, and T. Owen Actor network theory and social science: possibilities and implications Journal of Public Administration and Governance 1 2 2011 140 157
67. M. Prensky Digital Game-Based Learning 2004 McGraw Hill New York
68. Y. Rogers 57 varieties of activity theory Interacting with Computers 20 2008 247 250 (Pubitemid 351253770)
69. Roto, V.; Law, E.; Vermeeren, A.; Hoonholt, J.; 2011. User Experience White Paper. Retrieved from 〈 http://www.allaboutux.org/ 〉.
70. M. Roussou, M. Oliver, and M. Slater Exploring activity theory as a tool for evaluating interactivity and learning in virtual environments for children Cognition, Technology and Work 10 2008 141 153 (Pubitemid 351667223)
71. Roussou, M.; 2004. Examining young learners activity within interactive virtual environments. In: Proceedings of the Interaction Design & Children, pp. 167-168.
72. Schrier, K.; 2006. Using augmented reality games to teach 21st century skills. In: Proceedings of the SIGGRAPH Conference. ACM Press, Boston.
73. Schwarz, D.; et al.; 2009. Phase 2 didactic design and game design specifications. Project 80Days deliverable D6.2. Unpublishable Manuscript.
74. Squire, K.; 2002. Cultural framing of computer/video games. Game Studies 2(1). Retrieved 20 July 2010 from: 〈 http://www.gamestudies.org/0102/ squire/ 〉.
75. L. Suchman Plans and Situated Actions: The Problem of Human-Machine Communication 1987 Cambridge University Press New York
76. P. Sweetser, and P. Wyeth Game flow: a model for evaluating player enjoyment in games ACM Computers in Entertainment 3 3 2005 1 24
77. Uden, L.; Willis, N.; 2001. Designing user interfaces using Activity Theory. In: Proceedings of the 34th Annual Hawaii International Conference on System Sciences (HICSS-34), January 3-6, 2001, Maui, Hawaii. IEEE Computer Society.
78. L. Vygotsky Mind in Society: The Development of Higher Psychological Processes 1978 Harvard University Press Cambridge, MA
79. T. Winograd, and F. Flores Understanding Computers and Cognition: A New Foundation for Design 1986 Ablex
80. M. Zuckerman, D.M. Kuhlman, M. Thornquist, and H. Kiers Five (or three): robust questionnaire scale factors of personality without culture Personality and Individual Differences 12 1991 929 941