Adaptive experience engine for serious games

IEEE Transactions on Computational Intelligence and AI in Games

Volumn 1, Issue 4, 2009, Pages 264-280

  Bellotti, Francesco ^a   Berta, Riccardo ^a   De Gloria, Alessandro ^a   Primavera, Ludovica ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

Genetic algorithms; Reinforcement learning (RL); Serious games; Technology enhanced education; User modeling

Indexed keywords

COMPUTATIONAL INTELLIGENCE; EDUCATION TECHNIQUE; EFFECTIVE LEARNING; ENGINEERING METHODS; GAME DESIGNERS; GAME ENGINE; GROWING DEMAND; INTERACTIVE LEARNING; KNOWLEDGE LEVEL; LEARNING CURVES; LEARNING OBJECTIVES; MODULE-BASED; NEW DESIGN; PHYSICAL WORLD; REAL-TIME MISSIONS; REALISTIC SIMULATION; RUN-TIME SCHEDULING; SEMANTIC ANNOTATIONS; SERIOUS GAMES; SKILL ACQUISITION; STATE OF THE ART; TASK SEQUENCING; TEST RESULTS; USER MODELING; USER PROFILE;

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL EFFICIENCY; EDUCATION; REINFORCEMENT; REINFORCEMENT LEARNING; SPECIFICATIONS;

LEARNING ALGORITHMS;

EID: 77955666872     PISSN: 1943068X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCIAIG.2009.2035923     Document Type: Article

References (85)

1. C. Quinn and L. Neal, "Serious games for serious topics," eLearn Mag. [Online]. Available: http://www.elearnmag.org/subpage.cfm?section= opinion&article=96-1
2. F. L. Greitzer, O. A. Kuchar, and K. Huston, "Cognitive science implications for enhancing training effectiveness in a serious gaming context," ACM J. Edu. Resources Comput., vol. 7, no. 3, pp. 2-16, Aug. 2007.
3. K. Burke, "Sixty percent of all Americans play video games, contributing to the fourth straight year of double digit growth for the interactive entertainment industry," Interactive Digit. Software Assoc. [Online]. Available: http://www.isda.com/releases/4-21-2000.html
4. M. Prensky, "Digital game-based learning," ACM Comput. Entertain., vol. 1, no. 1, pp. 1-20, Oct. 2003.
5. M. Zyda, "From visual simulation to virtual reality to games," IEEE Computer, vol. 38, no. 9, pp. 25-31, Sep. 2005.
6. E. Raybourn and N. Bos, "Design and evaluation challenges of serious games," in Proc. ACM Conf. Human Factors Comput. Syst., Portland, OR, Apr. 2-7, 2005, pp. 2049-2050.
7. W. L. Johnson, "Lessons learned from games for education," in Proc. ACM SIGGRAPH Educators Program, Los Angeles, CA, Jul.-Aug. 31-04, 2005.
8. J. P. Gee, What Video Games Have to Teach us About Learning and Literacy. New York: Palgrave Macmillan, 2003.
9. P. Moreno-Ger, D. Burgos, J. L. Sierra, and B. Fernández- Manjón, "A game-based adaptive unit of learning with ims learning design and e-Adventure," in Proc. 2nd Eur. Conf. Technol. Enhanced Learn., Crete, Greece, 2007, pp. 247-261.
10. J. P. Gee, "How would a state of the art instructional video game look like?," Innovate J. Online Edu., vol. 1, no. 6, 2005.
11. R. C. Atkinson and R. M. Shiffrin, "Human memory: A proposed system and its control processes," Psychol. Learn. Motiv., pp. 89-195, 1968.
12. E. Tulving, Organization of Memory. New York: Academic, 1972.
13. K. Squire, "Open-ended video games: A model for developing learning for the interactive age," in The Ecology of Games: Connecting Youth, Games, and Learning, K. Salen, Ed. Cambridge, MA: MIT Press, 2008, pp. 167-198.
14. J. Willis, A Framework for Task-Based Learning. Harlow, U.K.: Longman Addison- Wesley, 1996.
15. J. Willis and D. Willis, Eds., Challenge and Change in Language Teaching. Oxford, U.K.: Heinemann ELT, 1996.
16. R. Ellis, Task-Based Language Learning and Teaching. New York: Oxford Univ. Press, 2003.
17. C. Anderson, The Long Tail. How Endless Choice is Creating Unlimited Demand. New York: Random House, 2006.
18. F. Bellotti, R. Berta, A. De Gloria, and V. Zappi, "Exploring gaming mechanisms to enhance knowledge acquisition in virtual worlds," in Proc. 3rd Int. Conf. Digit. Interactive Media Entertain. Arts, Athens, Greece, Sep. 10-12, 2008, pp. 77-84.
19. F. Bellotti, R. Berta, A. De Gloria, and L. Primavera, "Travel in Europe: An online game environment to promote and divulgate European heritage," in Visual Travel Recommender Systems, Social Communities and User Interface Design. Hershey, PA: Book, IGI Global, 2009.
20. S. Papert, "Situating Constructionism," in Constructionism, Harel and S. Papert, Eds. Norwood, NJ: Ablex, 1993.
21. H. Kelly, K. Howell, E. Glinert, L. Holding, C. Swain, A. Burrowbridge, and M. Roper, "How to build serious games," Commun. ACM, vol. 50, no. 7, pp. 44-49, Jul. 2007.
22. A. Sliney and D. Murphy, "JDoc:Aserious game for medical learning," in Proc. Int. Conf. Adv. Computer-Human Interaction, 2008, pp. 131-136.
23. J. R. Parker, S. Chan, and J. Howell, "OceanQuest: A university-based serious game project," in Proc. Digit. Games Res. Assoc. Conf., Vancouver, BC, Canada, Jun. 16-20, 2005.
24. M. Slater, P. Khanna, J. Mortensen, and I. Yu, "Visual realism enhances realistic response in an immersive virtual environment," IEEE Comput. Graph. Appl., vol. 29, no. 3, pp. 76-84, May/Jun. 2009.
25. A. Frazer, D. Argles, and G. Wills, "Is less actually more? the usefulness of educational mini-game," in Proc. IEEE Int. Conf. Adv. Learn. Technol., 2007, pp. 533-537.
26. F. Bellotti, R. Berta, A. De Gloria, and L. Primavera, "Enhancing the educational value of videogames," ACM Comput. Entertain., 2009, to be published.
27. Learning Science and Technology R&D Roadmap, Federation of American Scientists, Washington, DC, 2003 [Online]. Available: www.fas.org/ learningfederation
28. A. Moshirnia, "The educational potential of modified video games," in Proc. Informing Sci. Inf. Technol. Conf. InSITE, 2007, pp. 512-523.
29. O. A. Kuchar, K. Huston, and F. L. Greitzer, "Applying principles of gaming, motivation and learning to enhance the effectiveness of CyberCIEGE," Pacific Northwest Nat. Lab., Richland, WA, Rep. PNNL- 15802, 2006.
30. L. Vygotsky, "Play and its role in the mental development of the child," in Play- Its Role in Development and Evolution, J. Bruner, A. Jolly, and K. Sylva, Eds. New York: Basic Books, 1976, pp. 537-554.
31. C. Aldrich, A Field Guide to Educational Simulations. Learning Circuits. Alexandria, VA: American Society for Training and Development, 2003.
32. S. Blackman, "Serious games... and less!," in Proc. ACM SIGGRAPH Comput. Graph., 2005, pp. 12-16.
33. A. Conconi, T. Ganchev, O. Kocsis, G. Papadopoulos, F. Fernandez- Aranda, and S. Jimenez-Murcia, "PlayMancer: A serious gaming 3D environment," in Proc. 4th Int. Conf. Autom. Solut. Cross Media Content Multi-Channel Distrib., Florence, Italy, Nov. 17-19, 2008, pp. 111-117.
34. R. Darken, P. McDowell, and E. Johnson, "Projects in VR: The Delta3D open source game engine," IEEE Comput. Graph. Appl., vol. 25, no. 3, pp. 10-12, May/Jun. 2005.
35. C. J. Darken, B. G. Anderegg, and P. L. McDowell, "Game AI in Delta3D," in Proc. Conf. Comput. Intell. Games, Apr. 1-5, 2007, pp. 312-319.
36. N. Peirce, O. Conlan, and V. Wade, "Adaptive educational games: Providing non-invasive personalised learning experiences," in Proc. 2nd IEEE Int. Conf. Digit. Games Intell. Toys Based Edu., Banff, AB, Canada, Nov. 17-19, 2008, pp. 28-35.
37. G. Gunter, R. F. Kenny, and E. H. Vick, "A case for formal design paradigm for serious games," in Proc. CODE-Human Syst. Digital Bodies, 2006, pp. 1-19.
38. E. Wenger, Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge. San Francisco, CA: Morgan Kaufmann, 1987.
39. V. J. Shute and J. Psotka, "Intelligent tutoring systems: Past, present and future," in Handbook of Research on Educational Communications and Technology, D. Jonassen, Ed. Mahwah, NJ: Scholastic Publications, 1996.
40. B. Magerko, "Adaptation in digital games," IEEE Computer, vol. 41, no. 6, pp. 87-89, Jun. 2008.
41. B. Magerko, B. Stensrud, and L. Holt, "Bringing the schoolhouse inside the box-A tool for engaging, individualized training," in Proc. 25th Army Sci. Conf., Orlando, FL, 2006, pp. 1-8.
42. M. O. Riedl, A. Stern, D. Dini, and J. Alderman, "Dynamic experience management in virtual worlds for entertainment, education, and training," Int. Trans. Syst. Sci. Appl., vol. 4, Special Issue on Agent Based Systems for Human Learning, no. 2, pp. 23-24, 2008.
43. M. O. Riedl and R. M. Young, "From linear story generation to branching story graphs," IEEE Comput. Graph. Appl., vol. 26, Special Issue on Interactive Narrative, no. 3, pp. 26-31, May/Jun. 2006.
44. M. O. Riedl and A. Stern, "Believable agents and intelligent story adaptation for interactive storytelling," in Proc. 3rd Int. Conf. Technol. Interactive Digit. Storytelling Entertain., Darmstadt, Germany, 2006, pp. 1-12.
45. J. P. Rowe, S. W. Mcquiggan, B. W. Mott, and J. C. Lester, "Motivation in narrative-centered learning environments," in Proc. Workshop Narrative Learn. Environ./13th AIED Conf., Marina del Rey, CA, Jul. 2007, pp. 40-49.
46. M. Si, S. Marsella, and D. Pynadath, "Thespian: Modeling socially normative behavior in a decision-theoretic framework," in Proc. Conf. Intell. Virtual Agents, 2006, pp. 369-382.
47. M. Si, S. C. Marsella, and D. V. Pynadath, "THESPIAN: An Architecture for Interactive Pedagogical Drama," in Proc. Artif. Intell. Edu.-Supporting Learning Through Intelligent and Socially Informed Technology, 2005, pp. 595-602.
48. Learning Object MetadataWorking Group, [Online]. Available: http:// ltsc.ieee.org/wg12/, accepted for publication
49. L. J. Cronbach, "Analysis of covariance in nonrandomized experiments: Parameters affecting bias," Stanford Evaluation Consortium, Stanford, CA, 1977.
50. A. J. Kolb and D. A. Kolb, "Learning styles and learning spaces: Enhancing experiential learning in higher education," Acad. anage. Learn. Edu., vol. 4, no. 2, pp. 193-212, 2005.
51. F. Bellotti, R. Berta, A. De Gloria, and L. Primavera, "A task annotation model for sandbox serious games," in Proc. Comput. Intell. Games, Como, Italy, 2009, pp. 233-240.
52. D. E. Goldberg, "Genetic algorithms in search optimisation and machine learning," in Genetic Operators for Combinatorial Optimization in TSP and Microarray Gene Ordering. Reading, MA: Addison-Wesley, 1989.
53. M. Damsbo and P. T. Ruhoff, "An evolutionary algorithm for welding task sequence ordering," in Proc. Int. Conf. Artif. Intell. Symbolic Comput., Plattsburgh, New York, Sep. 1998, pp. 120-131.
54. S. Ray, S. Bandyopadhyay, and S. K. Pal, "Genetic operators for combinatorial optimization in TSP and microarray gene ordering," Appl. Intell., vol. 26, no. 3, pp. 183-195, 2007.
55. J. E. Baker, "Reducing bias and inefficiency in the selection algorithm," in Proc. 2nd Int. Conf. Genetic Algorithms Appl., J. J. Grefenstette, Ed., Hillsdale, NJ, 1987, pp. 14-21.
56. C. N. Quinn, Engaging Learning: Designing e-Learning SimulationGames. San Francisco, CA: Wiley, 2005.
57. O. A. Kuchar, K. Huston, and F. L. Greitzer, "Applying principles of gaming, motivation and learning to enhance the effectiveness of CyberCIEGE," Pacific Northwest Nat. Lab., Richland, WA, Rep. PNNL-15802, 2006.
58. P. Sweetser and P.Wyeth, "GameFlow: A model for evaluating player enjoyment in games," ACM Comput. Entertain., vol. 3, no. 3, p. 3, Jul. 2005.
59. G. Tesauro, "Temporal difference learning and TD-Gammon," Commun. ACM, vol. 38, no. 3, pp. 58-68, 1995.
60. R. P. Salustowicz, M. A. Wiering, and J. Schmidhuber, "Learning team strategies: Soccer case studies," Mach. Learn., vol. 33, no. 2, pp. 263-282, 1998.
61. M. Ponsen and P. Spronck, "Improving adaptive game AI with evolutionary learning," in Proc. Comput. Games, Artif. Intell. Design Edu., 2004, pp. 389-396.
62. M. Smith, S. Lee-Urban, and H. Munoz-Avila, "RETALIATE: Learning winning policies in first-person shooter games," in Proc. 17th Innovative Appl. Artif. Intell. Conf., 2007, pp. 1801-1806.
63. S.Wender and I.Watson, "Using reinforcement learning for city site selection in the turn-based strategy game Civilization IV," in Proc. IEEE Symp. Comput. Intell. Games, 2008, pp. 372-377.
64. M. McPartland, "A Practical Guide to Reinforcement Learning in Shooter Games," in AI Game Programming Wisdom, S. Rabin, Ed. Boston, MA: Charles River Media, 2008, vol. 4.
65. R. Sutton, "Learning to predict by the methods of temporal differences," Mach. Learn., vol. 3, no. 9, pp. 9-44, 1988.
66. C. Watkins, "Learning from delayed rewards," Ph.D. dissertation, King's College, Univ. Cambridge, Cambridge, U.K., 1989.
67. G. Rummery and M. Niranjan, "On-line Q-learning using connectionist systems," Eng. Dept., Cambridge Univ., Tech. Rep. CUED/F-INFENG/TR 166, 1994.
68. R. Sutton, "DYNA, an integrated architecture for learning, planning, and reacting," ACM SIGART Bull., vol. 2, no. 4, pp. 160-163, 1991.
69. R. Barto, S. Bradtke, and S. Singh, "Learning to act using real-time dynamic programming," Dept. Comput. Sci., Univ. Massachusetts at Amherst, Amherst, MA, Tech. Rep. UM-CS-1993-002, 1993.
70. J. Boyan, "Least-squares temporal difference learning," in Proc. 16th Int. Conf. Mach. Learn., 1999, pp. 233-246.
71. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamic Programming. Belmont, MA: Athena Scientific, 1996.
72. R. Sutton, "Generalization in reinforcement learning: Successful examples using sparse coarse coding," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1996, vol. 8, pp. 1038-1044.
73. S. Whiteson and P. Stone, "Evolutionary function approximation for reinforcement learning," J. Mach. Learn. Res., vol. 7, pp. 877-917, 2006.
74. T. Malone, "What makes things fun to learn? a study of an intrinsically motivating computer game," in Proc. Amer. Edu. Res. Assoc. Annu. Meeting, Los Angeles, CA, Apr. 17, 1981.
75. F. Melo and I. Ribeiro, "Q-learning with linear function approximation," in Proc. 20th Annu. Conf. Learn. Theory, 2007, pp. 308-322.
76. R. Bernhaupt, M. Eckschlager, and M. Tscheligi, "Methods for evaluating games: How to measure usability and user experience in games?," in Proc. Int. Conf. Adv. Comput. Entertain. Technol., Salzburg, Austria, Jun. 13-15, 2007, pp. 309-310.
77. M. Csikszentmihalyi, Flow: The Psychology of Optimal Experience. New York: Harper & Row, 1990.
78. J. Chen, "Flow in games (and everything else)," Commun. ACM, vol. 50, no. 4, pp. 31-34, Apr. 2007.
79. B. Cowley, D. Charles, M. Black, and R. Hickey, "Toward an understanding of flow in video games," Comput. Entertain., vol. 6, no. 2, pp. 1-20, Jul. 2008.
80. A. Raney, "Expanding disposition theory: Reconsidering character liking, moral evaluations, and enjoyment," Commun. Theory, vol. 14, no. 4, pp. 348-369, 2004.
81. R. Nabi and M. Krcmar, "Conceptualising media enjoyment as attitude: implications for mass media effects research," Commun. Theory, vol. 4, no. 14, pp. 288-310, 2004.
82. M. Green, T. Brock, and G. Kaufman, "Understanding media enjoyment: The role of transportation into narrative worlds," Commun. Theory, vol. 14, no. 4, pp. 311-327, 2004.
83. M. Federoff, "Heuristics and usability guidelines for the creation and evaluation of fun in video games," Indiana Univ., Bloomington, IN [Online]. Available: http://www.melissafederoff.com/thesis.html
84. S. Chen and D. Michael, "Proof of learning: Assessment in serious games," GamasutraMag. 2005 [Online]. Available: http://www.gamasutra. com/features/20051019/chen-01.shtml
85. H. W. Hodgins, "The future of learning objects," in The Instructional Use of Learning Objects, D. A.Wiley, Ed. Bloomington, IN: Agency for Instructional Technology, 2000, pp. 281-298.