A test of spatial contiguity for virtual human's gestures in multimedia learning environments

Journal of Educational Computing Research

Volumn 53, Issue 1, 2015, Pages 3-14

  Craig, Scotty D ^a   Twyford, Jessica ^a   Irigoyen, Norma ^a   Zipp, Sarah A ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

Gesturing; Pedagogical agent; Spatial contiguity; Virtual humans

Indexed keywords

EID: 84961951119     PISSN: 07356331     EISSN: 15414140     Source Type: Journal    
DOI: 10.1177/0735633115585927     Document Type: Article

References (31)

1. Atkinson, R. K. (2002). Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology, 94, 416.
2. Ayres, P., & Sweller, J. (2005). The split-attention principle. In R. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 135-146). New York, NY: Cambridge University Press.
3. Baddeley, A. D. (1992). Working memory. Science, 255, 556-559.
4. Bailenson, J. N., Yee, N., Blascovich, J., Beall, A. C., Lundblad, N., & Jin, M. (2008). The use of immersive virtual reality in the learning sciences: Digital transformations of teachers, students, and social context. The Journal of the Learning Sciences, 17(1), 102-141.
5. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6(1), 3-5.
6. Cassell, J., & McNeill, D. (1991). Gesture and the poetics of prose. Poetics Today, 12(3), 375-404.
7. Cassell, J., Vilhjalmsson, H., & Bickmore, T. (2004). BEAT: The behavior expression animation toolkit. In H. Prendinger, & M. Ishizuka (Eds.), Life-Like Characters. Tools, Affective Functions, and Applications, Cognitive Technologies Series (pp.163-185). Berlin: Springer.
8. Craig, S. D., Gholson, B., & Driscoll, D. (2002). Animated pedagogical agents in multimedia educational environments: Effects of agent properties, picture features and redundancy. Journal of Educational Psychology, 94, 428.
9. Falloon, G. (2010). Using avatars and virtual environments in learning: What do they have to offer? British Journal of Educational Technology, 41(1), 108-122.
10. Flevares, L. M., & Perry, M. (2001). How many do you see? The use of nonspoken representations in first-grade mathematics lessons. Journal of Educational Psychology, 93(2), 330.
11. Ginns, P. (2006). Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction, 16(6), 511-525.
12. Graesser, A., & McNamara, D. (2010). Self-regulated learning in learning environments with pedagogical agents that interact in natural language. Educational Psychologist, 45(4), 234-244.
13. Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3(11), 419-429.
14. Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297.
15. Johnson, W. L., Rickel, J. W., & Lester, J. C. (2000). Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education, 11(1), 47-78.
16. Kittur, A., Chi, E. H., & Suh, B. (2008, April). Crowdsourcing user studies with Mechanical Turk. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 453-456). New York, NY: ACM.
17. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
18. Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1-19.
19. Mayer, R. E. (2005). Cognitive theory of multimedia learning. In R. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 31-48). New York, NY: Cambridge University Press.
20. Mautone, P. D., & Mayer, R. E. (2001). Signaling as a cognitive guide in multimedia learning. Journal of Educational Psychology, 93(2), 377.
21. Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York, NY: Cambridge University Press.
22. Mayer, R. E., & Moreno, R. (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of educational psychology, 90(2), 312.
23. Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91, 358-368.
24. Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction, 19(2), 177-213.
25. Paivio, A. (1986). Mental representations: A dual coding approach. Oxford, England: Oxford University Press.
26. Peterson, M. (2005). Learning interaction in an avatar-based virtual environment: A preliminary study. PacCALL Journal, 1, 29-40.
27. Rickel, J., Marsala, S., Gratch, J., Hill, R., Traum, R., & Swartout, W. (2002). Toward a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems, 17, 32-38.
28. Roth, W. M. (2001). Gestures: Their role in teaching and learning. Review of Educational Research, 71(3), 365-392.
29. Schroeder, N. L., Adesope, O. O., & Gilbert, R. B. (2013). How effective are pedagogical agents for learning? A meta-analytic review. Journal of Educational Computing Research, 49(1), 1-39.
30. Twyford, J., & Craig, S. D. (2013). Virtual humans and gesturing during multimedia learning: An investigation of predictions from the temporal contiguity effect. In T. Bastiaens & G. Marks (Eds.), World conference on e-learning in corporate, government, healthcare, and higher education (ELEARN) 2013 (pp. 2541-2545). Chesapeake, VA: AACE.
31. Wilson, A. D., Bobick, A. F., & Cassell, J. (1996). Recovering the temporal structure of natural gesture. In Proceedings of the Second IEEE International Conference on Automatic Face and Gesture Recognition (pp. 66-71). Los Alamitos, CA: IEEE Computer Society Press.