Digital Games, Design, and Learning: A Systematic Review and Meta-Analysis

Review of Educational Research

Volumn 86, Issue 1, 2016, Pages 79-122

  Clark, Douglas B ^a   Tanner Smith, Emily E ^a   Killingsworth, Stephen S ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

digital games; learning; meta analysis; systematic review

Indexed keywords

EID: 84957888891     PISSN: 00346543     EISSN: 19351046     Source Type: Journal    
DOI: 10.3102/0034654315582065     Document Type: Article

References (72)

1. A.Bandura (1997). Self-efficacy: The exercise of control. New York, NY: Freeman.
2. S.A.BarabB.ScottS.SiyahhanR.GoldstoneA.Ingram-GobleS.ZuikerS.Warren (2009). Transformational play as a curricular scaffold: Using videogames to support science education. Journal of Science Education and Technology, 18, 305–320. doi:10.1007/s10956-009-9171-5
3. S.A.BarabS.ZuikerS.WarrenD.HickeyA.Ingram-GobleE.-J.KwonS.C.. Herring (2007). Situationally embodied curriculum: Relating formalisms and contexts. Science Education, 91, 750–782. doi:10.1002/sce.20217
4. S.BarzilaiI.Blau (2014). Scaffolding game-based learning: Impact on learning achievements, perceived learning, and game experiences. Computers & Education, 70, 65–79. doi:10.1016/j.compedu.2013.08.003
5. M.Borenstein (2009). Effect sizes for continuous data. In (Eds.), The handbook of research synthesis and meta-analysis, 2nd edition (pp. 221-235). New York, NY: Russell Sage Foundation.
6. J.D.BransfordA.L.BrownR.R.Cocking (Eds.). (2000). How people learn. Washington, DC: National Academies Press.
7. J.D.BransfordR.D.SherwoodT.S.HasselbringC.K.KinzerS.M.Williams (1990). Anchored instruction: Why we need it and how technology can help. In (Ed.), Cognition, education, and multimedia: Exploring ideas in high technology (pp. 115–141). New York, NY: Routledge.
8. J.S.BrownA.CollinsP.Duguid (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42. doi:10.3102/0013189X018001032
9. N.J.CepedaH.PashlerE.VulJ.T.WixtedD.Rohrer (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132, 354–380. doi:10.1037/0033-2909.132.3.354
10. R.E.Clark (1994). Media will never influence learning. Educational Technology Research & Development, 42, 21–29. doi:10.1007/BF02299088
11. M.D.Dickey (2006). Game design narrative for learning: Appropriating adventure game design narrative devices and techniques for the design of interactive learning environments. Educational Technology Research & Development, 54, 245–263. doi:10.1007/s11423-006-8806-y
12. E.Dieterle (2009). Neomillennial learning styles and River City. Children, Youth & Environments, 19, 245–278. Retrieved from http://www.jstor.org/action/showPublication?journalCode=chilyoutenvi
13. S.DuvalR.Tweedie (2000). A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. Journal of the American Statistical Association, 95, 89–98. doi:10.1080/01621459.2000.10473905
14. A.EcheverriaE.BarriosM.NussbaumM.AmesticaS.Leclerc (2012). The atomic intrinsic integration approach: A structured methodology for the design of games for the conceptual understanding of physics. Computers & Education, 59, 806–816. doi:10.1016/j.compedu.2012.03.025
15. M.EggerG.Davey SmithM.SchneiderC.Minder (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634. doi:10.1136/bmj.315.7109.629
16. Federation of American Scientists. (2006). Summit on educational games: Harnessing the power of video games for learning. Washington, DC: Author. Retrieved from http://informalscience.org/images/research/Summit_on_Educational_Games.pdf
17. J.FengI.SpenceJ.Pratt (2007). Playing an action video game reduces gender differences in spatial cognition. Psychological Science, 18, 850–855. doi:10.1111/j.1467-9280.2007.01990.x
18. J.P.Gee (2007). What video games have to teach us about learning and literacy (2nd ed.). New York, NY: Palgrave Macmillan.
19. C.GirardJ.EcalleA.Magnan (2013). Serious games as new educational tools: how effective are they? A meta-analysis of recent studies. Journal of Computer Assisted Learning, 29, 207–219. doi: 10.1111/j.1365-2729.2012.00489.x
20. L.J.GleserI.Olkin (2009). Stochastically dependent effect sizes. In (Eds.), The handbook of research synthesis and meta-analysis (pp. 357–376). New York, NY: Russell Sage Foundation.
21. C.S.GreenD.Bavelier (2006). Effect of action video games on the spatial distribution of visuospatial attention. Journal of Experimental Psychology, 32, 1465-1478. doi:10.1037/0096-1523.32.6.1465
22. C.S.GreenD.Bavelier (2007). Action-video-game experience alters the spatial resolution of vision. Psychological Science, 18, 88–94. doi:10.1111/j.1467-9280.2007.01853.x
23. M.P.J.HabgoodS.E.Ainsworth (2011). Motivating children to learn effectively: Exploring the value of intrinsic integration in educational games. Journal of the Learning Sciences, 20, 169–206. doi:10.1080/10508406.2010.508029
24. L.V.Hedges (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107–128. doi:10.3102/10769986006002107
25. L.V.Hedges (2007). Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32, 341–370. doi:10.3102/1076998606298043
26. L.V.HedgesE.C.Hedberg (2007). Intraclass correlations for planning group randomized experiments in rural education. Journal of Research in Rural Education, 22(10), 1–15.
27. L.V.HedgesE.TiptonM.C.Johnson (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65. doi:10.1002/jrsm.5
28. F.HeiderM.Simmel (1944). An experimental study of apparent behavior. American Journal of Psychology, 57, 243–259.
29. J.P.T.HigginsJ.J.DeeksD.G.Altman (2008). Special topics in statistics. In (Eds.), Cochrane handbook for systematic review of interventions (pp. 481-529). Hoboken, NJ: Wiley.
30. P.J.HinesB.R.JasnyJ.Mervis (2009). Adding a T to the three R’s. Science, 323, 53. doi:10.1126/science.323.5910.53a
31. M.A.HoneyM.Hilton (Eds.). (2010). Learning science through computer games and simulations. Washington, DC: National Academies Press.
32. P.JüniA.WitshciR.BlochM.Egger (1999). The hazards of scoring the quality of clinical trials for meta-analysis. Journal of the American Medical Association, 282, 1054–1060. doi:10.1001/jama.282.11.1054
33. Y.B.Kafai (1996). Learning design by making games: Children’s development of strategies in the creation of a complex computational artifact. In (Eds.), Constructionism in practice: Designing, thinking and learning in a digital world (pp. 71–96). Mahwah, NJ: Erlbaum.
34. Y.B.Kafai (2006). Playing and making games for learning: Instructionist and constructionist perspectives for game studies. Games and Culture, 1, 36–40. doi:10.1177/1555412005281767
35. Y.B.KafaiM.QuinteroD.Feldon (2010). Investigating the “‘Why’” in Whypox: Casual and systematic explorations of a virtual epidemic. Games and Culture, 5, 116–135. doi:10.1177/1555412009351265
36. F.Ke (2009). A qualitative meta-analysis of computer games as learning tools. In (Ed.), Handbook of Research on Effective Electronic Gaming in Education (pp. 1–32). New York: IGI Global.
37. D.J.Ketelhut (2007). The impact of student self-efficacy on scientific inquiry skills: An exploratory investigation in River City: A multi-user virtual environment. Journal of Science Education and Technology, 16, 99–111. doi:10.1007/s10956-006-9038-y
38. S.S.KillingsworthD.T.LevinM.M.Saylor (2011). Analyzing action for agents with varying cognitive capacities. Social Cognition, 29, 56–73.
39. E.KlopferH.ScheintaubW.HuangD.WendelR.Roque (2009). The simulation cycle: Combining games, simulations, engineering and science using StarLogo TNG. E-Learning and Digital Media, 6, 71–96. doi:10.2304/elea.2009.6.1.71
40. R.B.Kozma (1994). Will media influence learning? Reframing the debate. Educational Technology Research & Development, 42(2), 7–19. doi:10.1007/BF02299087
41. J.J.LeeJ.Hammer (2011). Gamification in education: What, how, why bother?Academic Exchange Quarterly, 15(2), 1–5.
42. C.Lim (2008). Global citizenship education, school curriculum and games: Learning Mathematics, English and Science as a global citizen. Computers & Education, 51, 1073–1093. doi:10.1016/j.compedu.2007.10.005
43. J.A.López-LópezW.Van den NoortgateE.E.Tanner-SmithS.J.WilsonM.W.Lipsey (2015). Assessing meta-regression models for examining moderator relationships with dependent effect sizes: A Monte Carlo simulation. Manuscript in preparation.
44. J.A.López-LópezW.ViechtbauerJ.Sánchez-MecaF.Marín-Martínez (2010, July). Comparing the performance of alternative statistical tests for moderators in mixed-effects meta-regression models. Paper presented at the 5th annual meeting of the Society for Research Synthesis Methodology, Cartagena, Spain.
45. N.MahajanA.L.Woodward (2009). Seven-month-old infants selectively reproduce the goals of animate but not inanimate agents. Infancy, 14, 667–679. doi:10.1080/15250000903265184
46. T.W.MaloneM.R.Lepper (1987). Making learning fun: A taxonomy of intrinsic motivations for learning. In (Eds.), Aptitude, learning, and instruction. Cognitive and affective process analyses (Vol. 3, pp. 223–253). Hillsdale, NJ: Lawrence Erlbaum.
47. M.Martinez-GarzaD.B.ClarkB.Nelson (2013). Digital games and the U.S. National Research Council’s science proficiency goals. Studies in Science Education, 49, 170–208. doi:10.1080/03057267.2013.839372
48. R.E.Mayer (2011). Multimedia learning and games. In (Eds.), Computer games and instruction (pp. 281–305). Charlotte, NC: Information Age.
49. M.A.McDanielC.L.FadlerH.Pashler (2013). Effects of spaced versus massed training in function learning. Journal of Experimental Psychology, 39, 1417–1432. doi:10.1037/a0032184
50. J.PellegrinoM.Hilton (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. Washington DC: National Academies Press.
51. P.R.Pintrich (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95, 667–686. doi:10.1037/0022-0663.95.4.667
52. S.W.Raudenbush (2009). Analyzing effect sizes: Random-effects models. In (Eds.), The handbook of research synthesis and meta-analysis (pp. 295–315). New York, NY: Russell Sage Foundation.
53. H.R.RothsteinA.J.SuttonM.Borenstein (2005). Publication bias in meta-analysis: Prevention, assessment and adjustments. Chichester, England: John Wiley.
54. D.H.Schunk (1991). Self-efficacy and academic motivation. Educational Psychologist, 26, 207–231. doi:10.1080/00461520.1991.9653133
55. D.L.Schwartz (1995). The emergence of abstract representations in dyad problem solving. Journal of the Learning Sciences, 4, 321–354. doi:10.1207/s15327809jls0403_3
56. L.Sheldon (2011). The multiplayer classroom: Designing coursework as a game. Boston, MA: Cengage.
57. S.SingerM.L.HiltonH.A.Schweingruber (2005). America’s lab report: Investigations in high school science. Washington, DC: National Academies Press.
58. T.Sitzmann. (2011). A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology, 64, 489–528. doi:10.1111/j.1744-6570.2011.01190.x
59. K.Squire (2011). Video games and learning: Teaching and participatory culture in the digital age. New York, NY: Teachers College Press.
60. K.D.SquireM.Jan (2007). Mad city mystery: Developing scientific argumentation skills with a place-based augmented reality game on handheld computers. Journal of Science Education and Technology, 16, 5–29. doi:10.1007/s10956-006-9037-z
61. K.D.SquireE.Klopfer (2007). Augmented reality simulations on handheld computers. Journal of the Learning Sciences, 16, 371–413. doi:10.1080/10508400701413435
62. D.SteinkuehlerS.Duncan (2008). Scientific habits of mind in virtual worlds. Journal of Science Education and Technology, 17, 530–543. doi:10.1007/s10956-008-9120-8
63. E.E.Tanner-SmithE.Tipton (2014). Robust variance estimation with dependent effect sizes: Practical considerations and a software tutorial in Stata and SPSS. Research Synthesis Methods, 5, 13–30. doi:10.1002/jrsm.1091
64. E.E.Tanner-SmithS.J.WilsonM.W.Lipsey (2013). The comparative effectiveness of outpatient treatment for adolescent substance abuse: A meta-analysis. Journal of Substance Abuse Treatment, 44, 145–158. doi:10.1016/j.jsat.2012.05.006
65. E.Tipton (2013). Robust variance estimation in meta-regression with binary dependent effects. Research Synthesis Methods, 4, 169–187. doi:10.1002/jrsm.1070
66. J.W.Tukey (1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
67. H.van der MeijE.AlbersH.Leemkuil (2011). Learning from games: Does collaboration help?British Journal of Educational Technology, 42, 655–664. doi:10.1111/j.1467-8535.2010.01067.x
68. J.J.VogelD.S.VogelJ.Cannon-BowersC.A.BowersK.MuseM.Wright (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34, 229–243.
69. S.J.WilsonE.E.Tanner-SmithM.W.LipseyK.Steinka-FryJ.Morrison (2011). Dropout prevention and intervention programs: Effects on school completion and dropout among school-aged children and youth. Campbell Systematic Reviews, 8. doi:10.4073/csr.2011.8
70. P.WoutersF.PaasJ.J.M.van Merriënboer (2008). How to optimize learning from animated models: A review of guidelines based on cognitive load. Review of Educational Research, 78, 645–675. doi:10.3102/0034654308320320
71. P.WoutersC.van NimwegenH.van OostendorpE.D.van der Spek (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105, 249–265. doi:10.1037/a0031311
72. M.F.YoungS.SlotaA.B.CutterG.JaletteG.MullinB.LaiM.. Yukhymenko (2012). Our princess is in another castle: A review of trends in serious gaming for education. Review of Educational Research, 82, 61–89. doi:10.3102/0034654312436980