The relative effectiveness of different active learning implementations in teaching elementary school students how to design simple experiments.

Journal of Educational Psychology

Volumn 112, Issue 8, 2020, Pages 1582-1596

  Martella, Amedee Marchand ^a   Klahr, David ^b   Li, Weiling ^a  

^a PURDUE UNIVERSITY   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

active learning; control of variables strategy; direct explicit instruction; inquiry based learning; science instruction

Indexed keywords

EID: 85077995478     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/edu0000449     Document Type: Article

References (57)

1. Adams, A. E. M., Garcia, J., & Traustadóttir, T. (2016). A quasi experiment to determine the effectiveness of a “partially flipped” versus “fully flipped” undergraduate class in genetics and evolution. CBE Life Sciences Education, 15, 1–9. http://dx.doi.org/10.1187/cbe.15-07-0157
2. Akinoğlu, O., & Tandoğan, R. O. (2007). The effects of problem-based active learning science education on students’ academic achievement, attitude and concept learning. Eurasia Journal of Mathematics, Science and Technology Education, 3, 71–81. http://dx.doi.org/10.12973/ejmste/75375
3. Alfieri, L., Brooks, P. J., Aldrich, N. J., & Tenenbaum, H. R. (2011). Does discovery-based instruction enhance learning? Journal of Educational Psychology, 103, 1–18. http://dx.doi.org/10.1037/a0021017
4. Archer, A. L., & Hughes, C. A. (2011). Explicit instruction: Effective and efficient teaching. New York, NY: Guilford Press.
5. Bonwell, C. C., & Eison, J. A. (1991). Active learning: Creating excitement in the classroom [Monograph]. Retrieved from http://files.eric.ed.gov/fulltext/ED336049.pdf
6. Brennan, R. L., & Prediger, D. J. (1981). Coefficient kappa: Some uses, misuses, and alternatives. Educational and Psychological Measurement, 41, 687–699. http://dx.doi.org/10.1177/001316448104100307
7. Browne, W. J., & Draper, D. (2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1, 473–514. http://dx.doi.org/10.1214/06-BA117
8. Case, R. (1974). Structures and structures: Some functional limitations on the course of cognitive growth. Cognitive Psychology, 6, 544–574. http://dx.doi.org/10.1016/0010-0285(74)90025-5
9. Cattaneo, H. (2017). Telling active learning pedagogies apart: From theory to practice. Journal of New Approaches in Educational Research, 6, 144–152. http://dx.doi.org/10.7821/naer.2017.7.237
10. Chen, Z., & Klahr, D. (1999). All other things being equal: Acquisition and transfer of the control of variables strategy. Child Development, 70, 1098–1120. http://dx.doi.org/10.1111/1467-8624.00081
11. Chen, Z., & Klahr, D. (2008). Remote transfer of scientific reasoning and problem-solving strategies in children. In R. V. Kail (Ed.), Advances in child development and behavior (Vol. 36, pp. 419–470). Amsterdam, the Netherlands: Elsevier.
12. Chi, M. T. H., Adams, J., Bogusch, E. B., Bruchok, C., Kang, S., Lancaster, M., … Yaghmourian, D. L. (2018). Translating the ICAP theory of cognitive engagement into practice. Cognitive Science, 42, 1777–1832. http://dx.doi.org/10.1111/cogs.12626
13. Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49, 219–243. http://dx.doi.org/10.1080/00461520.2014.965823
14. Clark, R. E., Kirschner, P. A., & Sweller, J. (2012). Putting students on the path to learning: The case for fully guided instruction. American Educator, 36, 6–11. Retrieved from https://www.aft.org/sites/default/files/periodicals/Clark.pdf
15. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. New York, NY: Routledge.
16. Davis, A., Goulding, M., & Suggate, J. (2017). Mathematical knowledge for primary teachers (5th ed.). New York, NY: Routledge. http://dx.doi.org/10.4324/9781315621128
17. Dean, D., Jr., & Kuhn, D. (2007). Direct instruction vs. discovery: The long view. Science Education, 91, 384–397. http://dx.doi.org/10.1002/sce.20194
18. Eddy, S. L., & Hogan, K. A. (2014). Getting under the hood: How and for whom does increasing course structure work? CBE Life Sciences Education, 13, 453–468. http://dx.doi.org/10.1187/cbe.14-03-0050
19. Eichler, J. F., & Peeples, J. (2016). Flipped classroom modules for large enrollment general chemistry courses: A low barrier approach to increase active learning and improve student grades. Chemistry Education Research and Practice, 17, 197–208. http://dx.doi.org/10.1039/C5RP00159E
20. Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences of the United States of America, 111, 8410–8415. http://dx.doi.org/10.1073/pnas.1319030111
21. Goldstein, H. (1987). Multilevel models in educational and social research. London, UK: Charles Griffin.
22. Gwet, K. L. (2008). Computing inter-rater reliability and its variance in the presence of high agreement. British Journal of Mathematical and Statistical Psychology, 61, 29–48. http://dx.doi.org/10.1348/000711006X126600
23. Herman, P., & Gomez, L. M. (2009). Taking guided learning theory to school. In S. Tobias & T. M. Duffy (Eds.), Constructivist instruction (pp. 62–81). New York, NY: Routledge.
24. Hmelo-Silver, C. E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42, 99–107. http://dx.doi.org/10.1080/00461520701263368
25. Hughes, C. A., Morris, J. R., Therrien, W. J., & Benson, S. K. (2017). Explicit instruction: Historical and contemporary contexts. Learning Disabilities Research & Practice, 32, 140–148. http://dx.doi.org/10.1111/ldrp.12142
26. Kapur, M. (2014). Productive failure in learning math. Cognitive Science, 38, 1008–1022. http://dx.doi.org/10.1111/cogs.12107
27. Kapur, M. (2015). Learning from productive failure. Learning: Research and Practice, 1, 51–65. http://dx.doi.org/10.1080/23735082.2015.1002195
28. Kapur, M. (2016). Examining productive failure, productive success, unproductive failure, and unproductive success in learning. Educational Psychologist, 51, 289–299. http://dx.doi.org/10.1080/00461520.2016.1155457
29. Kinoshita, T. J., Knight, D. B., & Gibbes, B. (2017). The positive influence of active learning in a lecture hall: An analysis of normalized gain scores in introductory environmental engineering. Innovations in Education and Teaching International, 54, 275–284. http://dx.doi.org/10.1080/14703297.2015.1114957
30. Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41, 75–86. http://dx.doi.org/10.1207/s15326985ep4102_1
31. Klahr, D. (2010). Coming up for air: But is it Oxygen or Phlogiston? A response to Taber's review of constructivist instruction: Success or failure? Education Review, 13, 1–6. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.1001.2756&rep=rep1&type=pdf
32. Klahr, D. (2013). What do we mean? On the importance of not abandoning scientific rigor when talking about science education. Proceedings of the National Academy of Sciences of the United States of America, 110, 14075–14080. http://dx.doi.org/10.1073/pnas.1212738110
33. Klahr, D., & Chen, Z. (2011). Finding one's place in transfer space. Child Development Perspectives, 5, 196–204. http://dx.doi.org/10.1111/j.1750-8606.2011.00171.x
34. Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effect of direct instruction and discovery learning. Psychological Science, 15, 661–667. http://dx.doi.org/10.1111/j.0956-7976.2004.00737.x
35. Kolb, A. Y., & Kolb, D. A. (2005). Learning styles and learning spaces: Enhancing experiential learning in higher education. Academy of Management Learning & Education, 4, 193–212. http://dx.doi.org/10.5465/amle.2005.17268566
36. Krippendorff, K. (2011). Computing Krippendorff's alpha-reliability. Retrieved from https://repository.upenn.edu/cgi/viewcontent.cgi?article=1043&context=asc_papers
37. Kuhn, D., Garcia-Mila, M., Zohar, A., Andersen, C., White, S. H., Klahr, D., & Carver, S. M. (1995). Strategies for knowledge acquisition. Monographs of the Society for Research in Child Development, 60, 1–160. http://dx.doi.org/10.2307/1166059
38. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. http://dx.doi.org/10.2307/2529310
39. Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 86, 681–718. http://dx.doi.org/10.3102/0034654315627366
40. Lin, X., & Lehman, J. D. (1999). Supporting learning of variable control in a computer-based biology environment: Effects of prompting college students to reflect on their own thinking. Journal of Research in Science Teaching, 36, 837–858. http://dx.doi.org/10.1002/(SICI)1098-2736(199909)36:7<837::AID-TEA6>3.0.CO;2-U
41. Lorch, R. F., Lorch, E. P., Calderhead, W. J., Dunlap, E. E., Hodell, E. C., & Freer, B. D. (2010). Learning the control of variable strategy in higher and lower achieving classrooms: Contributions of explicit instruction and experimentation. Journal of Educational Psychology, 102, 90–101. http://dx.doi.org/10.1037/a0017972
42. Maas, C. J., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86–92. http://dx.doi.org/10.1027/1614-2241.1.3.86
43. Marx, R. W., Blumenfeld, P. C., Krajcik, J. C., Fishman, B., Soloway, E., Geier, R., & Tal, R. T. (2004). Inquiry-based science in the middle grades: Assessment of learning in urban systemic reform. Journal of Research in Science Teaching, 41, 1063–1080. http://dx.doi.org/10.1002/tea.20039
44. Matlen, B. J., & Klahr, D. (2013). Sequential effects of high and low instructional guidance on children's acquisition of experimentation skills: Is it all in the timing? Instructional Science, 41, 621–634. http://dx.doi.org/10.1007/s11251-012-9248-z
45. McNeish, D., & Wentzel, K. R. (2017). Accommodating small sample sizes in three-level models when the third level is incidental. Multivariate Behavioral Research, 52, 200–215. http://dx.doi.org/10.1080/00273171.2016.1262236
46. Murray, D. M. (1998). Design and analysis of group randomized trials. New York, NY: Oxford University Press.
47. Rau, M. A., Kennedy, K., Oxtoby, L., Bollom, M., & Moore, J. W. (2017). Unpacking “active learning”: A combination of flipped classroom and collaboration support is more effective but collaboration support alone is not. Journal of Chemical Education, 94, 1406–1414. http://dx.doi.org/10.1021/acs.jchemed.7b00240
48. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage.
49. Rosenshine, B. (2008). Five meanings of direct instruction. Lincoln, IL: Center on Innovation & Improvement. Retrieved from http://www.centerii.org/search/Resources/FiveDirectInstruct.pdf
50. Schwartz, D. L., & Martin, T. (2004). Inventing to prepare for future learning: The hidden efficiency of encouraging original student production in statistics instruction. Cognition and Instruction, 22, 129–184. http://dx.doi.org/10.1207/s1532690xci2202_1
51. Schwichow, M., Croker, S., Zimmerman, C., Hoffler, T., & Hartig, H. (2016). Teaching the control-of-variables strategy: A meta-analysis. Developmental Review, 39, 37–63. http://dx.doi.org/10.1016/j.dr.2015.12.001
52. Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19, 321–325. http://dx.doi.org/10.1086/266577
53. Stockard, J., Wood, T. W., Coughlin, C., & Rasplica Khoury, C. (2018). The effectiveness of Direct Instruction curricula: A meta-analysis of a half century of research. Review of Educational Research, 88, 479–507. http://dx.doi.org/10.3102/0034654317751919
54. Taraban, R. T., Box, C., Myers, R., Pollard, R., & Bowen, C. W. (2007). Effects of active-learning experiences on achievement, attitudes, and behaviors in high school biology. Journal of Research in Science Teaching, 44, 960–979. http://dx.doi.org/10.1002/tea.20183
55. Webb, D. J. (2017). Concepts first: A course with improved educational outcomes and parity for underrepresented minority groups. American Journal of Physics, 85, 628–632. http://dx.doi.org/10.1119/1.4991371
56. What Works Clearinghouse. (2017). What Works Clearinghouse (WWC) standards handbook: Version 4.0. Retrieved from https://ies.ed.gov/ncee/wwc/Handbooks
57. Wieman, C. E. (2014). Large-scale comparison of science teaching methods sends clear message. Proceedings of the National Academy of Sciences of the United States of America, 111, 8319–8320. http://dx.doi.org/10.1073/pnas.1407304111