Teachers’ formative assessment abilities and their relationship to student learning: findings from a four-year intervention study

Instructional Science

Volumn 44, Issue 3, 2016, Pages 267-291

  Furtak, Erin Marie ^a   Kiemer, Katharina ^b   Circi, Ruhan Kizil ^a   Swanson, Rebecca ^a   de León, Vanessa ^a   Morrison, Deb ^a   Heredia, Sara C ^c  

^a UNIVERSITY OF COLORADO   (United States)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c Exploratorium   (United States)

Author keywords

Biology education; Formative assessment; Professional development; Science teaching; Secondary science; Student achievement

Indexed keywords

EID: 84963733152     PISSN: 00204277     EISSN: 15731952     Source Type: Journal    
DOI: 10.1007/s11251-016-9371-3     Document Type: Article

References (84)

1. Alexander, R. J. (2008). Towards dialogic teaching: Rethinking classroom talk. New York: Dialogos.
2. Alonzo, A. C., & Gotwals, A. W. (Eds.). (2012). Learning progressions in science: Current challenges and future directions. New York: Springer Science & Business Media.
3. Alonzo, A. C., & Steedle, J. T. (2009). Developing and assessing a force and motion learning progression. Science Education, 93(3), 389–421.
4. Atkin, J. M., Coffey, J. E., Moorthy, S., Sato, M., & Thibeault, M. (2005). Designing everyday assessment in the science classroom. New York: Teachers College Press.
5. Ayala, C. C., Shavelson, R. J., Ruiz-Primo, M. A., Brandon, P., Yin, Y., Furtak, E. M., et al. (2008). From formal embedded assessments to reflective lessons: The development of formative assessment suites. Applied Measurement in Education, 21(4), 315–334.
6. Ball, D. L., & Cohen, D. K. (1999). Developing practice, developing practitioners: Toward a practice-based theory of professional education. San Francisco: Jossey Bass.
7. Bates, D., Maechler, M., & Bolker, B. (2012). lme4: Linear mixed-effects models using S4 classes. R package version 0.999999-0. Retrieved from http://CRAN.R-project.org/package=lme4.
8. Bell, B., & Cowie, B. (1999). Researching Formative Assessment. In J. Loughran (Ed.), Researching teaching: Methodologies and practices for understanding pedagogy (pp. 198–214). London: Falmer Press.
9. Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5–25. doi:10.1080/0969594X.2010.513678.
10. Bernstein, B. (2000). Pedagogy, symbolic control, and identity: Theory, research, critique. Lanham, MA: Rowman & Littlefield Publishers Inc.
11. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. doi:10.1080/0969595980050102.
12. Borko, H. (2004). Professional development and teacher learning: Mapping the terrain. Educational Researcher, 33(8), 3–15.
13. Borko, H., Jacobs, J., Eiteljorg, E., & Pittman, M. (2008). Video as a tool for fostering productive discussions in mathematics professional development. Teaching and Teacher Education, 24(2), 417–436. doi:10.1016/j.tate.2006.11.012.
14. Briggs, D., Alonzo, A., Schwab, C., & Wilson, M. (2006). Diagnostic assessment with ordered multiple-choice items. Educational Assessment, 11(1), 33–64.
15. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage Publications Inc.
16. Campbell, D. T., & Stanley, J. C. (1966). Experimental and Quasi-experimental designs for research. Chicago: Rand McNally.
17. Cazden, C. B. (2001). The language of teaching and learning. Portsmouth, NH: Heinemann.
18. Clarke, D., & Hollingsworth, H. (2002). Elaborating a model of teacher professional growth. Teaching and Teacher Education, 18(8), 947–967.
19. Coffey, J. E., Hammer, D., Levin, D. M., & Grant, T. (2011). The missing disciplinary substance of formative assessment. Journal of Research in Science Teaching, 48(10), 1109–1136. doi:10.1002/tea.20440.
20. Corcoran, T., Mosher, F. A., & Rogat, A. (2009). Learning progressions in science: An evidence-based approach to reform. Philadelphia, PA: Consortium for Policy Research in Education.
21. Cowie, B., & Bell, B. (1999). A model of formative assessment in science education. Assessment in Education: Principles, Policy & Practice, 6(1), 101–116.
22. Desimone, L. M. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Educational Researcher, 38(3), 181–199. doi:10.3102/0013189x08331140.
23. Dillon, J. T. (1985). Using questions to foil discussions. Teaching and Teacher Education, 2, 109–121. doi:10.1016/0742-051X(85)90010-1.
24. Duschl, R. A., & Gitomer, D. H. (1997). Strategies and challenges to changing the focus of assessment and instruction in science classrooms. Educational Assessment, 4(1), 37–73.
25. Duschl, R., Maeng, S., & Sezen, A. (2011). Learning progressions and teaching sequences: A review and analysis. Studies in Science Education, 47(2), 123–182.
26. Falk, A. (2012). Teachers learning from professional development in elementary science: Reciprocal relations between formative assessment and pedagogical content knowledge. Science Education, 96(2), 265–290. doi:10.1002/sce.20473.
27. Friedrichsen, P. M., & Dana, Th M. (2003). Using a card-sorting task to elicit and clarify science-teaching orientations. Journal of Science Teacher Education, 14(4), 291–309.
28. Furtak, E. M. (2009a). Formative assessment for secondary science teachers. Thousand Oaks, CA: Corwin Press.
29. Furtak, E. M. (2009). Toward learning progressions as teacher development tools. In A. C. Alonzo & A. W. Gotwals (Eds.), Learning Progressions in Science Conference. Retrieved from http://education.msu.edu/projects/leaps/proceedings/Default.html.
30. Furtak, E. M. (2011). ‘Flying Blind’: An exploration of beginning science teachers’ enactment of formative assessment practices. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
31. Furtak, E. M. (2012). Linking a learning progression for natural selection to teachers’ enactment of formative assessment. Journal of Research in Science Teaching, 49(9), 1181–1210.
32. Furtak, E. M., & Heredia, S. (2014). Exploring the influence of learning progressions in two teacher communities. Journal of Research in Science Teaching, 51(8), 982–1020.
33. Furtak, E. M., Morrison, D. L., & Kroog, H. (2014). Investigating the link between learning progressions and classroom assessment. Science Education, 98(4), 640–673.
34. Gröschner, A., Seidel, T., Kiemer, K., & Pehmer, A.-K. (2014). Through the lens of teacher professional development components: The “Dialogic Video Cycle” as an innovative program to foster classroom dialogue. Professional Development in Education, (September), 1–28.
35. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.
36. Heritage, M. (2008). Learning progressions: Supporting instruction and formative assessment. Washington, DC: Council of Chief State School Officers.
37. Heritage, M., Kim, J., Vendlinski, T., & Herman, J. (2009). From evidence to action: A seamless process in formative assessment? Educational Measurement: Issues and Practice, 28(3), 24–31.
38. Herppich, S., Wittwer, J., Nückles, M., & Renkl, A. (2014). Addressing knowledge deficits in tutoring and the role of teaching experience: Benefits for learning and summative assessment. Journal of Educational Psychology, 106, 934–945.
39. Jurik, V., Gröschner, A., & Seidel, T. (2013). How student characteristics affect girls’ and boys’ verbal engagement in physics instruction. Learning and Instruction, 23, 33–42. doi:10.1016/j.learninstruc.2012.09.002.
40. Kang, H., Thompson, J., & Windschitl, M. (2014). Creating opportunities for students to show what they know: The role of scaffolding in assessment tasks. Science Education, 98(4), 674–704.
41. Kiemer, K., Seidel, T., Gröschner, A., & Pehmer, A.-K. (2015). Effects of a productive classroom discourse intervention on students’ motivation to learn mathematics and science. Learning and Instruction, 35, 94–103. doi:10.1016/j.learninstruc.2014.10.003.
42. Kingston, N., & Nash, B. (2011). Formative assessment: A meta-analysis and a call for research. Educational Measurement: Issues and Practice, 30(4), 28–37.
43. Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254.
44. Kobarg, M., & Seidel, T. (2007). Prozessorientierte Lernbegleitung—Videoanalysen im Physikunterricht der Sekundarstufe I. Unterrichtswissenschaft, 35(2), 148–168.
45. Lee, V. (2000). Using hierarchical linear modeling to study social contexts: The case of school effects. Educational Psychologist, 35, 125–141.
46. Maas, C. J., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1(3), 86–92.
47. Mehan, H. (1979). Learning lessons. Cambridge, MA: Harvard University Press.
48. Mercer, N. (2010). The analysis of classroom talk: Methods and methodologies. British Journal of Educational Psychology, 80(1), 1–14. doi:10.1348/000709909x479853.
49. Michaels, S., O’Connor, C., & Resnick, L. B. (2008). Deliberative discourse idealized and realized: Accountable talk in the classroom and in civic life. Studies in Philosophy and Education, 27(4), 283–297. doi:10.1007/s11217-007-9071-1.
50. National Research Council. (2001a). Classroom assessment and the national science education standards. Washington, DC: National Academy Press.
51. National Research Council. (2001b). Inquiry and the national science education standards. Washington, D.C.: National Academy Press.
52. National Research Council. (2007). Taking science to school: Learning and teaching science in grades K-8. Washington, DC: National Academies Press.
53. NGSS Lead States. (2013). Next generation science standards: For states, by states. Washington, DC: National Academies Press.
54. Oliveira, A. W. (2010). Improving teacher questioning in science inquiry discussions through professional development. Journal of Research in Science Teaching, 47(4), 422–453. doi:10.1002/tea.20345.
55. Otero, V. K., & Nathan, M. J. (2008). Preservice elementary teachers’ views of their students’ prior knowledge of science. Journal of Research in Science Teaching, 45(4), 497–523.
56. Palmer, D. J., Stough, L. M., Burdenski, T. K, Jr, & Gonzales, M. (2005). Identifying teacher expertise: An examination of researchers’ decision making. Educational Psychologist, 40(1), 13–25.
57. Penuel, W. R., Fishman, B. J., Cheng, B. H., & Sabelli, N. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40(7), 331–337.
58. R Core Team (2012). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. Retrieved from http://www.R-project.org/.
59. Reznitskaya, A. (2012). Dialogic teaching: Rethinking language use during literature discussions. The Reading Teacher, 65(7), 446–456. doi:10.1002/TRTR.01066.
60. Rimmele, R. (2015). Videograph, version 4.2.1.26X3. Leibniz Institute for Science Education, Kiel, Germany.
61. Ruiz-Primo, M. A., Shavelson, R. J., Li, M., & Schultz, S. E. (2001). On the validity of cognitive interpretations of scores from alternative concept-mapping techniques. Educational Assessment, 7, 99–141.
62. Ruiz-Primo, M. A., & Furtak, E. M. (2006). Informal formative assessment and scientific inquiry: Exploring teachers’ practices and student learning. Educational Assessment, 11(3 & 4), 237–263.
63. Ruiz-Primo, M. A., & Furtak, E. M. (2007). Exploring teachers’ informal formative assessment practices and students’ understanding in the context of scientific inquiry. Journal of Research in Science Teaching, 44(1), 57–84.
64. Scott, P., Mortimer, E. F., & Aguiar, O. G. (2006). The tension between authoritative and dialogic discourse: A fundamental characteristic of meaning making interactions in high school science lessons. Science Education, 90(4), 605–631.
65. Schoppek, W. (2015). Mehrebenenanalyse oder Varianzanalyse? Ein simulationsbasierter Vergleich von Verfahren zur Auswertung pädagogisch-psychologischer Experimente. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 47, 199–209.
66. Seidel, T., & Prenzel, M. (2006). Stability of teaching patterns in physics instruction: Findings from a video study. Learning and Instruction, 16(3), 228–240.
67. Seidel, T., Prenzel, M., Rimmele, R., Herweg, C., Kobarg, M., Schwindt, K., et al. (2007). Science teaching and learning in german physics classrooms—findings from the IPN-video study. In M. Prenzel (Ed.), Studies on the educational quality of schools. The final report on the DFG priority programme (pp. 79–99). Münster: Waxmann.
68. Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher, 29(7), 4–14. doi:10.2307/1176145.
69. Sherin, M. G. (2004). New perspectives on the role of video in teacher education. Advances in Research on Teaching, 10, 1–28.
70. Sherin, M. G., & Han, S. Y. (2002). Teacher learning in the context of a video club. Teaching and Teacher Education, 20, 163–183.
71. Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2), 4–14.
72. Smith, J. I., Combs, E. D., Nagami, P. H., Alto, V. M., Goh, H. G., Gourdet, M. A. A., et al. (2013). Development of the biology card sorting task to measure conceptual expertise in biology. CBE—Life Sciences in Education, 12, 628–644.
73. Smith, J. P., DiSessa, A. A., & Roschelle, J. (1993). Misconceptions reconceived: A Constructivist analysis of knowledge in transition. The Journal of the Learning Sciences, 3(2), 115–163.
74. Smith, H., & Higgins, S. (2006). Opening classroom interaction: The importance of feedback. Cambridge Journal of Education, 36(4), 485–502.
75. Snijders, T., & Bosker, R. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Thousand Oaks, CA: Sage.
76. Thompson, J., Windschitl, M., & Braaten, M. (2013). Developing a theory of ambitious early-career teacher practice. American Educational Research Journal, 50(3), 574–615. doi:10.3102/0002831213476334.
77. van Driel, J. H., Verloop, N., & de Vos, W. (1998). Developing science teachers’ pedagogical content knowledge. Journal of Research in Science Teaching, 35(6), 673–695.
78. Van Veen, K., Zwart, R., & Meirink, J. (2012). What makes teacher professional development effective? A literature review. Teacher Learning that Matters: International Perspectives, 3–21.
79. Whitcomb, J. A. (2013). Learning and pedagogy in initial teacher preparation. In I. B. Weiner (Ed.), Handbook of psychology (2nd ed., pp. 441–463). New York: Wiley.
80. White, R., & Gunstone, R. (1992). Probing understanding. New York: Routledge.
81. Wiliam, D. (2007). Changing classroom practice. Educational Leadership, 65(4), 36.
82. Wiliam, D., Lee, C., Harrison, C., & Black, P. (2004). Teachers developing assessment for learning: Impact on student achievement. Assessment in Education: Principles, Policy & Practice, 11(1), 49–65. doi:10.1080/0969594042000208994.
83. Wilson, S. M. (2013). Professional development for science teachers. Science, 340, 310–313. doi:10.1126/science.1230725.
84. Yin, Y., Shavelson, R. J., Ayala, C. C., Ruiz-Primo, M. A., Brandon, P., Furtak, E. M., et al. (2008). On the impact of formative assessment on student motivation, achievement, and conceptual change. Applied Measurement in Education, 21(4), 335–359.