Effectiveness of Large-Scale, State-Sponsored Language and Literacy Professional Development on Early Childhood Educator Outcomes

Journal of Research on Educational Effectiveness

Volumn 10, Issue 2, 2017, Pages 354-378

  Piasta, Shayne B ^a   Justice, Laura M ^a   O'Connell, Ann A ^a   Mauck, Susan A ^a   Weber Mayrer, Melissa ^a   Schachter, Rachel E ^a   Farley, Kristin S ^a   Spear, Caitlin F ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

early childhood; effectiveness trial; language and literacy; professional development

Indexed keywords

EID: 85015714210     PISSN: 19345747     EISSN: 19345739     Source Type: Journal    
DOI: 10.1080/19345747.2016.1270378     Document Type: Article

References (81)

1. Arnold, D. H., Lonigan, C. J., Whitehurst, G. J., & Epstein, J. N., (1994). Accelerating language development through picture book reading:Replication and extension to a videotape training format. Journal of Educational Psychology, 86, 235–243.
2. Arthur, A. A., McCormick, C., & Bovaird, J., (2012). Psychometric properties of LARRC scales:Recommendations for the Family Background Questionnaire and Teacher Background Questionnaire. Lincoln, NE:Language and Reading Research Consortium.
3. Assel, M. A., Landry, S. H., Swank, P. R., & Gunnewig, S., (2007). An evaluation of curriculum, setting, and mentoring on the performance of children enrolled in pre-kindergarten. Reading and Writing, 20, 463–494.
4. Bandura, A., (1997). Self-efficacy:The exercise of control. New York, NY:W. H. Freeman.
5. Bean, R. M., Draper, J. A., Hall, V., Vandermolen, J., & Zigmond, N., (2010). Coaches and coaching in Reading First schools. The Elementary School Journal, 111, 87–114.
6. Beck, I., & McKeown, M., (2007). Increasing low-income children's oral vocabulary repertoires through rich and focused instruction. The Elementary School Journal, 107, 251–271.
7. Biemiller, A., & Boote, C., (2006). An effective method for building meaning vocabulary in primary grades. Journal of Educational Psychology, 98, 44–62.
8. Borko, H., (2004). Professional development and teacher learning:Mapping the terrain. Educational Researcher, 33, 3–15. doi:10.3102/0013189x033008003
9. Burchinal, M., Howes, C., Pianta, R., Bryant, D., Early, D., Clifford, R., & Barbarin, O., (2008). Predicting child outcomes at the end of kindergarten from the quality of pre-kindergarten teacher–child interactions and instruction. Applied Development Science, 12, 140–153.
10. Cabell, S. Q., DeCoster, J., LoCasale-Crouch, J., Hamre, B. K., & Pianta, R. C., (2013). Variation in the effectiveness of instructional interactions across preschool classroom settings and learning activities. Early Childhood Research Quarterly, 28, 820–830. doi:10.1016/j.ecresq.2013.07.007
11. Carlisle, J., & Berebitsky, D., (2011). Literacy coaching as a component of professional development. Reading and Writing, 24, 773–800. doi:10.1007/s11145-009-9224-4
12. Chen, H. T., (2010). The bottom-up approach to integrative validity:A new perspective for program evaluation. Evaluation and Program Planning, 33, 205–214.
13. Clifford, R. M., Barbarin, O., Chang, F., Early, D., Bryant, D., Howes, C., … Pianta, R., (2005). What is pre-kindergarten? Characteristics of public pre-kindergarten programs. Applied Developmental Science, 9, 126–143.
14. Cunningham, A. E., Etter, K., Platas, L., Wheeler, S., & Campbell, K., (2015). Professional development in emergent literacy:A design experiment of Teacher Study Groups. Early Childhood Research Quarterly, 31, 62–77. doi:10.1016/j.ecresq.2014.12.002
15. Cunningham, A. E., Zibulsky, J., & Callahan, M. D., (2009). Starting small:Building preschool teacher knowledge that supports early literacy development. Reading and Writing, 22, 287–510.
16. Desimone, L. M., (2009). Improving impact studies of teachers' professional development:Toward better conceptualizations and measures. Educational Researcher, 38, 181–199.
17. Desimone, L. M., Porter, A. C., Garet, M. S., Yoon, K. S., & Birman, B. F., (2002). Effects of professional development on teachers' instruction:Results from a three-year longitudinal study. Educational Evaluation and Policy Analysis, 24, 81–112.
18. Durlak, J. A., & DuPre, E. P., (2008). Implementation matters:A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. doi:10.1007/s10464-008-9165-0
19. Early, D. M., Maxwell, K. L., Burchinal, M., Alva, S., Bender, R. H., Bryant, D., … Griffin, J. A., (2007). Teachers' education, classroom quality, and young children's academic skills:Results from seven studies of preschool programs. Child Development, 78, 558–580.
20. Enders, C. K., (2010). Applied missing data analysis (2nd ed.). New York, NY:Guilford Press.
21. Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S., (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38, 915–945.
22. Goldschmidt, P., & Phelps, G., (2010). Does teacher professional development affect content and pedagogical knowledge:How much and for how long? Economics of Education Review, 29, 432–439.
23. Gottfredson, D., Cook, T., Gardner, F. M., Gorman-Smith, D., Howe, G., Sandler, I., & Zafft, K., (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science. Prevention Science, 16, 893–926. doi:10.1007/s11121-015-0555-x
24. Graham, J. W., (2012). Missing data:Analysis and design. New York, NY:Springer.
25. Hale-Jinks, C., & Knopf, H., (2006). Tackling teacher turnover in child care:Understanding causes and consequences, identifying solutions. Childhood Education, 82, 219–226.
26. Hamre, B. K., Hatfield, B., Pianta, R., & Jamil, F., (2014). Evidence for general and domain-specific elements of teacher–child interactions:Associations with preschool children's development. Child Development, 85, 1257–1274. doi:10.1111/cdev.12184
27. Hamre, B. K., Justice, L. M., Pianta, R. C., Kilday, C., Sweeney, B., Downer, J. T., & Leach, A., (2010). Implementation fidelity of MyTeachingPartner literacy and language activities:Association with preschoolers' language and literacy growth. Early Childhood Research Quarterly, 25, 329–347.
28. Hill, H. C., (2009). Fixing teacher professional development. Phi Delta Kappan, 90, 470–476. doi:10.1177/003172170909000705
29. Hindman, A. H., & Wasik, B. A., (2008). Head Start teachers' beliefs about language and literacy instruction. Early Childhood Research Quarterly, 23, 479–492.
30. Hindman, A. H., & Wasik, B. A., (2012). Unpacking an effective language and literacy coaching intervention in Head Start:Following teachers' learning over two years of training. The Elementary School Journal, 113, 131–154. doi:10.1086/666389
31. Horizon Research. (2002). The 2000 National Survey of Science and Mathematics Education:Compendium of tables. Chapel Hill, NC:Horizon Research.
32. Institute of Education Sciences. (2014, March). What Works Clearinghouse procedures and standards handbook (version 3.0). Retrieved from http://ies.ed.gov/ncee/wwc/Handbooks
33. Institute of Medicine and National Research Council. (2012). The early childhood care and education workforce:Challenges and opportunities:A workshop report. Washington, DC:The National Academies Press.
34. Jackson, B., Larzelere, R., St. Clair, L., Corr, M., Fichter, C., & Egertson, H., (2006). The impact of HeadsUp! Reading on early childhood educators' literacy practices and preschool children's literacy skills. Early Childhood Research Quarterly, 21, 213–226.
35. James-Burdumy, S., Deke, J., Gersten, R., Lugo-Gil, J., Newman-Gonchar, R., Dimino, J., … Liu, A. Y.-H., (2012). Effectiveness of four supplemental reading comprehension interventions. Journal of Research on Educational Effectiveness, 5, 345–383. doi:10.1080/19345747.2012.698374
36. Justice, L. M., Kaderavek, J. N., Fan, X., Sofka, A., & Hunt, A., (2009). Accelerating preschoolers' early literacy development through classroom-based teacher–child storybook reading and explicit print referencing. Language, Speech, and Hearing Services in Schools, 40, 67–85.
37. Justice, L. M., Mashburn, A. J., Hamre, B. K., & Pianta, R. C., (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23, 51–68. doi:10.1016/j.ecresq.2007.09.004
38. Kelcey, B., (2011). Assessing the effects of teachers' reading knowledge on students' achievement using multilevel propensity score stratification. Educational Evaluation and Policy Analysis, 33, 458–482.
39. Kennedy, M. M., (2010). Against boldness. Journal of Teacher Education, 61, 16–20.
40. Landry, S. H., Anthony, J. L., Swank, P. R., & Monseque-Bailey, P., (2009). Effectiveness of comprehensive professional development for teachers of at-risk preschoolers. Journal of Educational Psychology, 101, 448–465. doi:10.1037/a0013842
41. Landry, S. H., Swank, P., Anthony, J., & Assel, M., (2011). An experimental study evaluating professional development activities within a state funded pre-kindergarten program. Reading and Writing, 24, 971–1010. doi:10.1007/s11145-010-9243-1
42. Landry, S. H., Swank, P. R., Smith, K. E., Assel, M. A., & Gunnewig, S. B., (2006). Enhancing early literacy skills for preschool children:Bringing a professional development model to scale. Journal of Learning Disabilities, 39, 306–324.
43. LoCasale-Crouch, J., Konold, T., Pianta, R., Howes, C., Burchinal, M., Bryant, D., … Barbarin, O., (2007). Observed classroom quality profiles in state-funded pre-kindergarten programs and associations with teacher, program, and classroom characteristics. Early Childhood Research Quarterly, 22, 3–17.
44. Lonigan, C. J., Farver, J., Phillips, B., & Clancy-Menchetti, J., (2011). Promoting the development of preschool children's emergent literacy skills:A randomized evaluation of a literacy-focused curriculum and two professional development models. Reading and Writing, 24, 305–337. doi:10.1007/s11145-009-9214-6
45. Markussen-Brown, J., Juhl, C. B., Piasta, S. B., Bleses, D., Højen, A., & Justice, L. M., (2017). The effects of language- and literacy-focused professional development on early educators and children:A best-evidence meta-analysis. Early Childhood Research Quarterly, 38, 97–115. doi:10.1016/j.ecresq.2016.07.002
46. Mashburn, A. J., Downer, J. T., Hamre, B. K., Justice, L. M., & Pianta, R. C., (2010). Consultation for teachers and children's language and literacy development during pre-kindergarten. Applied Developmental Science, 14, 179–196.
47. Matsumura, L. C., Garnier, H. E., & Resnick, L. B., (2010). Implementing literacy coaching:The role of school social resources. Educational Evaluation and Policy Analysis, 32, 249–272.
48. McGinty, A. S., & Sofka, A. E., (2009). Classroom Literacy Observation Profile. Charlottesville, VA:University of Virginia.
49. Milburn, T. F., Hipfner-Boucher, K., Weitzman, E., Greenberg, J., Pelletier, J., & Girolametto, L., (2015). Effects of coaching on educators' and preschoolers' use of references to print and phonological awareness during a small-group craft/writing activity. Language, Speech, and Hearing Services in Schools, 46, 94–111.
50. Miller, P., & Votruba-Drzal, E., (2013). Early academic skills and childhood experiences across the urban–rural continuum. Early Childhood Research Quarterly, 28, 234–248.
51. Moats, L. C., (1994). The missing foundation in teacher education. Annals of Dyslexia, 44, 81–102.
52. National Early Literacy Panel. (2008). Developing early literacy. Washington, DC:National Institute for Literacy.
53. National Reading Panel. (2000). Report of the National Reading Panel:Teaching children to read. Washington, DC:National Institute of Child Health and Human Development.
54. Neuman, S. B., & Cunningham, L., (2009). The impact of professional development and coaching on early language and literacy instructional practices. American Educational Research Journal, 46, 532–566.
55. Neuman, S. B., & Wright, T. S. (2010). Promoting language and literacy development for early childhood educators:A mixed-methods study of coursework and coaching. The Elementary School Journal, 111, 63–86.
56. O'Connell, A., Logan, J., Pentimonti, J., & McCoach, B., (2013). Linear and quadratic growth models for continuous and dichotomous outcomes. In Y. Petscher & C. Schatschneider (Eds.), Applied quantitative analysis in the social sciences (pp. 125–168). New York, NY:Routledge.
57. Pelatti, C. Y., Piasta, S. B., Justice, L. M., & O'Connell, A. A., (2014). Language- and literacy-learning opportunities in early childhood classrooms:Children's typical experiences and within-classroom variability. Early Childhood Research Quarterly, 29, 445–456. doi:10.1016/j.ecresq.2014.05.004
58. Peterson, D. S., Taylor, B. M., Burnham, B., & Schock, R., (2009). Reflective coaching conversations:A missing piece. The Reading Teacher, 62, 500–509.
59. Pianta, R. C., Howes, C., Burchinal, M., Bryant, D., Clifford, R., Early, D., & Barbarin, O., (2005). Features of pre-kindergarten programs, classrooms, and teachers:Do they predict observed classroom quality and child-teacher interactions? Applied Developmental Science, 9, 144–159.
60. Pianta, R. C., La Paro, K. M., & Hamre, B. K., (2006). Classroom Assessment Scoring System:Pre-K. Charlottesville, VA:Center for Advanced Study of Teaching and Learning.
61. Pianta, R. C., Mashburn, A. J., Downer, J. T., Hamre, B. K., & Justice, L., (2008). Effects of web-mediated professional development resources on teacher–child interactions in pre-kindergarten classrooms. Early Childhood Research Quarterly, 23, 431–451.
62. Piasta, S. B., (2016). Current understandings of what works to support the development of emergent literacy in early childhood classrooms. Child Development Perspectives, 10, 234–239. doi:10.1111/cdep.12188
63. Piasta, S. B., Dynia, J. M., Justice, L. M., Pentimonti, J. M., Kaderavek, J. N., & Schatschneider, C., (2010). Impact of professional development on preschool teachers' print references during shared read alouds:A latent growth curve analysis. Journal of Research on Educational Effectiveness, 3, 343–380.
64. Piasta, S. B., Justice, L. M., Cabell, S. Q., Wiggins, A. K., Pence Turnbull, K., & Curenton, S. M. (2012). Impact of professional development on preschool teachers' conversational responsitivity and children's linguistic productivity and complexity. Early Childhood Research Quarterly, 27, 387–400. doi:10.1016/j.ecresq.2012.01.001
65. Powell, D. R., Diamond, K. E., Burchinal, M. R., & Koehler, M. J., (2010). Effects of an early literacy professional development intervention on Head Start teachers and children. Journal of Educational Psychology, 102, 299–312. doi:10.1037/a0017763
66. Rhodes, H., & Huston, A., (2012). Building the workforce our youngest children deserve. Social Policy Report (Vol. 26). Ann Arbor, MI:Society for Research in Child Development.
67. Rogers, R., (2014). Coaching literacy teachers as they design critical literacy practices. Reading & Writing Quarterly, 30, 241–261.
68. Ross, J., & Bruce, C., (2007). Professional development effects on teacher efficacy:Results of randomized field trial. The Journal of Educational Research, 101, 50–60.
69. Sailors, M., & Price, L., (2015). Support for the Improvement of Practices through Intensive Coaching (SIPIC):A model of coaching for improving reading instruction and reading achievement. Teaching and Teacher Education, 45, 115–127.
70. Sarama, J., Clements, D. H., Starkey, P., Klein, A., & Wakeley, A., (2008). Scaling up the implementation of a pre-kindergarten mathematics curriculum:Teaching for understanding with trajectories and technologies. Journal of Research on Educational Effectiveness, 1, 89–119.
71. Schachter, R. E., (2015). An analytic study of the professional development research in early childhood education. Early Education and Development, 26, 1057–1085. doi:10.1080/10409289.2015.1009335
72. Schachter, R. E., Spear, C. F., Piasta, S. B., Justice, L. M., & Logan, J. A. R., (2016). Early childhood educators' knowledge, beliefs, education, experiences, and children's language- and literacy-learning opportunities:What is the connection? Early Childhood Research Quarterly, 36, 281–294. doi:10.1016/j.ecresq.2016.01.008
73. Schachter, R. E., Weber-Mayrer, M. M., Piasta, S. B., & O'Connell, A. A., (2015). What do coaches and teachers talk about during coaching?:Coaches' reports of the content of coaching interactions. Manuscript submitted for publication.
74. Shadish, W. R., Cook, T. D., & Campbell, D. T., (2002). Experimental and quasi-experimental designs for generalized causal inference. New York, NY:Houghton Mifflin.
75. Sheridan, S. M., Edwards, C. P., Marvin, C. A., & Knoche, L. L., (2009). Professional development in early childhood programs:Process issues and research needs. Early Education and Development, 20, 377–401. doi:10.1080/10409280802582795
76. Wayne, A. J., Yoon, K. S., Zhu, P., Cronen, S., & Garet, M. S., (2008). Experimenting with teacher professional development:Motives and methods. Educational Researcher, 37, 469–479.
77. Weber-Mayrer, M. M., Piasta, S. B., Ottley, J. R., Justice, L. M., & O'Connell, A. A. (2016). Early childhood literacy coaching:An examination of coaching intensity and changes in educators' literacy knowledge and practice. Manuscript submitted for publication.
78. Weber-Mayrer, M. M., Piasta, S. B., & Pelatti, C. Y., (2015). State-sponsored professional development for early childhood educators:Who participates and associated implications for future offerings. Journal of Early Childhood Teacher Education, 36, 44–60.
79. Weiland, C., & Yoshikawa, H., (2013). Impacts of a prekindergarten program on children's mathematics, language, literacy, executive function, and emotional skills. Child Development, 84, 2112–2130. doi:10.1111/cdev.12099
80. Yoon, K. S., Duncan, T., Lee, S. W.-Y., Scarloss, B., & Shapley, K., (2007). Reviewing the evidence on how teacher professional development affects student achievement. Washington, DC:U.S. Department of Education, Institute of Education Sciences, Regional Educational Laboratory Southwest.
81. Yoshikawa, H., Leyva, D., Snow, C. E., Treviño, E., Barata, M. C., Weiland, C., … Arbour, M. C., (2015). Experimental impacts of a teacher professional development program in Chile on preschool classroom quality and child outcomes. Developmental Psychology, 51, 309–322. doi:10.1037/a0038785