Longitudinal Evaluation of a Scale-Up Model for Teaching Mathematics With Trajectories and Technologies: Persistence of Effects in the Third Year

American Educational Research Journal

Volumn 50, Issue 4, 2013, Pages 812-850

  Clements, Douglas H ^a   Sarama, Julie ^a   Wolfe, Christopher B ^b   Spitler, Mary Elaine ^c  

^a UNIVERSITY OF DENVER   (United States)

^b INDIANA UNIVERSITY KOKOMO   (United States)

^c UNIVERSITY AT BUFFALO   (United States)

Author keywords

at risk students; classroom research; computers and learning; early childhood; learning trajectories; mathematics; primary; scale up; technology

Indexed keywords

EID: 84880627091     PISSN: 00028312     EISSN: None     Source Type: Journal    
DOI: 10.3102/0002831212469270     Document Type: Article

References (135)

1. Agodini R.,Harris B.An experimental evaluation of four early elementary school math curricula.Journal of Research on Educational Effectiveness. 2010;3:199-253.
2. Akiba M.,LeTendre G. K.,Scribner J. P.Teacher quality, opportunity gap, and national achievement in 46 countries.Educational Researcher. 2007;36:369-387.
3. Aunola K.,Leskinen E.,Lerkkanen M.-K.,Nurmi J.-E.Developmental dynamics of math performance from pre-school to grade 2.Journal of Educational Psychology. 2004;96:699-713.
4. Baker E. L.Scale up in education, Volume I: Ideas in principle. Schneider B.McDonald S.-K., ed. Lanham, MD: Rowman & Littlefield; 2007:37-54.
5. Ball D. L.,Cohen D. K.Instruction, capacity, and improvement. Philadelphia, PA: Consortium for Policy Research in Education, University of Pennsylvania; 1999:.
6. Ballou D.,Sanders W. L.,Wright P.Controlling for student background in value-added assessment of teachers.Journal of Educational and Behavioral Statistics. 2004;29 (1): 37-65.
7. Bennett N.,Desforges C.,Cockburn A.,Wilkinson B.The quality of pupil learning experiences. Hillsdale, NJ: Erlbaum; 1984:.
8. Borman G. D.Scale up in education, Volume II: Issues in practice. Schneider B.McDonald S.-K., ed. Lanham, MD: Rowman & Littlefield; 2007:41-67.
9. Bredekamp S.Engaging young children in mathematics: Standards for early childhood mathematics education. Clements D. H.Sarama J.DiBiase A.-M., ed. Mahwah, NJ: Erlbaum; 2004:77-82.
10. Bright G. W.,Bowman A. H.,Vacc N. N.Teachers' frameworks for understanding children's mathematical thinking. Proceedings of the 21st Conference of the International Group for the Psychology of Mathematics Education; 1997; 1997. 105.
11. Broberg A. G.,Wessels H.,Lamb M. E.,Hwang C. P.Effects of day care on the development of cognitive abilities in 8-year-olds: A longitudinal study.Developmental Psychology. 1997;33:62-69.
12. Brooks-Gunn J.Do you believe in magic? What we can expect from early childhood intervention programs.Social Policy Report. 2003;171 (1): 3-14.
13. Carneiro P.,Heckman J. J.Inequality in America: What role for human capital policies?. Krueger A. B.Heckman J. J., ed. Cambridge, MA: MIT Press; 2003:77-239.
14. Carpenter T. P.,Fennema E. H.,Peterson P. L.,Carey D. A.Teacher's pedagogical content knowledge of students' problem solving in elementary arithmetic.Journal for Research in Mathematics Education. 1988;19:385-401.
15. Carpenter T. P.,Franke M. L.Expanding the reach of education reforms: Perspectives from leaders in the scale-up of educational interventions. Glennan T. K.Bodilly S. J.Galegher J. R.Kerr K. A., ed. Santa Monica, CA: RAND Corporation; 2004:41-80.
16. Carpenter T. P.,Moser J. M.The acquisition of addition and subtraction concepts in grades one through three.Journal for Research in Mathematics Education. 1984;15:179-202.
17. Carr M.,Steiner H. H.,Kyser B.,Biddlecomb B.A comparison of predictors of early emerging gender differences in mathematics competence.Learning and Individual Differences. 2008;18:61-75.
18. Case R.,Griffin S.,Kelly W. M.Developmental health and the wealth of nations. Keating D. P.Hertzman C., ed. New York, NY: Guilford; 1999:125-149.
19. CCSSO/NGA. (2010). Common core state standards for mathematics. Washington, DC: Council of Chief State School Officers and the National Governors Association Center for Best Practices. Retrieved from http://corestandards.org/.
20. Celedón-Pattichis S.,Musanti S. I.,Marshall M. E.Mathematics teaching & learning in K-12: Equity and professional development. Foote M. Q., ed. New York, NY: Palgrave Macmillan; 2010:7-24.
21. Cicchetti D.Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology.Psychological Assessment. 1994;6 (4): 284-290.
22. Clarke D. M.,Cheeseman J.,Gervasoni A.,Gronn D.,Horne M.,McDonough A., Rowley G.Early Numeracy Research Project final report. Melbourne, Australia: Department of Education, Employment and Training, the Catholic Education Office (Melbourne), and the Association of Independent Schools Victoria; 2002:.
23. Clarke D. M.,Clarke B. A.Perspectives on the teaching of mathematics (66th yearbook). Rubenstein R. N.Bright G. W., ed. Reston, VA: National Council of Teachers of Mathematics; 2004:67-81.
24. Clements D. H.,Sarama J.Building Blocks for early childhood mathematics.Early Childhood Research Quarterly. 2004a;19:181-189.
25. Mathematical Thinking and Learning. Clements D. H.Sarama J., ed. 2004b:.
26. Clements D. H.,Sarama J.Second handbook of research on mathematics teaching and learning. Lester F. K., ed. New York, NY: Information Age Publishing; 2007a:461-555.
27. Clements D. H.,Sarama J.Effects of a preschool mathematics curriculum: Summative research on the Building Blocks project.Journal for Research in Mathematics Education. 2007b;38:136-163.
28. Clements D. H.,Sarama J.Experimental evaluation of the effects of a research-based preschool mathematics curriculum.American Educational Research Journal. 2008a;45:443-494.
29. Clements D. H.,Sarama J. Paper presented at the American Educational Research Association; 2008bNew York, NY; 2008b.
30. Clements D. H.,Sarama J.Learning and teaching early math: The learning trajectories approach. New York, NY: Routledge; 2009:.
31. Clements D. H.,Sarama J.Early childhood mathematics intervention.Science. 2011;333 (6045): 968-970.
32. Clements D. H.,Sarama J.Columbus, OH: SRA/McGraw-Hill; 2012:.
33. Clements D. H.,Sarama J.,DiBiase A.-M.Preschool and kindergarten mathematics: A national conference.; 2003; 2003. 510.
34. Clements D. H.,Sarama J.,Liu X.Development of a measure of early mathematics achievement using the Rasch model: The Research-based Early Maths Assessment.Educational Psychology. 2008;28 (4): 457-482.
35. Clements D. H.,Sarama J.,Spitler M. E.,Lange A. A.,Wolfe C. B.Mathematics learned by young children in an intervention based on learning trajectories: A large-scale cluster randomized trial.Journal for Research in Mathematics Education. 2011;42 (2): 127-166.
36. Cohen D. K.Rewards and reforms: Creating educational incentives that work. Fuhrman S. H.O'Day J. A., ed. San Francisco, CA: Jossey Bass; 1996:61-112.
37. Cooper H.,Allen A. B.,Patall E. A.,Dent A. L.Effects of full-day kindergarten on academic achievement and social development.Review of Educational Research. 2010;80 (1): 34-70.
38. Powerful reforms with shallow roots: Improving America's urban schools. Cuban L.Usdan M., ed. New York, NY: Teachers College; 2003:.
39. Currie J.,Thomas D.Does Head Start make a difference?.American Economic Review. 1995;85:341-364.
40. Currie J.,Thomas D.School quality and the longer-term effects of Head Start.Journal of Human Resources. 2000;35 (4): 755-774.
41. Darling-Hammond L.The right to learn: A blueprint for creating schools that work. San Francisco, CA: Jossey-Bass; 1997:.
42. Darling-Hammond L.Securing the right to learn: Policy and practice for powerful teaching and learning.Educational Researcher. 2006;35 (7): 13-24.
43. DentonK.WestJ. (2002). Children's reading and mathematics achievement in kindergarten and first grade. Washington, DC: U.S. Department of Education, National Center for Education Statistics. Retrieved from http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2002125.
44. Duncan G. J.,Claessens A.,Engel M.The contributions of hard skills and socio-emotional behavior to school readiness. Evanston, IL: Northwestern University; 2004:.
45. Duncan G. J.,Magnuson K.Whither opportunity? Rising inequality and the uncertain life chances of low-income children. Duncan G. J.Magnuson K., ed. New York, NY: Russell Sage Press; 2011:.
46. Enders C.,Tofighi D.Centering predictor variables in cross-sectional multilevel models: A new look at an old issue.Psychological Methods. 2007;12:121-138.
47. Engel M.,Claessens A.,Finch M.Teaching students what they already know? The misalignment between mathematics instructional content and student knowledge in kindergarten.Educational Evaluation and Policy Analysis.
48. Fairchild A. J.,MacKinnon D. P.,Taborga M. P.,Taylor A. B.R2 effect-size measure of mediation analysis.Behavioral Research Methods. 2009;41:486-498.
49. Fennema E. H.,Carpenter T. P.,Franke M. L.,Levi L.A longitudinal study of gender differences in young children's mathematical thinking.Educational Researcher. 1998;27:6-11.
50. FishR. (2003). Effects of attending prekindergarten on academic achievement (Unpublished master's thesis). University of Buffalo, State University of New York, Buffalo, NY.
51. Fixsen D. L.,Blase K. A.,Naoom S. F.,Wallace F.Core implementation components.Research on Social Work Practice. 2009;19 (5): 531-540.
52. Fixsen D. L.,Naoom S. F.,Blase K. A.,Friedman R. M.,Wallace F.Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, the National Implementation Research Network; 2005:.
53. Fraivillig J. L.,Murphy L. A.,Fuson K. C.Advancing children's mathematical thinking in Everyday Mathematics classrooms.Journal for Research in Mathematics Education. 1999;30:148-170.
54. Fullan M. G.Successful school improvement. Philadelphia, PA: Open University Press; 1992:.
55. Garces E.,Currie J.,Thomas D.Longer term effects of Head Start.American Economic Review. 2002;92 (4): 999-1012.
56. Gray S. W.,Ramsey B. K.,Klaus R. A.As the twig is bent. Lasting effects of preschool programs. Mahwah, NJ: Erlbaum; 1983:33-69.
57. Griffin S.,Case R.Re-thinking the primary school math curriculum: An approach based on cognitive science.Issues in Education. 1997;3:1-49.
58. Griffin S.,Case R.,Siegler R. S.Classroom lessons: Integrating cognitive theory and classroom practice. McGilly K., ed. Cambridge, MA: MIT Press; 1994:25-49.
59. Hall G. E.,Hord S. M.Implementing change: Patterns, principles, and potholes. Boston, MA: Allyn and Bacon; 2001:.
60. HeckD. J.WeissI. R.BoydS.HowardM. (2002). Lessons learned about planning and implementing statewide systemic initiatives in mathematics and science education. Retrieved from http://www.horizon-research.com/presentations/2002/ssi_aera2002.pdf.
61. Hedges L. V.,Hedberg E. C.Intraclass correlation values for planning group randomized trials in education.Educational Evaluation and Policy Analysis. 2007;1:60-87.
62. Hiebert J. C.Relationships between research and the NCTM Standards.Journal for Research in Mathematics Education. 1999;30:3-19.
63. Huberman M.Successful school improvement. Fullan M. G., ed. Philadelphia, PA: Open University Press; 1992:1-20.
64. Investigations in number, data, and space. 2nd ed.). (2008). Upper Saddle River, NJ: Pearson Scott Foresman.Upper Saddle River, NJ: Pearson Scott Foresman; 2008:.
65. Jackson K. Paper presented at the American Educational Research Association; 2011New Orleans, LA; 2011.
66. Jackson K.,Wilson J.Supporting African American students' learning of mathematics: A problem of practice.Urban Education. 2012;:.
67. Jacobs V. R.,Franke M. L.,Carpenter T. P.,Levi L.,Battey D.Professional development focused on children's algebraic reasoning in elementary school.Journal for Research in Mathematics Education. 2001;38:258-288.
68. Jordan H.,Mendro R.,Weerasinghe D. Paper presented at the National Evaluation Institute; 1997Indianapolis, IN; 1997.
69. Kaser J. S.,Bourexis P. S.,Loucks-Horsley S.,Raizen S. A.Enhancing program quality in science and mathematics. Thousand Oaks, CA: Corwin Press; 1999:.
70. Kilday C. R.,Kinzie M. B.An analysis of instruments that measure the quality of mathematics teaching in early childhood.Early Childhood Education Journal. 2009;36:365-372.
71. Kirk R. E.Experimental design: Procedures for the social scientist. Belmont, CA: Wadsworth; 1982:.
72. Klein A.,Starkey P.,Clements D. H.,Sarama J.,Iyer R.Effects of a pre-kindergarten mathematics intervention: A randomized experiment.Journal of Research on Educational Effectiveness. 2008;1:155-178.
73. Klein A.,Starkey P.,Wakeley A.Child Math Assessment: Preschool Battery (CMA). Berkeley, CA: University of California, Berkeley; 2000:.
74. Klingner J. K.,Ahwee S.,Pilonieta P.,Menendez R.Barriers and facilitators in scaling up research-based practices.Exceptional Children. 2003;69:411-429.
75. Ladson-Billings G.It doesn't add up: African American students' mathematics achievement.Journal for Research in Mathematics Education. 1997;28 (6): 697-708.
76. Lawless K. A.,Pellegrino J. W.Professional development in integrating technology into teaching and learning knowns, unknowns, and ways to pursue better questions and answers.Review of Educational Research. 2007;77 (4): 575-614.
77. Leak J.,Duncan G. J.,Li W.,Magnuson K.,Schindler H.,Yoshikawa H.Is timing everything? How early childhood education program cognitive and achievement impacts vary by starting age, program duration and time since the end of the program. Irvine, CA: University of California, Irvine Department of Education; 2012:.
78. MacKinnon D. P.,Fritz M. S.,Williams J.,Lockwood C. M.Distribution of the product confidence limits for the indirect effect: Program PRODCLIN.Behavior Research Methods. 2007;39 (3): 384-389.
79. MacKinnon D. P.,Lockwood C. M.,Williams J.Confidence limits for the indirect effect: Distribution of the product and resampling methods.Multivariate Behavioral Research. 2004;39:99-128.
80. Magnuson K. A.,Waldfogel J.Early childhood care and education: Effects on ethnic and racial gaps in school readiness.The Future of Children. 2005;15:169-196.
81. Martens R.,Hurks P. P. M.,Meijs C.,Wassenberg R.,Jolles J.Sex differences in arithmetical performance scores: Central tendency and variability.Learning and Individual Differences. 2011;21:549-554.
82. Martin D. B.Beyond missionaries or cannibals: Who should teach mathematics to African American children?.The High School Journal. 2007;91 (1): 6-28.
83. McDonald S.-K.,Keesler V. A.,Kauffman N. J.,Schneider B.Scaling-up exemplary interventions.Educational Researcher. 2006;35 (3): 15-24.
84. McLoyd V. C.Socioeconomic disadvantage and child development.American Psychologist. 1998;53:185-204.
85. Montie J. E.,Xiang Z.,Schweinhart L. J.Preschool experience in 10 countries: Cognitive and language performance at age 7.Early Childhood Research Quarterly. 2006;21:313-331.
86. Foundations for success: The final report of the National Mathematics Advisory Panel. Washington, DC: U.S. Department of Education, Office of Planning, Evaluation and Policy Development; 2008:.
87. Eager to learn: Educating our preschoolers. Washington, DC: National Academy Press; 2001:.
88. Taking science to school: Learning and teaching science in grades K-8. Washington, DC: National Academy Press; 2007:.
89. Mathematics in early childhood: Learning paths toward excellence and equity. Washington, DC: National Academy Press; 2009:.
90. Natriello G.,McDill E. L.,Pallas A. M.Schooling disadvantaged children: Racing against catastrophe. New York, NY: Teachers College Press; 1990:.
91. Pallas A. M.,Alexander K. L.,Entwisle D. R.,Thompson M.School performance, status relations, and the structure of sentiment: Bringing the teacher back.American Sociological Review. 1987;52:665-682.
92. Paris S. G.,Morrison F. J.,Miller K. F.Handbook of research in educational psychology. Alexander P.Winne P., ed. Mahwah, NJ: Erlbaum; 2006:61-85.
93. Pellegrino J. W.Scale up in practice. Schneider B.McDonald S.-K., ed. Lanham, MD: Rowan & Littlefield; 2007:131-139.
94. Pituch K. A.,Murphy D. L.,Tate R. L.Three-level models for indirect effect in school and class randomized experiments in education.The Journal of Experimental Education. 2010;78:60-95.
95. Pituch K. A.,Stapleton L. M.,Kang J.A comparison of single sample and bootstrap methods to assess mediation in cluster randomized trials.Multivariate Behavioral Research. 2006;41:367-400.
96. Preacher K. J.,Curran P. J.,Bauer D. J.Computational tools for probing interaction effects in multiple linear regression, multilevel modeling, and latent curve analysis.Journal of Educational and Behavioral Statistics. 2006;31:437-448.
97. Preacher K. J.,Hayes A. F.Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models.Behavior Research Methods. 2008;40:879-889.
98. Preschool Curriculum Evaluation Research Consortium. (2008). Effects of preschool curriculum programs on school readiness (NCER 2008-2009). Washington, DC: Government Printing Office. Retrieved from http://ncer.ed.gov.
99. Ramey C. T.,Ramey S. L.Early intervention and early experience.American Psychologist. 1998;53:109-120.
100. Raudenbush S. W.Scale up in education, Volume II: Issues in practice. Schneider B.McDonald S.-K., ed. Lanham, MD: Rowman & Littlefield; 2007:23-40.
101. Raudenbush S. W.Advancing educational policy by advancing research on instruction.American Educational Research Journal. 2008;45:206-230.
102. Raudenbush S. W.Brown Educational Researcher. legacy and the O'Connor challenge: Transforming schools in the images of children's potential; 2009:169-180.
103. Raudenbush S. W.,Bryk A. S.,Cheong Y. F.,Congdon R.HLM: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International; 2006:.
104. Rist R.Student social class and teacher expectations: The self-fulfilling prophecy in ghetto education.Harvard Educational Review. 1970;40 (3): 411-451.
105. Royer J. M.,Tronsky L. N.,Jackson S. J.,Horace Marchant I.Math-fact retrieval as the cognitive mechanism underlying gender differences in math test performance.Contemporary Educational Psychology. 1999;24:181-266.
106. Sanders W. L.,Horn S. P.Journal of Personnel Evaluation in Education. database: Implications for educational evaluation and research; 1998:247-256.
107. Sanders W. L.,Rivers J. C.Cumulative and residual effects of teachers on future student academic achievement. Knoxville, TN: University of Tennessee Value-Added Research and Assessment Center; 1996:.
108. Sarama J.,Clements D. H.Early childhood mathematics education research: Learning trajectories for young children. New York, NY: Routledge; 2009:.
109. Sarama J.,Clements D. H.,Henry J. J.Network of influences in an implementation of a mathematics curriculum innovation.International Journal of Computers for Mathematical Learning. 1998;3:113-148.
110. Sarama J.,Clements D. H.,Starkey P.,Klein A.,Wakeley A.Scaling up the implementation of a pre-kindergarten mathematics curriculum: Teaching for understanding with trajectories and technologies.Journal of Research on Educational Effectiveness. 2008;1:89-119.
111. Sarama J.,Clements D. H.,Wolfe C. B.,Spitler M. E.Longitudinal evaluation of a scale-up model for teaching mathematics with trajectories and technologies.Journal of Research on Educational Effectiveness. 2012;5 (2): 105-135.
112. Sarama J.,DiBiase A.-M.Engaging young children in mathematics: Standards for early childhood mathematics education. Clements D. H.Sarama J.DiBiase A.-M., ed. Mahwah, NJ: Erlbaum; 2004:415-446.
113. Sarama J.,Lange A.,Clements D. H.,Wolfe C. B.The impacts of an early mathematics curriculum on emerging literacy and language.Early Childhood Research Quarterly. 2012;27:489-502.
114. Sawada D.,Piburn M. D.,Judson E.,Turley J.,Falconer K.,Benford R.,Bloom I.Measuring reform practices in science and mathematics classrooms: The reformed teaching observation protocol.School Science and Mathematics. 2002;102:245-253.
115. Schoen H. L.,Cebulla K. J.,Finn K. F.,Fi C.Teacher variables that relate to student achievement when using a standards-based curriculum.Journal for Research in Mathematics Education. 2003;34 (3): 228-259.
116. Showers B.,Joyce B.,Bennett B.Synthesis of research on staff development: A framework for future study and a state-of-the-art analysis.Educational Leadership. 1987;45 (3): 77-87.
117. Siegler R. S.How does change occur: A microgenetic study of number conservation.Cognitive Psychology. 1995;28:255-273.
118. Snipes J.,Doolittle F.,Herlihy C.Foundations for success: Case studies of how urban school systems improve student achievement. Washington, DC: Council of the Great City Schools; 2002:.
119. Sowder J. T.Second handbook of research on mathematics teaching and learning. Lester F. K., ed. New York, NY: Information Age Publishing; 2007:157-223.
120. Starkey P.,Klein A.,Wakeley A.Enhancing young children's mathematical knowledge through a pre-kindergarten mathematics intervention.Early Childhood Research Quarterly. 2004;19:99-120.
121. Stevenson H. W.,Newman R. S.Long-term prediction of achievement and attitudes in mathematics and reading.Child Development. 1986;57:646-659.
122. Stipek D. J.,Ryan R. H.Economically disadvantaged preschoolers: Ready to learn but further to go.Developmental Psychology. 1997;33:711-723.
123. ThomasB. (1982). An abstract of kindergarten teachers' elicitation and utilization of children's prior knowledge in the teaching of shape concepts. Unpublished manuscript, School of Education, Health, Nursing, and Arts Professions, New York University.
124. Turner R. C.,Ritter G. W.,Robertson A. H.,Featherston L. Paper presented at the American Educational Research Association; 2006San Francisco, CA; 2006.
125. Head Start impact study. Final report. Washington, DC: Office of Planning, Research and Evaluation, U.S. Department of Health and Human Services; 2010:.
126. Van den Heuvel-Panhuizen M.Assessment and realistic mathematics education. Utrecht, the Netherlands: Freudenthal Institute, Utrecht University; 1996:.
127. Weiland C.,Wolfe C. B.,Hurwitz M. D.,Clements D. H.,Sarama J. H.,Yoshikawa H.Early mathematics assessment: Validation of the short form of a prekindergarten and kindergarten mathematics measure.Educational Psychology. 2012;32 (3): 311-333.
128. Weiss I. R. Paper presented at the meeting of the research presession of the 80th annual meeting of the National Council of Teachers of Mathematics Las Vegas; 2002NV; 2002.
129. WolfeB. (1991). Effective practices in inservice education: An exploratory study of the perceptions of Head Start participants (Unpublished doctoral dissertation). University of Wisconsin-Madison, WI.
130. Wood K.,Frid S.Early childhood numeracy in a multiage setting.Mathematics Education Research Journal. 2005;16 (3): 80-99.
131. Wright B.What number knowledge is possessed by children beginning the kindergarten year of school?.Mathematics Education Research Journal. 1991;3 (1): 1-16.
132. Wright B. D.,Stone M. H.Best test design: Rasch measurement. Chicago, IL: MESA Press; 1979:.
133. Wright R. J.,Martland J.,Stafford A. K.,Stanger G.Teaching number: Advancing children's skills and strategies. London: Paul Chapman/Sage; 2002:.
134. Wright S. P.,Horn S. P.,Sanders W. L.Teacher and classroom context effects on student achievement: Implications for teacher evaluation.Journal of Personnel Evaluation in Education. 1997;11:57-67.
135. Zhai F.,Raver C.,Jones S. M.Academic performance of subsequent schools and impacts of early interventions: Evidence from a randomized controlled trial in Head Start settings.Children and Youth Services Review. 2012;34 (5): 946-954.