Capturing the cumulative effects of school reform: An 11-year study of the impacts of America's Choice on student achievement

Educational Evaluation and Policy Analysis

Volumn 28, Issue 3, 2006, Pages 231-257

  May, Henry ^a,b   Supovitz, Jonathan A ^a,b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b University of Pennsylvania ^*  (United States)

Author keywords

Comprehensive school reform; Growth curve analysis; Student achievement; Time series

Indexed keywords

EID: 33750564034     PISSN: 01623737     EISSN: None     Source Type: Journal    
DOI: 10.3102/01623737028003231     Document Type: Article

References (54)

1. Becker, W. C., & Gersten, R. M. (1982). A Mow-up of follow-through: The later effects of the direct instruction model on children in fifth and sixth grades. American Educational Research Journal, 19(1), 75-92.
2. Bloom, H. (2001). Measuring the impacts of whole-school reforms: Methodological lessons from an evaluation of accelerated schools. New York: Manpower Demonstration Research Corporation.
3. Bloom, H. S. (1999). Estimating program impacts on student achievement using "short" interrupted time-series. New York: Manpower Demonstration Research Corporation.
4. Bloom, H., Ham, S., Melton, L., & O'Brien, J. (2001). Evaluation of the Accelerated Schools approach: A look at early implementation and impacts in eight elementary schools. New York: Manpower Demonstration Research Corporation.
5. Bodilly, S. (1996). Lessons from New American Schools Development Corporation's demonstration phase. Santa Monica, CA: Rand.
6. Borman, G., & Hewes, G. (2002). Long-term effects and cost-effectiveness of Success for All. Educational Evaluation and Policy Analysis, 24, 243-266.
7. Borman, G. D., Hewes, G. M., Overman, L. T., & Brown, S. (2003). Comprehensive school reform and achievement: A meta-analysis. Review of Educational Research 73(2), 125-230.
8. Borman, G. D., Slavin, R. E., Cheung, A., Chamberlain, A. M., Madden, N. A., & Chambers, B. (2005a). Success for All: First-year results from the national randomized field trial. Educational Evaluation and Policy Analysis, 27, 1-22.
9. Borman, G. D., Slavin, R. E., Cheung, A., Chamberlain, A. M., Madden, N. A., & Chambers, B. (2005b). The national randomized field trial of Success for All: Second-year outcomes. American Educational Research Journal, 42(4), 673-696.
10. Browne, W. J. (2002). MCMC estimation in MLwiN. London: Centre for Multilevel Modelling, University of London.
11. Browne, W. J., Goldstein, H., & Rasbash, J. (2001). Multiple membership multiple classification (MMMC) models. Statistical Modelling 1, 103-124.
12. Bryk, A., & Weisberg, H. (1977). Use of the non-equivalent control group design when subjects are growing. Psychological Bulletin, 84(5), 950-962.
13. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.), Handbook of research on teaching (pp. 171-246). Chicago: RandMcNally.
14. Datnow, A., Borman, G. D., Stringfield, S., Overman, L. T., & Castellano, M. (2003). Comprehensive school reform in culturally and linguistically diverse contexts: Implementation and outcomes from a four-year study. Educational Evaluation and Policy Analysis, 25, 143-170.
15. Datnow, A., & Stringfield, S. (2000). Working together for reliable school reform. Journal of Education for Students Placed at Risk, 5(2), 183-204.
16. Dunn, M., Kadane, J. B, & Garrow, J. R. (2003). Comparing Harm Done by Mobility and Class Absence: Missing Students and Missing Data. Journal of Educational and Behavioral Statistics, 28(3), 269-288.
17. Feuer, M. I., Holland, P. W., Green, B. F., Bertenthal, M. W., & Hemphill, F. C. (1999). Uncommon measures: Equivalence and linkage among educational tests. Washington, DC: National Academy Press.
18. Geman, S.,& Geman, D. (1984). Stochastic relaxation Gibbs distributions and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6(6), 721-741.
19. Harcourt. (1997). Stanford Achievement Test Series, ninth edition, spring norms book. San Antonio, TX: Author.
20. Herman, R., Aladjem, D., McMahon, P., Masem, E., Mulligan, I., O'Malley, A., et al. (1999). An educator's guide to schoolwide reform. Washington, DC: American Institutes for Research.
21. Jones, E. M., Gottfredson, G. D., & Gottfredson, D. C. (1997). Success for some: An evaluation of a Success for All program. Evaluation Review, 21(6), 643-670.
22. Ligas, M. R. (2002). Evaluation of Broward County Alliance of Quality Schools Project. Journal of Education for Students Placed at Risk, 7(2), 117-139.
23. Ligas, M. R., & Vaughan, D. W. (1999). Alliance of quality schools: 1998-99 evaluation report. Broward, FL: Broward County Schools.
24. Linn, R. L. (1993). Linking results of distinct assessments. Applied Measurement in Education, 6(1), 83-102.
25. Loret, P. G., Seder, A., Bianchini, J. C., & Vale, C. A. (1972). A description of the Anchor Test Study. Princeton, NJ: Educational Testing Service.
26. MacIver, M. A., & Kemper, E. (2002). The impact of Direct Instruction on elementary students' reading achievement in an urban school district. Journal of Education for Students Placed at Risk, 7(2), 197-220.
27. Madden, N. A., Slavin, R. E., Karweit, N. L., Dolan, L. J., & Wasik, B. A. (1993). Success for All: Longitudinal effects of a restructuring program for innercity elementary schools. American Educational Research Journal, 30, 123-148.
28. Martineau, I. A. (2006). Distorting value added: The use of longitudinal, vertically scaled student achievement data for growth-based, value-added accountability. Journal of Educational and Behavioral Statistics, 31(1), 35-62.
29. May, H. (2004, April). Practical longitudinal analysis of student achievement using cross-classified Bayesian hierarchical linear modeling. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
30. May, H., Supovitz, I. A., & Lesnick, J. (2004). The impact of America's Choice on writing performance in Georgia: First-year results. Philadelphia: Consortium for Policy Research in Education, University of Pennsylvania.
31. Meyer, L. A. (1983). Long-term academic effects of direct instruction follow through. Technical Report No. 299. Champaign, IL: University of Illinois at Urbana-Champaign, Center for the Study of Reading. (Eric Document Reproduction Service No. ED 237932.)
32. Mislevy, R. J. (1992). Linking educational assessments: Concepts, issues, methods, and prospects. Princeton, NJ: Educational Testing Service.
33. Northwest Regional Educational Laboratory. (2005). Catalog of school reform models. Portland, OR: Author. Retrieved August 1, 2005, from http://www.nwrel.org/scpd/catalog/guide.shtml
34. Purkey, S. C., & Smith, M. S. (1983). Effective schools: A review. Elementary School Journal, 83(4), 426-452.
35. Rasbash, J., & Goldstein, H. (1994). Efficient analysis of mixed hierarchical and cross-classified random structures using a multilevel model. Journal of Educational and Behavioral Statistics, 19, 337-350.
36. Rasbash, J., Browne, W., Healy, M., Cameron, B., & Charlton, C. (2003). MLwiN (Version 2.00) [Computer Software], London: Centre for Multilevel Modelling, University of London.
37. Raudenbush, S. W. (1993). A crossed random effects model for unbalanced data with applications in cross-sectional and longitudinal research. Journal of Educational and Behavioral Statistics, 18, 321-349.
38. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage.
39. Raudenbush, S. W., & Liu, X. (2001). Effects of study duration, frequency of observation, and sample size on power in studies of treatment effects on polynomial change. Psychological Methods, 6, 387-401.
40. Reynolds, D., & Teddlie, C. (2000). The processes of school effectiveness. In C. Teddlie & D. Reynolds (Eds.), The international handbook of school effectiveness research (pp. 134-159). London: Falmer Press.
41. Rogosa, D. R. (1995). Myths and methods: "Myths about longitudinal research," plus supplemental questions. In J. M. Gottman (Ed.), The analysis of change (pp. 3-65). Hillsdale, NJ: Erlbaum.
42. Rogosa, D. R., Brandt, D., & Zimowski, M. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726-748.
43. Ross, S. M., Smith, L. J., & Casey, J. P. (1997). Preventing early school failure: Impacts of Success for All on standardized test outcomes, minority group performance, and school effectiveness. Journal of Education for Students Placed at Risk, 2(1), 29-53.
44. Rowan, B. P., & Miller, J. M. (2006, April). Organizing schools for instructional improvement; A longitudinal study of three CSR models. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
45. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. New York: Houghton Mifflin.
46. Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis; Modeling change and event occurrence. New York: Oxford University Press.
47. Smith, M. S., & O'Day, J. A. (1991). Systemic school reform. In S. Fuhrman & B. Malen (Eds.), The politics of curriculum and testing. Bristol, PA: Falmer Press.
48. Supovitz, J. A., & May, H. (2004). A study of the links between implementation and effectiveness of the America's Choice comprehensive school reform design. Journal of Education for Students Placed at Risk, 9(4), 389-419.
49. Supovitz, J. A., Poglinco, S. M., & Snyder, B. A. (2001). Moving mountains: successes and challenges of the America's Choice comprehensive school reform design. Philadelphia: Consortium for Policy Research in Education.
50. Supovitz, J. A., & Taylor, B. S. (2003). The impact of standards-based reform in Duval County, Florida, 1999-2002. Philadelphia: Consortium for Policy Research in Education.
51. Supovitz, J. A., & Taylor, B. S. (2005). Systemic education evaluation: Evaluating the impact of systemwide reform in education. American Journal of Evaluation, 26(2), 204-230.
52. Supovitz, J. A., Taylor, B. S., & May, H. (2002). Impact of America's Choice on student performance in Duval County, Florida. Philadelphia: Consortium for Policy Research in Education.
53. U.S. Department of Education. (2005). Department of Education, 2005. Retrieved August 1, 2005 from http://www.ed.gov/programs/compreform/funding.html
54. Yen, W. M. (1986). The choice of scale for educational measurement: An IRT perspective. Journal of Educational Measurement, 23(4), 399-325.