The sensitivity of value-added teacher effect estimates to different mathematics achievement measures

Journal of Educational Measurement

Volumn 44, Issue 1, 2007, Pages 47-67

  Lockwood, J R ^a   McCaffrey, Daniel F ^a   Hamilton, Laura S ^a   Stecher, Brian ^a   Le, Vi Nhuan ^a   Martinez, José Felipe ^a,b  

^a RAND CORPORATION   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34249084724     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2007.00026.x     Document Type: Article

References (30)

1. American Educational Research Association (AERA), American Psychological Association (APA), National Council on Measurement in Education (NCME) (1999). Standards for educational and psychological testing. Washington, DC : APA.
2. Ballou, D., Sanders, W., & Wright, P. (2004). Controlling for student background in value-added assessment of teachers. Journal of Educational and Behavioral Statistics, 21, 37 66.
3. Ballou, D. (2005, April). Distinguishing teachers from classroom context. Paper presented at the annual conference of the American Education Research Association, Montreal, Canada.
4. Braun, H. (2005). Value-added modeling: What does due diligence require In R. Lissitz (Ed. Value added models in education: Theory and practice (pp. 19 38). Maple Grove, MN : JAM Press.
5. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. London : Chapman & Hall.
6. Goldstein, H. (2003). Multilevel statistical models (3rd ed.). London : Edward Arnold.
7. Hamilton, L. S. (1998). Gender differences on high school science achievement tests: Do format and content matter? Educational evaluation and policy analysis, 20, 179 195.
8. Hamilton, L. S. (2004). Improving inferences about student achievement: A multi-dimensional perspective. In S. J. Paik (Ed. Advancing educational productivity: Policy implications from national databases (pp. 175 201). Greenwich, CT : Information Age Publishing.
9. Hamilton, L. S., McCaffrey, D. F., & Koretz, D. M. (2006). Validating achievement gains in cohort-to-cohort and individual growth-based modeling contexts. In R. Lissitz (Ed. Longitudinal and value added modeling of student performance. Maple Grove, MN : JAM Press.
10. Harcourt Brace Educational Measurement (1997). Stanford achievement test series: Technical data report (9th ed.). San Antonio : Harcourt Brace and Company.
11. Hershberg, T. (2005, February). Value-added assessment and systemic reform: A response to America's human capital development challenge. Paper prepared for the Aspen Institute's Congressional Institute, Cancun, Mexico. Available at http://www.cgp.upenn.edu/pdf/aspen.pdf (retrieved 1/12/06).
12. Kupermintz, H., Ennis, M. M., Hamilton, L. S., Talbert, J. E., & Snow, R. E. (1995). Enhancing the validity and usefulness of large-scale educational assessments: I. NELS:88 mathematics achievement. American Educational Research Journal, 32, 525 554.
13. Le, V., Stecher, B., Lockwood, J. R., Hamilton, L. S., Robyn, A., Williams, V., Ryan, G., Kerr, K., Martinez, F., & Klein, S. (2006). Improving mathematics and science education: A longitudinal investigation of the relationship between reform-oriented instruction and student achievement. MG-480-EDU. Santa Monica, CA : RAND.
14. Little, R., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). New York : John Wiley & Sons.
15. Lockwood, J. R., McCaffrey, D. F., Mariano, L. T., & Setodji, C. (forthcoming). Bayesian methods for scalable multivariate value-added assessment. Journal of Educational and Behavioral Statistics.
16. Martineau, J. A. (2006). Distorting value added: The use of longitudinal, vertically scaled student achievement data for value-added accountability. Journal of Educational and Behavioral Statistics, 31, 35 62.
17. McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003). Evaluating value-added models for teacher accountability, MG-158-EDU. Santa Monica, CA : RAND.
18. McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., Louis, T. A., & Hamilton, L. S. (2004a). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29, 67 101.
19. McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., Louis, T. A., & Hamilton, L. S. (2004b). Let's see more empirical studies of value-added models of teacher effects: A reply to Raudenbush, Rubin, Stuart and Zanuto. Journal of Educational and Behavioral Statistics, 29, 139 144.
20. McCaffrey, D. F., Lockwood, J. R., Mariano, L. T., & Setodji, C. (2005). Challenges for value-added assessment of teacher effects. In R. Lissitz (Ed. Value added models in education: Theory and practice (pp. 272 297). Maple Grove, MN : JAM Press.
21. Nye, B., Konstantopoulos, S., & Hedges, L. V. (2004). How large are teacher effects? Educational Evaluation and Policy Analysis, 26, 237 257.
22. Pinheiro, J. C., & Bates, D. M. (2000). Mixed-effects models in S and S-PLUS. New York : Springer-Verlag.
23. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA : Sage Publications.
24. R Development Core Team (2005). R: A language and environment for statistical computing. Vienna, Austria : R Foundation for Statistical Computing.
25. Robinson, G. K. (1991). That BLUP is a good thing: The estimation of random effects (with discussion). Statistical Science, 6, 15 51.
26. Rowan, B., Correnti, R., & Miller, R. J. (2002). What large-scale survey research tells us about teacher effects on student achievement: Insights from the Prospects study of elementary schools. Teachers College Record, 104, 1525 1567.
27. Sanders, W., Saxton, A., & Horn, B. (1997). The Tennessee value-added assessment system: A quantitative outcomes-based approach to educational assessment. In J. Millman (Ed. Grading teachers, grading schools: Is student achievement a valid evaluation measure? (pp. 137 162). Thousand Oaks, CA : Corwin Press, Inc.
28. Schmidt, W. H., Houang, R. T., & McKnight, C. C. (2005). Value-added research: Right idea but wrong solution? In R. Lissitz (Ed. Value added models in education: Theory and practice (pp. 272 297). Maple Grove, MN : JAM Press.
29. U.S. Department of Education (2005). Secretary Spellings announces growth model pilot, addresses Chief State School Officers' Annual Policy Forum in Richmond (press release, November 18, 2005). Retrieved November 25, 2005 from http://www.ed.gov/news/pressreleases/2005/11/11182005.html.
30. Webster, W., & Mendro, R. (1997). The Dallas value-added accountability system. In J. Millman (Ed. Grading teachers, grading schools: Is student achievement a valid evaluation measure? (pp. 81 99). Thousand Oaks, CA : Corwin Press, Inc.