Practical Differences Among Aggregate-Level Conditional Status Metrics: From Median Student Growth Percentiles to Value-Added Models

Journal of Educational and Behavioral Statistics

Volumn 40, Issue 1, 2015, Pages 35-68

  Castellano, Katherine E ^a   Ho, Andrew D ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b HARVARD GRADUATE SCHOOL OF EDUCATION   (United States)

Author keywords

conditional status; group level growth; student growth percentiles; value added models

Indexed keywords

EID: 84921365375     PISSN: 10769986     EISSN: 19351054     Source Type: Journal    
DOI: 10.3102/1076998614548485     Document Type: Article

References (47)

1. AkramK.EricksonF.MeyerR., (2013). Issues in the estimation of student growth percentiles. Paper presented at the annual meeting of The Association for Education Finance and Policy, New Orleans, LA. Retrieved from the AEFP website: http://www.aefpweb.org/
2. Ballou D.,Sanders W.,Wright P.Controlling for student background in value-added assessments of teachers.Journal of Educational and Behavioral Statistics. 2004;29:37-65
3. Betebenner D. W.The future of test-based educational accountability. Ryan K. E.Shepard L. A., ed. New York, NY: Taylor & Francis; 2008a:155-170.
4. BetebennerD. W. (2008b). A primer on student growth percentiles. Retrieved from the Georgia Department of Education website: http://www.doe.k12.ga.us/
5. Betebenner D. W.Norm- and criterion-referenced student growth.Educational Measurement: Issues and Practice. 2009;28:42-51
6. BetebennerD. W. (2010a). New directions for student growth models. Retrieved from the Kansas Department of Education website: http://www.ksde.org/
7. Betebenner D. W.SGP: Student growth percentile and percentile growth projection/trajectory functions. 2010b:
8. Briggs D.,Betebenner D. W..Paper presented at the invited symposium Measuring and Evaluating Changes in Student Achievement: A Conversation about Technical and Conceptual Issues at the annual meeting of the National Council for Measurement in Education; 2009, AprilSan Diego, CA; 2009, April.
9. Casella G.,Berger R. L.Statistical inference. 2001). Statistical inference (2nd ed.). Pacific Grove, CA: Duxbury Thomson Learning.Pacific Grove, CA: Duxbury Thomson Learning; 2001:
10. Castellano K. E.,Ho A. D.Contrasting OLS and quantile regression approaches to student “growth” percentiles.Journal of Educational and Behavioral Statistics. 2013a;38:190-214
11. Castellano K. E.,Ho A. D.A practitioner’s guide to growth models. Washington, DC: Council of Chief State School Officers; 2013b:
12. ChettyR.FriedmanJ. N.RockoffJ. E. (2012). The long-term impacts of teachers: Teacher value-added and student outcomes in adulthood. NBER Working Paper No. 17699. Retrieved fromhttp://obs.rc.fas.harvard.edu/chetty/value_added.pdf
13. Colorado Department of Education. (2012). Colorado growth model FAQs (General). Retrieved fromhttp://www.schoolview.org/GMFAQ.asp
14. EhlertM.KoedelC.ParsonsE.Podgursky. (2012). Selecting growth measures for school and teacher evaluations. Working Paper 80. National Center for Analysis of Longitudinal Data in Educational Research. Retrieved from the ERIC website: http://eric.ed.gov/?id=ED535515
15. Ellis K. J.,Abrams S. A.,Wong W. W.Monitoring childhood obesity: Assessment of the weight/height2 index.American Journal of Epidemiology. 1999;150:939-946
16. Fetler M. E.A method for the construction of differentiated school norms.Applied Measurement in Education. 1991;4:53-66
17. Goldhaber D.,Walch J.,Gabele B.Does the model matter? Exploring the relationship between different student achievement-based teacher assessments. Seattle, WA: University of Washington; 2012:
18. GuarinoC. M.ReckaseM. D.StacyB. W.WooldridgeJ. M. (2014). A comparison of growth percentile and value-added models of teacher performance. Working Paper #39. The Education Policy Center at Michigan State University. Retrieved fromhttp://education.msu.edu/epc/publications/documents/WP39AComparisonofGrowthPercentileandValue-AddedModel.pdf
19. GuarinoC. M.ReckaseM. D.WooldridgeJ. M. (2012). Can value-added measures of teacher performance be trusted?Working Paper #18. The Education Policy Center at Michigan State University. Retrieved fromhttp://education.msu.edu/epc/library/documents/Guarino-Reckase-Wooldridge-May-2012-Can-Value-Added-Measures-of-Teacher-Performace-Be-Truste.pdf
20. Hedges L. V.,Hedberg E. C.Intraclass correlation values for planning group-randomized trials in education.Educational Evaluation and Policy Analysis. 2007;29:60-87
21. HoungB.JustmanM. (2013). Comparing lest-squares value-added analysis and student growth percentile analysis for evaluating student progress and estimating school effects. Melbourne Institute Working Paper Series Working Paper No. 7/13. Retrieved fromhttp://papers.ssrn.com/sol3/papers.cfm?abstract_id=2230187
22. Koenker R.Quantile regression. New York, NY: Cambridge University Press; 2005:
23. KolenM. J. (2011). Issues associated with vertical scales for PARCC assessments. Retrieved fromhttps://www.parcconline.org/sites/parcc/files/PARCCVertScal289-12-201129.pdf
24. Lissitz R. W.,Doran H.,Schafer W. D.,Willhoft J.Longitudinal and value added models of student performance. Lissitz R. W., ed. Maple Grove, MN: JAM Press; 2006:1-46.
25. Lockwood J. R.,McCaffrey D. F.Correcting for test score measurement error in ANCOVA models for estimating treatment effects.Journal of Educational and Behavioral Statistics. 2014;39:22-52
26. Lord F. M.The measurement of growth.Educational and Psychological Measurement. 1956;16:421-437
27. Manning W. H.,DuBois P. H.Correlational methods in research on human learning.Perceptual and Motor Skills. 1962;15:287-321
28. Massachusetts Department of Elementary and Secondary Education. (1999). Massachusetts comprehensive assessment system: 1998 technical report. Retrieved fromhttp://www.doe.mass.edu/mcas/tech/98techrpt.pdf
29. McCaffrey D. F.,Lockwood J. R.,Koretz D.,Louis T. A.,Hamilton L.Models for value-added modeling of teacher effects.Journal of Educational and Behavioral Statistics. 2004;29:67-101
30. McCaffrey D. F.,Sass T. R.,Lockwood J. R.,Mihaly K.The intertemporal variability of teacher effect estimates.Education Finance and Policy. 2009;4:572-606
31. Papay J. P.Different tests, different answers: The stability of teacher value-added estimates across outcome measures.American Educational Research Journal. 2011;48:163-193
32. R Development Core Team. (2009). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved fromhttp://www.R-project.org
33. Rabe-Hesketh S.,Skrondal A.Multilevel and longitudinal modeling using Stata Volume I: Continuous responses. 2012). Multilevel and longitudinal modeling using Stata (3rd ed.): Volume I: Continuous responses. College Station, TX: Stata Press.College Station, TX: Stata Press; 2012:
34. Raudenbush S. W.,Bryk A. S.Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage; 2002:
35. Reardon S. F.,Raudenbush S. W.Assumptions of value-added models for estimating school effects.American Education Finance Association. 2009;4:492-519
36. Rogosa D. R.,Willett J. B.Understanding correlates of change by modeling individual differences in growth.Psychometrika. 1985;50:203-228
37. SandersW. L. (2006). Comparisons among various educational assessment value-added models(SAS White Paper). Retrieved fromhttp://www.sas.com/resources/
38. Sanders W. L.,Saxton A. M.,Horn S. P.Grading teachers, grading schools: Is student achievement a valid educational measure?. Millman J., ed. Thousand Oaks, CA: Corwin Press; 1997:137-162.
39. Scholten A. Z.,Borsboom D.A reanalysis of Lord’s statistical treatment of football numbers.Journal of Mathematical Psychology. 2009;53:69-75
40. Singer J. D.,Willett J. B.Applied longitudinal data analysis: Modeling change and event occurrence. 2003;:
41. Snijders T. A. B.,Bosker R. J.Multilevel analysis: An introduction to basic and advanced multilevel modeling. 2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Washington, DC: Sage.Washington, DC: Sage; 2011:
42. Spencer B. D.Test scores as social statistics: Comparing distributions.Journal of Educational Statistics. 1983;8:249-269
43. Suen W.Decomposing wage residuals: Unmeasured skill or statistical artifact?.Journal of Labor Economics. 1997;15:555-566
44. U.S. Department of Education. (2005). Secretary Spellings announces growth model pilot, Addresses chief state school officers’ annual policy forum in Richmond (press release). Retrieved fromhttp://www2.ed.gov/news/pressreleases/2005/11/11182005.html
45. U.S. Department of Education. (2009). Race to the top program: Executive summary. Retrieved fromhttp://www2.ed.gov/programs/racetothetop/executive-summary.pdf
46. WrightS. P. (2010). An investigation of two nonparametric regression models for value-added assessment in education. SAS White Paper. Retrieved fromhttp://www.sas.com/whitepapers/indexAZ.html
47. Zwick R.Statistical and psychometric issues in the measurement of educational achievement trends: Examples from the National Assessment of Educational Progress.Journal of Educational Statistics. 1992;17:205-218