A propensity score matching analysis of the effects of special education services

Journal of Special Education

Volumn 43, Issue 4, 2010, Pages 236-254

  Morgan, Paul L ^a   Frisco, Michelle L ^a   Farkas, George ^b   Hibel, Jacob ^a  

^a PENNSYLVANIA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Behavior; Disabilities; Education policy; Mathematics; Reading; Special education

Indexed keywords

EID: 73549120212     PISSN: 00224669     EISSN: None     Source Type: Journal    
DOI: 10.1177/0022466908323007     Document Type: Article

References (100)

1. Abbott, M., Walton, C., Tapia, Y., & Greenwood, C. (1999). Research to practice: A blueprint for closing the gap in local schools. Exceptional Children, 65, 339-352.
2. Allison, P.D. (1990). Change scores as dependent variables in regression analysis. Sociological Methodology, 20, 93-114.
3. Andrews, H., Goldberg, D., Wellen, N., Pittman, B., & Struening, E. (1995). Prediction of special education placement from birth certificate data. American Journal of Preventative Medicine, 11, 55-61.
4. Bateman, B.D., & Linden, M.A. (2006). Better IEPs: How to develop legally correct and educationally useful programs (4th ed.). Verona, WI: IEP Resources, Attainment Co.
5. Becker, S.O., & Ichino, A. (2002). Estimation of average treatment effects based on propensity scores. Stata Journal, 2, 358-377.
6. Blackorby, J., & Wagner, M. (1996). Longitudinal postschool outcomes of youth with disabilities: Findings from the National Longitudinal Transition Study. Exceptional Children, 62, 399-413.
7. Boardman, A.G., Arguelles, M.E., Vaughn, S., Hughes, M.T., & Klingner, J. (2005). Special education teachers' views of research-based practices. Journal of Special Education, 39, 168-180.
8. Carnine, D. (1997). Bridging the research-to-practice gap. Exceptional Children, 63, 513-521.
9. Cronbach, L.J., & Furby, L. (1970). How we should measure change or should we? Psychological Bulletin, 74, 68-80.
10. Czajka, J.L., Hirabayashi, S.M., Little, R.J.A., & Rubin, D.B. (1992). Projecting from advance data using propensity modeling: An application to income and tax statistics. Journal of Business and Economic Statistics, 10, 117-131.
11. Deal v. Hamilton County Board of Education, 392 F.3d 840 6th Cir. (2004).
12. Dehejia, R.H., & Wahba, S. (1999). Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs. Journal of the American Statistical Association, 94, 1053-1062.
13. Delgado, C.E.F., & Scott, K.G. (2006). Comparison of referral rates for preschool children at risk for disabilities using information obtained from birth certificate records. Journal of Special Education, 40, 28-35.
14. Delgado, C.E.F., Vagi, S.J., & Scott, K.G. (2005). Early risk factors for speech and language impairments. Exceptionality, 13, 173-191.
15. Denton, C.A., Vaughn, S., & Fletcher, J.M. (2003). Bringing research-based practice in reading intervention to scale. Learning Disabilities Research and Practice, 18, 201-211.
16. Deshler, D.D. (2005). Intervention research and bridging the gap between research and practice. LD Online. Retrieved August, 8, 2007, from http://www.ldonline.org/article/5596.
17. DiPerna, J.C., Lei, P.-W., & Reid, E.E. (2007). Kindergarten predictors of mathematical growth in the primary grades: An investigation using the Early Childhood Longitudinal Study-Kindergarten Cohort. Journal of Educational Psychology, 99, 396-379.
18. Donovan, M.S., & Cross, C.T. (2002). Minority students in special and gifted education. Washington, DC: National Academy Press.
19. Feng, H., & Cartledge, G. (1996). Social skill assessment of inner city Asian, African, and European American students. School Psychology Review, 25, 228-239.
20. Fergusson, D.M., & Woodward, L.J. (2002). Mental health, educational, and social role outcomes of adolescents with depression. Archives of General Psychiatry, 59, 225-231.
21. Forness, S.R., Freeman, S.F.N., & Paparella, T. (2006). Recent randomized clinical trials comparing behavioral interventions and psychopharmacologic treatments for students with EBD. Behavioral Disorders, 31, 284-296.
22. Frisco, M.L., Muller, C., & Frank, K. (2007). Family structure change and adolescents' school performance: A propensity score approach. Journal of Marriage and Family, 69, 721-741.
23. Fuchs, D., Fuchs, L.S., Mathes, P.G., & Simmons, D.C. (1997). Peer-assisted learning strategies: Making classrooms more responsive to diversity. American Educational Research Journal, 34, 174-206.
24. Furlong, M.J., & Karno, M. (1995). Review of the Social Skills Rating System. In J. C. Conoley & J. C. Impara (Eds.), Twelfth mental measurements yearbook (pp. 697-969). Lincoln, NE: Buros Institute of Mental Measurement.
25. Gersten, R., Baker, S., & Lloyd, J.W. (2000). Designing high-quality research in special education: Group experimental design. Journal of Special Education, 34, 2-18.
26. Gersten, R., Vaughn, S., Deshler, D., & Schiller, E. (1997). What we know about using research findings: Implications for improving special education practice. Journal of Learning Disabilities, 30, 466-476.
27. Goodman, L.A. (1978). Analyzing qualitative/categorical data. Cambridge, MA: Abt Books.
28. Green, K.M., & Ensminger, M.E. (2006). Adult social behavioral effects of heavy adolescent marijuana use among African Americans. Developmental Psychology, 42, 1168-1178.
29. Gresham, P.M., & Elliot, S.N. (1990). Social Skills Rating System. Circle Pines, MN: American Guidance Service.
30. Harry, B., & Klingner, J.K. (2006). Why are so many minority students in special education? Understanding race and disability in schools. New York: Teachers College Press.
31. Harknett, K. (2006). Does receiving an earnings supplement affect union formation? Estimating effects for program participants using propensity score matching. Evaluation Review, 30, 741-778.
32. Heckman, J.J. (1996). Identification of causal effects using instrumental variables: Comment. Journal of the American Statistical Association, 91, 459-462.
33. Heckman, J.J., Ichimura, H., & Todd, P.E. (1997). Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. Review of Economic Studies, 64, 605-654.
34. Hibel, J., Farkas, G., & Morgan, P.L. (2008). Who is placed into special education? Manuscript under review.
35. Hollomon, H.A., Dobbins, D.R., & Scott, K.G. (1998). The effects of biological and social risk factors on special education placement: Birthweight and maternal education as an example. Research in Developmental Disabilities, 19, 281-294.
36. Hong, G., & Raudenbush, S.W. (2005). Effects of kindergarten retention policy on children's cognitive growth in reading and mathematics. Educational Evaluation and Policy Analysis, 27, 205-224.
37. Hosp, J.L., & Reschly, D.J. (2002). Predictors of restrictiveness of placement for African American and Caucasian students with learning disabilities. Exceptional Children, 68, 225-238.
38. Hosp, J.L., & Reschly, D.J. (2004). Disproportionate representation of minority students in special education: Academic, demographic, and economic predictors. Exceptional Children, 70, 185-199.
39. Howlin, P., Gordon, R.K., Pasco, G., Wade, A., & Charman, T. (2007). The effectiveness of Picture Exchange Communication System (PECS) training for teachers of children with autism: A pragmatic, group randomised controlled trial. Journal of Child Psychology and Psychiatry, 48, 473-481.
40. Individuals with Disabilities Improvement Education Act, Pub. L. 108-446, Statute No. 2651 (2004).
41. Jones, A.S., D'Agostino, R.B., Gondolf, E.W., & Heckert, A. (2004). Assessing the effect of batterer program completion on re-assault using propensity scores. Journal of Interpersonal Violence, 19, 1002-1020.
42. Kansas State Legislative Research Department. (2004). Estimated special education excess costs-FY 2008. Retrieved August 8, 2007, from http://www.ksde.org/LinkClick.aspx?fileticket=lv0CzOcvet0%3D&tabid=119&mid=4087.
43. Katusic, S.K., Colligan R.C., Barbaresi, W.J., Schaid, D.J., & Jacobsen, S.J. (2001). Incidence of reading disability in a population-based birth cohort, 1976-1982, Rochester, Minn. Mayo Clinic Proceedings, 76, 1081-1092.
44. Kavale, K.A. (1988). Learning disability and cultural-economic disadvantage: The case for a relationship. Learning Disability Quarterly, 11, 195-210.
45. La Greca, A.M., & Stone, W.L. (1990). LD status and achievement: Confounding variables in the study of children's social status, self-esteem, and behavioral functioning. Journal of Learning Disabilities, 23, 483-490.
46. Lachin, J.M. (2000). Statistical considerations in the intent-to-treat principle. Controlled Clinical Trials, 21, 241-243.
47. Lane, K.L., Wehby, J.H., Little, M.A., & Cooley, C. (2005). Students educated in self-contained classrooms and self-contained schools: Part II. How do they progress over time. Behavioral Disorders, 30, 363-374.
48. Lechner, M. (2002). Program heterogeneity and propensity score matching: An application to the evaluation of active labor market policies. Review of Economics and Statistics, 84, 205-220.
49. Levy, S., & Vaughn, S. (2002). An observational study of reading instruction of teachers of students with emotional/behavioral disorders. Behavioral Disorders, 27, 215-235.
50. Luellen, J.K., Shadish, W.R., & Clark, M.H. (2005). Propensity scores: An introduction and experimental test. Evaluation Review, 29, 530-558.
51. Magiera, K., & Zigmond, N. (2005). Co-teaching in middle school classrooms under routine conditions: Does the instructional experience differ for students with disabilities in co-taught and solo-taught classes? Learning Disabilities Research and Practice, 20, 79-85.
52. Mann, E.A., McCartney, K., & Park, J.M. (2007). Preschool predictors of the need for early remedial and special education services. Elementary School Journal, 107, 273-285.
53. Mannerkoski, M.K., Aberg, L.E., Auti, T.H., Hoikkala, M., Sarna, S., & Heiskala, H.J. (2007). Newborns at risk for special-education placement: A population-based study. European Journal of Paediatric Neurology, 11, 223-231.
54. Maris, E. (1998). Covariance adjustment versus gain scores- Revisited. Psychological Methods, 3, 309-327.
55. McClelland, M.M., Acock, A.C., & Morrison, F.J. (2006). The impact of kindergarten learning-related skills on academic trajectories at the end of elementary school. Early Childhood Research Quarterly, 21, 471-490.
56. McLeskey, J., Tyler, N.C., & Flippin, S.S. (2004). The supply of and demand for special education teachers: A review of research regarding the chronic shortage of special education teachers. Journal of Special Education, 38, 5-21.
57. Meisels, S.J., Atkins-Burnett, S., & Nicholson, J. (1996). Assessment of social competence, adaptive behaviors, and approaches to learning with young children. Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement.
58. Merrell, K.W., & Shinn, M.R. (1990). Critical variables in the learning disabilities identification process. School Psychology Review, 19, 74-90.
59. Morgan, P.L., & Sideridis, G.D. (2006). Contrasting the effectiveness of fluency interventions for students with or at risk for learning disabilities: A multilevel random coefficient modeling meta-analysis. Learning Disabilities: Research and Practice, 21, 191-210.
60. Pagan, A., & Ullah, A. (1999). Nonparametric econometrics. Cambridge, UK: Cambridge University Press.
61. Parsons, S., & Bynner, J. (1997). Numeracy and employment. Education and Training, 39, 43-51.
62. Petkova, E., & Teresi, J. (2002). Some statistical issues in the analyses of data from longitudinal studies of elderly chronic care populations. Psychosomatic Medicine, 64, 531-547.
63. Phelps, A., & Hanley-Maxwell, C. (1997). School to work transitions for youth with disabilities: A review of outcomes and practices. Review of Educational Research, 67, 197-226.
64. President's Commission on Excellence in Special Education. (2002). A new era: Revitalizing special education for children and their families. Retrieved December 4, 2007, from http://www.ed.gov/inits/commissionsboards/whspecialeducation/reports/index.html.
65. Reynolds, A.M., Elksnin, N., & Brown, F.R. (1996). Specific reading disabilities: Early identification and long-term outcome. Mental Retardation and Developmental Disabilities Research Reviews, 2, 21-27.
66. Rivera-Batiz, F.L. (1992). Quantitative literacy and the likelihood of employment among young adults in the United States. Journal of Human Resources, 27, 313-328.
67. Rosenbaum, P.R. (1986). Dropping out of high school in the United States: An observational study. Journal of Educational Statistics, 11, 207-224.
68. Rosenbaum, P.R., & Rubin, D. (1983). The central role of the propensity score in observational studies of causal effects. Biometrika, 70, 41-55.
69. Rubin, D.B. (1997). Estimating causal effects from large data sets using propensity scores. Annals of Internal Medicine, 127, 757-763.
70. Russ, S., Chiang, B., Rylance, B.J., & Bongers, J. (2001). Caseload in special education: An integration of research findings. Exceptional Children, 67, 161-172.
71. Schaefer, C., Petras, H., Ialongo, N., Poduska, J., & Kellam, S. (2003). Modeling growth in boys' aggressive behavior across elementary school: Links to later criminal involvement, conduct disorder, and anti-social personality disorder. Developmental Psychology, 39, 1020-1035.
72. Schneider, B. (2001). Educational stratification and the life course. Sociological Focus, 34, 463-466.
73. Schneider, B., Carnoy, M., Kilpatrick, J., Schmidt, W.H., & Shavelson, R.J. (2007). Estimating causal effects using experimental and observational designs. Washington, DC: American Educational Research Association.
74. Schwartz, I., Carta, J., & Grant, S. (1996). Examining the use of recommended language intervention practices in early childhood special education classrooms. Topics in Early Childhood Special Education, 16, 251-272.
75. Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and quasi-experimental design for generalized causal inference. Boston: Houghton-Mifflin.
76. Sheiner, L.B., & Rubin, D.B. (1995). Intention to treat analysis and the goals of clinical trials. Clinical Pharmacology and Therapeutics, 57, 6-15.
77. Shores, R.E., Jack, S.L., Gunter, P.L., Ellis, D.N., DeBriere, T.J., & Wehby, J.H. (1993). Classroom interactions of children with behavior disorders. Journal of Emotional and Behavioral Disorders, 1, 27-39.
78. Snell, M.E. (2003). Applying research to practice: The more pervasive problem? Research and Practice for Persons With Severe Disabilities, 28, 143-147.
79. Snow, C.E., Burns, M.S., & Griffin, P. (1998). Preventing reading difficulties in young children. Washington, DC: National Academy Press.
80. Sprague, J., & Walker, H. (2000). Early identification and intervention for youth with antisocial and violent behavior. Exceptional Children, 66, 367-379.
81. Stanovich, K. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21, 360-407.
82. Stecker, P.M., Fuchs, L.S., & Fuchs, D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42, 795-819.
83. Stone, R.A., Obrosky, D.S., Singer, D.E., Kapoor, W.N., Fine, M.J., & the Pneumonia Patient Outcomes Research Team (PORT) Investigators. (1995). Propensity score adjustment for pretreatment differences between hospitalized and ambulatory patients with community-acquired pneumonia. Medical Care, 33, 56-66.
84. Swanson, H.L., & Hoskyn, M. (1998). Experimental intervention research on students with learning disabilities: A meta-analysis of the treatment outcomes. Review of Educational Research, 68, 277-321.
85. Tach, L., & Farkas, G. (2006). Learning-related behaviors, cognitive skills, and ability grouping when schooling begins. Social Science Research, 35, 1048-1079.
86. Taylor, P.B., Gunter, P.L., & Slate, J.R. (2001). Teachers' perceptions of inappropriate student behavior as a function of teachers' and students' gender and ethnic background. Behavioral Disorders, 26, 146-115.
87. U.S. Department of Education. (2002). Twenty-fourth annual report to Congress on the implementation of the Individuals with Disabilities Education Act. Washington, DC: Government Printing Office.
88. U.S. Department of Education. (2005). 27th annual report to Congress on the implementation of the Individuals with Disabilities Education Act (Vol. 1). Retrieved December 3, 2007, from http://www.ed.gov/about/reports/annual/osep/2005/parts-b-c/27th-vol-1.pdf.
89. U.S. Department of Education. (2007). The Math Now programs [Press release]. Retrieved August 8, 2007, from http://www.ed.gov/news/pressreleases/2006/02/02062006.html.
90. U.S. Department of Education, National Center for Education Statistics. (2002). Early Childhood Longitudinal Study- Kindergarten Class of 1998-1999 (ECLS-K): Psychometric report for kindergarten through first grade (Working Paper No. 2002-05). Washington, DC: U.S. Department of Education, Office of Educational Research and Improvement.
91. U.S. Department of Education, National Center for Education Statistics. (2004). User's manual for the ECLS-K third grade public-use data file and electronic code book (NCES 2004-001). Washington, DC: U.S. Department of Education, Institute for Education Sciences.
92. U.S. Department of Education, National Center for Education Statistics. (2005). Early Childhood Longitudinal Study- Kindergarten Class of 1998-1999 (ECLS-K): Psychometric report for the third grade (NCES 2005-062). Washington, DC: U.S. Department of Education, Institute of Education Sciences.
93. U.S. Department of Education, National Center for Education Statistics. (2007a). Demographic and school characteristics of students receiving special education in the elementary grades (NCES 2007-005). Retrieved December 3, 2007, from http://nces.ed.gov/pubs2007/2007005.pdf.
94. U.S. Department of Education, National Center for Education Statistics. (2007b). The nation's report card. Available from http://nces.ed.gov/nationsreportcard/.
95. U.S. Department of Education, Office of Special Education Programs. (2006). IDEA regulations: Individualized Education Program (IEP). Retrieved August 10, 2007, from http://idea.ed.gov/explore/view/p/%2Croot%2Cdynamic%2CTopicalBrief%2C10%2C.
96. Valas, H. (2001). Learned helplessness and psychological adjustment II: Effects of learning disabilities and low achievement. Scandinavian Journal of Educational Research, 45, 101-114.
97. Walker, H.M., Colvin, G., & Ramsey, E. (1995). Antisocial behavior in school: Strategies and best practices. Pacific Grove, CA: Brooks/Cole.
98. Wang, W.-C., & Chyi-In, W. (2004). Gain score in item response theory as an effect size measure. Educational and Psychological Measurement, 64, 758-780.
99. Williams, R.H., & Zimmerman, D.W. (1996). Are simple gain scores obsolete? Applied Psychological Measurement, 20, 59- 69.
100. Winship, C., & Mare, R.D. (1992). Models for sample selection bias. Annual Review of Sociology, 18, 327-350.