Effects of Kindergarten Retention on Children's Social-Emotional Development: An Application of Propensity Score Method to Multivariate, Multilevel Data

Developmental Psychology

Volumn 44, Issue 2, 2008, Pages 407-421

  Hong, Guanglei ^a   Yu, Bing ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

causal inference; grade retention; measurement error; nonexperimental data; sensitivity analysis

Indexed keywords

ARTICLE; CHILD; COHORT ANALYSIS; CONTROL; EGO DEVELOPMENT; EMOTION; FEMALE; HUMAN; LONGITUDINAL STUDY; MALE; PERSONALITY TEST; POVERTY; PRESCHOOL CHILD; PSYCHOLOGICAL ASPECT; PSYCHOLOGY; PSYCHOMETRY; READING; SELF CONCEPT; SOCIAL ADAPTATION; STATISTICS; UNITED STATES;

CHILD; CHILD, PRESCHOOL; COHORT STUDIES; EMOTIONS; FEMALE; HUMANS; INTERNAL-EXTERNAL CONTROL; LONGITUDINAL STUDIES; MALE; PERSONALITY ASSESSMENT; PERSONALITY DEVELOPMENT; POVERTY; PSYCHOMETRICS; READING; SELF EFFICACY; SOCIAL ADJUSTMENT; UNDERACHIEVEMENT; UNITED STATES;

EID: 42049092306     PISSN: 00121649     EISSN: None     Source Type: Journal    
DOI: 10.1037/0012-1649.44.2.407     Document Type: Article

References (64)

1. Becker H.S. Outsiders (1963), Free Press, New York
2. Brookhart M.A., Schneeweiss S., Rothman K.J., Glynn R.J., Avorn J., and Stürmer T. Variable selection for propensity score models. American Journal of Epidemiology 163 12 (2006) 1149-1156
3. Byrnes D.A. Attitudes of students, parents, and educators toward repeating a grade. In: Shepard L.A., and Smith M.L. (Eds). Flunking grades: Research and policies on retention (1989), Falmer Press, New York 108-131
4. Cheong Y.F., and Raudenbush S.W. Measurement and structural models for children's problem behaviors. Psychological Methods 5 4 (2000) 477-495
5. Cochran W.G. The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 24 2 (1968) 295-313
6. Dawson P. A primer on student retention: What the research says. Communique (Milwaukee, WI) 26 8 (1998) 28-30
7. Festinger L.A. A theory of social comparison processes. Human Relations 7 (1954) 117-140
8. Finlayson H.J. Nonpromotion and self-concept development. Phi Delta Kappan 59 (1977) 205-206
9. Grant J., and Richardson I. The retention/promotion checklist (1998), Crystal Springs Books, Peterborough, NH
10. Gresham F., and Elliot S. Social skills rating system (1990), American Guidance Services, Circle Pines, MN
11. Hambleton R.K., Swaminathan H., and Rogers H.J. Fundamentals of item response theory (1991), Sage, Newbury Park, CA
12. Hill J.L., Waldfogel J., Brooks-Gunn J., and Han W.-J. Maternal employment and child development: A fresh look using newer methods. Developmental Psychology 41 6 (2005) 833-850
13. Holmes C.T. Grade-level retention effects: A meta-analysis of research studies. In: Shepard L.A., and Smith M.L. (Eds). Flunking grades: Research and policies on retention (1989), Falmer Press, London 16-33
14. Holmes C.T., and Matthews K.M. The effects of nonpromotion on elementary and junior high school pupils: A meta-analysis. Review of Educational Research 54 (1984) 225-236
15. Hong, G. (2004). Causal inference for multi-level observational data with application to kindergarten retention. Unpublished doctoral dissertation, University of Michigan, Ann Arbor.
16. Hong, G. (2007, January). Marginal mean weighting adjustment for selection bias. Invited presentation at the University of Chicago Education Workshop, Chicago, IL.
17. Hong, G., & Hong, Y. (2007, December). Reading instruction time and homogeneous grouping in kindergarten: An application of the marginal mean weighting method. Invited presentation at the University of Michigan, School of Education, Ann Arbor, MI.
18. Hong G., and Raudenbush S.W. Effects of kindergarten retention policy on children's cognitive growth in reading and mathematics. Educational Evaluation and Policy Analysis 27 3 (2005) 205-224
19. Hong G., and Raudenbush S.W. Evaluating kindergarten retention policy: A case study of causal inference for multi-level observational data. Journal of the American Statistical Association 101 475 (2006) 901-910
20. Hong G., and Yu B. Early grade retention and children's reading and math learning in elementary years. Educational Evaluation and Policy Analysis 29 4 (2007) 239-261
21. Huang I.-C., Frangakis C., Dominici F., Diette G.B., and Wu A.W. Approach for risk adjustment in profiling multiple physician groups on asthma care. Health Services Research 40 (2005) 253-278
22. Imbens G.W. The role of the propensity score in estimating dose-response functions. Biometrika 87 (2000) 706-710
23. Jimerson S. Meta-analysis of grade retention research: Implications for practice in the 21st century. School Psychology Review 30 3 (2001) 420-437
24. Jimerson S., Carlson E., Rotert M., Egeland B., and Sroufe L.A. A prospective, longitudinal study of the correlates and consequences of early grade retention. Journal of School Psychology 35 1 (1997) 3-25
25. Lemert E.M. Human deviance, social problems, and social control (1967), Prentice-Hall, Englewood Cliffs, NJ
26. Lin D.Y., Psaty B.M., and Kronmal R.A. Assessing the sensitivity of regression results to unmeasured confounders in observational studies. Biometrics 54 (1998) 948-963
27. Little R.J.A. A note about models for selectivity bias. Econometrica 53 6 (1985) 1469-1474
28. Little R.J., An H., and Johanns J. A comparison of subset selection and analysis of covariance for the adjustment of confounders. Psychological Methods 5 4 (2000) 459-476
29. Lord F.M. A paradox in the interpretation of group comparisons. Psychological Bulletin 68 (1967) 304-305
30. Mantzicopoulos P., and Morrison D. Kindergarten retention: Academic and behavioral outcomes through the end of the second grade. American Educational Research Journal 29 (1992) 182-198
31. Marsh H. Self-Description Questionnaire manual (1990), University of Western Sydney, Macarthur, Campbelltown, New South Wales, Australia
32. McCoy A.R., and Reynolds A.J. Grade retention and school performance: An extended investigation. Journal of School Psychology 37 3 (1999) 273-298
33. Morrison F.J., Griffith E.M., and Alberts D.M. Nature-nurture in the classroom: Entrance age, school readiness, and learning in children. Developmental Psychology 33 2 (1997) 254-262
34. Morrison I.E., and Perry I.F. Acceptance of overage children by classmates. Elementary School Journal 56 (1956) 217-220
35. National Center for Education Statistics. Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K) psychometric report for kindergarten through first grade (Working Paper No. 200205) (2002), Author, Washington, DC
36. Pagani L., Tremblay R.E., Vitaro F., Boulerice B., and McDuff P. Effects of grade retention on academic performance and behavioral development. Development and Psychopathology 13 (2001) 297-315
37. Pierson L., and Connell J. Effects of grade retention on self-system processes, school engagement, and academic performance. Journal of Educational Psychology 84 (1992) 300-307
38. Plummer D.L., and Graziano W.G. Impact of grade retention on the social development of elementary school children. Developmental Psychology 23 2 (1987) 267-275
39. Pollack J.M., Atkins-Burnett S., Tourangeau K., and West J. Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K) psychometric report for the third grade (Tech. Rep. No. 2005062) (2005), National Center for Education Statistics, Washington, DC
40. Pollack J.M., Najarian M., Rock D.A., Atkins-Burnett S., and Hausken E.G. Early Childhood Longitudinal Study-Kindergarten Class of 1998-99 (ECLS-K) psychometric report for the fifth grade (Tech. Rep. No. 2006036rev) (2005), National Center for Education Statistics, Washington, DC
41. Quay H.C., and Peterson D. Manual for the Revised Behavior Problem Checklist (1987), University of Miami, Coral Gables, FL
42. Raudenbush S., Bryk A., Cheong Y.F., Congdon R., and du Toit M. HLM6: Hierarchical linear and nonlinear modeling (2004), Scientific Software International, Lincolnwood, IL
43. Raudenbush S.W., Brennan R.T., and Barnett R.C. A multivariate hierarchical model for studying psychological change within married couples. Journal of Family Psychology 9 2 (1995) 161-174
44. Raudenbush S.W., and Bryk A.S. Hierarchical linear models: Applications and data analysis methods. 2nd ed. (2002), Sage, Thousand Oaks, CA
45. Raudenbush S.W., Rowan B., and Kang S.J. A multilevel, multivariate model for studying school climate in secondary schools with estimation via the EM algorithm. Journal of Educational Statistics 16 4 (1991) 295-330
46. Reynolds A.J. Grade retention and school adjustment: An exploratory analysis. Educational Evaluation and Policy Analysis 14 (1992) 101-121
47. Robins J.M. Marginal structural models versus structural nested models as tools for causal inference. In: Halloran M.E., and Berry D. (Eds). Statistical models in epidemiology, the environment, and clinical trials (2000), Springer, New York 95-134
48. Robins J.M., Hernan M., and Siebert U. Effects of multiple interventions. Population Health Metrics 2 (2003) 2191-2230
49. Rosenbaum P.R. From association to causation in observational studies: The role of tests of strongly ignorable treatment assignment. Journal of the American Statistical Association 79 385 (1984) 41-48
50. Rosenbaum P.R. Dropping out of high school in the United States: An observational study. Journal of Educational Statistics 11 (1986) 207-224
51. Rosenbaum P.R. Model-based direct adjustment. Journal of the American Statistical Association 82 398 (1987) 387-394
52. Rosenbaum P.R. Observational studies. 2nd ed. (2002), Springer-Verlag, New York
53. Rosenbaum P.R., and Rubin D.B. The central role of the propensity score in observational studies for causal effects. Biometrika 70 1 (1983) 41-55
54. Rosenbaum P.R., and Rubin D.B. Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association 79 387 (1984) 516-524
55. Rubin D.B. Comment: Which ifs have causal answers. Journal of the American Statistical Association 81 (1986) 961-962
56. Rubin D.B., and Thomas N. Combining propensity score matching with additional adjustments for prognostic covariates. Journal of the American Statistical Association 95 (2000) 573-585
57. Shadish W.R., Cook T.D., and Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference (2002), Houghton Mifflin, Boston
58. Shepard L.A. A review of research on kindergarten retention. In: Shepard L.A., and Smith M.L. (Eds). Flunking grades: Research and policies on retention (1989), Palmer Press, Philadelphia 64-78
59. Shepard L.A., and Smith M.L. Academic and emotional effects of kindergarten retention in one school district. In: Shepard L.A., and Smith M.L. (Eds). Flunking grades: Research and policies on retention (1989), Falmer Press, London 79-107
60. SPSS, Inc. SPSS 15.0 base user's guide (2006), Prentice Hall, Upper Saddle River, NJ
61. Stone R. The assumption on which causal inferences rest. Journal of the Royal Statistical Society, Series B (Methodological) 55 2 (1993) 455-466
62. Tomchin E.M., and Impara J.C. Unraveling teachers' beliefs about grade retention. American Educational Research Journal 29 1 (1992) 199-223
63. U.S. Bureau of the Census. Current population survey (1995), Author, Washington, DC
64. Zill N., Loomis L.S., and West J. The elementary school performance and adjustment of children who enter kindergarten late or repeat kindergarten: Findings from national surveys (Stat. Anal. Rep. NCES 98-097) (1997), U.S. Department of Education, Office of Educational Research and Improvement, National Center for Education Statistics, Washington, DC