On Analysis of Symmetrically Predicted Endogenous Subgroups: Part One of a Method Note in Three Parts

American Journal of Evaluation

Volumn 34, Issue 2, 2013, Pages 225-236

  Peck, Laura R ^a  

^a ABT ASSOCIATES   (United States)

Author keywords

experimental evaluation; instrumental variables; principal stratification; selection bias; subgroup analysis

Indexed keywords

EID: 84877090789     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214013481666     Document Type: Article

References (40)

1. Angrist J. D.,Imbens G. W.,Rubin D. B.Identification of causal effects using instrumental variables.Journal of the American Statistical Association. 1996;91:444-455.
2. Bell S. H.,Peck L. R.Using symmetric predication of endogenous subgroups for causal inferences about program effects under robust assumptions. Bethesda, MD: Abt Associates; 2012:.
3. Bloom H. S.Accounting for no-shows in experimental evaluation designs.Evaluation Review. 1984;8:225-246.
4. Bloom H. S.Learning more from social experiments: Evolving analytic approaches. New York, NY: Russell Sage Foundation; 2005:.
5. Bloom H. S.,Michalopoulos C.When is the story in the subgroups? Strategies for interpreting and reporting intervention effects for subgroups. New York, NY: Manpower Demonstration Research Corporation; 2010:.
6. Bloom H. S.,Raudenbush S. S.,Weiss M.Estimating variation in program impacts: Theory, practice and applications. New York, NY: Manpower Demonstration Research Corporation; 2011:.
7. Bos J. M.The labor market value of remedial education: Evidence from time series data on an experimental program for school dropouts (Doctoral dissertation, Robert F. Wagner Graduate School of Public Service, New York University, 1995).Dissertation Abstracts International. 1995;56:4139.
8. Fernald L. C. H.,Hamad R.,Karlan D.,Ozer E. J.,Zinman J.Small individual loans and mental health: A randomized controlled trial among South African adults.BMC Public Health. 2008;8:409.
9. Frangakis C. E.,Rubin D. B.Principal stratification in causal inference.Biometrics. 2002;58:21-29.
10. Gaubert J. M.,Gubits D.,Alderson D. P.,Knox V.The supporting healthy marriage evaluation: Final implementation findings. OPRE Report 2012-12. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services; 2012:.
11. Gibson C. M.Privileging the participant: The importance of subgroup analysis in social welfare evaluations.American Journal of Evaluation. 2003;24:443-469.
12. Greenberg David H.,Shroder Mark.The Digest of Social Experiments. 2004;:.
13. Ham J. C.,LaLonde R. J.The effect of sample selection and initial conditions in duration models: Evidence from experimental data on training.Econometrica. 1996;64:175-205.
14. Hamilton W. L.,Burstein N. R.,Baker A. J.,Earle A.,Gluckman S.,Peck L.,White A.The New York state child assistance program: Five year impacts, costs, and benefits. Cambridge, MA: Abt Associates; 1996:.
15. Harknett K.Estimating effects for program participants using propensity score does receiving an earnings supplement affect union formation?.Evaluation Review. 2006;30:741-778.
16. Harvill E.,Peck L. R.,Bell S. H.On overfitting in analysis of symmetrically-predicted endogenous subgroups. 2012, November 10:.
17. Hsaio C.,Shen Y.,Wang B.,Weeks G.Evaluating the impacts of Washington state repeated job search services on the earnings of prime-age female TANF recipients.Journal of Applied Econometrics. 2007;22:453-475.
18. Kemple J. J.,Snipes J. C.Career academies: Impacts on students' engagement and performance in high school. New York, NY: Manpower Demonstration Research Corporation; 2000:.
19. Kemple J. J.,Snipes J. C.,Bloom H. S.New York, NY: MDRC; 2001:.
20. Klerman J. A.Subgroup analysis: A view from the trenches. Cambridge, MA: Abt Associates; 2010:.
21. Macias C.,Jones D. R.,Hargreaves W. A.,Wang Q.,Rodican C. F.,Barreira P. J.,Gold P. B.When programs benefit some people more than others: Tests of differential service effectiveness.Administration and Policy in Mental Health and Mental Health Services Research. 2008;35:283-294.
22. Morris P. A.,Hendra R.Losing the safety net: How a time-limited welfare policy affects families at risk of reaching time limits.Developmental Psychology. 2009;45:383-400.
23. Moulton S.,Peck L. R.,Dillman K.-N.Does neighborhood quality impact health and well-being? Evidence from the Moving to Opportunity Demonstration. 2012, November 10:.
24. Orr L.Social experiments: Evaluating public programs with experimental methods. New York, NY: Sage; 1999:.
25. Orr L. L.,Bloom H. S.,Bell S. H.,Doolittle F.,Lin W.Does job training for the disadvantaged work? Evidence from the national JTPA study. Washington, DC: Urban Institute Press; 1996:.
26. Peck L. R.Do social programs affect nonparticipants? Evidence from the child assistance program. 1999:.
27. Peck L. R.Subgroup analysis in social experiments (Doctoral dissertation, Robert F. Wagner Graduate School of Public Service, New York University, 2002).Dissertation Abstracts International. 2002;63:359.
28. Peck L. R.Subgroup analysis in social experiments: Measuring program impacts based on post treatment choice.American Journal of Evaluation. 2003;24:157-187.
29. Peck L. R.Using cluster analysis in program evaluation.Evaluation Review. 2005;29:178-196.
30. Peck L. R.What are the effects of welfare sanction policies? Or, using propensity scores as a subgroup indicator to learn more from social experiments.American Journal of Evaluation. 2007;28:256-274.
31. Peck L. R.,Bell S. H.,Heid C.,Mashburn A.,Downer J.,Cook R.,Jenkins F.How do children's early experiences of quality care and education impact their cognitive, social and behavioral outcomes?. in progress:.
32. Schochet P. Z.Is regression adjustment supported by the Neyman model for causal inference?.Journal of Statistical Planning and Inference. 2010;140:246-259.
33. Schochet P. Z.,Burghardt J.Using propensity scoring to estimate program-related subgroup impacts in experimental program evaluations.Evaluation Review. 2007;31:95-120.
34. Shroder M.Locational constraint, housing counseling, and successful lease-up in a randomized housing voucher experiment.Journal of Urban Economics. 2002;51:315-338.
35. Unlu F.,Bozzi L.,Layzer C.,Smith A.,Price C.,Hurtig R.Linking implementation fidelity to impacts in an RCT: A matching approach. Cambridge, MA: Abt Associates. Unpublished manuscript; 2011:.
36. Unlu F.,Yamaguchi R.,Bernstein L.,Edmunds J.Estimating impacts on program-related subgroups in North Carolina's early college high school study. Cambridge, MA: Abt Associates. Unpublished manuscript; 2011:.
37. Wood R. G.,Quinn M.,Clarkwest A.BSF's effects on couples who attended group relationship skills sessions: A special analysis of 15-month data. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families; 2011:.
38. Zhai F. C.,Raver C.,Jones S. M.Academic performance of subsequent schools and impacts of early interventions: Evidence from a randomized controlled trial in head start settings.Children and Youth Services Review. 2012;34:946-954.
39. Zhai F. C.,Raver C.,Jones S. M.,Li-Grining C. P.,Pressler E.,Gao Q.Dosage effects on school readiness: Evidence from a randomized classroom-based intervention.Social Service Review. 2010;84:615-655.
40. Zhai F. C.,Raver C.,Li-Grining C.Classroom-based interventions and teachers' perceived job stressors and confidence: Evidence from a randomized trial in head start settings.Early Childhood Research Quarterly. 2011;26:442-452.