Causal inference in sociological research

Annual Review of Sociology

Volumn 36, Issue , 2010, Pages 21-47

  Gangl, Markus ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

counterfactual model; endogeneity; identification; nonparametric estimation; treatment effects; unobserved heterogeneity

Indexed keywords

EID: 77955621189     PISSN: 03600572     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.soc.012809.102702     Document Type: Article

References (159)

1. Abbring JH, Heckman JJ. 2007. Econometric evaluation of social programs, Part III: distributional treatment effects, dynamic treatment effects, dynamic discrete choice, and general equilibrium policy evaluation. See Heckman & Leamer 2007, pp. 5145-5303
2. Allison PD. 1990. Change scores as dependent variables in regression analysis. Sociol. Methodol. 20:93-114
3. Allison PD. 1994. Using panel data to estimate the effects of events. Sociol. Methods Res. 23:174-199
4. Allison PD. 2009. Fixed Effects Regression Models. Thousand Oaks, CA: Sage
5. Angrist JD. 1990. Lifetime earnings and the Vietnam era draft lottery: evidence from social security administrative records. Am. Econ. Rev. 80:313-335
6. Angrist JD. 2001. Estimations of limited dependent variable models with dummy endogenous regressors: simple strategies for empirical practice. J. Bus. Econ. Stat. 19:2-16
7. Angrist JD, Evans WN. 1998. Children and their parents' labor supply: evidence from exogenous variation in family size. Am. Econ. Rev. 88:450-477
8. Angrist JD, Imbens GW. 1995. Two-stage least squares estimation of average causal effects in models with variable treatment intensity. J. Am. Stat. Assoc. 90:431-442
9. Angrist JD, Imbens GW, Rubin DB. 1996. Identification of causal effects using instrumental variables. J. Am. Stat. Assoc. 91:444-455
10. Angrist JD, Krueger AB. 1999. Empirical strategies in labor economics. In Handbook of Labor Economics, ed. O Ashenfelter, D Card, 3:1277-1366 Amsterdam: Elsevier
11. Angrist JD, Krueger AB. 2001. Instrumental variables and the search for identification: from supply and demand to natural experiments. J. Econ. Perspect. 15:69-85
12. Angrist JD, Lavy V. 1999. Using Maimonides' rule to estimate the effect of class size on scholastic achievement. Q.J. Econ. 114:533-575
13. Angrist JD, Pischke J-S. 2009. Mostly Harmless Econometrics. An Empiricist's Companion. Princeton, NJ: Princeton Univ. Press
14. Ashenfelter O, Rouse C. 1998. Income, schooling, and ability: evidence from a new sample of identical twins. Q.J. Econ. 113:253-284 (Pubitemid 128039960)
15. Athey S, Imbens GW. 2006. Identification and inference in nonlinear difference-in-difference models. Econometrica 74:431-497
16. Axinn WG, Barber JS. 2001. Mass education and fertility transition. Am. Sociol. Rev. 66:481-505
17. Baltagi BH. 2008. Econometric Analysis of Panel Data. Chicester: Wiley. 4th ed.
18. Barber JS, Murphy SA, Verbitsky N. 2004. Adjusting for time-varying confounding in survival analysis. Sociol. Methodol. 34:163-192
19. Berk RA, de Leeuw J. 1999. An evaluation of California's inmate classification system using a generalized regression discontinuity design. J. Am. Stat. Assoc. 94:1045-1052
20. Berk RA, Rauma D. 1983. Capitalizing on nonrandom assignment to treatments: a regression-discontinuity evaluation of a crime-control program. J.Am. Stat. Assoc. 78:21-27
21. Bertrand M, Mullainathan S. 2004. Are Greg and Emily more employable than Lakisha and Jamal? A field experiment on labor market discrimination. Am. Econ. Rev. 94:991-1013
22. BitlerMP, Gelbach JB, Hoynes HW. 2006. What mean impacts miss: distributional effects of welfare reform experiments. Am. Econ. Rev. 96:988-1012
23. Blundell R, Dearden L, Sianesi B. 2005. Evaluating the effects of education on earnings: models, methods and results from the national child development survey. J. R. Stat. Soc. A 168:473-512
24. Blundell R, Dias MC. 2009. Alternative approaches to evaluation in empirical microeconomics. J. Hum. Resour. 44:565-640
25. Bound J, Jaeger DA, Baker RM. 1995. Problems with instrumental variables estimation when the correlation between the instruments and the endogenous explanatory variable is weak. J. Am. Stat. Assoc. 90:443-450
26. Brand JE. 2006. The effects of job displacement on job quality: findings from the Wisconsin longitudinal study. Res. Soc. Stratif. Mobil. 24:275-298
27. Brand JE, Halaby CN. 2006. Regression and matching estimates of the effects of elite college attendance on educational and career achievement. Soc. Sci. Res. 35:749-770
28. Brand JE, Xie Y. 2007. Identification and estimation of causal effects with time-varying treatments and time-varying outcomes. Sociol. Methodol. 37:393-434
29. Brock WA, Durlauf SN. 2001. Discrete choice with social interactions. Rev. Econ. Stud. 68:235-60
30. Budig MJ, England P. 2001. The wage penalty for motherhood. Am. Sociol. Rev. 66:204-225
31. Carneiro P, Hansen K, Heckman JJ. 2003. Estimating distributions of treatment effects with an application to the returns to schooling and measurement of the effects of uncertainty on college choice. Int. Econ. Rev. 44:361-422
32. Chernozhukov V, Hansen C. 2006. Instrumental quantile regression inference for structural and treatment effect models. J. Econom. 132:491-525
33. Clampet-Lundquist S,Massey DS. 2008. Neighborhood effects on economic self-sufficiency: a reconsideration of the Moving to Opportunity experiment. Am. J. Sociol. 114:107-143
34. Coleman JS. 1990. Foundations of Social Theory. Cambridge, MA: Harvard Univ. Press
35. Cook TD, Campbell DT. 1979. Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally
36. Correll SJ, Benard S, Paik I. 2007. Getting a job: Is there a motherhood penalty? Am. J. Sociol. 112:1297-1338
37. Crepon B, Ferracci M, Jolivet G, van den Berg GJ. 2009. Active labor market policy effects in a dynamic setting. J. Eur. Econ. Assoc. 7:595-605
38. Cunha F, Heckman JJ, Navarro S. 2006. Counterfactual analysis of inequality and social mobility. In Mobility and Inequality: Frontiers of Research in Sociology and Economics, ed. SL Morgan, DB Grusky, GS Fields, pp. 290-348. Stanford, CA: Stanford Univ. Press
39. Dehejia R. 2005. Practical propensity score matching: a reply to Smith and Todd. J. Econom. 125:355-364
40. Dehejia RH, Wahba S. 2002. Propensity score-matching methods for nonexperimental causal studies. Rev. Econ. Stat. 84:151-161
41. DiPrete TA, Gangl M. 2004. Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments. Sociol. Methodol. 34:271-310
42. DiPrete TA, McManus PA. 2000. Family chance, employment transitions, and the welfare state: household income dynamics in the United States and Germany. Am. Sociol. Rev. 65:343-370
43. Downey D, Broh B, von Hippel P. 2004. Are schools the great equalizer? Cognitive inequality during the summer months and the school year. Am. Sociol. Rev. 69:613-635
44. Duncan GJ, Yeung WJ, Brooks-Gunn J, Smith JR. 1998. How much does childhood poverty affect the life chances of children? Am. Sociol. Rev. 63:406-423
45. Durlauf SN. 2001. A framework for the study of individual behavior and social interactions. Sociol. Methodol. 31:47-87
46. Durlauf SN. 2002. On the empirics of social capital. Econ. J. 112:F459-79
47. Elwert F, Christakis NA. 2008. Wives and ex-wives: a new test for homogamy bias in the widowhood effect. Demography 45:851-873
48. Firebaugh G. 2008. Seven Rules for Social Research. Princeton, NJ: Princeton Univ. Press
49. Fox J. 2008. Applied Regression Analysis and Generalized Linear Models. Los Angeles: Sage. 2nd ed.
50. Frank KA. 2000. Impact of a confounding variable on a regression coefficient. Sociol. Methods Res. 29:147-194
51. Fredriksson P, Johansson P. 2008. Dynamic treatment assignment: the consequences for evaluations using observational data. J. Bus. Econ. Stat. 26:435-445
52. Freedman DA, Berk RA. 2008. Weighting regressions by propensity scores. Eval. Rev. 32:392-409
53. Freese J. 2008. Genetics and social structure. Am. J. Sociol. 114:S1-35
54. Gangl M. 2004. Welfare states and the scar effects of unemployment: a comparative analysis of the United States and West Germany. Am. J. Sociol. 109:1319-1364
55. Gangl M. 2006. Scar effects of unemployment: an assessment of institutional complementarities. Am. Sociol. Rev. 71:986-1013
56. Gangl M, DiPrete TA. 2006. Kausalanalyse durch Matchingverfahren [Matching methods for the causal analysis of observational data]. In Methoden der empirischen Sozialforschung. Sonderh. 44 Kolner Z. Soziol. Sozialpsychol., ed. A Diekmann, pp. 396-420. Wiesbaden: VS Verlag
57. Garfinkel I, Manski CF, Michalopoulos C. 1992. Micro experiments and macro effects. In Evaluating Welfare and Training Programs, ed. CF Manski, I Garfinkel, pp. 253-273 Cambridge, MA: Harvard Univ. Press
58. Gill RD, Robins JM. 2001. Causal inference for complex longitudinal data: the continuous case. Ann. Stat. 29:1785-1811
59. Goldin C, Rouse C. 2000. Orchestrating impartiality: the impact of "blind" auditions on female musicians. Am. Econ. Rev. 90:715-741
60. Halaby CN. 2004. Panel models in sociological research: theory into practice. Annu. Rev. Sociol. 30:507-544
61. Harding DJ. 2003. Counterfactual models of neighborhood effects: the effect of neighborhood poverty on dropping out and teenage pregnancy. Am. J. Sociol. 109:676-719
62. Heckman JJ. 1978. Dummy endogenous variables in a simultaneous equation system. Econometrica 46:931-959
63. Heckman JJ. 1992. Randomization and social policy evaluation. In Evaluating Welfare and Training Programs, ed. CF Manski, I Garfinkel, pp. 201-230 Cambridge, MA: Harvard Univ. Press
64. Heckman JJ. 1997. Instrumental variables: a study of implicit behavioral assumptions used in making program evaluations. J. Hum. Resour. 32:441-462
65. Heckman JJ. 2000. Causal parameters and policy analysis in economics: a twentieth century retrospective. Q. J. Econ. 115:45-97
66. Heckman JJ. 2001. Micro data, heterogeneity, and the evaluation of public policy: Nobel lecture. J. Polit. Econ. 109:673-748
67. Heckman JJ. 2005. The scientific model of causality. Sociol. Methodol. 35:1-97
68. Heckman JJ, Hotz VJ. 1989. Choosing among alternative nonexperimental methods for estimating the impact of social programs: the case of manpower training. J. Am. Stat. Assoc. 84:862-874
69. Heckman JJ, Ichimura H, Todd PE. 1997a. Matching as an econometric evaluation estimator: evidence from evaluating a job training program. Rev. Econ. Stud. 64:605-654
70. Heckman JJ, Ichimura H, Todd PE. 1998. Matching as an econometric evaluation estimator. Rev. Econ. Stud. 65:261-294
71. Heckman JJ, LaLonde RJ, Smith JA. 1999. The economics and econometrics of active labor market programs. In Handbook of Labor Economics, ed. O Ashenfelter, D Card, 3:1865-2097. Amsterdam: Elsevier
72. Heckman JJ, Leamer EE. 2007. Handbook of Econometrics Volume 6B. Amsterdam: Elsevier
73. Heckman JJ, Robb R. 1985. Alternative methods for evaluating the impact of interventions. In Longitudinal Analysis of Labor Market Data, ed. JJ Heckman, B Singer, pp. 156-245. Cambridge, UK: Cambridge Univ. Press
74. Heckman JJ, Robb R. 1986. Alternative methods for solving the problem of selection bias in evaluating the impact of treatment on outcomes. In Drawing Inferences from Self-Selected Samples, ed. H Wainer, pp. 63-113. New York: Springer
75. Heckman JJ, Smith J, Clements N. 1997b. Making the most out of program evaluations and social experiments: accounting for heterogeneity in program impacts. Rev. Econ. Stud. 64:487-535
76. Heckman JJ, Tobias J, Vytlacil E. 2001. Four parameters of interest in the evaluation of social programs. South. Econ. J. 68:210-223
77. Heckman JJ, Urzua S, Vytlacil E. 2006. Understanding instrumental variables in models with essential heterogeneity. Rev. Econom. Stat. 88:389-432
78. Heckman JJ, Vytlacil E. 2005. Structural equations, treatment effects, and econometric policy evaluation. Econometrica 73:669-738
79. Heckman JJ, Vytlacil EJ. 2007a. Econometric evaluation of social programs, Part I: causal models, structural models and econometric policy evaluation. See Heckman & Leamer 2007, pp. 4779-4874
80. Heckman JJ, Vytlacil EJ. 2007b. Econometric evaluation of social programs, Part II: using the marginal treatment effect to organize alternative econometric estimators to evaluate social programs, and to forecast their effects in new environments. See Heckman & Leamer 2007, pp. 4875-5143
81. Hermn Ma, Brumback B, Robins JM. 2001. Marginal structural models to estimate the joint causal effect of nonrandomized treatments. J. Am. Stat. Assoc. 96:440-448
82. Hirano K, Imbens GW, Ridder G. 2003. Efficient estimation of average treatment effects using the estimated propensity score. Econometrica 71:1161-1189
83. Ho DE, Imai K, King G. 2007. Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Polit. Anal. 15:199-236
84. Holland PW. 1986. Statistics and causal inference. J. Am. Stat. Assoc. 81:945-960
85. Hong G, Raudenbush SW. 2006. Evaluating kindergarten retention policy: a case study of causal inference for multilevel observational data. J. Am. Stat. Assoc. 101:901-910
86. Hong G, Raudenbush SW. 2008. Causal inference for time-varying instructional treatments. J. Educ. Behav. Stat. 33:333-362
87. Hsiao C. 2003. Analysis of Panel Data. Cambridge, UK: Cambridge Univ. Press. 2nd ed.
88. Imai K, King G, Stuart EA. 2008. Misunderstandings between experimentalists and observationalists about causal inference. J. R. Stat. Soc. A 171:481-502
89. Imbens GW. 2003. Sensitivity to exogeneity assumptions in program evaluation. Am. Econ. Rev. 93:126-132
90. Imbens GW. 2004. Nonparametric estimation of average treatment effects under exogeneity: a review. Rev. Econom. Stat. 86:4-29
91. Imbens GW, Angrist JD. 1994. Identification and estimation of local average treatment effects. Econometrica 62:467-475
92. Imbens GW, Lemieux T. 2008. Regression discontinuity designs: a guide to practice. J. Econom. 142:615-35
93. Imbens GW, Rubin DB. 1997. Estimating outcome distributions for compliers in instrumental variables models. Rev. Econ. Stud. 64:555-574
94. Imbens GW, Rubin DB. 2010. Causal Inference in Statistics and the Social Sciences. Cambridge, UK: Cambridge Univ. Press. In press
95. Imbens GW, Wooldridge JM. 2009. Recent developments in the econometrics of program evaluation. J. Econ. Lit. 47:5-86
96. Jones SRG. 1990. Worker interdependence and output: the Hawthorne studies reevaluated. Am. Sociol. Rev. 55:176-190
97. King G, Keohane RO, Verba S. 1994. Designing Social Inquiry: Scientific Inference in Qualitative Research. Princeton, NJ: Princeton Univ. Press
98. Kirk DS. 2009. A natural experiment on residential change and recidivism: lessons from Hurricane Katrina. Am. Sociol. Rev. 74:484-505
99. Koenker R. 2005. Quantile Regression. Cambridge, UK: Cambridge Univ. Press
100. Logan JA. 1996. Opportunity and choice in socially structured labor markets. Am. J. Sociol. 102:114-160
101. Logan JA. 1998. Estimating two-sided logit models. Sociol. Methodol. 28:139-173
102. Logan JA, Hoff PD, Newton MA. 2008. Two-sided estimation of mate preferences for similarities in age, education, and religion. J. Am. Stat. Assoc. 103:559-569
103. LongJS. 1997. Regression Models for Categorical and Limited Dependent Variables. Thousand Oaks, CA: Sage
104. Ludwig J, Liebman JB, Kling JR, Duncan GJ, Katz LF, et al. 2008. What can we learn about neighborhood effects from the Moving to Opportunity experiment? Am. J. Sociol. 114:144-188
105. MacKinnon DP. 2008. Introduction to Statistical Mediation Analysis. New York: Erlbaum
106. Manski C. 1993. Identification of endogenous social effects: the reflection problem. Rev. Econ. Stud. 60:531-542
107. Manski CF. 1995. Identification Problems in the Social Sciences. Cambridge, MA: Harvard Univ. Press
108. Manski CF. 2003. Partial Identifaation of Probabilities Distributions. New York: Springer Manski CF. 2007. Identifaation for Prediction and Decision. Cambridge, MA: Harvard Univ. Press
109. Manski CF, Sandefur GD,McLanahan S, Powers D. 1992. Alternative estimates of the effect of family structure during adolescence on high school graduation. J. Am. Stat. Assoc. 87:25-37
110. McManus PA, DiPrete TA. 2001. Losers and winners: the financial consequences of separation and divorce for men. Am. Sociol. Rev. 66:246-268
111. Moffitt RL. 2005. Remarks on the analysis of causal relationships in population research. Demography 42:91108
112. Morgan SL. 2001. Counterfactuals, causal effect heterogeneity, and the Catholic school effect on learning. Sociol. Educ. 74:341-374
113. Morgan SL. 2005. On the Edge of Commitment: Educational Attainment and Race in the United States. Stanford, CA: Stanford Univ. Press
114. Morgan SL, Harding DJ. 2006. Matching estimators of causal effects. Prospects and pitfalls in theory and practice. Sociol. Methods Res. 35:3-60
115. Morgan SL, Todd JJ. 2008. A diagnostic routine for the detection of consequential heterogeneity of causal effects. Sociol. Methodol. 38:231-281
116. Morgan SL, Winship C. 2007. Counterfactuals and Causal Inference. Methods and Principles for Social Research. Cambridge, UK: Cambridge Univ. Press
117. Ni Bhrolchain M. 2001. 'Divorce effects' and causality in the social sciences. Eur. Sociol. Rev. 17:33-57
118. Pager D. 2003. The mark of a criminal record. Am. J. Sociol. 108:937-975
119. Pearl J. 2000. Causality. Models, Reasoning and Inference. Cambridge, UK: Cambridge Univ. Press
120. Rindfuss RR, Guilkey D, Morgan SP, Kravdal O, Guzzo KB. 2007. Child care availability and first-birth timing in Norway. Demography 44:345-372
121. Robins JM, Herrnn Ma, Brumback B. 2000. Marginal structural models and causal inference in epidemiology. Epidemiology 11:550-560
122. Robins JM, Mark SD, Newey WK. 1992. Estimating exposure effects by modelling the expectation of exposure conditional on confounders. Bio/metrics 48:479-495
123. Rosenbaum PR. 1987. The role of a second control group in an observational study. Stat. Sci. 2:292-306
124. Rosenbaum PR. 2002. Observational Studies. New York: Springer. 2nd ed.
125. Rosenbaum PR, Rubin DB. 1983a. Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. J. R. Stat. Soc. B 45:212-218
126. Rosenbaum PR, Rubin DB. 1983 b. The central role of the propensity score in observational studies. Biometrika 70:41-55
127. Rosenzweig MR, Wolpin KI. 2000. Natural 'natural experiments' in economics. J. Econ. Lit. 38:827-74
128. Rossi PH, Lipsey MW, Freeman HE. 2004. Evaluation: A Systematic Approach. Thousand Oaks, CA: Sage. 7th ed.
129. Rubin DB. 1978. Bayesian inference for causal effects: the role of randomization. Ann. Stat. 6:34-58
130. Rubin DB. 1986. Statistics and causal inference: comment: Which ifs have causal answers? J. Am. Stat. Assoc. 81:961-962
131. Rubin DB. 2001. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Serv. Outcomes Res. Methodol. 2:169-188
132. Rubin DB. 2005. Causal inference using potential outcomes: design, modeling, decisions. J. Am. Stat. Assoc. 100:322-331
133. Rubin DB. 2006. Matched Sampling for Causal Effects. Cambridge, UK: Cambridge Univ. Press
134. Rubin DB, Thomas N. 2000. Combining propensity score matching with additional adjustments for prognostic covariates. J. Am. Stat. Assoc. 95:573-585
135. Ruhm CJ. 1998. The economic consequences of parental leave mandates: lessons from Europe. Q. J. Econ. 113:285-317
136. Sampson RJ. 2008. Moving to inequality: neighborhood effects and experiments meet social structure. Am. J. Sociol. 114:189-231
137. Sampson RJ, Laub JH, Wimer C. 2006. Does marriage reduce crime? A counterfactual approach to within-individual causal effects. Criminology 44:465-508
138. Sampson RJ, Sharkey P, Raudenbush SW. 2008. Durable effects of concentrated disadvantage on verbal ability among African-American children. Proc. Natl. Acad. Sci. USA 105:845-852
139. Shadish WR, Cook TD, Campbell DT. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin
140. Sieben I, de Graaf PM. 2004. Schooling or social origin? The bias in the effect of educational attainment on social orientations. Eur. Sociol. Rev. 20:107-122
141. Smith HL. 1990. Specification problems in experimental and nonexperimental social research. Sociol. Methodol. 20:59-91
142. Smith HL. 1997. Matching with multiple controls to estimate treatment effects in observational studies. Sociol. Methodol. 27:325-353
143. Smith HL. 2003. Some thoughts on causation as it relates to demography and population studies. Popul. Dev. Rev. 29:459-469
144. Smith HL. 2005. Introducing new contraceptives in rural China: a field experiment. Ann. Am. Acad. Polit. Soc. Sci. 599:246-271
145. Smith JA, Todd PE. 2005. Does matching overcome LaLonde's critique of nonexperimental estimators? J. Econom. 125:305-353
146. Sobel ME. 1995. Causal inference in the social and behavioral sciences. In Handbook of Statistical Modeling for the Social and Behavioral Sciences ed. G Arminger, CC Clogg, ME Sobel, pp. 1-38. New York: Plenum
147. Sobel ME. 1998. Causal inference in statistical models of the process of socioeconomic achievement. A case study. Sociol. Methods Res. 27:318-348
148. Sobel ME. 2005. Discussion: 'the scientific model of causality.' Sociol. Methodol. 35:99-133
149. Sobel ME. 2006. What do randomized studies of housing mobility demonstrate? Causal inference in the face of interference. J.Am. Stat. Assoc. 101:1398-1407
150. Train KE. 2003. Discrete Choice Methods with Simulation. Cambridge, UK: Cambridge Univ. Press
151. van der Laan MJ, Robins JM. 2003. Unifified Methods for Censored Longitudinal Data and Causality. New York: Springer
152. Vytlacil EJ. 2002. Independence, monotonicity, and latent index models: an equivalence result. Econometrica 70:331-341
153. Waldfogel J, Han W-J, Brooks-Gunn J. 2002. The effects of early maternal employment on child cognitive development. Demography 39:369-392
154. Winship C, Harding DJ. 2008. A mechanism-based approach to the identification of age-period-cohort models. Sociol. Methods Res. 36:362-401
155. Winship C, Morgan SL. 1999. The estimation of causal effects from observational data. Annu. Rev. Sociol. 25:659-706
156. Wooldridge JM. 2002. Econometric Analysis of Cross Section and Panel Data. Cambridge, MA: MIT Press
157. Wooldridge JM. 2006. Introductory Econometrics: A Modern Approach. Mason, OH: Thompson/South-Western. 3rd ed.
158. Wooldridge JM. 2007. Inverse probability weighted estimation for general missing data problems. J. Econom. 141:1281-1301
159. Yakubovich V. 2006. Weak ties, information, and influence: how workers find jobs in a local Russian labor market. Am. Sociol. Rev. 70:408-421