Natural experiments as a means of testing causal inferences

Causality: Wiley Series in Probability and Statistics

Volumn , Issue , 2012, Pages 253-272

  Rutter, Michael ^a  

^a MEDICAL RESEARCH COUNCIL   (United Kingdom)

Author keywords

'Natural experiments' naturally occurring, in separating variables; 'Natural experiments' testing causal inferences; Measures, and target populations specified; MR, genotype in hypothesised cause, RD for unmeasured confounders; Noncausal interpretations of association; Reverse causation, a key issue; SEMs, treating confounders as latent variables; The twin strategy, use of multivariate twin analyses; Uncertainties regarding unmeasured confounders

Indexed keywords

EID: 84957098699     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781119945710.ch18     Document Type: Chapter

References (85)

1. Academy of Medical Sciences (2007) Identifying the Environmental Causes of Disease: How should we decide what to believe and when to take action? London: Academy of Medical Sciences.
2. Anderson, K.E., Lytton, H. and Romney, D.M. (1986) Mothers' interactions with normal and conduct-disordered boys: Who affects whom? Developmental Psychology, 22, 604-609.
3. Baron, R.M. and Kenny, D.A. (1986) The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182.
4. Bell, R.Q. (1968) A reinterpretation of the direction of effects in studies of socialization. Psychological Review, 75, 81-95.
5. Bell, R.Q. and Harper, L.V. (1977) Child Effects on Adults. Hillsdale, NJ: Erlbaum.
6. Brown, G.W., Harris, T.O. and Bifulco, A. (1986) Long-term effects of early loss of parent, in Depression in Childhood: developmental perspectives (eds M. Rutter, C. Izard and P. Reed). New York: Guilford Press, pp. 251-296.
7. Cahan, S. and Cohen, N. (1989) Age versus schooling effects on intelligence development. Child Development, 60, 1239-1249.
8. Caspi, A., Moffitt, T.E., Morgan, J., Rutter, M., Taylor, A., Arseneault, L., et al. (2004) Maternal expressed emotion predicts children's antisocial behavior problems: Using monozygotic-twin differences to identify environmental effects on behavioral development. Developmental Psychology, 40, 149-161.
9. Champion, L. A., Goodall, G. and Rutter, M. (1995). Behavioural problems in childhood and stressors in early adult life. I: A 20-year follow-up of London school children. Psychological Medicine, 25, 231-246.
10. Coid, J., Kirkbride, J.B., Barker, D., Cowden, F., Stamps, R., Yang, M. and Jones, P. B. (2008) Raised incidence rates of all psychoses among migrant groups: findings from the East London first episode psychosis study. Archives of General Psychiatry, 65 (11), 1250-1258.
11. Cook, T.D. and Campbell, D.T. (1979) Quasi-experimentation: design and analysis issues for field settings. Chicago: Rand-McNally.
12. Cornfield, J., Haenszel, W., Hammond, E., Lilienfeld, A., Shimkin, M. and Wynder, E. (1959) Smoking and lung cancer: recent evidence and a discussion of some questions. Journal of the National Cancer Institute, 22, 173-203.
13. Costello, E. J., Compton, F. N., Keeler, G. and Angold, A. (2003) Relationships between poverty and psychopathology: A natural experiment. Journal of American Medical Association, 290, 2023-2029.
14. Davey Smith, G. and Ebrahim, S. (2003) 'Mendelian randomization': Can genetic epidemiology contribute to understanding environmental determinants of disease? International Journal ofEpidemiol- ogy, 32, 1-22.
15. Davey Smith, G. and Ebrahim, S. (2005) What can Mendelian randomization tell us about modifiable behavioural and environmental exposures. British Medical Journal, 330, 1076-1079.
16. Dawid, P. and Pickles, A. (2007) Appendix I: Statistics, in Identifying the Environmental Causes of Disease: How should we decide what to believe and when to take action? (ed. M. Rutter). London: Academy of Medical Sciences, pp. 93-102.
17. D'Onofrio, B.M., Turkheimer, E., Eaves, L.J., Corey, L.A., Berg, K., Solaas, M.H. and Emery, R.E. (2003) The role of the children of twins design in elucidating causal relations between parent characteristics and child outcomes. Journal of Child Psychology and Psychiatry, 44, 1130-1144.
18. D'Onofrio, B.M., Van Hulle, C.A., Waldman, I.D., Rodgers, J.L., Harden, K.P., Rathouz, PJ. and Lahey, B.B. (2008) Smoking during pregnancy and offspring externalizing problems: an exploration of genetic and environmental confounds. Development and Psychopathology, 20, 139-164.
19. Duyme, M., Dumaret, A.-C. and Tomkiewicz, S. (1999). How can we boost IQs of 'dull children'? A late adoption study. Proceedings of the National Academy of Sciences, USA, 96, 8790-8794.
20. Eaves, L.J., Silberg, J.L. and Maes, H.H. (2005) Revisiting the children of twins: Can they be used to resolve the environmental effects of dyadic parental treatment on child behaviour? Twin Research and Human Genetics, 8, 283-290.
21. Fairchild, A.J. and MacKinnon, D.P. (2009) A general model for testing mediation and moderation effects. Preventative Science, 10, 87-99.
22. Fergusson, D.M., Horwood, L.J. and Lynskey, M.T. (1992) Family change, parental discord and early offending. Journal of Child Psychology and Psychiatry, 33, 1059-1075.
23. Foster, E.M. and McLanahan, S. (1996) An illustration of the use of instrumental variables: Do neighborhood conditions affect a young person's chance of finishing high school? Psychological Methods, 1, 249-260.
24. Ge, X., Conger, R.D., Cadoret, R.J., Neiderhiser, J.M., Yates, W., Troughton, E. and Stewart, M.A. (1996) The developmental interface between nature and nurture: a mutual influence model of child antisocial behavior and parenting. Developmental Psychology, 32, 574-589.
25. Gill, R.D. and Robins, J.M. (2001) Causal inference for complex longitudinal data: the continuous case. Annals of Statistics, 29, 1785-1811.
26. Grant, B.F. and Dawson, D.A. (1997) Age at onset of alcohol use and its association withDSM-IV alcohol abuse and dependence: results from the National Longitudinal Alcohol Epidemiologic Survey. Journal of Substance Abuse, 9, 103-110.
27. Haviland, A.M., Rosenbaum, P.R., Nagin, D.S. and Tremblay, R.E. (2008) Combining group-based trajectory modelling and propensity score matching for causal inferences in nonexperimental longitudinal data. Developmental Psychology, 44, 422-436.
28. Honda, H., Shimizu, Y. and Rutter, M. (2005) No effect of MMR withdrawal on the incidence of autism: a total population study. Journal of Child Psychology and Psychiatry, 46, 572-579.
29. Irons, D.E., McGue, M., Iacono, W.G. and Oetting, W.S. (2007) Mendelian randomization: a novel test of the gateway hypothesis and models of gene-environment interplay. Development and Psychopathology, 19, 1181-1195.
30. Jaffee, S.R. (2011) Genotype-environment correlations: definitions, methods of measurement, and impli-cations for research on adolescent psychopathology, in The Dynamic Genome and Mental Health: the role of genes and environments in youth development (eds K.K. Kendler, S.R. Jaffee and D. Romer), New York: Oxford University Press, pp. 79-102.
31. Jaffee, S. R. and Price, T. S. (2007) Gene-environment correlations: a review of the evidence and implications for prevention of mental illness. Molecular Psychiatry, 12, 432-442.
32. Jaffee, S.R., Caspi, A., Moffitt, T.E., Polo-Tomas, M., Price, T.S. and Taylor, A. (2004) The limits of child effects: evidence for genetically mediated child effects on corporal punishment but not on physical maltreatment. Developmental Psychology, 40, 1047-1058.
33. Jaffee, S.R., Strait, L.B. and Odgers, C.L. (2011) From correlates to causes: Can quasi-experimental studies and statistical innovations bring us closer to identifying the causes of antisocial behaviour? Psychological Bulletin [Oct 24 Epub ahead of print].
34. Jones, P.B. and Fung, W.L.A. (2005) Ethnicity and mental health - the example of schizophrenia in the African Caribbean population in Europe, in Ethnicity and Causal Mechanisms (eds M. Rutter and M. Tienda). Cambridge: Cambridge University Press, pp. 227-261
35. Katan, M.B. (1986) Apolipoprotein E isoforms, serum cholesterol, and cancer. Lancet, 1, 507-508.
36. Kendler, K.S. and Baker, J.H. (2007) Genetic influences on measures of the environment: a systematic review. Psychological Medicine, 37, 615-626.
37. Kendler, K.S. and Prescott, C.A. (2006) Genes, Environment, and Psychopathology: understanding the causes of psychiatric and substance use disorders. New York: Guilford Press.
38. Lynch, S.K., Turkheimer, E., D'Onofrio, B.M., Mendle, J. and Emery, R.E. (2006) A genetically informed study of the association between harsh punishment and offspring behavioural problems. Journal of Family Psychology, 20, 190-198.
39. McClellan, J.M., Susser, E. and King, M.C. (2006) Maternal famine, de novo mutations, and schizophrenia. Journal of the American Medical Association, 296, 582-584.
40. McGue, M. and Iacono, W.G. (2005) The association of early adolescent problem behavior with adult psychopathology. American Journal of Psychiatry, 162, 1118-1124.
41. McKim, V.R. and Turner, S.P. (eds) (1997) Causality in Crisis?: statistical methods and the search for causal knowledge in the social sciences. Notre Dame, IN: University of Notre Dame Press.
42. MacKinnon, D.P., Fairchild, A.J. and Fritz, M.S. (2007) Mediation analysis. Annual Review of Psychology, 58, 593-614.
43. Maes, H. H., Woodard, C.E., Murrelle, L., Meyer, J.M., Silberg, J.L., Hewitt, J.K., et al. (1999) Tobacco, alcohol and drug use in eight- to 16-year-old twins: the Virginia twin study of adolescent behavioral development. Journal of Studies on Alcohol, 60, 293-305.
44. Marmot, M.G. and Syme, S.L. (1976) Acculturation and coronary heart disease in Japanese-Americans. American Journal of Epidemiology, 104, 225-247.
45. Maynard, R.A. (ed.) (1997) Kids Having Kids: economic costs and social consequences of teen pregnancy. Washington, DC: Urban Institute Press.
46. Melhuish, E., Belsky, J., Leyland, A.H. and Barnes, J. (2008) Effects of fully-established Sure Start Local Programmes on 3-year-old children and their families living in England: a quasi-experimental observational study. National Evaluation of Sure Start Research Team. Lancet, 8, 1641-1647.
47. Miech, R.A., Caspi, A., Moffitt, T.E., Entner Wright, B.R. and Silva, P.A. (1999) Low socio-economic status and mental disorders: a longitudinal study of selection and causation during young adulthood. American Journal of Sociology, 104, 1096-1131.
48. Moffitt, T.E. and The E-Risk Study Team. (2002) Teenaged mothers in contemporary Britain. Journal of Child Psychology and Psychiatry, 43, 727-742.
49. Nagin, D.S., Barker, T., Lacourse, E. and Tremblay, R.E. (2008) The interrelationship of temporally distinct risk markers and the transition from childhood physical aggression to adolescent violent delinquency, in Applied Data Techniques for Turning Points Research. New York: Routledge, Chapter 2, pp. 17-36.
50. Obel, C., Olsen, J., Brink Heriksen, T., Rodriguez, A., Jarvelin, M-R., Moilanen, R., Parner, E., Markussen Linnet, K., Taanila, A., Ebeling, H., Heiervang, E. and Gissler, M. (2011) Is maternal smoking during pregnancy arisk factor for hyperkinetic disorder? Findings from a sibling design. International Journal of Epidemiology, 40, 338-345.
51. O'Connor, T.G., Deater-Deckard, K., Fulker, D., Rutter, M. and Plomin, R. (1998) Genotype-environment correlations in late childhood and early adolescence: antisocial behavioral problems and coercive parenting. Developmental Psychology, 34, 970-981.
52. Odgers, C.L., Caspi, A., Nagin, D.S., Piquero, A.R., Slutske, W.S., Milne, B.J., Dickson, N., Poulton, R. and Moffitt, T.E. (2008) Is it important to prevent early exposure to drugs and alcohol among adolscents? Psychological Science, 19, 1037-1044.
53. Pearl, J. (1995) Causal diagrams for empirical research, Biometrika, 82, 669-688.
54. Pike, A., McGuire, S., Hetherington, E.M., Reiss, D. and Plomin, R. (1996) Family environment and adolescent depression and antisocial behaviour: a multivariate genetic analysis. Developmental Psychology, 32, 590-603.
55. Prescott, C.A. andKendler, K.S. (1999) Age at first drink and risk for alcoholism: anoncausal association. Alcoholism: Clinical and Experimental Research, 23, 101-107.
56. Rice, F., Harold, G.T., Boivin, J., Hay, D.F., van den Bree, M. and Thapar, A. (2009) Disentangling prenatal and inherited influences in humans with an experimental design. Proceedings of the National Academy of Science USA, 106, 2464-2467.
57. Robins, L. (1966) Deviant Children Grown Up. Baltimore: Williams & Wilkins.
58. Robins, J.M., Hernan, M.A. and Brumback, B. (2000) Marginal structural models and causal inference in epidemiology. Epidemiology, 11, 550-560.
59. Rutter, M. (1983) Statistical and personal interactions: facets and perspectives, in: D. Human Development: An Interactional Perspective (eds D. Magnusson and V. Allen). New York: Academic Press, pp. 295-319.
60. Rutter, M. (2005) Incidence of autism spectrum disorders: changes over time and their meaning. Acta Paediatrica, 94, 2-15.
61. Rutter, M. (2006) Genes and Behavior: nature-nurture interplay explained. Oxford, UK: Blackwell.
62. Rutter, M. (2007) Proceeding from observed correlation to causal inference: the use of natural experiments. Perspectives on Psychological Science, 2, 377-395.
63. Rutter, M. (2009) Epidemiological methods to tackle causal questions. International Journal of Epidemiology, 38, 3-6.
64. Rutter, M. and Azis-Clauson, C. (2011) Extreme deprivation, in The SAGE Handbook of Developmental Disorders (eds P. Howlin, T. Charman and M. Ghaziuddin), SAGE Publications Ltd., pp. 529550.
65. Rutter, M. and Sonuga-Barke, E.J. (eds) (2010) Deprivation-specific psychological patterns: effects of institutional deprivation. Monographs of the Society for Research in Child Development, 75 (1).
66. Rutter, M., Pickles, A., Murray, R. and Eaves, L. (2001) Testing hypotheses on specific environmental causal effects on behaviour. Psychological Bulletin, 127, 291-324.
67. Rutter, M., Thorpe, K., Greenwood, R., Northstone, K. and Golding, J. (2003). Twins as a natural experiment to study the causes of mild language delay: I. Design; twin-singleton differences in language, and obstetric risks. Journal of Child Psychology and Psychiatry, 44, 326-334.
68. Sampson, R.J., Laub, J.H. and Wimer, C. (2006) Does marriage reduce crime? A counterfactual approach to within-individual causal effects. Criminology, 44, 465-508.
69. Shadish, W.R., Cook, T.D. and Campbell, D.T. (2002). Experimental and Quasi-experimental Designs for Generalized Causal Inference. Boston, MA: Houghton Mifflin.
70. Silberg, J.L. and Eaves, L.J. (2004) Analysing the contributions of genes and parent-child interaction to childhood behavioural and emotional problems: a model for the children of twins. Psychological Medicine, 34, 347-356.
71. Silberg, J.L., Maes, H. and Eaves, L.J. (2010) Genetic and environmental influences on the transmission of parental depression to children's depression and conduct disturbance: an extended children of twins study. Journal of Child Psychology and Psychiatry, 51, 734-744.
72. Spergel, I.A. (1990) Youth gangs: continuity and change, in Crime and Justice: a review of research (eds M. Tonry and N. Morris), vol. 12. Chicago: University of Chicago Press, pp. 171-275.
73. St Clair, D., Xu, M., Wang, P., Yu, Y., Fang, Y., Zhang, F., et al. (2005) Rates of adult schizophrenia following prenatal exposure to the Chinese famine of 1959-1961. Journal of the American Medical Association, 294, 557-562.
74. Stattin, J. and Magnusson, D. (1990) Paths Through Life, vol. 2, Pubertal Maturation in Female Development. Hillsdale, NJ: Erlbaum.
75. Stein, Z.A., Susser, M., Saenger, G. and Marolla, F. (1975) Famine and human development: the Dutch hunger winter of 1944-1945. New York: Oxford University Press.
76. Stillman, S., McKenzie, D. and Gibson, J. (2009) Migration and mental health: evidence from a natural experiment. Journal ofHealth Economics, 3, 677-687.
77. Stoolmiller, M. (1999) Implications of the restricted range of family environments for estimates of heritability and nonshared environment in behaviour-genetic adoption studies. Psychological Bulletin, 125, 392-409.
78. Thapar, A., Harold, G., Rice, F., Ge, X., Boivin, J., Hay, D., van den Bree, M. and Lewis, A. (2007) Do intrauterine or genetic influences explain the foetal origins of chronic disease? A novel experimental method for disentangling effects. BMC Medical Research Methodology, 7, 25.
79. Thapar, A., Rice, F., Hay, D., Boivin, J., Langley, K., van den Bree, M., Rutter, M., & Harold, G. (2009) Prenatal smoking might not cause attention-deficit/hyperactivity disorder: evidence from a novel design. Biological Psychiatry, 66, 722-727.
80. Thistlewaite, D.L. and Campbell, D.T. (1960) Regression-discontinuity analysis: an alternative to the ex-post facto experiment. Journal of Educational Psychology, 51, 309-317.
81. Thornberry, T.P., Krohn, M.D., Lizotte, A.J. and Chard-Wiershem, D. (1993). The role of juvenile gangs in facilitating delinquent behavior. Journal of Research in Crime and Delinquency, 30, 55-87.
82. Thorpe, K., Rutter, M. and Greenwood, R. (2003) Twins as a natural experiment to study the causes of mild language delay: II. Family interaction risk factors. Journal of Child Psychology and Psychiatry, 44, 342-355.
83. Valencia, M.E., Bennett, P.H., Ravussin, E., Esparza, J., Fox, C. and Schulz, L.O. (1999) The Pima Indians in Sonora, Mexico. Nutrition Reviews, 57, S55-S58.
84. Vitaro, F., Brendgen, M. and Arseneault, L. (2009) The discordant MZ-twin method: one step closer to the holy grail of causality. International Journal of Behavioral Development, 33, 376-382.
85. Wakschlag, L.S., Pickett, K.E., Middlecamp, M.K., Walton, L.L., Tenzer, P. and Leventhal, B.L. (2003) Pregnant smokers who quit, pregnant smokers who don't: Does history of problem behaviour make a difference? Social Science and Medicine, 56, 2449-2460.