A Probability Index of the Robustness of a Causal Inference

Journal of Educational and Behavioral Statistics

Volumn 28, Issue 4, 2003, Pages 315-337

  Pan, Wei ^a   Frank, Kenneth A ^b  

^a UNIVERSITY OF CINCINNATI   (United States)

^b MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Causal inference; Confounding variables; Linear models; Regression coefficients; Sensitivity analysis

Indexed keywords

EID: 1642349486     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986028004315     Document Type: Article

References (76)

1. Abbott, A. (1998). The causal devolution. Sociological Methods and Research, 27(2), 148-181.
2. Abelson, R. (1997). On the surprising longevity of flogged horses. Psychological Science, 8(1), 12-15.
3. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444-455.
4. Aroian, L. A. (1947). The probability function of the product of two normally distributed variables. The Annals of Mathematical Statistics, 18(2), 265-271.
5. Aroian, L. A., Taneja, V. S., & Cornwell, L. W. (1978). Mathematical forms of the distribution of the product of two normal variables. Communications in Statistics: Part A Theory and Methods, 7(2), 165-172.
6. Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423-437.
7. Bowden, R. J., & Turkington, D. A. (1984). Instrumental variables. Cambridge, UK: Cambridge University Press.
8. Bowman, K. O., & Shenton, L. R. (1979). Approximate percentage points for Pearson distributions. Biometrika, 66, 147-151.
9. Carver, R. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
10. Chow, S. L. (1988). Significance test or effect size. Psychological Bulletin, 103(1), 105-110.
11. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd Ed.). Hillsdale, NJ: Erlbaum.
12. Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
13. Cohen, J. (1994). The earth is round (p <. 05). American Psychologist, 49, 997-1003.
14. Cohen, J., & Cohen, P. (1983). Applied multivariate regression/correlation analysis for the behavioral sciences (2nd Ed.). Hillsdale, NJ: Erlbaum.
15. Cohen, M. R., & Nagel, E. (1934). An introduction to logic and the scientific method. New York: Harcourt Brace.
16. Cook, T., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin.
17. Cordray, D. S. (1986). Quasi-experimental analysis: A mixture of methods and judgment. New Directions for Program Evaluation, 31, 9-27.
18. Cornwell, L. W., Aroian, L. A., & Taneja, V. S. (1978). Numerical evaluation of the distribution of the product of two normal variables. Journal of Statistical Computing and Simulation, 7, 123-131.
19. Cortina, J. M., & Dunlap, W. P. (1997). On the logic and purpose of significance testing. Psychological Methods, 2, 161-172.
20. Davis, W. A. (1988). Probabilistic theories of causation. In J. H. Fetter (Ed.), Probability and causality (pp. 133-160). Dordrecht: D. Reidel.
21. Dowe, P. (1992). Wesley Salmon's process theory of causality and the conserved quantity theory. Philosophy of Science, 59, 195-216.
22. Duncan, O. D., Featherman, D. L., & Duncan, B. (1972). Socioeconomic background and achievement. New York: Seminar Press.
23. Einhorn, H. J., & Hogarth, R. M. (1986). Judging probable cause. Psychological Review, 99(1), 3-19.
24. Elderton, W. P., & Johnson, N. L. (1969). Systems of frequency curves. London, UK: Cambridge University Press.
25. Featherman, D. L., & Hauser, R. M. (1976). Sexual inequalities and socioeconomic achievement in the U.S. 1962-1973. American Sociological Review, 41, 462-483.
26. Frank, K. A. (2000). The impact of a confounding variable on a regression coefficient. Sociological Methods and Research, 29(2), 147-194.
27. Frick, R. W. (1999). Defending the statistical status quo. Theory and Psychology, 9, 183-189.
28. Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for the data analysis in the behavioral sciences: Methodological issue (pp. 311-339). Hillsdale, NJ: Lawrence Erlbaum.
29. Grayson, D. A. (1998). The frequentist façade and the flight from evidential inference. British Journal of Psychology, 89, 325-345.
30. Harris, R. J. (1997). Significance tests have their place. Psychological Science, 5(1), 8-11.
31. Heckman, J. J. (1997). Instrumental variable: A study of implicit behavioral assumptions used in making program evaluation. Journal of Human Resources, 32, 441-462.
32. Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945-970.
33. Holland, P. W. (1988). Causal inference, path analysis, and recursive structural equations models (With discussion). In C. C. Clogg (Ed.), Sociological methodology (pp. 449-493). Washington, DC: American Sociological Association.
34. Hunter, J. E. (1997). Needed: A ban on the significance test. Psychological Science, 5(1), 3-7.
35. Jacobs, J. E., Finken, L. L., Griffin, N. L., & Wright, J. D. (1998). The career plans of science-talented rural adolescent girls. American Educational Research Journal, 35, 681-704.
36. Kendall, M., Sir, & Stuart, A. (1977). The advanced theory of statistics, Vol. 1, Distribution theory (4th Ed.). New York: Macmillan.
37. Lee, O. (1999). Science knowledge, world views, and information sources in social and cultural contexts: Making sense after a nature disaster. American Educational Research Journal, 36, 187-219.
38. Lin, D. Y., Psaty, B. M., & Kronmal, R. A. (1998). Assessing the sensitivity of regression results to unmeasured confounders in observational studies. Biometrics, 54, 948-936.
39. Mackie, J. (1974). The cement of the universe. Oxford, UK: Oxford University Press.
40. McDonald, R. P. (1997). Haldane's lungs: A case study in path analysis. Multivariate Behavioral Research, 32, 1-38.
41. McKim, V. R., & Turner, S. P. (Eds.). (1997). Causality in crisis? Statistical methods and the search for causal knowledge in the social sciences. Notre Dame, IN: University of Notre Dame Press.
42. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald and the slow progress of soft psychology. Journal of Counseling and Clinical Psychology, 46, 806-834.
43. Meeker, W. Q., Cornwell, L. W., & Aroian, L. A. (1981). The product of two normally distributed random variables. In W. Kenney & R. Odeh (Eds.), Selected tables in mathematical statistics (Vol. VII, pp. 1-256). Providence, RI: American Mathematical Society.
44. Meeker, W. Q., & Escobar, L. A. (1994). An algorithm to compute the CDF of the product of two normal random variables. Communications in Statistics: Part B - Simulation and Computation, 23(1), 271-280.
45. Mill, J. S. [1843] (1973). A system of logic: Ratiocinative and inductive. In J. M. Robson (Ed.), The collected works of John Stuart Mill (vols. 7, 8). Toronto: University of Toronto Press.
46. Morrison, D. E., & Henkel, R. E. (1970). The significance test controversy. Chicago, IL: Aldine.
47. Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. New York: Willey.
48. Okagaki, L., & Frensch, P. A. (1998). Parenting and children's school achievement: A multiethnic perspective. American Educational Research Journal, 35, 123-144.
49. Pan, W. (2002). The distribution of the product of two dependent correlation coefficients with applications in causal inference. Dissertation Abstract International, 62(12), 4137A. (UMI No. AAT 3036725).
50. Pearl, J. (2000). Causality: Models, reasoning, and inference. New York: Cambridge University Press.
51. Pearson, E. S., & Hartley, H. O. (1972). Biometrika tables for statisticians, Vol. II. New York: Cambridge University Press.
52. Pearson, K. (1895). Contributions to the mathematical theory of evolution, II. Skew variations in homogeneous material. Philosophical Transactions of the Royal Society of London, Series A, 186, 343-414.
53. Portes, P. R. (1999). Social and psychological factors in the academic achievement of children of immigrants: a cultural history puzzle. American Educational Research Journal, 36, 489-507.
54. Reichenbach, H. (1956). The direction of time. Berkeley, CA: University of California Press.
55. Rosenbaum, P. R. (1986). Dropping out of high school in the United States: An observational study. Journal of Educational Statistics, 11, 207-224.
56. Rozenboom, W. W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416-428.
57. Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688-701.
58. Salmon, W. (1984). Scientific explanation and the causal structure of the world. Princeton, NJ: Princeton University Press.
59. Salmon, W. (1994). Causality without counterfactuals. Philosophy of Science, 61, 397-312.
60. Salmon, W. (1998). Causality and explanation. New York: Oxford University Press.
61. SAS Institute Inc. (2001). The SAS System for Windows (Version 8.02) [Computer software]. Cary, NC: SAS Institute Inc.
62. Scheines, R., Spirites, P., Glymour, C., Meek, C., & Richardson, T. (1998). The TETRAD project: Constraint based aids to causal model specification. Multivariate Behavioral Research, 33, 65-117.
63. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115-129.
64. Sewell, W. H., Hauser, R. M., & Wolf, W. C. (1980). Sex, schooling, and occupational status. American Journal of Sociology, 86, 551-583.
65. Sobel, M. E. (1996). An introduction to causal inference. Sociological Methods and Research, 24(3), 353-379.
66. Sobel, M. E. (1998). Causal inference in statistical models of the process of socioeconomic achievement: A case study. Sociological Methods and Research, 27(2), 318-348.
67. Sober, E. (1988). The principle of the common cause. In J. H. Fetter (Ed.), Probability and causality (p. 211-228). Dordrecht: D. Reidel.
68. Sohn, D. (1998). Statistical significance and replicability. Theory and Psychology, 8, 291-311.
69. Spirites, P., Glymour, C., & Scheines, R. (1993). Causation, prediction, and search [Lecture Notes in Statistics 81]. New York: Springer-Verlag.
70. Suppes, P. (1970). A probabilistic theory of causality. Amsterdam, NE: North-Holland.
71. Thompson, B. (1999). If statistical significance tests are broken/misused, what practices should supplement or replace them? Theory and Psychology, 9, 165-181.
72. Wainer, H. (1999). One cheer for null hypothesis significance testing. Psychological Methods, 4, 212-213.
73. Wilkinson, L., & Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanation. American Psychologist, 54, 594-604.
74. Winship, C., & Morgan, S. L. (1999). The estimation of causal effects from observed data. Annual Review of Sociology, 25, 659-706.
75. Wolfram Research Inc. (2000). Mathematica (Version 4.1.0.0) [Computer software]. Champaign, IL: Wolfram Research Inc.
76. Woodward, J. (1997). Causal models, probabilities, and invariance. In V. R. McKim & S. P. Turner (Eds.), Causality in crisis? Statistical methods and the search for causal knowledge in the social sciences (pp. 265-315). Notre Dame, IN: University of Notre Dame Press.