Randomization does not justify logistic regression

Statistical Science

Volumn 23, Issue 2, 2008, Pages 237-249

  Freedman, David A ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Average predicted probability; Logistic regression; Logit; Models; Randomization

Indexed keywords

EID: 50849122090     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-STS262     Document Type: Article

References (50)

1. AMEMIYA, T. (1981). Qualitative response models: A survey. J. Economic Literature 19 1483-1536.
2. AMEMIYA, T. (1985). Advanced Econometrics. Harvard Univ. Press.
3. ARIS, E. M. D., HAGENAARS, J. A. P., CROON, M. and VER-MUNT, J. K. (2000). The use of randomization for logit and logistic models. In Proceedings of the Fifth International Conference on Social Science Methodology (J. Blasius, J. Hox, E. de Leuw and P. Smidt, eds.). TT Publications, Cologne.
4. BERK, R. A. (2004). Regression Analysis: A Constructive Critique. Sage, Thousand Oaks, CA.
5. BERKSON, J. (1944). Application of the logistic function to bioassay. J. Amer. Statist. Assoc. 39 357-365.
6. BRADY, H. E. and COLLIER, D. (2004). Rethinking Social Inquiry: Diverse Tools, Shared Standards. Rowman & Littlefield, Lanham, MD.
7. BRANT, R. (1996). Digesting logistic regression results. The American Statistician 50 117-119.
8. CHRYSTAL, G. (1889). Algebra: An Elementary Text Book for the Higher Classes of Secondary Schools and for Colleges. Part II. Adam and Charles Black, Edinburgh. Available on Google Scholar 7/28/07.
9. DABROWSKA, D. M. and SPEED, T. P. (1990). On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Statist. Sci. 5 456-480. MR1092986
10. DE MOIVRE, A. (1697). A method of raising an infinite multinomial to any given power, or extracting any given root of the same. Philos. Trans. Roy. Soc. London 19 619-625.
11. DUCH, R. M. and PALMER, H. D. (2004). It's not whether you win or lose, but how you play the game. American Political Science Review 98 437-452.
12. DUCHARME, G. R. and LEPAGE, Y. (1986). Testing collapsibility in contingency tables. J. Roy. Statist. Soc. Ser. B 48 197-205. MR0867997
13. EVANS, W. N. and SCHWAB, R. M. (1995). Finishing high school and starting college: Do Catholic schools make a difference? Quarterly J. Economics 110 941-974.
14. FREEDMAN, D. A. (2005). Statistical Models: Theory and Practice. Cambridge Univ. Press. MR2175838
15. FREEDMAN, D. A. (2006a). Statistical models for causation: What inferential leverage do they provide? Evaluation Review 30 691-713.
16. FREEDMAN, D. A. (2006b). On the so-called "Huber Sandwich Estimator" and "robust standard errors." Amer. Statist. 60 299-302. MR2291297
17. FREEDMAN, D. A. (2008a). On regression adjustments to experimental data. Adv. in Appl. Math. 40 180-193. MR2388610
18. FREEDMAN, D. A. (2008b). On regression adjustments in experiments with several treatments. Ann. Appl. Statist. 2 176-196.
19. FREY, B. S. and MEIER, S. (2004). Social comparisons and prosocial behavior: Testing "conditional cooperation" in a field experiment. American Economic Review 94 1717-1722.
20. GAIL, M. H. (1986). Adjusting for covariates that have the same distribution in exposed and unexposed cohorts. In Modern Statistical Methods in Chronic Disease Epidemiology (S. H. Moolgavkar and R. L. Prentice, eds.) 3-18. Wiley, New York.
21. GAIL, M. H. (1988). The effect of pooling across strata in perfectly balanced studies. Biometrics 44 151-162.
22. GERTLER, P. (2004). Do conditional cash transfers improve child health? Evidence from PROGRESA's control randomized experiment. American Economic Review 94 336-341.
23. GILENS, M. (2001). Political ignorance and collective policy preferences. American Political Science Review 95 379-396.
24. GUO, G. H. and GENG, Z. (1995). Collapsibility of logistic regression coefficients. J. Roy. Statist. Soc. Ser. B 57 263-267. MR1325390
25. HECKMAN, J. J. (2000). Causal parameters and policy analysis in economics: A twentieth century retrospective. Quarterly J. Economics 115 45-97.
26. HILL, A. B. (1961). Principles of Medical Statistics, 7th ed. The Lancet, London.
27. HODGES, J. L. and LEHMANN, E. (1964). Basic Concepts of Probability and Statistics. Holden-Day, San Francisco. MR0185709
28. HOEFFDING, H. (1963). Probability inequalities for sums of bounded random variables. J. Amer. Statist. Assoc. 58 13-30. MR0144363
29. HOLLAND, P. W. (1986). Statistics and causal inference (with discussion). J. Amer. Statist. Assoc. 8 945-970. MR0867618
30. HU, W.-Y. (2003). Marriage and economic incentives: Evidence from a welfare experiment. J. Human Resources 38 942-963.
31. KOCH, C. G. and GILLINGS, D. B. (2005). Inference, designbased vs. model-based. In Encyclopedia of Statistical Sciences (S. Kotz, C. B. Read, N. Balakrishnan and B. Vidakovic, eds.), 2nd ed. Wiley, Hoboken, NJ.
32. LANE, P. W. and NELDER, J. A. (1982). Analysis of covariance and standardization as instances of prediction. Biometrics 38 613-621.
33. LIM, W. (1999). Estimating impacts on binary outcomes under random assignment. Unpublished technical note, MDRC, New York.
34. MIDDLETON, J. (2007). Even for randomized experiments, logistic regression is not generally consistent. Unpublished technical note, Political Science Dept., Yale Univ.
35. NETTO, E. (1927). Lehrbuch der Combinatorik. Teubner, Leipzig.
36. NEYMAN, J. (1923). Sur les applications de la théorie des probabilités aux experiences agricoles: Essai des principes. Roczniki Nauk Rolniczych 10 1-51. (In Polish.)
37. English translation by D. M. Dabrowska and T. P. Speed (1990) Statist. Sci. 5 465-480 (with discussion).
38. NEYMAN, J., KOLODZIEJCZYK, S. and IWASZKIEWICZ, K. (1935). Statistical problems in agricultural experimentation. J. Roy. Statist. Soc. 2 Supplement 107-154.
39. PATE, A. M. and HAMILTON, E. E. (1992). Formal and informal deterrents to domestic violence: The Dade county spouse assault experiment. American Sociological Review 57 691-697.
40. PRATT, J. W. (1981). Concavity of the log likelihood. J. Amer. Statist. Assoc. 76 103-106. MR0608179
41. ROBINS, J. M. (1999). Association, causation, and marginal structural models. Synthese 121 151-179. MR1766776
42. ROBINSON, L. D. and JEWELL, N. P. (1991). Some surprising results about covariate adjustment in logistic regression models. Internat. Statist. Rev. 58 227-240.
43. ROSENBAUM, P. R. (2002). Covariance adjustment in randomized experiments and observational studies (with discussion). Statist. Sci. 17 286-327. MR1962487
44. ROSENBLUM, M. and VAN DER LAAN, M. J. (2008). Using regression models to analyze randomized trials: Asymptotically valid hypothesis tests despite incorrectly specified models. Available at http://www.bepress.com/ucbbiostat/paper219/.
45. SCHEFFÉ, H. (1956). Alternative models for the analysis of variance. Ann. Math. Statist. 27 251-271. MR0082249
46. TAUBER, S. (1963). On multinomial coefficients. Amer. Math. Monthly 70 1058-1063. MR0160735
47. TROPFKE, J. (1903). Geschichte der Elementar-mathematik in systematischer Darstellung. Verlag Von Veit & Comp, Leipzig.
48. TRUETT, J., CORNFIELD, J. and KANNEL, W. (1967). A multivariate analysis of the risk of coronary heart disease in Framingham. J. Chronic Diseases 20 511-524.
49. VERHULST, P. F. (1845). Recherches mathématiques sur la loi d'accroissement de la population. Nouveaux mémoires de l'Académie Royale des Sciences et Belles-Lettres de Bruxelles 18 1-38.
50. YULE, G. U. (1925). The growth of population and the factors which control it (with discussion). J. Roy. Statist. Soc. 88 1-62.