Rerandomization to improve covariate balance in experiments

Annals of Statistics

Volumn 40, Issue 2, 2012, Pages 1263-1282

  Morgan, Kari Lock ^a   Rubin, Donald B ^b  

^a DUKE UNIVERSITY   (United States)

^b HARVARD UNIVERSITY   (United States)

Author keywords

Causal effect; Clinical trial; Experimental design; Hotelling's T 2; Mahalanobis distance; Randomization; Treatment allocation

Indexed keywords

EID: 84872006253     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/12-AOS1008     Document Type: Article

References (71)

1. Aickin, M. (2001). Randomization, Balance, and The Validity and Efficiency of Design-Adaptive Allocation Methods. J. Statist. Plann. inference 94 97-119. Mr1820173
2. Anscombe, F. J. (1948A). The Validity of Comparative Experiments. J. Roy. Statist. Soc. Ser. A. 111 181-211. Mr0030181
3. Arnold, G. C. (1986). Randomization: A Historic Controversy. in The Fascination of Statistics (R. J. Brook, G. C. Arnold, T. H. Hassard and R. M. Pringle, Eds.) 231-244. Crc Press, Boca Raton, Fl.
4. Atkinson, A. C. (2002). The Comparison of Designs for Sequential Clinical Trials with Covariate information. J. Roy. Statist. Soc. Ser. A 165 349-373. Mr1904822
5. Bailey, R. A. (1983). Restricted Randomization. Biometrika 70 183-198. Mr0742988
6. Bailey, R. A. (1986). Randomization, Constrained. Encyclopedia of Statistical Sciences 7 519-524.
7. Bailey, R. A. and Rowley, C. A. (1987). Valid Randomization. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 410 105-124.
8. Birkett, N. J. (1985). Adaptive Allocation in Randomized Controlled Trials. Control Clin Trials 6 146-155.
9. Brillinger, D., Jones, L. and Tukey, J. (1978). The Management of Weather Resources Ii: The Role of Statistics in Weather Resources Management. Us Government Printing office, Washington, Dc.
10. Bruhn, M. andmckenzie, D. (2009). in Pursuit of Balance: Randomization in Practice in Development Field Experiments. American Economic Journal: Applied Economics 1 200-232.
11. Cochran, W. G. and Rubin, D. B. (1973). Controlling Bias in Observational Studies: A Review. SankhȳA Ser. A 35 417-446.
12. Cox, D. R. (1982). Randomization and Concomitant Variables in The Design of Experiments. in Statistics and Probability: Essays in Honor of C. R. Rao 197-202. North-Holland, Amsterdam. Mr0659470
13. Cox, D. R. (2009). Randomization in The Design of Experiments. international Statistical Review 77 415-429.
14. Efron, B. (1971). forcing A Sequential Experiment to Be Balanced. Biometrika 58 403-417. Mr0312660
15. Erdo S, P. and Rényi, A. (1959). on The Central Limit Theorem for Samples From A Finite Population. Magyar Tud. Akad. Mat. Kutató int. KöZl. 4 49-61. Mr0107294
16. Fisher, R. A. (1926). The Arrangement of Field Experiments. Journal of The Ministry of Agriculture of Great Britain 33 503-513.
17. Fisher, R. A. (1935). The Design of Experiments. Oliver and Boyd, Edinburgh.
18. Freedman, D. A. (2008). on Regression Adjustments to Experimental Data. Adv. in Appl. Math. 40 180-193. Mr2388610
19. Garthwaite, P. H. (1996). Confidence intervals From Randomization Tests. Biometrics 1387-1393.
20. Gosset, W. J. (1938). Comparison Between Balanced and Random Arrangements of Field Plots. Biometrika 29 363.
21. Greenberg, B. G. (1951). Why Randomize? Biometrics 7 309-322.
22. Greevy, R., Lu, B., Silber, J. H. and Rosenbaum, P. (2004). Optimal Multivariate Matching Before Randomization. Biostatistics 5 263-275.
23. Grundy, P. M. and Healy, M. J. R. (1950). Restricted Randomization and Quasi-Latin Squares. J. R. Stat. Soc. Ser. B Stat. Methodol. 12 286-291.
24. HáJek, J. (1960). Limiting Distributions in Simple Random Sampling From A Finite Population. Magyar Tud. Akad. Mat. Kutató int. KöZl. 5 361-374. Mr0125612
25. Hansen, B. B. and Bowers, J. (2008). Covariate Balance in Simple, Stratified and Clustered Comparative Studies. Statist. Sci. 23 219-236. Mr2516821
26. Harville, D. A. (1975). Experimental Randomization: Who Needs It? Amer. Statist. 27-31.
27. Ho, D. E., Imai, K., King, G. and Stuart, E. A. (2007). Matching As Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal inference. Political Analysis 15 199-236.
28. Holschuh, N. (1980). Randomization and Design: I. in R. A. Fisher: An Appreciation (S. E. Fienberg and D. V. Hinkley, Eds.). Lecture Notes in Statistics 1 35-45. Springer, New York.
29. Imai, K., King, G. and Stuart, E. A. (2008). Misunderstanding Between Experimentalists and Observationalists About Causal inference. J. Roy. Statist. Soc. Ser. A 171 481-502. Mr2427345
30. Imai, K.,King, G. andnall, C. (2009). The Essential Role of Pair Matching in Cluster-Randomized Experiments, with Application to The Mexican Universal Health insurance Evaluation. Statist. Sci. 24 29-53. Mr2561126
31. Keele, L.,Mcconnaughy, C.,White, I., List, P. M. E. M. and Bailey, D. (2009). Adjusting Experimental Data. in Experiments in Political Science Conference.
32. Kempthorne, O. (1955). The Randomization Theory of Experimental inference. J. Amer. Statist. Assoc. 50 946-967. Mr0071696
33. Kempthorne, O. (1986). Randomization Ii. Encyclopedia of Statistical Sciences 7 519-524.
34. Krause, M. S. andhoward, K. I. (2003). What Random Assignment Does and Does Not Do. Journal of Clinical Psychology 59 751-766.
35. Lehmann, E. L. and Romano, J. P. (2005). Testing Statistical Hypotheses, 3Rd Ed. Springer Texts in Statistics. Springer, New York. Mr2135927
36. Lock, K. F. (2011). Rerandomization to Improve Covariate Balance in Randomized Experiments Ph.D. Thesis, Harvard Univ., Cambridge, Ma.
37. Maclure, M., Nguyen, A., Carney, G., Dormuth, C., Roelants, H., Ho, K. and Schneeweiss, S. (2006). Measuring Prescribing Improvements in Pragmatic Trials of Educational tools for General Practitioners. Basic & Clinical Pharmacology & toxicology 98 243-252.
38. Manly, B. F. J. (2007). Randomization, Bootstrap and Monte Carlo Methods in Biology, 3Rd Ed. Chapman & Hall/Crc, Boca Raton, Fl. Mr2257066
39. Mardia, K. V., Kent, J. T. and Bibby, J. M. (1980). Multivariate Analysis. Academic Press, London. Mr0560319
40. Mcentegart, D. J. (2003). The Pursuit of Balance Using Stratified and Dynamic Randomization Techniques: An Overview. Drug information Journal 37 293-308.
41. Morris, C. (1979). A Finite Selection Model for Experimental Design of The Health insurance Study. J. Econometrics 11 43-61.
42. Morris, C. N. and Hill, J. L. (2000). The Health insurance Experiment: Design Using The Finite Selection Model. in Public Policy and Statistics: Case Studies From Rand 29-53. Springer, New York.
43. Moulton, L. H. (2004). Covariate-Based Constrained Randomization of Group-Randomized Trials. Clin Trials 1 297-305.
44. Pocock, S. J. (1979). Allocation of Patients to Treatment in Clinical Trials. Biometrics 35 183-197.
45. Pocock, S. J. and Simon, R. (1975). Sequential Treatment Assignment with Balancing for Prognostic Factors in The Controlled Clinical Trial. Biometrics 31 103-115.
46. Raynor, A. A. (1986). Some Sidelights on Experimental Design. in The Fascination of Statistics (R. J. Brook, G. C. Arnold, T. H. Hassard and R. M. Pringle, Eds.) 245-264. Crc Press, Boca Raton, Fl.
47. Rosenberger, W. F. and Lachin, J. M. (2002). Randomization in Clinical Trials: Theory and Practice. Wiley, New York. Mr1914364
48. Rosenberger, W. F. and Sverdlov, O. (2008). Handling Covariates in The Design of Clinical Trials. Statist. Sci. 23 404-419. Mr2483911
49. Rubin, D. B. (1974). Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies. Journal of Educational Psychology 66 688.
50. Rubin, D. B. (1976). Multivariate Matching Methods That are Equal Percent Bias Reducing. I. Some Examples. Biometrics 32 109-120. Mr0400555
51. Rubin, D. B. (1978). Bayesian inference for Causal Effects: The Role of Randomization. Ann. Statist. 6 34-58. Mr0472152
52. Rubin, D. B. (1980). Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment. J. Amer. Statist. Assoc. 75 591-593.
53. Rubin, D. B. (2006). Matched Sampling for Causal Effects. Cambridge Univ. Press, Cambridge. Mr2307965
54. Rubin, D. B. (2008A). Comment: The Design and Analysis of Gold Standard Randomized Experiments. J. Amer. Statist. Assoc. 103 1350-1353. Mr2655717
55. Rubin, D. B. (2008B). for Objective Causal inference, Design Trumps Analysis. Ann. Appl. Stat. 2 808-804. Mr2516795
56. Rubin, D. B. and Thomas, N. (1992). Affinely invariant Matching Methods with Ellipsoidal Distributions. Ann. Statist. 20 1079-1093. Mr1165607
57. Savage, L. J. (1962). The Foundations of Statistical inference. Methuen & Co. Ltd., London. Mr0146908
58. Scott, N. W.,Mcpherson, G. C., Ramsay, C. R. and Campbell, M. K. (2002). The Method of Minimization for Allocation to Clinical Trials. A Review. Control Clinical Trials 23 662-674.
59. Seidenfeld, T. (1981). Levi on The Dogma of Randomization in Experiments. in Henry E. Kyburg, Jr. & Isaac Levi (R. J. Bogdan, Ed.) 263-291. Springer, Berlin.
60. Simon, R. (1979). Restricted Randomization Designs in Clinical Trials. Biometrics 35 503-512.
61. Soares, J. F. andwu, C. F. J. (1985). Optimality of Random Allocation Design for The Control of Accidental Bias in Sequential Experiments. J. Statist. Plann. inference 11 81-87. Mr0783375
62. Splawa-Neyman, J. (1990). on The Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9. Statist. Sci. 5 465-472. Mr1092986
63. Sprott, D. A. and Farewell, V. T. (1993). Randomization in Experimental Science. Statist. Papers 34 89-94. Mr1221524
64. Tukey, J. W. (1993). Tightening The Clinical Trial. Control Clin Trials 14 266-285.
65. Urbach, P. (1985). Randomization and The Design of Experiments. Philos. Sci. 52 256-273. Mr0804567
66. White, S. J. and Freedman, L. S. (1978). Allocation of Patients to Treatment Groups in A Controlled Clinical Study. British Journal of Cancer 37 849.
67. Worrall, J. (2010). Evidence: Philosophy of Science Meets Medicine. J. Eval. Clin. Pract. 16 356-362.
68. Xu, Z. and Kalbfleisch, J. D. (2010). Propensity Score Matching in Randomized Clinical Trials. Biometrics 66 813-823. Mr2758217
69. Yates, F. (1939). The Comparative Advantages of Systematic and Randomized Arrangements in The Design of Agricultural and Biological Experiments. Biometrika 30 440.
70. Yates, F. (1948). Contribution to The Discussion of "The Validity of Comparative Experiments" By Fj Anscombe. J. Roy. Statist. Soc. Ser. A 111 204-205.
71. Youden, W. J. (1972). Randomization and Experimentation. Technometrics 14 13-22.