John W. Tukey's contributions to multiple comparisons

Annals of Statistics

Volumn 30, Issue 6, 2002, Pages 1576-1594

  Benjamini, Yoav ^a   Braun, Henry ^b  

^a TEL AVIV UNIVERSITY   (Israel)

^b EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

False discovery rate; John W. Tukey; Mulitiplicity; Multiple comparisons; Simultaneous inference

Indexed keywords

EID: 0037004138     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/aos/1043351247     Document Type: Article

References (58)

1. ALMOND, R. G., LEWIS, C., TUKEY, J. W. and YAN, D. (2000). Displays for comparing a given state to many others. Amer. Statist 54 89-93.
2. ANDREWS, D. F., BICKEL, P. J., HAMPEL, F. R., HUBER, P. J., ROGERS, W. H. and TUKEY, J. W. (1972). Robust Estimates of Location: Survey and Advances. Princeton Univ. Press.
3. BASFORD, K. E. and TUKEY, J. W. (1997). Graphical profiles as an aid to understanding plant breeding experiments. J. Statist. Plann. Inference 57 93-107.
4. BASFORD, K. E. and TUKEY, J. W. (1998). Graphical Analysis of Multiresponse Data. Chapman and Hall, London.
5. BEGUN, J. and GABRIEL, K. R. (1981). Closure of the Newman-Keuls multiple comparisons procedure. J. Amer. Statist. Assoc. 76 241-245.
6. BENJAMINI, Y. and HOCHBERG, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 289-300.
7. BENJAMINI, Y., HOCHBERG, Y. and KLING, Y. (1993). False discovery rate control in pairwise comparisons. Working Paper 93-2, Dept. Statistics and O.R., Tel Aviv Univ.
8. BENJAMINI, Y., HOCHBERG, Y. and STARK, P. B. (1998). Confidence intervals with more power to determine the sign: Two ends constrain the means. J. Amer. Statist. Assoc. 93 309-317.
9. BERRY, D. A. and HOCHBERG, Y. (1999). Bayesian perspectives on multiple comparisons. J. Statist. Plann. Inference 82 215-227.
10. BRAUN, H. I. and TUKEY, J. W. (1983). Multiple comparisons through orderly partitions: The maximum subrange procedure. In Principals of Modern Psychological Measurement: A Festschrift for Frederic M. Lord (H. Wainer and S. Messick, eds.) 55-65. Erlbaum, Hillsdale, NJ.
11. BRILLINGER, D. R., FERNHOLZ, L. T. and MORGENTHALER, S., eds. (1997). The Practice of Data Analysis. Princeton Univ. Press.
12. BROWN, L. D. (1979). A proof that the Tukey-Kramer multiple comparison procedure for differences between treatment means is level-α for 3, 4, or 5 treatments. Technical report, Dept. Mathematics, Cornell Univ.
13. BROWN, L. D. (1984). A note on the Tukey-Kramer procedure for pairwise comparisons of correlated means. In Design of Experiments: Ranking and Selection (Essays in Honor of Robert E. Beckhofer) (T. J. Santner and A. C. Tamhane, eds.) 1-6. Dekker, New York.
14. BROWN, L. D., CASELLA, G. and HWANG, J. T. G. (1995). Optimal confidence sets, bioequivalence, and the limaçon of Pascal. J. Amer. Statist. Assoc. 90 880-889.
15. CURRAN-EVERETT, D. (2001). Multiple comparisons: Philosophies and illustrations. Amer. J. Physiology: Regulatory Integrative and Comparative Physiology 279 R1-R8.
16. DONOHO, D. L. and JOHNSTONE, I. M. (1994). Ideal spatial adaptation by wavelet shrinkage. Biometrika 81 425-455.
17. DUNN, O. J. (1974). On multiple tests and confidence intervals. Comm. Statist. 3 101-103.
18. DUNNETT, C. W. (1980). Pairwise multiple comparisons in the homogeneous variance, unequal sample size case. J. Amer. Statist. Assoc. 75 789-795.
19. HAYTER, A. J. (1984). A proof of the conjecture that the Tukey-Kramer multiple comparisons procedure is conservative. Ann. Statist. 12 61-75.
20. HAYTER, A. J. (1989). Pairwise comparisons of generally correlated means. J. Amer. Statist. Assoc. 84 208-213.
21. HAYTER, A. and HSU, J. (1994). On the relationship between stepwise decision procedures and confidence sets. J. Amer. Statist. Assoc. 89 128-136.
22. HOAGLIN, D. C., MOSTELLER, F. and TUKEY, J. W., eds. (1991). Fundamentals of Exploratory Analysis of Variance. Wiley, New York.
23. HOCHBERG, Y. (1974). The distribution of the range in general balanced models. Amer. Statist. 28 137-138.
24. HOCHBERG, Y. (1975). An extension of the t-method to general unbalanced models of fixed effects. J. Roy. Statist. Soc. Ser. B 37 426-433.
25. HOCHBERG, Y. and TAMHANE, A. C. (1987). Multiple Comparison Procedures. Wiley, New York.
26. HSU, J. C. (1996). Multiple Comparisons: Theory and Methods. Chapman and Hall, London.
27. JONES, L. V., LEWIS, C. and TUKEY, J. W. (2001). Hypothesis tests, multiplicity of. In International Encyclopedia of the Social and Behavioral Sciences (N. J. Smelser and P. B. Baltes, eds.) 7127-7133. Elsevier, London.
28. JONES, L. V. and TUKEY, J. W. (2000). A sensible formulation of the significance test. Psychological Methods 5 411-414.
29. KESELMAN, H. J., CRIBBIE, R. and HOLLAND, B. (1999). The pairwise multiple comparison multiplicity problem: An alternative approach to familywise and comparisonwise type I error control. Psychological Methods 4 58-69.
30. KRAMER, C. Y. (1956). Extension of multiple range tests to group means with unequal numbers of replications. Biometrics 12 307-310.
31. KURTZ, T. E. (1956). An extension of a multiple comparisons procedure. Ph.D. dissertation, Princeton Univ.
32. LEWIS, C. and TUKEY, J. W. (2001). Improved multiple comparison procedures for controlling the false discovery rate. Unpublished manuscript.
33. MARCUS, R., PERITZ, E. and GABRIEL, K. R. (1976). On closed testing procedures with special reference to ordered analysis of variance. Biometrika 63 655-660.
34. MAY, J. M. (1952). Extended and corrected tables of the upper percentage points of the "Studentized" range. Biometrika 39 192-193.
35. McGILL, R., TUKEY, J. W. and LARSEN, W. O. (1978). Variations on box plots. Amer. Statist. 32 12-16.
36. MILLER, R. G. (1966). Simultaneous Statistical Inference. McGraw-Hill, New York.
37. OTTENBACHER, K. J. (1998). Quantitative evaluation of multiplicity in epidimiology and public health research. Amer. J. Epidimiology 147 615-619.
38. RAMSEY, P. H. (1981). Power of univariate pairwise multiple comparison procedures. Psychological Bulletin 90 352-366.
39. SEO, T., MANO, S. and FUJIKOSHI, Y. (1994). A generalized Tukey conjecture for multiple comparisons among mean vectors. J. Amer. Statist. Assoc. 89 676-679.
40. SHAFFER, J. P. (1995). Multiple hypothesis testing: A review. Annual Review of Psychology 46 561-584.
41. SPJØTVOLL, E. and STOLINE, M. R. (1973). An extension of the T-method of multiple comparison to include the cases with unequal sample sizes. J. Amer. Statist. Assoc. 68 975-978.
42. TUKEY, J. W. (1951). Reminder sheets for "Discussion of paper on multiple comparisons by Henry Scheffé" In The Collected Works of John W. Tukey VIII. Multiple Comparisons: 1948-1983 469-475. Chapman and Hall, New York.
43. TUKEY, J. W. (1953). The problem of multiple comparisons. Unpublished manuscript. In The Collected Works of John W. Tukey VIII. Multiple Comparisons: 1948-1983 1-300. Chapman and Hall, New York.
44. TUKEY, J. W. (1960). A survey of sampling from contaminated distributions. In Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling (I. Olkin, S. G. Ghurye, W. Hoeffding, W. G. Madow and H. B. Mann, eds.) 448-485. Stanford Univ. Press.
45. TUKEY, J. W. (1977a). Some thoughts on clinical trials, especially problems of multiplicity. Science 198 679-684.
46. TUKEY, J. W. (1977b). Higher criticism for individual significances in several tables or parts of tables. Internal working paper 89-9, Princeton Univ.
47. TUKEY, J. W. (1991). The philosophy of multiple comparisons. Statist. Sci. 6 100-116.
48. TUKEY, J. W. (1993a). Graphic comparisons of several linked aspects: Alternatives and suggested principles (with discussion). J. Comput. Graph. Statist. 2 1-49.
49. TUKEY, J. W. (1993b). Where should multiple comparisons go next? In Multiple Comparisons, Selection, and Applications in Biometry (F. M. Hoppe, ed.) 187-207. Dekker, New York.
50. TUKEY, J. W. (1994). The Collected Works of John W. Tukey VIII. Multiple Comparisons: 1948-1983. Chapman and Hall, New York.
51. TUKEY, J. W. (1995). Controlling the proportion of false discoveries for multiple comparison - Future directions. In Perspectives on Statistics for Educational Research: Proceedings of a Workshop (V. S. Williams, L. V. Jones and I. Olkin, eds.). Technical Report 35, National Institute of Statistical Sciences, Research Triangle Park, NC.
52. TUKEY, J. W., BLOOMFIELD, P., BRAUN, H. I. and McNEILL, D. R. (1978). Advances in data analysis. Unpublished manuscript.
53. TUKEY, J. W., CIMINERA, J. L. and HEYSE, J. F. (1985). Testing the statistical certainty of a response to increasing doses of a drug. Biometrics 41 295-301.
54. WELSCH, R. E. (1977). Stepwise multiple comparison procedures. J. Amer. Statist. Assoc. 72 566-575.
55. WILKINSON, L. (1999). Statistical methods in psychology journals - guidelines and explanations. American Psychology 54 594-604.
56. WILLIAMS, V. S. L., JONES, L. V. and TUKEY, J. W. (1994). Controlling error in multiple comparisons, with special attention to the National Assessment of Educational Progress. Technical Report 33, National Institute of Statistical Sciences, Research Triangle Park, NC.
57. WILLIAMS, V. S. L., JONES, L. V. and TUKEY J. W. (1999). Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. Journal of Educational and Behavioral Statistics 24 42-69.
58. YEKUTIELI, D. (2001). Controlling the false discovery rate under dependency. Ph.D. dissertation, Dept. Statistics, Tel Aviv Univ. (in Hebrew).