4 On some multiplicity problems and multiple comparison procedures in biostatistics

Handbook of Statistics

Volumn 18, Issue , 2000, Pages 75-113

  Hochberg, Yosef ^a   Westfall, Peter H ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0141883594     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(00)18006-X     Document Type: Review

References (100)

1. Aitchison J. Confidence-region tests. J. Roy. Statist. Soc. Ser. B 26 (1964) 462-476
2. Ali M.W. Exact versus asymptotic tests of trend of tumor prevalence in tumorigenicity experiments: A comparison of p-values for small frequency of tumors. Drug Inform. J. 24 (1990) 727-737
3. Bailar III J.C. Scientific inferences and environmental health problems. Chance Vol. 4 No. 2 (1991) 27-38
4. Bauer P. Multiple testing in clinical trials. Statist. Med. 10 (1991) 871-890
5. Benjamini Y., and Hochberg Y. Controlling the false discovery rate: A new and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 57 (1995) 1289-1300
6. Accepted for Publication in the. Benjamini Y., and Hochberg Y. On the adaptive control of the false discovery rate in multiple independent testing problems. J. Educ. Beh. Statist (1996)
7. Benjamini Y., and Hochberg Y. Multiple hypotheses testing with weights. Scan. J. Statist. 24 3 (1997) 407-418
8. (submitted). Benjamini Y., Hochberg Y., and Kling Y. False discovery rate controlling procedures for pairwise comparisons (1995)
9. To appear in. Benjamini Y., Hochberg Y., and Stark P. Confidence intervals with more power to determine the sign: Two ends constrain the means. JASA (1997)
10. Berger J.O., and Sellke T. Testing a point null hypothesis: The irreconcilability of p values and evidence. J. Amer. Statist. Assoc. 82 (1987) 112-122
11. Berger R.L. Multiparameter hypothesis testing and acceptance sampling. Technometrics 24 (1982) 295-300
12. Berry D.A., and Hochberg Y. On Bayesian and quasi-Bayesian approaches to multiple comparison problems. The International Conference on Multiple Comparisons Special Issue. The Journal of Statistical Planning and Inference (1997)
13. Breslow N. Biostatistics and Bayes. Statist. Sci. 5 (1990) 269-298
14. Carmer S.G., and Walker W.M. Baby bear's dilemma: A statistical tale. Agronomy J. 74 (1982) 122-124
15. Chow S.C., and Liu J.P. Design and Analysis of Bioavailability and Bioequivalence Studies (1992), Marcel Dekker, Inc.
16. Cook R.J., and Farewell V.T. Multiplicity considerations in the design and analysis of clinical trials. JRSS-A 159 (1996) 93-110
17. Copas J.B., and Long T. Estimating the residual variance in orthogonal regression with variable selection. The Statistician 40 (1991) 51-59
18. Reprinted 1984 as Vol. 1 of Cournot's Oevres Completètes. Cournot A.A. Exposition de la théorie des chances et des probabilités. In: Bru B. (Ed). Pris Hachette (1843), J Vrin, Paris
19. Dept. of Health and Human Services. Guideline for the Format and Content of the Nonclinical/Pharmacology/Toxicology Section of an Application (1987), U.S. Food and Drug Administration
20. Dept. of Health and Human Services. International Conference on Harmonisation; Draft Guideline on Statistical Principles for Clinical Trials (1998), U.S. Food and Drug Administration, 5600 Fishers Lane, Rockville, MD 20857
21. http:\\www.fda.gov:80/cder/guidance/ichstatprinc.htm
22. Diaconis P. Theories of data analysis from magical thinking through classical statistics. In: Hoaglin D.C., Mosteller F., and Tukey J.W. (Eds). Exploring Data Tables, Trends and Shapes (1985), Wiley, New York 1-36
23. Draper D., Gaver Jr. D.P., Goel P.K., Greenhouse J.B., Hedges L.V., Morris C.N., Tucker J.R., and Waternaux C.M. Contemporary Statistics Number 1: Combining Information. Amer. Statist. Assoc. (1992), National Academy Press
24. Duncan D.B. A Bayesian approach to multiple comparisons. Technometrics 7 (1965) 171-222
25. Dunnett C.W. A multiple comparison procedure for comparing several treatments with a control. J. Amer. Statist. Assoc. 50 (1955) 1096-1121
26. Edwards S., Koch G.G., Sollecito W.A., and Peace K.E. Summarization, analysis, and monitoring of adverse experiences. In: Peace K. (Ed). Statistical Issues in Drug Research and Development (1990), Marcel Dekker Inc., Washington, D.C.
27. Ernhart C.B., Landa B., and Schnell N.B. Subclinical levels of lead and development deficit - A multivariate follow-up reassessment. Pediatrics 67 (1981) 911-919
28. Farrar D.B., and Crump K.S. Exact tests for any carcinogenic effect in animal bioassays. Fund. Appl. Toxicol. 11 (1988) 652-663
29. Fears T.R., Tarone R.E., and Chu K.C. False positive and false negative rates for carcinogenicity screens. Cancer Res. 37 (1977) 1941-1945
30. Fleming T.R. Current issues in clinical trials. Statist. Sci. 7 (1992) 428-456
31. Finney D.J. Whither biometry?. In: Hoppe F.M. (Ed). Multiple Comparisons, Selection and Applications in Biometry (1993), Marcel Dekker, Inc., New York
32. Fisher R.A. The Design of Experiments (1935), Oliver and Boyd
33. Gabriel K.R. Simultaneous test procedures - Some theory of multiple comparisons. Ann. Math. Statist. 40 (1969) 224-250
34. Godfrey K. Comparing the means of several groups. New Engl. J. Med. 311 (1985) 1450-1456
35. Grechanovsky E., and Hochberg Y. Closed procedures are better and often admit a shortcut by JSPI (1998)
36. Greenberg B.G. Biostatistics. Encyclopedia of Statistical Sciences Vol. 1 (1982) 251-263
37. Hall P., and Wilson S.R. Two guidelines for bootstrap hypothesis testing. Biometrics 47 (1991) 757-762
38. Haseman J.K. A reexamination of false-positive rates for carcinogenicity studies. Fund. Appl. Toxicol. 3 (1983) 334-339
39. Haseman J.K., Winbush J.S., and O'Donnell M.W. Use of dual control groups to estimate false positive rates in laboratory animal carcinogenicity studies. Fund. Appl. Toxicol. 7 (1986) 573-584
40. Heyse J.F., and Rom D. Adjusting for multiplicity of statistical tests in the analysis of carcinogenicity studies. Biom. J. 30 (1988) 883-896
41. (papers in honor of H. A. David). Hochberg Y. On assessing multiple equivalences with reference to bioequivalence. Part V: Biometry and Applications. In: Nagaraja H.N., Sen P.K., and Morrison D.F. (Eds). Statistical Theory and Applications (1996), Springer, Edinburgh, UK 267-276
42. Hochberg Y., and Benjamini Y. More powerful procedures for multiple significance testing. Statist. Med. 9 (1990) 811-818
43. to appear. Hochberg Y., and Hommel G. Simes' tests of multiple hypotheses. Encyclopedia of Statistical Sciences (1997)
44. Hochberg Y., and Tamhane A.C. Multiple Comparison Procedures (1987), John Wiley
45. Holm S. A Simple sequentially rejective multiple test procedure. Scand. J. Statist. 6 (1979) 65-70
46. Keuls M. The use of the 'studentized range' in connection with an analysis of variance. Euphytica 1 (1952) 112-122
47. Feb. 7, 1995. King R.T. The tale of a dream, a drug, and data dredging. The Wall Street J. (1995)
48. Koch G.G., Carr G.J., Amara I.A., Stokes M.E., and Uryniak T.J. Categorical data analysis. In: Berry D.A. (Ed). Statistical Methodology in the Pharmaceutical Sciences (1990), Marcel Dekker, New York
49. Krishnaiah P.R. Some developments on simultaneous test procedures. In: Krishnaiah P.R. (Ed). Developments in Statistics Vol. 2 (1979), North-Holland, Amsterdam 157-201
50. Lehmann E.L. Testing multiparameter hypotheses. Ann. Math. Statist. 32 (1952) 990-1012
51. Lin K.K., and Rahman. Overall false positive rates in tests for linear trend in tumor incidence in animal carcinogenicity studies of new drugs. J. Biopharm. Statist. 8 (1998) 1-15
52. Louis T.A. Comment on Evaluating therapeutic interventions: Some issues and experiences. Statist. Sci. 7 (1992) 450-452
53. Marcus R., Peritz E., and Gabriel K.R. On closed testing procedures with special reference to ordered analysis of variance. Biometrika 63 (1976) 655-660
54. Mehta C., and Patel N. StatXact 3 for Windows (1995), Cytel Software Corp.
55. Miller Jr. R.G. Simultaneous Statist. Inferences (1966), McGraw-Hill, Cambridge
56. Naik U.D. Some selection rules for comparing P processes with a standard. Comm. Statist. Ser. A 4 (1975) 519-535
57. Needleman H.L., Gunnoe C., Leviton A., Reed R., Peresie H., Maher C., and Barrett P. Deficits in psychologic and classroom performance of children with elevated dentine lead levels. The New Engl. J. Med. 300 (1979) 689-695
58. Newman D. The distribution of the range in samples from a normal population, expressed in terms of an independent estimate of standard deviation. Biometrika 31 (1939) 20-30
59. Nowak R. Problems in clinical trials go far beyond misconduct. Science 264 (1994) 1538-1541
60. O'Neill R.T., and Wetheril B.G. The present state of multiple comparisons methods (with discussion). J. Roy. Statist. Soc. Ser. B 33 (1971) 218-241
61. Palca J. Get-the-lead-out guru challenged. Science 253 (1991) 842-844
62. Peto R., Pike M., Day N., Gray R., Lee P., Parish S., Peto J., Richards S., and Wahrendorf J. Guidelines for simple, sensitive significance tests for carcinogenic effects in long-term animal experiments. Long-Term and Short-Term Screening Assays for Carcinogens: A Critical Appraisal. IARC Monographs, Annex to Supplement 2 (1980), International Agency for Research on Cancer, Lyon 311-426
63. Pocock S.J. Clinical Trials - A Practical Approach (1983), Wiley
64. Putter J. Multiple comparisons in selected inferences. In: Bickel P.J., Doksum K., and Hodges Jr. J.L. (Eds). A Festschrift for E.L. Lehman (1983), Wadsworth, Belmont CA 328-347
65. Reitmeir P., and Wassmer G. One-sided multiple endpoint testing in two-sample comparisons. Comm. Statist.: Simul. and Comput. 25 (1996) 99-117
66. Rom D.M. Strengthening some common multiple test procedures for discrete data. Statist. Med. 11 (1992) 511-514
67. Rothman K.J. No adjustments are needed for multiple comparisons. Epidemiology 1 (1990) 43-46
68. Roy S.N., and Bose R.C. Simultaneous confidence interval estimation. Ann. Math. Statist. 24 (1953) 220-238
69. SAS Institute. SAS/STAT® Software: Changes and Enhancements through Release 6.11 (1996), SAS Institute Inc., Cary, NC
70. Saville D.J. Multiple comparison procedures: The practical solution. The Amer. Statistician 44 (1990) 174-180
71. Schweder T., and Spjøtvoll E. Plots of p-values to evaluate many tests simultaneously. Biometrika 69 (1982) 493-502
72. Seeger P. Variance Analysis of Complete Designs (1966), Almquist & Wiksell
73. Seeger P. A note on a method for the analysis of significance en masse. Technometrics 10 3 (1968) 586-593
74. Shafer G., and Olkin I. Adjusting P values to account for selection over dichotomies. J. Amer. Statist. Assoc. 78 (1983) 674-678
75. Shaffer J.P. Modified sequentially rejective multiple test procedures. J. Amer. Statist. Assoc. 81 (1986) 826-831
76. Shaffer J.P. Multiple hypothesis testing: A review. Tech. Rep. #23 (1994), National Institute of Statistical Sciences, Stockholm
77. Shaffer J. Multiple hypotheses testing. Annu. Rev. Psychology 46 (1995) 561-584
78. Shaffer J.P. A semi-Bayesian study of Duncan's Bayesian multiple comparison procedure. The International Conference on Multiple Comparisons Special issue. J. Statist. Plan. Inf. (1997)
79. Šidák Z. Rectangular confidence regions for the means of multivariate normal distributions. J. Amer. Statist. Assoc. 62 (1967) 626-633
80. Simes R.J. An improved Bonferroni procedure for multiple tests of significance. Biometrika 73 (1986) 751-754
81. Simon R. Problems of multiplicity in clinical trials. J. Statist. Plan. Inf. 42 (1994) 209-221
82. Soper K.A., and Tonkonoh N. The discrete distribution used for the log-rank test can be inaccurate. Biom. J. 35 (1993) 291-298
83. Soper K.A., and Westfall P.H. Monte Carlo estimation of significance levels for carcinogenicity tests using univariate and multivariate models. J. Statist. Comp. Sim. 37 (1990) 189-209
84. Sterling T.D., Rosenbaum W.L., and Weinkam J.J. Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The Amer. Statistician 49 1 (1995) 108-112
85. Stigler S.M. The History of Statistics (1986), Harvard University Press, P.O. Box 14162 Research Triangle Park, N.C. 27709, U.S.A.
86. Tamhane A.C. Multiple comparisons. In: Ghosh S., and Rao C.R. (Eds). Handbook of Statistics Vol. 13 (1996) 587-630
87. Tarone R.E. A modified Bonferroni method for discrete data. Biometrics 46 (1990) 515-522
88. Troendle J.F. A stepwise resampling method of multiple hypothesis testing. J. Amer. Statist. Assoc. 90 (1995) 370-378
89. Tukey J.W. The problem of multiple comparisons. Mimeographed Notes (1953), Princeton University, Cambridge
90. Tukey J.W. Some thoughts on clinical trials, especially problems of multiplicity. Science 198 (1977) 679-684
91. Tukey J.W. The philosophy of multiple comparisons. Statist. Sci. 6 (1991) 100-116
92. Weller J.I., Song J.Z., Ronin Y.I., and Korol A.B. Experimental designs and solutions to multiple trait comparisons. International Conference on Multiple Comparisons. Tel Aviv, Israel (1996)
93. Westfall P.H. Multiple testing of general contrasts using logical constraints and correlations. J. Amer. Statist. Assoc. 92 (1997) 299-306
94. Westfall P.H., Johnson W.O., and Utts J.M. A Bayesian perspective on the Bonferroni adjustment. Biometrika 84 (1997) 419-427
95. Westfall P.H., and Soper K.A. Weighted multiplicity adjustments for animal carcinogenicity tests. J. Biopharm. Statist. 8 (1998) 23-44
96. Westfall P.H., and Wolfinger R.D. Multiple tests with discrete distributions. The Amer. Statistician 51 (1997) 3-8
97. Westfall P.H., and Young S.S. P-value adjustments for multiple tests in multivariate binomial models. J. Amer. Statist. Assoc. 84 (1989) 780-786
98. Westfall P.H., and Young S.S. Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment (1993), John Wiley
99. Williams V.S.L., Jones L.V., and Tukey J.W. Controlling error in multiple comparisons, with special attention to the trial state assessment of educational progress. Technical report (1994), The National Institute of Statistical Sciences, New York
100. Zelen M. Biostatistical science as a discipline: A look into the future. Biometrics 39 (1983) 827-837