Procedures for testing multiple endpoints in clinical trials: An overview

Journal of Statistical Planning and Inference

Volumn 82, Issue 1-2, 1999, Pages 69-81

  Wassmer, Gernot ^a   Reitmeir, Peter ^b   Kieser, Meinhard ^c   Lehmacher, Walter ^a  

^a UNIVERSITY OF COLOGNE   (Germany)

^b INSTITUTE OF EPIDEMIOLOGY   (Germany)

^c DR WILLMAR SCHWABE GMBH AND CO KG   (Germany)

Author keywords

Bootstrap; Clinical trials; Closed testing procedure

Indexed keywords

EID: 0033465071     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/s0378-3758(99)00032-4     Document Type: Article

References (75)

1. Bauer, P., Köhne, K., 1994. Evaluations of experiments with adaptive interim analyses. Biometrics 50, 1029-1041. Correction in Biometrics 52, 380.
2. Bauer, P., Köhne, K., 1994. Evaluations of experiments with adaptive interim analyses. Biometrics 50, 1029-1041. Correction in Biometrics 52, 380.
3. Bauer, P., Röhmel, J., 1995. An adaptive method for establishing a dose response relationship. Statist. Med. 14, 1595-1607.
4. Benjamini, Y., Hochberg, Y., 1997. Multiple hypotheses testing with weights. Scand. J. Statist. 24, 407-418.
5. Blair, R.C., Troendle, J.F., Beck, R.W., 1996. Control of familywise errors in multiple endpoint assessments via stepwise permutation tests. Statist. Med. 15, 1107-1121.
6. Bregenzer, T., Lehmacher, W., 1998. Directional tests for the analysis of clinical trials with multiple endpoints allowing for incomplete data. Biometrical J. 40, 911-928.
7. Cook, R.J., Farewell, V.T., 1996. Multiplicity considerations in the design and analysis of clinical trials. J. Roy. Statist. Soc. A 159, 93-110.
8. Dawson, J.D., 1994. Stratification of summary statistical tests according to missing data patterns. Statist. Med. 13, 1853-1863.
9. Dawson, J.D., Lagakos, S.W., 1993. Size and power of two-sample tests of repeated measures data. Biometrics 49, 1022-1032.
10. DeMets, D.L., Ware, J.H., 1980. Group sequential methods for clinical trials with a one-sided hypothesis. Biometrika 67, 651-660.
11. Follmann, D., 1995. Multivariate tests for multiple endpoints in clinical trials. Statist. Med. 14, 1163-1175.
12. Follmann, D., 1996. A simple multivariate test for one-sided alternatives. J. Am. Statist. Assoc. 91, 854-861.
13. Frick, H., 1995. Comparing trials with multiple outcomes. The multivariate one-sided hypothesis with unknown covariance. Biometrical J. 37, 909-917.
14. Frick, H., 1996. On the power behaviour of Läuter's exact multivariate one-sided tests. Biometrical J. 38, 405-414.
15. 0 and incorporating costs. Biometrika 69, 75-80.
16. Hochberg, Y., 1988. A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75, 800-802.
17. Hochberg, Y., Tamhane, A.C., 1987. Multiple Comparison Procedures. Wiley, New York.
18. Holm, S., 1979. A simple sequentially rejective multiple test procedure. Scand. J. Statist. 6, 65-70.
19. Hommel, G., 1983. Tests of the overall hypothesis for arbitrary dependence structures. Biometrical J. 25, 423-430.
20. Hommel, G., 1986. Multiple test procedures for arbitrary dependence structures. Metrika 33, 321-336.
21. Hommel, G., 1988. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika 75, 383-386.
22. Hommel, G., 1989. A comparison of two modified Bonferroni procedures. Biometrika 76, 624-625.
23. James, S., 1991. Approximate multinormal probabilities applied to correlated multiple endpoints in clinical trials. Statist. Med. 10, 1123-1135.
24. Kieser, M., Bauer, P., Lehmacher, W., 1999. Inference on multiple endpoints in clinical trials with adaptive interim analyses. Biometrical J., in press.
25. Kieser, M., Lehmacher, W., 1995. Multiples Testen bei klinischen Prüfungen mit Zwischenauswertungen und a priori geordneten Hypothesen. In: Vollmar, J. (Ed.), Medizinische Forschung - Ärztliches Handeln. Proceedings, MMV Medizin Verlag München, pp. 162-165.
26. Kieser, M., Reitmeir, P., Wassmer, G., 1995. Test procedures for clinical trials with multiple endpoints. In: Vollmar, J. (Ed.), Biometrie in der Chemisch-pharmazeutischen Industrie, Vol. 6. Fischer, Stuttgart, Jena, New York, pp. 41-60.
27. Koch, G.G., Gansky, S.A., 1996. Statistical considerations for multiplicity in confirmatory protocols. Drug Inform. J. 30, 523-534.
28. Koziol, J.A., 1991. Nonparametric approaches to the analysis of multiple endpoints. Biom. Inf. Med. Biol. 2, 44-47.
29. Koziol, J.A., Maxwell, D.A., Fukushima, M., Colmerauer, M.E.M., Pilch, Y.H., 1981. A distribution-free test for tumor-growth curve analyses with application to an animal tumor immunotherapy experiment. Biometrics 37, 383-390.
30. Kropf, S., 1988. Application of multiple test procedures to the combination of multivariate and univariate tests with varying variable sets. Biometrical J. 30, 461-470.
31. Krummenauer, F., Hommel, G., 1999. A note on the size of Simes' global test for discrete test statistics. J. Statist. Plann. Inference 82, 151-162 (this issue).
32. Kudô, A., 1963. A multivariate analogue of the one-sided test. Biometrika 50, 403-418.
33. Lachin, M.L., 1992. Same large-sample distribution-free estimators and tests for multivariate partially incomplete data from two populations. Statist. Med. 11, 1151-1170.
34. Lan, K.K.G., DeMets, D.L., 1983. Discrete sequential boundaries for clinical trials. Biometrika 70, 659-663.
35. Läuter, J., 1996. Exact t and F tests for analyzing studies with multiple endpoints. Biometrics 52, 964-970.
36. Läuter, J., Glimm, E., Kropf, S., 1996. New multivariate tests for data with an inherent structure. Biometrical J. 38, 5-23.
37. Lee, J.W., 1994. Group sequential testing in clinical trials with multivariate observations: A review. Statist. Med. 13, 101-111.
38. Lehmacher, W., Kieser, M., Hothorn, L.A., 1996. Adaptive interim and multiple testing for dose-response analysis. Paper presented at the International Conference on Multiple Comparison Procedures, Tel Aviv, Israel, June 23-26, 1996.
39. Lehmacher, W., Wassmer, G., Reitmeir, P., 1991. Procedures for two-sample comparisons with multiple endpoints controlling the experimentwise error rate. Biometrics 47, 511-521.
40. Lehmacher, W., Wassmer, G., Reitmeir, P., 1994. Comment on: On the design and analysis of randomized clinical trials with mulitple endpoints. Biometrics 50, 581-583.
41. Marcus, R., Peritz, E., Gabriel, K.R., 1976. On closed testing procedures with special reference to ordered analysis of variance. Biometrika 63, 655-660.
42. Maurer, W., Hothorn, A., Lehmacher, W., 1995. Multiple comparisons in drug clinical trials and preclinical assays: A-priori ordered hypotheses. In: Vollmar, J. (Ed.), Biometrie in der Chemisch-pharmazeutischen Industrie, Vol. 6. Fischer, Stuttgart, Jena, New York, pp. 3-18.
43. Nüesch, P.E., 1966. On the problem of testing location in multivariate populations for restricted alternatives. Ann. Math. Statist. 37, 113-119.
44. O'Brien, P.C., 1984. Procedures for comparing samples with multiple endpoints. Biometrics 40, 1079-1087.
45. O'Brien, P.C., Fleming, T.R., 1979. A multiple testing procedure for clinical trials. Biometrics 35, 549-556.
46. O'Brien, P.C., Geller, N.L., 1997. Interpreting tests for efficacy in clinical trials with multiple endpoints. Contr. Clin. Trials 18, 222-227.
47. Pampallona, S., Tsiatis, A.A., 1994. Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis. J. Statist. Plann. Inference 42, 19-35.
48. Perlman, M.D., 1969. One-sided testing problems in multivariate analysis. Ann. Math. Statist. 40, 549-567.
49. Pocock, S.J., 1977. Group sequential methods in the design and analysis of clinical trials. Biometrika 64, 191-199.
50. Pocock, S.J., Geller, N.L., Tsiatis, A.A., 1987. The analysis of multiple endpoints in clinical trials. Biometrics 43, 487-498.
51. Proschan, M.A., Hunsberger, A., 1995. Designed extension of studies based on conditional power. Biometrics 51, 1315-1324.
52. Reitmeir, P., 1996. Analysis of multiple endpoints using bootstrap-techniques. Abstract. Biometrical Bull. 13/3, 8.
53. Reitmeir, P., Wassmer, G., 1996. One-sided multiple endpoint testing in two-sample comparisons. Commun. Statist. Comput. Simulation 25, 99-117.
54. Reitmeir, P., Wassmer, G., 1999. Resampling based methods for the analysis of multiple endpoints in clinical trials. Statist. Med., in press.
55. Röhmel, J., Streitberg, B., 1987. Zur konstruktion globaler tests. EDV in Medizin and Biologie 1, 7-11.
56. 0 ab, wenn k unter n gegebenen tests zur Ablehnung führen'. Metrika 25, 171-178.
57. Sen, P.K., 1999a. Some remarks on Simes type multiple tests of significance. J. Statist. Plann. Inference, in press.
58. Sen, P.K., 1999b. Multiple comparisons in interim analysis. J. Statist. Plann. Inference, in press.
59. Senn, S., 1989. Combining outcome measures. Statistical power is irrelevant. Biometrics 45, 1027-1028.
60. Simes, R.J., 1986. An improved Boniferroni procedure for multiple tests of significance. Biometrika 73, 751-754.
61. Simon, R., 1994. Problems of multiplicity in clinical trials. J. Statist. Plann. Inference 42, 209-221.
62. Tang, D.-I, 1994. Uniformly more powerful tests in a one-sided multivariate problem. J. Am. Statist. Assoc. 89. 1006-1011.
63. Tang, D.-I, Geller, N.L., Pocock, S.J., 1993. On the design and analysis of randomized clinical trials with multiple endpoints. Biometrics 49, 23-30.
64. Tang, D.-I, Gnecco, C., Geller, N.L., 1989a. An approximate likelihood ratio test for a normal mean vector with nonnegative components with application to clinical trials. Biometrika 76, 577-583.
65. Tang, D.-I, Gnecco, C., Geller, N.L., 1989b. Design of group sequential clinical trials with multiple endpoints. J. Am. Statist. Assoc. 84, 776-779.
66. Troendle, J.F., 1995. A stepwise resampling method of multiple hypothesis testing. J. Am. Statist. Assoc. 90, 370-378.
67. Troendle, J.F., 1996. A permutational step-up method of testing multiple outcomes. Biometrics 52, 846-859.
68. Troendle, J.F., Legler, J.M., 1998. A comparison of one-sided methods to identify significant individual outcomes in a multiple outcome setting: Stepwise tests or global tests with closed testing. Statist. Med. 17, 1245-1260.
69. Tsai, K.-T., Koziol, J.A., 1994. Assessing multiple endpoints with ordered alternatives. Commun. Statist. Theory Meth. 23, 533-544.
70. Wassmer, G., 1998. A comparison of two methods for adaptive interim analyses in clinical trials. Biometrics 54, 696-705.
71. Wei, L.J., Johnson, W.E., 1985. Combining dependent tests with incomplete repeated measurements. Biometrika 72, 359-364.
72. Wei, L.J., Lachin, J.M., 1984. Two-sample asymptotically distribution free tests for incomplete multivariate observations. J. Am. Statist. Assoc. 79, 653-661.
73. Westfall, P.H., Young, S.S., 1989. p-value adjustment for multiple tests in multivariate binomial models. J. Am. Statist. Assoc. 84, 780-786.
74. Westfall, P.H., Young, S.S., 1993. Resampling-Based Multiple Testing. Wiley, New York.
75. Wright, S.P., 1992. Adjusted p-values for simultaneous inference. Biometrics 48, 1005-1013.