Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations

Pain

Volumn 139, Issue 3, 2008, Pages 485-493

  Turk, Dennis C ^a   Dworkin, Robert H ^b   McDermott, Michael P ^b   Bellamy, Nicholas ^c   Burke, Laurie B ^d   Chandler, Julie M ^e   Cleeland, Charles S ^f   Cowan, Penney ^g   Dimitrova, Rozalina ^h   Farrar, John T ⁱ   Hertz, Sharon ^d   Heyse, Joseph F ^e   Iyengar, Smriti ^j   Jadad, Alejandro R ^k   Jay, Gary W ^l   Jermano, John A ^m   Katz, Nathaniel P ⁿ   Manning, Donald C ^o   Martin, Susan ^p   Max, Mitchell B ^q   McGrath, Patrick ^r   McQuay, Henry J ^s   Quessy, Steve ^t   Rappaport, Bob A ^d   Revicki, Dennis A ^u   Rothman, Margaret ^v   Stauffer, Joseph W ^w   Svensson, Ola ^x   White, Richard E ^y   Witter, James ^z   more..

^a UNIVERSITY OF WASHINGTON   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

^c UNIVERSITY OF QUEENSLAND   (Australia)

^d CENTER FOR DRUG EVALUATION AND RESEARCH   (United States)

^e MERCK RESEARCH LABORATORIES   (United States)

^f UNIVERSITY OF TEXAS MD ANDERSON CANCER CENTER   (United States)

^g American Chronic Pain Association   (United States)

^h ALLERGAN INC   (United States)

ⁱ UNIVERSITY OF PENNSYLVANIA   (United States)

^j ELI LILLY AND COMPANY   (United States)

^k UNIVERSITY OF TORONTO   (Canada)

^l Schwarz Biosciences   (United States)

^m NeurogesX Inc   (United States)

ⁿ Analgesic Research   (United States)

^o CELGENE CORPORATION   (United States)

^p PFIZER INC   (United States)

^q UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^r DALHOUSIE UNIVERSITY   (Canada)

^s UNIVERSITY OF OXFORD   (United Kingdom)

^t GLAXOSMITHKLINE   (United States)

^u UNITED BIOSOURCE CORPORATION   (United States)

^v JOHNSON AND JOHNSON   (United States)

^w Alpharma   (United States)

^x ASTRAZENECA R AND D   (Sweden)

^y ENDO PHARMACEUTICALS INC   (United States)

^z NATIONAL INSTITUTES OF HEALTH   (United States)

more..

Author keywords

Acute pain; Chronic pain; Clinical trials; Multiple endpoints; Multiplicity; Sampling error; Treatment outcomes; Type I error

Indexed keywords

ANALGESIC AGENT; PLACEBO;

BECK DEPRESSION INVENTORY; BIOASSAY; BRIEF PAIN INVENTORY; CHRONIC PAIN; CLINICAL TRIAL; ERROR; FALSE POSITIVE RESULT; HUMAN; INTERMETHOD COMPARISON; MEDICAL RESEARCH; MULTIDIMENSIONAL SCALING; MULTIVARIATE ANALYSIS OF COVARIANCE; NULL HYPOTHESIS; OUTCOME ASSESSMENT; PAIN ASSESSMENT; PAIN PARAMETERS; PRIORITY JOURNAL; PROBABILITY SAMPLE; PROFILE OF MOOD STATES; PROSPECTIVE STUDY; REVIEW; SAMPLING ERROR; STATISTICAL SIGNIFICANCE; TREATMENT OUTCOME;

CLINICAL TRIALS AS TOPIC; CONFOUNDING FACTORS (EPIDEMIOLOGY); ENDPOINT DETERMINATION; HUMANS; LEAST-SQUARES ANALYSIS; MULTIVARIATE ANALYSIS; PAIN; PROBABILITY THEORY; RESEARCH DESIGN;

EID: 53349167526     PISSN: 03043959     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.pain.2008.06.025     Document Type: Review

References (61)

1. Altman D.G., Schulz K.F., Moher D., Egger M., Davidoff F., Elbourne D., et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med 134 (2001) 663-694
2. Bauer P., Chi G., Geller N., Gould A.L., Jordan D., Mohanty S., et al. Industry, government, and academic panel discussion on multiple comparisons in a "real" phase three clinical trial. J Biopharm Stat 13 (2003) 691-701
3. Bauer P., Rohmel J., Maurer W., and Hothorn L. Testing strategies in multi-dose experiments including active control. Stat Med 17 (1998) 2133-2146
4. Beck A.T., Ward C.H., Mendelson M., Mock J., and Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry 4 (1961) 561-571
5. Bellamy N., Kirwan J., Boers M., Brooks P., Strand V., Tugwell P., et al. Recommendations for a core set of outcome measures for future phase III clinical trials in knee, hip, and hand osteoarthritis: consensus development at OMERACT III. J Rheumatol 24 (1997) 799-802
6. Benjamini Y., and Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc B 57 (1995) 289-300
7. Chi G.Y.H. Multiple testing: multiple comparisons and multiple endpoints. Drug Inf J 32 (1998) 1347S-1362S
8. Cleeland C.S., and Ryan K.M. Pain assessment: global use of the brief pain inventory. Ann Acad Med 23 (1994) 129-138
9. Committee for Proprietary Medicinal Products (CPMP). Points to consider on multiplicity issues in clinical trials. London: European Agency for the Evaluation of Medicinal Products, 2002, http://www.emea.europa.eu/pdfs/human/ewp/090899en.pdf.
10. Cruccu G., Anand P., Attal N., Garcia-Larrea L., Haanpaa M., Jorum E., et al. EFNS guidelines for neuropathic pain assessment. Eur J Neurol 11 (2004) 153-162
11. Cutter G.R., Baier M.L., Rudick R.A., Cookfair D.L., Fischer J.S., Petkau J., et al. Development of a multiple sclerosis functional composite as a clinical trial outcome measure. Brain 122 (1999) 871-882
12. D'Agostino R.B. Controlling alphas in a clinical trial: the case for secondary endpoints. Stat Med 19 (2000) 763-766
13. Davis C.E. Secondary endpoints can be validly analyzed, even if the primary endpoint does not provide clear statistical significance. Control Clin Trials 18 (1997) 557-560
14. Deyo R.A., Battie M., Beurskens A.H., Bombardier C., Croft P., Koes B., et al. Outcome measures for low back pain research: a proposal for standardized use. Spine 23 (1998) 2003-2013
15. ®: a practical guide (2005), SAS Institute, Cary, NC
16. Dmitrienko A., Offen W.W., and Westfall P.H. Gatekeeping strategies for clinical trials that do not require all primary effects to be significant. Stat Med 22 (2003) 2387-2400
17. Dmitrienko A., Wiens B.L., Tamhane A.C., and Wang X. Tree-structured gatekeeping tests in clinical trials with hierarchically ordered multiple objectives. Stat Med 26 (2007) 2465-2478
18. Dworkin R.H., Turk D.C., Farrar J.T., Haythornthwaite J.A., Jensen M.P., Katz N.P., et al. Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain 113 (2005) 9-19
19. Dworkin R.H., Turk D.C., Wyrwich K.W., Beaton D., Cleeland C.S., Farrar J.T., et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. J Pain 9 (2008) 105-121
20. Felson D.T., Anderson J.J., Boers M., Bombardier C., Chernoff M., Fried B., et al. The American College of Rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials. Arthritis Rheum 36 (1993) 729-740
21. Felson D.T., Anderson J.J., Boers M., Bombardier C., Furst D., Goldsmith C., et al. The American College of Rheumatology preliminary definition of improvement in rheumatoid arthritis. Arthritis Rheum 38 (1995) 727-735
22. Fisher L.D. Carvedilol and the Food and Drug Administration (FDA) approval process: the FDA paradigm and reflections on hypothesis testing. Control Clin Trials 20 (1999) 16-39
23. Freemantle N., Calvert M., Wood J., Eastaugh J., and Griffin C. Composite outcomes in randomized trials: greater precision but with greater uncertainty?. Jama 289 (2003) 2554-2559
24. Gönen M., Westfall P.H., and Johnson W.O. Bayesian multiple testing for two-sample multivariate endpoints. Biometrics 59 (2003) 76-82
25. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika 75 (1988) 800-802
26. Holm S. A simple sequentially rejective multiple test procedure. Scand J Stat 6 (1979) 65-70
27. Hommel G. A stepwise rejective multiple test procedure based on a modified Bonferroni test. Biometrika 75 (1988) 383-386
28. Kerns R.D., Turk D.C., and Rudy T.E. The West Haven-Yale Multidimensional Pain Inventory (WHYMPI). Pain 23 (1985) 345-356
29. Läuter J. Exact t and F tests for analyzing studies with multiple endpoints. Biometrics 52 (1996) 964-970
30. Lefkopoulou M., and Ryan L. Global tests for multiple binary outcomes. Biometrics 49 (1993) 975-988
31. Legler J.M., Lefkopoulou M., and Ryan L.M. Efficiency and power of tests for multiple binary outcomes. J Am Stat Assoc 90 (1995) 680-693
32. Lehmacher W., Wassmer G., and Reitmeir P. Procedures for two-sample comparisons with multiple endpoints controlling the experimentwise error rate. Biometrics 47 (1991) 511-521
33. Leon A.C. Multiplicity-adjusted sample size requirements: a strategy to maintain statistical power with Bonferroni adjustments. J Clin Psychiatry 65 (2004) 1511-1514
34. Leon A.C., Heo M., Teres J., and Morikawa T. Statistical power of multiplicity adjustment strategies for correlated binary endpoints. Stat Med 26 (2007) 1712-1723
35. Liu A., Tan M., Boyett J.M., and Xiong X. Testing secondary hypotheses following sequential clinical trials. Biometrics 56 (2000) 640-644
36. Marcus R., Peritz, and Gabriel K.R. On closed testing procedures with special reference to ordered analysis of variance. Biometrika 63 (1976) 655-660
37. McNair D.M., Lorr M., and Droppleman L.F. Profile of mood states (1971), Educational and Industrial Testing Service, San Diego
38. Mehrotra D.M., and Heyse J.F. Use of the false discovery rate for evaluating clinical safety data. Stat Methods Med Res 13 (2004) 227-238
39. Moyé L.A. P-value interpretation and alpha allocation in clinical trials. Ann Epidemiol 8 (1998) 351-357
40. Moyé L.A. End-point interpretation in clinical trials: the case for discipline. Control Clin Trials 20 (1999) 40-49
41. Moyé L.A. Alpha calculus in clinical trails: considerations and commentary for the new millennium. Stat Med 19 (2000) 767-779
42. Moyé L.A. Multiple analyses in clinical trials (2003), Springer-Verlag, New York
43. O'Brien P.C. Procedures for comparing samples with multiple endpoints. Biometrics 40 (1984) 1079-1087
44. O'Neill R.T. Secondary endpoints cannot be validity analyzed if the primary endpoint does not demonstrate clear statistical significance. Control Clin Trials 18 (1997) 550-556
45. Pocock S.J. Clinical trials with multiple outcomes: a statistical perspective on their design, analysis, and interpretation. Control Clin Trials 18 (1997) 530-545
46. Prentice R.L. On the role and analysis of secondary outcomes in clinical trials. Control Clin Trials 18 (1997) 561-567
47. Sankoh A.J., D'Agostino R.B., and Huque M.F. Efficacy endpoint selection and multiplicity adjustment methods in clinical trials with inherent multiple endpoint issues. Stat Med 22 (2003) 3133-3150
48. Sankoh A.J., Huque M.F., and Dubey S.D. Some comments on frequently used multiple endpoint adjustment methods in clinical trials. Stat Med 16 (1997) 2529-2542
49. Tang D.I., Geller N.L., and Pocock S.J. On the design and analysis of randomized clinical trials with multiple endpoints. Biometrics 49 (1993) 23-30
50. Tang D.I., Gnecco C., and Geller N.L. An approximate likelihood ratio test for a normal mean vector with nonnegative components with application to clinical trials. Biometrika 76 (1989) 577-583
51. Troendle J.F. A stepwise resampling method of multiple hypothesis testing. J Am Stat Assoc 90 (1995) 370-378
52. Troendle J.F., and Legler J.M. A comparison of one-sided methods to identify significant individual outcomes in a multiple outcome setting: stepwise tests or global tests with closed testing. Stat Med 17 (1998) 1245-1260
53. Turk D.C., Dworkin R.H., Allen R.R., Bellamy N., Brandenburg N., Carr D.B., et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain 106 (2003) 337-345
54. Turk D.C., Dworkin R.H., Burke L.B., Gershon R., Rothman M., Scott J., et al. Developing outcome measures for pain clinical trials: IMMPACT recommendations. Pain 125 (2006) 208-215
55. U.S. Department of Health and Human Services. Guidance for industry: E9 statistical principles for clinical trials. Rockville, MD: Office of Training and Communication, Food and Drug Administration, 1998.
56. Wassmer G., Reitmeir P., Kieser M., and Lehmacher W. Procedures for testing multiple endpoints in clinical trials: an overview. J Stat Planning Inference 82 (1999) 69-81
57. Westfall P.H., and Krishen A. Optimal weighted, fixed sequence, and gatekeeping multiple testing procedures. J Stat Planning Inference 99 (2001) 25-40
58. Westfall P.H., Krishen A., and Young S.S. Using prior information to allocate significance levels for multiple endpoints. Stat Med 17 (1998) 2107-2119
59. Westfall P.H., and Wolfinger R.D. Multiple tests with discrete distributions. Am Stat 51 (1997) 3-8
60. Westfall P.H., and Young S.S. Resampling-based multiple testing (1993), Wiley, New York
61. Willke R.J., Burke L.B., and Erickson P. Measuring treatment impact: a review of patient-reported outcomes and other efficacy endpoints in approved product labels. Control Clin Trials 25 (2004) 535-552