U is for unease: Reasons for mistrusting overlap measures for reporting clinical trials

Statistics in Biopharmaceutical Research

Volumn 3, Issue 2, 2011, Pages 302-309

  Senn, Stephen ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Cohen's d; Effect size; Mann Whitney; Proportion of similar responses; Sigma divided measure

Indexed keywords

CIMETIDINE; PLACEBO; TIOTROPIUM BROMIDE;

ARTICLE; ASTHMA; CHRONIC OBSTRUCTIVE LUNG DISEASE; CLINICAL TRIAL (TOPIC); CORRELATION COEFFICIENT; ERROR; FORCED EXPIRATORY VOLUME; HUMAN; MAXIMUM LIKELIHOOD METHOD; NONPARAMETRIC TEST; NULL HYPOTHESIS; PARAMETRIC TEST; PROBABILITY; RANDOM SAMPLE; RECEIVER OPERATING CHARACTERISTIC; SAMPLE SIZE; STATISTICAL DISTRIBUTION; STATISTICAL SIGNIFICANCE; TREATMENT OUTCOME; ULCER HEALING; VARIANCE; WILCOXON SIGNED RANKS TEST;

EID: 84865116058     PISSN: None     EISSN: 19466315     Source Type: Journal    
DOI: 10.1198/sbr.2010.10024     Document Type: Article

References (44)

1. Acion, L., Peterson, J. J., Temple, S., and Arndt, S. (2006), "Probabilistic Index: An Intuitive Non-Parametric Approach to Measuring the Size of Treatment Effects, " Statistics in Medicine, 25, 591-602. 303, 304
2. Al-Saleh, M. F. (2007), "On the Similarity Structure of Order Statistics, " Communications in Statistics-Theory and Methods, 36, 1433-1439. 304
3. Bouckaert, A., and Mouchart, M. (2001), "Sure Outcomes of Random Events: A Model for Clinical Trials, " Statistics in Medicine, 20, 521-543. 308
4. Brownie, C., Boos, D. D., and Hughes-Oliver, J. (1990), "Modifying the T and Anova F Tests When Treatment Is Expected to Increase Variability Relative to Controls, " Biometrics, 46, 259-266. 303
5. Brumback, L. C., Pepe, M. S., and Alonzo, T. A. (2006), "Using the Roc Curve for Gauging Treatment Effect in Clinical Trials, " Statistics in Medicine, 25, 575-590. 304
6. Brunner, E., Domhof, S., and Langer, F. (2001), Nonparametric Analysis of Longitudinal Data in Factorial Experiments, New York: Wiley. 304
7. Cohen, J. (1988), Statistical Power Analysis for the Behavioural Sciences, Hillsdale, NJ: Laurence Erlbaum Associates. 303
8. Deeks, J. J. (2002), "Issues in the Selection of a Summary Statistic for Meta-Analysis of Clinical Trials with Binary Outcomes, " Statistics in Medicine, 21, 1575-1600. 307
9. DerSimonian, R., and Laird, N. (1986), "Meta-Analysis in Clinical Trials, " Controlled Clinical Trials, 7, 177-188. 306
10. Glass, G. E. (1976), "Primary, Secondary and Meta-Analysis of Research, " Educational Research, 5, 3-8. 303
11. Glasziou, P. P., and Irwig, L. M. (1995), "An Evidence Based Approach to Individualising Treatment, " British Medical Journal, 311, 1356-1359. 307
12. Greenland, S. (1987), "Interpretation and Choice of Effect Measures in Epidemiologic Analyses, " American Journal of Epidemiology, 125, 761-768. 305, 307
13. Greenland, S., Schlesselman, J. J., and Criqui, M. H. (1986), "The Fallacy of Employing Standardized Regression Coefficients and Correlations as Measures of Effect, " American Journal of Epidemiology, 123, 203-208. 305
14. Greenland, S., Schlesselman, J. J., and Criqui, M. H. (1987), "Re: 'The Fallacy of Employing Standardized Regression Coefficients and Correlations as Measures of Effect', " American Journal of Epidemiology, 125, 349-350. 305, 307
15. Grizzle, J. E., Starmer, C. F., and Koch, G. G. (1969), "Analysis of Categorical Data by Linear Models, " Biometrics, 25, 489-504. 302
16. Hardy, R. J., and Thompson, S. G. (1996), "A Likelihood Approach to Meta-Analysis with Random Effects, " Statistics in Medicine, 15, 619-629. 306
17. Hedges, L., and Olkin, I. (1985), Statistical Method for Meta-Analysis, Orlando: Academic Press. 303
18. Hodges Jr, J. L., and Lehmann, E. L. (1963), "Estimates of Location Based on Rank Tests, " The Annals of Mathematical Statistics, 34, 598-611. 306
19. Jung, J. W., and Koch, G. G. (1998), "A Linear Model Method for Rank Measures of Association from Longitudinal Studies with Fixed Conditions (Visits) for Data Collection and More Than Two Groups, " Journal of Biopharmaceutical Statistics, 8, 299. 302
20. Jung, J. W., and Koch, G. G. (1999), "Multivariate Non-Parametric Methods for Mann-Whitney Statistics to Analyse Cross-over Studies with Two Treatment Sequences, " Statistics in Medicine, 18, 989-1017. 302
21. Koch, G. G. (1972), "The Use of Non-Parametric Methods in the Statistical Analysis of the Two-Period Change-over Design, " Biometrics, 28, 577-584. 302
22. Koch, G. G., Landis, J. R., Freeman, J. L., Freeman Jr, D. H., and Lehnen, R. G. (1977), "A General Methodology for the Analysis of Experiments with Repeated Measurement of Categorical Data, " Biometrics, 33, 133-158. 302
23. Koch, G. G., McCanless, I., and Ward, J. F., Jr. (1984), "Interpretation of Statistical Methodology Associated with Maintenance Trials, " American Journal of Medicine, 77, 43-50. 306
24. Koch, G. G., Tangen, C. M., Jung, J. W., and Amara, I. A. (1998), "Issues for Covariance Analysis of Dichotomous and Ordered Categorical Data from Randomized Clinical Trials and Non-Parametric Strategies for Addressing Them, " Statistics in Medicine, 17, 1863-1892. 302, 304
25. Landis, J. R., and Koch, G. G. (1977a), "An Application of Hierarchical Kappa-Type Statistics in the Assessment of Majority Agreement among Multiple Observers, " Biometrics, 33, 363-374. 302
26. Landis, J. R., and Koch, G. G. (1977b), "The Measurement of Observer Agreement for Categorical Data, " Biometrics, 33, 159-174. 302
27. Landis, J. R., and Koch, G. G. (1977c), "A One-Way Components of Variance Model for Categorical Data, " Biometrics, 33, 671-679. 302
28. Lane, P. W., and Nelder, J. A. (1982), "Analysis of Covariance and Standardization as Instances of Prediction, " Biometrics, 38, 613-621. 307
29. Lee, Y., and Nelder, J. A. (2004), "Conditional and Marginal Models: Another View, " Statistical Science, 19, 219-228. 307
30. Lindsey, J. K., and Lambert, P. (1998), "On the Appropriateness of Marginal Models for Repeated Measurements in Clinical Trials, " Statistics in Medicine, 17, 447-469. 307
31. Moerman, D. (1983), "General Medical Effectiveness and Human Biology: Placebo Effects in the Treatment of Ulcer Disease, " Medical Anthropology Quarterly, 14, 3, 13-16. 306
32. Rom, D. M., and Hwang, E. (1996), "Testing for Individual and Population Equivalence Based on the Proportion of Similar Responses" [see comments], Statistics in Medicine, 15, 1489-1505. 304
33. Rucker, G., Schwarzer, G., Carpenter, J. R., and Schumacher, M. (2008), "Undue Reliance on I(2) in Assessing Heterogeneity May Mislead, " BMC Medical Research Methodology, 8, 79. 305
34. Schielzeth, H. (2010), "Simple Means to Improve the Interpretability of Regression Coefficients, " Methods in Ecology and Evolution, 1, 103-113. 303, 305
35. Schmid, C. H., Lau, J., McIntosh, M. W., and Cappelleri, J. C. (1998), "An Empirical Study of the Effect of the Control Rate as a Predictor of Treatment Efficacy in Meta-Analysis of Clinical Trials, " Statistics in Medicine, 17, 1923-1942. 307
36. Senn, S. J. (1997), "Testing for Individual and Population Equivalence Based on the Proportion of Similar Responses" [Letter; Comment], Statistics in Medicine, 16, 1303-1306. 304, 305
37. Senn, S. J. (2000), "The Many Modes of Meta, " Drug Information Journal, 34, 535-549. 303, 305
38. Senn, S. J. (2004a), "Added Values: Controversies Concerning Randomization and Additivity in Clinical Trials, " Statistics in Medicine, 23, 3729-3753. 303, 305, 306, 307, 308
39. Senn, S. J. (2004b), "Conditional and Marginal Models: Another View-Comments and Rejoinders, " Statistical Science, 19, 228-238. 307
40. Senn, S. J. (2006), "Letter to the Editor: Probabilistic Index: An Intuitive Non-Parametric Approach to Measuring the Size of the Treatment Effects by L. Acion, J. J. Peterson, S. Temple and S. Arndt, " Statistics in Medicine, 25, 3944-3948. 305
41. Smeeth, L., Haines, A., and Ebrahim, S. (1999), "Numbers Needed to Treat Derived from Meta-Analyses-Sometimes Informative, Usually Misleading" [see comments], British Medical Journal, 318, 1548-1551. 307
42. Stine, R. A., and Heyse, J. F. (2001), "Non-Parametric Estimates of Overlap, " Statistics in Medicine, 20, 215-236. 304
43. Tashkin, D. P., Celli, B. Senn, S., Burkhart, D., Kesten, S., Menjoge, S. and Decrame, M. (2008), "A 4-Year Trial of Tiotropium in Chronic Obstructive Pulmonary Disease, " New England Journal of Medicine, 359, 1543-1554. 304
44. Weitzman, M. S. (1970), "Measures of Overlap of Income Distributions of White and Negro Families in the United States, " US Bureau of the Census. 304