Testing multiple outcomes in repeated measures designs

Psychological Methods

Volumn 15, Issue 3, 2010, Pages 268-280

  Lix, Lisa M ^a   Sajobi, Tolulope ^a  

^a UNIVERSITY OF SASKATCHEWAN   (Canada)

Author keywords

Correlation; Doubly multivariate data; Familywise error rate; Multiple testing; Resampling

Indexed keywords

ARTICLE; BEHAVIORAL RESEARCH; COMPUTER PROGRAM; EPIDEMIOLOGY; HUMAN; METHODOLOGY; MONTE CARLO METHOD; REPRODUCIBILITY; STANDARD; STATISTICAL ANALYSIS; STATISTICAL MODEL; STATISTICS; TREATMENT OUTCOME;

BEHAVIORAL RESEARCH; BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; MONTE CARLO METHOD; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; SOFTWARE; TREATMENT OUTCOME;

EID: 77956795536     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0017737     Document Type: Article

References (57)

1. Armitage P., Parmar M. Some approaches to the problem of multiplicity in clinical trials. Proceedings of the XIIIth International Biometric Conference 1986, 1-15. Biometric Society, Seattle, WA.
2. Bartlett M.S. A note on tests of significance in multivariate analysis. Proceedings of the Cambridge Philosophical Society 1939, 35:180-185.
3. Benjamini Y., Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society 1995, 57:289-300.
4. Benjamini Y., Hochberg Y. Multiple hypothesis testing with weights. Scandinavian Journal of Statistics 1997, 24:407-418.
5. Benjamini Y., Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Annals of Statistics 2001, 29:1165-1188.
6. Bird K.D., Hadzi-Pavlovic D. Simultaneous test procedures and the choice of a test statistic in MANOVA. Psychological Bulletin 1983, 93:167-178.
7. Blair R.C., Troendle J.F., Beck R.W. Control of familywise errors in multiple endpoint assessments via stepwise permutation tests. Statistics in Medicine 1996, 15:1107-1121.
8. Boik R.J. The mixed model for multivariate repeated measures: Validity conditions and an approximate test. Psychometrika 1988, 53:469-486.
9. Boik R.J. Scheffe's mixed model for multivariate repeated measures: A relative efficiency evaluation. Communication in Statistics 1991, 20:1233-1255.
10. Bradley J.V. Robustness?. British Journal of Mathematical and Statistical Psychology 1978, 31:144-152.
11. Bray J.H., Maxwell S.H. Analyzing and interpreting significant MANOVAs. Review of Educational Research 1982, 52:340-367.
12. Chen B.E., Sakoda L.C., Hsing A.W., Rosenberg P.S. Resampling-based multiple testing procedures for genetic case-control association studies. Genetic Epidemiology 2006, 30:495-507.
13. Dubey S.D. Adjustment of p-values for multiplicities of intercorrelating symptoms. Statistics in the pharmaceutical industry 1994, 513-527. Marcel Dekker, New York. 2nd ed. R.C. Buncher, J.Y. Tsay (Eds.).
14. Dunn O.J. Multiple comparisons among means. Journal of the American Statistical Association 1961, 56:52-64.
15. Dutilleul P. The MLE algorithm for the matrix normal distribution. Journal of Statistical Computation and Simulation 1999, 64:105-123.
16. Dutilleul P., Pinel-Alloul B. A doubly multivariate model for statistical analysis of spatio-temporal environmental data. Environmetrics 1996, 7:551-565.
17. Everitt B.S. The analysis of repeated measures: A practical review with examples. Statistician 1995, 44:113-135.
18. Feise R.J. Do multiple outcome measures require p-value adjustment?. BMC Medical Research Methodology 2002, 2:1-4.
19. Fisher L.D. A review of methods for handling multiple endpoints in clinical trials. Proceedings of the ASA Biopharmaceutical Section 1991, 43-46.
20. Galecki A.T. General class of covariance structures for two or more repeated factors in longitudinal data analysis. Communication in Statistics-Theory and Methods 1994, 23:3105-3119.
21. Ge Y., Dudoit S., Speed T.P. Resampling-based multiple testing for microarray data analysis. Test 2003, 12:1-77.
22. Guyatt G., Mitchell A., Irvine E.J., Singer J., Williams N., Goodacre R., Tompkins C. A new measure of health status for clinical trials in inflammatory bowel disease. Gastroenterology 1989, 96:804-810.
23. Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika 1988, 75:800-802.
24. Holland B.S., Copenhaver M.D. An improved sequentially rejective Bonferroni test procedure. Biometrics 1987, 43:417-423.
25. Holland J.M., Neimeyer R.A., Currier J.M., Berman J.S. The efficacy of personal construct therapy: A comprehensive review. Journal of Clinical Psychology 2007, 63:93-107.
26. Hotelling H. The generalization of Student's ratio. Annals of Mathematical Statistics 1931, 2:360-378.
27. Huang Y., Xu H., Calian V., Hsu J.C. To permute or not to permute. Bioinformatics 2006, 18:2244-2248.
28. Keefe F.J., Dunsmore J., Burnett R. Behavioral and cognitive-behavioral approaches to chronic pain: Recent advances and future directions. Journal of Consulting and Clinical Psychology 1992, 60:528-536.
29. Keselman H.J., Wilcox R.R., Lix L.M. A generally robust approach to hypothesis testing in independent and correlated groups designs. Psychophysiology 2003, 40:586-596.
30. Lix L.M., Deering K., Fouladi R.T., Manivong P. Comparing treatment and control groups on multiple outcomes: Robust procedures for testing a directional alternative hypothesis. Educational and Psychological Measurement 2009, 69:198-215.
31. Lix L.M., Graff L.A., Walker J.R., Clara I., Rawsthorne P., Rogala L., et al. Longitudinal study of quality of life and psychological functioning for active, fluctuating, and inactive disease patterns in inflammatory bowel disease. Inflammatory Bowel Disease 2008, 14:1575-1584.
32. Lix L.M., Hinds A. Multivariate contrasts for repeated measures designs under assumption violations. Journal of Modern Applied Statistical Methods 2004, 3:333-344.
33. Looney S.W., Stanley W.G. Exploratory repeated measures analysis for two or more groups. American Statistician 1989, 43:220-225.
34. McCain N.L., Gray D.P., Elswich R.K., Robins J.W., Tuck I., Walter J.M., et al. A randomized clinical trial of alternative stress management interventions in persons with HIV infection. Journal of Consulting and Clinical Psychology 2008, 76:431-441.
35. McCall R.B., Appelbaum M.I. Bias in the analysis of repeated measures designs: Some alternative approaches. Child Development 1973, 44:401-415.
36. Pillai K.C.S. Some new test criteria in multivariate analysis. Annals of Mathematical Statistics 1955, 26:117-121.
37. Pollard K.S., van der Laan M. Resampling-based multiple testing: Asymptotic control of Type I error and applications to gene expression data. Journal of Statistical Planning and Inference 2005, 125:85-100.
38. Ramsey P.H. Empirical power of procedures for comparing two groups on p variables. Journal of Educational Statistics 1982, 7:139-156.
39. Rom D. A sequentially rejective test procedure based on modified Bonferroni inequality. Biometrika 1990, 77:663-665.
40. Roy S.N., Bargman R.E. Tests of multiple independence and the associated confidence bounds. Annals of Mathematical Statistics 1958, 29:491-503.
41. Sankoh A.J., Huque M.F., Dubey S.D. Some comments on frequently used multiple endpoint adjustment methods in clinical trials. Statistics in Medicine 1997, 16:2529-2542.
42. SAS/IML user's guide, Version 9 2004, SAS Institute, SAS Institute, Cary, NC.
43. SAS/STAT user's guide, Version 9 2004, SAS Institute, SAS Institute, Cary, NC.
44. Stevens J.P. Step-down analysis and simultaneous confidence intervals in MANOVA. Multivariate Behavioral Research 1973, 8:391-402.
45. Thomas D.R. Univariate repeated measures techniques applied to multivariate data. Psychometrika 1983, 48:451-464.
46. Troendle J.F. A stepwise resampling method of multiple hypothesis testing. Journal of the American Statistical Association 1995, 90:370-378.
47. Troendle J.F. A permutational step-up method of testing multiple outcomes. Biometrics 1996, 52:846-859.
48. Wansbeek T., Verhees J. The algebra of multimode factor analysis. Linear Algebra and Its Applications 1990, 127:631-639.
49. Ware J.E., Snow K.K., Kosinski M. SF-36 health survey: Manual and interpretation guide 1993, Health Institute, New England Medical Center, Boston, MA.
50. Weisel A., Tur-Kaspa H. Effects of labels and personal contact on teachers' attitudes toward students with special needs. Exceptionality 2002, 10:1-10.
51. Weisz J.R., Doss A.J., Hawley K.M. Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology 2005, 56:337-363.
52. Werner K., Jansson M., Stoica P. On estimation of covariance matrices with Kronecker product structure. IEEE Transactions on Signal Processing 2008, 56:478-491.
53. Westfall P.H., Tobias R.D., Rom D., Wolfinger R.D., Hochberg Y. Multiple comparisons and multiple tests using SAS system 1999, SAS Institute, Cary, NC.
54. Westfall P.H., Young S.S. Resampling-based multiple testing: Examples and methods for p-value adjustment 1993, Wiley, New York.
55. Whittal M.L., Robichaud M., Thordarson D.S., McLean P.D. Group and individual treatment of obsessive-compulsive disorder using cognitive therapy and exposure plus response prevention: A 2-year follow-up of two randomized trials. Journal of Consulting and Clinical Psychology 2008, 76:1003-1014.
56. Wilkinson L. Statistical methods in psychology journals: Guidelines and explanations. American Psychologist 1999, 54:594-604. the Task Force on Statistical Inference.
57. Zhang J., Quan H., Ng J., Stepanavage M.E. Some statistical methods for multiple endpoints in clinical trials. Controlled Clinical Trials 1997, 18:204-221.