To test or not to test: Preliminary assessment of normality when comparing two independent samples

BMC Medical Research Methodology

Volumn 12, Issue , 2012, Pages

  Rochon, Justine ^a   Gondan, Matthias ^a   Kieser, Meinhard ^a  

^a UNIVERSITY OF HEIDELBERG   (Germany)

Author keywords

Mann Whitneys U test; Studentst test; Testing for normality

Indexed keywords

ARTICLE; COMPUTER SIMULATION; EPIDEMIOLOGY; HUMAN; NONPARAMETRIC TEST; NORMAL DISTRIBUTION; STATISTICAL ANALYSIS; STATISTICAL MODEL;

COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; NORMAL DISTRIBUTION; SELECTION BIAS; STATISTICS, NONPARAMETRIC;

EID: 84862276509     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-12-81     Document Type: Article

References (56)

1. Altman DG: Statistics in medical journals. Stat Med 1982, 1:59-71.
2. Altman DG: Statistics in medical journals: Developments in the 1980s. Stat Med 1991, 10:1897-1913.
3. Altman DG: Statistics in medical journals: Some recent trends. Stat Med 2000, 19:3275-3289.
4. Glantz SA: Biostatistics: How to detect, correct and prevent errors in medical literature. Circulation 1980, 61:1-7.
5. Pocock SJ, Hughes MD, Lee RJ: Statistical problems in the reporting of clinical trials-A survey of three medical journals. N Engl J Med 1987, 317:426-432.
6. Altman DG: Poor-quality medical research: What can journals do? JAMA 2002, 287:2765-2767.
7. Strasak AM, Zaman Q, Marinell G, Pfeiffer KP, Ulmer H: The use of statistics in medical research: A comparison of The New England Journal of Medicine and Nature Medicine. Am Stat 2007, 61:47-55.
8. Fernandes-Taylor S, Hyun JH, Reeder RN, Harris AHS: Common statistical and research design problems in manuscripts submitted to high-impact medical journals. BMC Res Notes 2011, 4:304.
9. Olsen CH: Review of the use of statistics in Infection and Immunity. Infect Immun 2003, 71:6689-6692.
10. Neville JA, Lang W, Fleischer AB: Errors in the Archives of Dermatology and the Journal of the American Academy of Dermatology from January through December 2003. Arch Dermatol 2006, 142:737-740.
11. Altman DG: Practical Statistics for Medical Research. London: Chapman and Hall; 1991.
12. Cressie N: Relaxing assumptions in the one sample t-test. Aust J Stat 1980, 22:143-153.
13. Ernst MD: Permutation methods: A basis for exact inference. Stat Sci 2004, 19:676-685.
14. Wilcox RR: How many discoveries have been lost by ignoring modern statistical methods? Am Psychol 1998, 53:300-314.
15. Micceri T: The unicorn, the normal curve, and other improbable creatures. Psychol Bull 1989, 105:156-166.
16. Kühnast C, Neuhäuser M: A note on the use of the non-parametric Wilcoxon-Mann-Whitney test in the analysis of medical studies. Ger Med Sci 2008, 6:2-5.
17. New England Journal of Medicine: Guidelines for manuscript submission. (Retrieved from http://www.nejm.org/page/author-center/manuscriptsubmission); 2011.
18. Altman DG, Gore SM, Gardner MJ, Pocock SJ: Statistics guidelines for contributors to medical journals. Br Med J 1983, 286:1489-1493.
19. Moher D, Schulz KF, Altman DG for the CONSORT Group: The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med 2001, 134:657-662.
20. Vickers AJ: Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data. BMC Med Res Meth 2005, 5:35.
21. ICH E9: Statistical principles for clinical trials. London, UK: International Conference on Harmonisation; 1998
22. Gebski VJ, Keech AC: Statistical methods in clinical trials. Med J Aust 2003, 178:182-184.
23. Livingston EH: Who was Student and why do we care so much about his t-test? J Surg Res 2004, 118:58-65.
24. Shuster J: Diagnostics for assumptions in moderate to large simple trials: do they really help? Stat Med 2005, 24:2431-2438.
25. Meredith WM, Frederiksen CH, McLaughlin DH: Statistics and data analysis. Annu Rev Psychol 1974, 25:453-505.
26. Bancroft TA: On biases in estimation due to the use of preliminary tests of significance. Ann Math Statist 1944, 15:190-204.
27. Paull AE: On a preliminary test for pooling mean squares in the analysis of variance. Ann Math Statist 1950, 21:539-556.
28. Gurland J, McCullough RS: Testing equality of means after a preliminary test of equality of variances. Biometrika 1962, 49:403-417.
29. Freidlin B, Miao W, Gastwirth JL: On the use of the Shapiro-Wilk test in two-stage adaptive inference for paired data from moderate to very heavy tailed distributions. Biom J 2003, 45:887-900.
30. Easterling RG, Anderson HE: The effect of preliminary normality goodness of fit tests on subsequent inference. J Stat Comput Simul 1978, 8:1-11.
31. Pappas PA, DePuy V: An overview of non-parametric tests in SAS: When, why and how. In Proceeding of the SouthEast SAS Users Group Conference (SESUG 2004): Paper TU04. SouthEast SAS Users Group: Miami, FL; 2004:1-5.
32. Bogaty P, Dumont S, OHara G, Boyer L, Auclair L, Jobin J, Boudreault J: Randomized trial of a noninvasive strategy to reduce hospital stay for patients with low-risk myocardial infarction. J Am Coll Cardiol 2001, 37:1289-1296.
33. Holman AJ, Myers RR: A randomized, double-blind, placebo-controlled trial of pramipexole, a dopamine agonist, in patients with fibromyalgia receiving concomitant medications. Arthritis Rheum 2005, 53:2495-2505.
34. Lawson ML, Kirk S, Mitchell T, Chen MK, Loux TJ, Daniels SR, Harmon CM, Clements RH, Garcia VF, Inge TH: One-year outcomes of Roux-en-Y gastric bypass for morbidly obese adolescents: a multicenter study from the Pediatric Bariatric Study Group. J Pediatr Surg 2006, 41:137-143.
35. Norager CB, Jensen MB, Madsen MR, Qvist N, Laurberg S: Effect of darbepoetin alfa on physical function in patients undergoing surgery for colorectal cancer. Oncology 2006, 71:212-220.
36. Shuster J: Student t-tests for potentially abnormal data. Stat Med 2009, 28:2170-2184.
37. Schoder V, Himmelmann A, Wilhelm KP: Preliminary testing for normality: Some statistical aspects of a common concept. Clin Exp Dermatol 2006, 31:757-761.
38. Wells CS, Hintze JM: Dealing with assumptions underlying statistical tests. Psychol Sch 2007, 44:495-502.
39. Rasch D, Kubinger KD, Moder K: The two-sample t test: pretesting its assumptions does not pay. Stat Papers 2011, 52:219-231.
40. Zimmerman DW: A simple and effective decision rule for choosing a significance test to protect against non-normality. Br J Math Stat Psychol 2011, 64:388-409.
41. Schucany WR, Ng HKT: Preliminary goodness-of-fit tests for normality do not validate the one-sample student t. Commun Stat Theory Methods 2006, 35:2275-2286.
42. Zimmerman DW: Some properties on preliminary tests of equality of variances in the two-sample location problem. J Gen Psychol 1996, 123:217-231.
43. Zimmerman DW: Invalidation of parametric and nonparametric statistical tests by concurrent violation of two assumptions. J Exp Educ 1998, 67:55-68.
44. Zimmerman DW: Conditional probabilities of rejecting H0 by pooled and separate-variances t tests given heterogeneity of sample variances. Commun Stat Simul Comput 2004, 33:69-81.
45. Zimmerman DW: A note on preliminary tests of equality of variances. Br J Math Stat Psychol 2004, 57:173-181.
46. R Development Core Team: R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2011.
47. Lee AFS: Students t statistics. In Encyclopedia of Biostatistics. 2nd edition. Edited by Armitage P, Colton T. New York: Wiley; 2005.
48. Rosner B: Fundamentals of Biostatistics. 3rd edition. Boston: PWS-Kent; 1990.
49. ICH E3: Structure and content of clinical study reports. London, UK: International Conference on Harmonisation; 1995.
50. Rochon J, Kieser M: A closer look at the effect of preliminary goodnessof- fit testing for normality for the one-sample t-test. Br J Math Stat Psychol 2011, 64:410-426.
51. Armitage P, Berry G, Matthews JNS: Statistical Methods in Medical Research. Malden, MA: Blackwell; 2002.
52. Boneau CA: The effects of violations underlying the t test. Psychol Bull 1960, 57:49-64.
53. Box GEP: Non-normality and tests of variances. Biometrika 1953, 40:318-335.
54. Rasch D, Guiard V: The robustness of parametric statistical methods. Psychology Science 2004, 46:175-208.
55. Sullivan LM, DAgostino RB: Robustness of the t test applied to data distorted from normality by floor effects. J Dent Res 1992, 71:1938-1943.
56. Akritas MG, Arnold SF, Brunner E: Nonparametric hypotheses and rank statistics for unbalanced factorial designs. J Am Stat Assoc 1997, 92:258-265.