The t test and beyond: Recommendations for testing the central tendencies of two independent samples in research on speech, language and hearing pathology

Journal of Communication Disorders

Volumn 58, Issue , 2015, Pages 158-168

  Rietveld, Toni ^a   van Hout, Roeland ^a  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Statistical analysis; Two independent samples

Indexed keywords

ARTICLE; BOOTSTRAPPING; DATA ANALYSIS; HEARING DISORDER; INFORMATION PROCESSING; LANGUAGE DISABILITY; MEDICAL LITERATURE; MEDICAL RESEARCH; METHODOLOGY; NONPARAMETRIC TEST; RANDOMIZATION; RANK SUM TEST; SPEECH DISORDER; STATISTICAL ANALYSIS; STUDENT T TEST; WILCOXON SIGNED RANKS TEST; COMMUNICATION DISORDER; HUMAN; SPEECH; STATISTICAL MODEL; STATISTICS;

COMMUNICATION DISORDERS; HUMANS; MODELS, STATISTICAL; RESEARCH DESIGN; SPEECH; STATISTICS AS TOPIC;

EID: 84947612757     PISSN: 00219924     EISSN: 18737994     Source Type: Journal    
DOI: 10.1016/j.jcomdis.2015.08.002     Document Type: Article

References (73)

1. Algina J., Olejnik S., Ocanto R. Type I error rates and power estimates for selected two-sample tests of scale. Journal of Educational Statistics 1989, 14(4):373-384.
2. Berger V.W. Pros and cons of permutation tests in clinical trials. Statistics in Medicine 2000, 19:1319-1328.
3. Bhattacharyya M. To pool or not to pool: A comparison between two commonly used test statistics. International Journal of Pure and Applied Mathematics 2013, 89(4):497-510.
4. Bergmann R., Ludbrook J., Spooren W.P.J.M. Different outcomes of the Wilcoxon-Mann-Whitney test from different statistics packages. The American Statistician 2000, 54(1):72-77.
5. Boneau C.A. The effects of violations of assumptions underlying the t test. Psychological Bulletin 1960, 57(1):49-64.
6. Bridge P.D., Sawilowsky S.S. Increasing physicians' awareness of the impact of statistics on research outcomes: Comparative power of the t-test and Wilcoxon rank-sum test in small samples applied research. Journal of Clinical Epidemiology 1999, 52:229-235.
7. Brunner E., Munzel U. The nonparametric Behrens-Fisher problem: Asymptotic theory and a small sample approximation. Biometrical Journal 2000, 42:17-25.
8. Chernick M.R. Bootstrap methods: A practitioner's guide 1999, Wiley, New York, NY.
9. Cohen M.E. Concise review: Analysis of ordinal dental data: Evaluation of conflicting recommendations. Journal of Dental Research 2001, 80(1):309-313.
10. De Winter J.C.F. Using the student's t-test with extremely small sample sizes. Practical Assessment, Research & Evaluation 2013, 18(10):1-12.
11. Draper D., Hodges J.S., Mallows C.L., Pregibon D. Exchangeability and data analysis. Journal of the Royal Statistical Society Series A 1993, 156(1):9-37.
12. Edgington E.S., Onghena P. Randomization tests 2007, Chapman & Hall/CRC, London. 4th ed.
13. Efron B. Bootstrap methods: Another look at the Jackknife. The Annals of Statistics 1979, 7(1):1-26.
14. Fagerland M.W., Sandvik L. The Wilcoxon-Mann-Whitney test under scrutiny. Statistics in Medicine 2009, 28:1487-1497.
15. Fagerland M.W., Sandvik L. Performance of five two-sample location tests for skewed distributions with unequal variances. Contemporary Clinical Trials 2009, 490-496.
16. Fagerland M.W., Sandvik L., Mowinckel P. Parametric methods outperformed non-parametric methods in comparisons of discrete numerical variables. BMC Medical Research Methodology 2011, 11:44.
17. Fagerland M.W. T-tests, non-parametric tests, and large studies-A paradox of statistical practice?. BMC Medical Research Methodology 2012, 12:78.
18. Freidlin B., Gastwirth J.L. Should the median test be retired from general use?. The American Statistician 2000, 54(3):161-164.
19. Good P.I. Resampling methods: A practical guide to data analysis 2006, Birkhäuser, Boston, MA. 3rd ed.
20. Grissom R.J. Heterogeneity of variance in clinical data. Journal of Consulting and Clinical Psychology 2000, 68(1):155-165.
21. Hall P. Bootstrap confidence intervals in nonparametric regression. Annuals of Statistics 1992, 20:695-711.
22. Hart A. Mann-Whitney test is not just a test of medians: Differences in spread can be important. British Medical Journal 2001, 323:391-393.
23. Hayes A.F. Randomization tests and the equality of variance assumption when comparing group means. Animal Behaviour 2000, 59:653-656.
24. Heeren T., D'Agostino R. Robustness of the two independent samples t-test when applied to ordinal scales. Statistics in Medicine 1987, 6:79-90.
25. Higgins J.J. Introduction to modern nonparametric statistics 2004, Brooks/Cole, Pacific Grove, CA.
26. Hu F., Hu J. A note on breakdown theory for bootstrap methods. Statistics & Probability Letters 2000, 50:49-53.
27. Huinck W., Rietveld T. The validity of a simple outcome measure to assess stuttering therapy. Folia Phoniatrica et Logopaedica 2007, 59:91-99.
28. ICH (1995). Structure and contents of clinical study reports.
29. Ioannidis J.P.A. Why most published research findings are false. PLoS Medicine 2005, 2(8):696-701.
30. Janssen A., Pauls T. A Monte Carlo comparison of studentized bootstrap and permutation tests for heteroscedastic two-sample problems. Computational Statististics 2005, 20:369-383.
31. Kasuya E. Mann-Whitney U test when variances are unequal. Animal Behaviour 2001, 61:1247-1249.
32. Keselman H.J., Wilcox R.R., Othman A.R., Fradette K. Trimming, transforming statistics, and bootstrapping: Circumventing the biasing effects of heteroscedasticity and nonnormality. Journal of Modern Applied Statistical Methods 2002, 1(2):288-309.
33. Keselman H.J., Othman A.R., Wilcox R.R., Fradette K. The new and improved two-sample t test. Psychological Science 2004, 15(1):47-51.
34. Kreiman J., Gerratt B.R. Validity of rating scale measures of voice quality. Journal of the Acoustical Society of America 1998, 104(3):1598-1608.
35. Lansing L.L. Bootstrapping versus the Student's t: The problems of Type I error and power 1999, Leligh University, Bethlehem, PA, (Unpublished Master's Thesis).
36. Legendre P., Legendre L. Numerical ecology 1998, Elsevier, Amsterdam. 2nd ed.
37. Lehmann E.L. Nonparametrics: Statistical methods based on ranks 1975, Holden-Day Inc., San Francisco.
38. Leys C., Ley C., Klein O., Bernard P., Licata L. Detecting outliers: Do not use standard deviation around the mean, use absolute deviation around the mean. Journal of Experimental Social Psychology 2013, 49:764-766.
39. Lindgren B.W. Statistical theory 1976, MacMillan Publishers, New York, NY. 3rd ed.
40. Ludbrook J., Dudley H. Why permutation tests are superior to t and F tests in biomedical research. The American Statistician 1998, 52(2):127-132.
41. Mann H.B., Whitney D.R. On a test whether one of two random variables is stochastically larger than the other. Annals of Mathematic Statistics 1947, 18:50-60.
42. Markowski C.A., Markowski E.P. Conditions for the effectiveness of a preliminary test of variance. The American Statistician 1990, 44(4):322-326.
43. Mends-Cole S.J. Probability coverage and interval length for Welch's and Yuen's techniques: Shift in location, change in scale, and (un)equal sizes. Journal of Modern Applied Statistical Methods 2007, 6(2):421-442.
44. Micceri T. The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin 1989, 105:156-166.
45. Mood A.M. Introduction to the theory of statistics 1950, McGraw-Hill, New York, NY.
46. Munzel U., Hauschke D. A nonparametric test for proving noninferiority in clinical trials with ordered categorical data. Pharmaceutical Statistics 2003, 2:31-37.
47. Nanna M.J., Sawilowsky S.S. Analysis of likert scale data in disability and medical rehabilitation research. Psychological Methods 1998, 3(1):55-67.
48. Neubert K., Brunner E. A studentized permutation test for the non-parametric Behrens-Fisher problem. Computational Statistics & Data Analysis 2007, 51(10):5192-5204.
49. Neuhäuser M., Ruxton G.D. Distribution-free two-sample comparisons in the case of heterogeneous variances. Behavioral Ecology and Sociobiology 2009, 63:617-623.
50. Neuhäuser M. A nonparametric two-sample comparison for skewed data with unequal variances. Journal of Clinical Epidemiology 2010, 63:691-693.
51. Porter P.S., Rao S.T., Ku J.-Y., Ku J.-Y., Poirot R.L., Dakins M. Small sample properties of nonparametric bootstrap t confidence intervals. Journal of the Air & Waste Management Association 1997, 47:1197-1203.
52. Rasch D., Kubinger K.D., Moder K. The two-sample t test: Pretesting its assumptions does not pay. Statistical Papers 2011, 52:219-231.
53. Reiczigel J., Zakarias I., Rozsa L. A bootstrap test of stochastic equality of two populations. The American Statistician 2005, 59(2):156-161.
54. Rietveld T., van Hout R. Statistics in language research: Analysis of variance 2005, Mouton de Gruyter, Berlin/New York, NY.
55. Rochon J., Gondan M., Kieser M. To test or not to test: Preliminary assessment of normality when comparing two independent samples. BMC Medical Research Methodology 2012, 12:81.
56. Rorden C., Bonilha L., Nichols T.E. Rank-order versus mean based statistics for neuroimaging. NeuroImage 2007, 35:1531-1537.
57. Ruxton G.D. The unequal variance t-test is an underused alternative to Student's t-test and the Mann-Whitney U tests. Behavioral Ecology 2006, 17(4):688-690.
58. Sapolsky D., Domoto-Reilly K., Dickerson B.C. Use of the Progressive Aphasia Severity Scale (PASS) in monitoring speech and language status in PPA. Aphasiology 2014, 28(8-9):993-1003.
59. Shapiro S.S., Wilk M.B. An analysis of variance for normality (complete samples). Biometrika 1965, 52(3-4):591-611.
60. Shoemaker L.H. Tests for differences in dispersion based on quantiles. The American Statistician 1995, 49(2):179-182.
61. Siegel S., Castellan N.J. Nonparametric statistics for the behavioral sciences 1988, McGraw-Hill Book Company, New York, NY. 2nd ed.
62. Skovlund E., Fensted G.U. Should we always choose a nonparametric test when comparing two apparently nonnormal distributions?. Journal of Clinical Epidemiology 2001, 54:86-92.
63. Student The probable error of a mean. Biometrika 1908, 6(1):1-25.
64. Vargha A., Delaney H.D. A critique and improvement of the CL common language effect size statistic of McGraw and Wong. Journal of Educational and Behavioral Statistics 2000, 25:101-132.
65. Velleman P.F., Wilkinson L. Nominal, ordinal interval, and ratio typologies are misleading. The American Statistician 1993, 47(1):65-72.
66. Welch B.L. The significance of the difference between two means when the population variances are unequal. Biometrika 1938, 34:350-362.
67. Wilcox R.R. Fundamentals of modern statistical methods 2010, Springer Verlag, New York, NY. 2nd ed.
68. Wilcoxon F. Individual comparisons by ranking methods. Biometrics 1945, 3:119-122.
69. Wirz S., Mackenzie Beck J. Assessement of voice quality the Vocal Profiles Analysis Scheme. Perceptual approaches to communication disorders 1995, 39-55. Whurr, London. S.L. Wirz (Ed.).
70. Yin T.S., Yusof Z.M., Yaacob C.R., Othman A.R. Performance of the traditional pooled variance t-test against the bootstrap procedure of difference between sample means. Malaysian Journal of Mathematical Sciences 2010, 4(1):85-94.
71. Yuen K.K. The two-sample trimmed t for unequal population variances. Biometrika 1974, 61:165-170.
72. Zimmerman D.W. A warning about the large sample Wilcoxon-Mann-Whitney test. Understanding Statistics 2003, 2(4):267-280.
73. Zimmerman D.W. A note on preliminary tests of equality of variances. British Journal of Mathematical Psychology 2004, 57:173-181.