Why permutation tests are superior to t and F tests in biomedical research

American Statistician

Volumn 52, Issue 2, 1998, Pages 127-132

  Ludbrook, John ^a   Dudley, Hugh ^b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Biomedical research; Fisher; Permutation tests; Randomization tests

Indexed keywords

EID: 0032372107     PISSN: 00031305     EISSN: 15372731     Source Type: Journal    
DOI: 10.1080/00031305.1998.10480551     Document Type: Article

References (29)

1. Bennett, J.H. (ed) (1990), Statistical Inference and Analysis: Selected Correspondence of R.A. Fisher, Oxford: Clarendon Press.
2. Boik, R.J. (1987), ‘The Fisher-Pitman Permutation Test: A Non-Robust Alternative to the Normal Theory F Test When Variances are Heterogeneous,” British Journal of Mathematical and Statistical Psychology, 40, 26-42.
3. Box, G.E.P., and Anderson, S.L. (1955), “Permutation Theory in the Derivation of Robust Criteria and the Study of Departures from Assumption,” Journal of the Royal Statistical Society, Ser. B, 17, 1-26.
4. Box, G.E.P., Hunter, W.G., and Hunter, J.S. (1978), Statistics for Experimenters: An Introduction to Design, Data Analysis, and Model Building, New York: Wiley.
5. Bradley, J.V. (1968), Distribution-Free Statistical Tests (2nd ed.), Eaglewood Cliffs, NJ: Prentice Hall.
6. Eden, T., and Yates, F. (1933), “On the Validity of Fisher’s z Test When Applied to an Actual Example of Non-Normal Data,” Journal of Agricultural Science, 23, 6-16.
7. Edgington, E. S. (1995), Randomization Tests (3rd ed.), New York: Marcel Dekker.
8. Feinstein, A.R. (1973), “Clinical Biostatistics. XIII. The Role of Randomization in Sampling, Testing, Allocation, and Credulous Idolatry (Part 2),” Journal of Clinical Pharmacology and Therapeutics, 14, 898-915.
9. Fisher, R.A. (1936), ‘“The Coefficient of Racial Likeness’ and the Future of Craniometry,” Journal of the Royal Anthropological Society, 66, 57-63.
10. Fisher, R.A. (1971), The Design of Experiments (8th ed.), New York: Hafner
11. Publishing. Reprinted in Bennett, J.H. (ed.) (1990), Statistical Methods, Experimental Design, and Scientific Inference, Oxford: Oxford University Press.
12. Fligner, M.A., and Policello, G.E. (1981) “Robust Rank Procedures for the Behrens-Fisher Problem,” Journal of the American Statistical Association, 76, 162-168.
13. Kempthome, O. (1955), “The Randomization Theory of Experimental Inference,” Journal of the American Statistical Association, 50, 946-967.
14. Kempthome, O., and Doerfler, T.E. (1969), “The Behavior of Some Significance Tests Under Experimental Randomization,” Biometrika, 56, 231-248.
15. Lehmann, E.L. (1975), Nonparametrics: Statistical Methods Based on Ranks, San Francisco: Holden Day.
16. Ludbrook, J. (1994), “Advantages of Permutation (Randomization) Tests in Clinical and Experimental Pharmacology and Physiology,” Clinical and Experimental Pharmacology and Physiology, 21, 673-686.
17. Ludbrook, J. (1996), “The Wilcoxon-Mann-Whitney Test Condemned,” (letter), British Journal of Surgery, 83, 136-137.
18. Ludbrook, J., and Dudley, H.A.F. (1994), “Issues in Biomedical Statistics: Statistical Inference,” Australian and New Zealand Journal of Surgery, 64, 630-636.
19. Manly, B.FJ. (1997), Randomization, Bootstrap and Monte Carlo Methods in Biology (2nd ed.), London: Chapman &Hall.
20. Neyman, J. (1934), “On the Two Different Aspects of the Representative Method: The Method of Stratified Sampling and the Method of Purposive Selection,” Journal of the Royal Statistical Society, 97, 558-606.
21. Neyman, J., and Pearson, E.S. (1928), “On the Use and Interpretation of Certain Test Criteria for Purposes of Statistical Inference. Part I,” Biometrika, 20A, 175-240.
22. Neyman, J., and Pearson, E.S. (1933), “The Testing of Statistical Hypotheses in Relation to Probabilities a priori,” in Proceedings of the Cambridge Philosophical Society, 20, pp. 492-510.
23. Pitman, E.J.G. (1937), “Significance Tests Which May be Applied to Samples from Any Population,” Journal of the Royal Statistical Society, Ser. B, 4, 119-130.
24. Romano, J.P. (1990), “On the Behavior of Randomization Tests without a Group Invariance Assumption,” Journal of the American Statistical Association, 85, 686-692.
25. Scheffe, H. (1959), The Analysis of Variance, New York: Wiley.
26. Siegel, S., and Castellan, N.J. (1988), Nonparametric Statistics for the Behavioral Sciences (2nd ed.), New York: McGraw-Hill.
27. Welch, B.L. (1937a), “On the z-Test in Randomized Blocks and Latin Squares,” Biometrika, 29, 21-52.
28. Welch, B.L. (1937b), ‘The Significance of the Difference Between Two Means When the Population Variances are Unequal,” Biometrika, 29, 350-362.
29. Wilcoxon, F. (1945), “Individual Comparisons by Ranking Methods,” Biometrics, 1, 80-83.