Permutation P-values should never be zero: Calculating exact P-values when permutations are randomly drawn

Statistical Applications in Genetics and Molecular Biology

Volumn 9, Issue 1, 2010, Pages

  Phipson, Belinda ^a   Smyth, Gordon K ^a  

^a WALTER AND ELIZA HALL INSTITUTE OF MEDICAL RESEARCH   (Australia)

Author keywords

microarray; Monte Carlo test; multiple testing; P values; permutation test

Indexed keywords

ARTICLE; GENOMICS; MATHEMATICAL PARAMETERS; MICROARRAY ANALYSIS; MONTE CARLO METHOD; PERMUTATION TEST; PROBABILITY; RANDOMIZATION; SAMPLING; STATISTICAL SIGNIFICANCE; GENE EXPRESSION PROFILING; METHODOLOGY; STATISTICAL MODEL;

GENE EXPRESSION PROFILING; GENOMICS; MODELS, STATISTICAL; PROBABILITY;

EID: 78149276744     PISSN: None     EISSN: 15446115     Source Type: Journal    
DOI: 10.2202/1544-6115.1585     Document Type: Article

References (17)

1. Barnard, G.A. (1963) Discussion of "The spectral analysis of point processes" by MS Bartlett. J.R. Statist. Soc. B, 25, 294.
2. Davison, A.C. and Hinkley, D.V. (1997) Bootstrap methods and their application, Cambridge University Press, United Kingdom.
3. Dwass, M. (1957) Modified randomization tests for nonparametric hypotheses. Ann. Math. Statist., 28, 181-187.
4. Dørum, G., Snipen, L., Solheim, M., and Saebo, S. (2009). Rotation testing in gene set enrichment analysis for small direct comparison experiments. Stat. Appl. Genet. Mol. Biol, 8, Article 34.
5. Efron, B. (1982) The jackknife, the bootstrap and other resampling plans, Society for Industrial and Applied Mathematics, England.
6. Efron, B. and Tibshirani, R.J.(1993) An introduction to the bootstrap, Chapman & Hall, New York.
7. Edgington, E.S. and Onghena, P. (2007) Randomization tests, Fourth Edition, Chapman & Hall/CRC, Boca Raton, FL.
8. Ernst, M.D. (2004) Permutation methods: a basis for exact inference. Statistical Scie,nce 19, 676-685.
9. Fisher, R.A. (1935) The Design of Experiments, 3rd Edition, Oliver & Boyd, London.
10. Goeman, J.J. and Bühlmann, P. (2007) Analyzing gene expression data in terms of gene sets: methodological issues. Bioinformatics, 23, 980-987.
11. Good, P. (1994) Permutation tests: a practical guide to resampling methods for testing hypotheses, Springer-Verlag New York, New York.
12. Higgins, J.J. (2004) An introduction to modern nonparametric statistics, Brooks/Cole, Pacific Grove, CA.
13. Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
14. Manly, B.F.J. (1997) Randomization, bootstrap and Monte Carlo methods in biology, Second Edition, Chapman & Hall, London.
15. Mielke, P.W. and Berry, K.J. (2001) Permutation tests: a distance function approach, Springer-Verlag New York, New York.
16. Onghena, P. and May, R.B. (1995) Pitfalls in computing and interpreting randomization test p values: A commentary on Chen and Dunlap. Behaviour Research Methods, Instruments, & Computers, 27, 408-411.
17. Wu, D., Lim, E., Vaillant, F., Asselin-Labat, M., Visvader, J.E. and Smyth, G.K. (2010) ROAST: rotation gene set tests for complex microarray experiments. Bioinformatics, 26, 2176-2182.