Multiway contingency tables: Monte Carlo resampling probability values for the chi-squared and likelihood-ratio tests

Psychological Reports

Volumn 107, Issue 2, 2010, Pages 501-510

  Long, Michael A ^a   Berry, Kenneth J ^b   Mielke Jr , Paul W ^b  

^a OKLAHOMA STATE UNIVERSITY   (United States)

^b Department of Environmental and Radiological Health Sciences   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CHI SQUARE DISTRIBUTION; HUMAN; MONTE CARLO METHOD; PROBABILITY; PSYCHOLOGY; STATISTICAL MODEL; STATISTICS;

CHI-SQUARE DISTRIBUTION; HUMANS; LIKELIHOOD FUNCTIONS; MONTE CARLO METHOD; PROBABILITY; PSYCHOLOGY;

EID: 78649459177     PISSN: 00332941     EISSN: 1558691X     Source Type: Journal    
DOI: 10.2466/03.PR0.107.5.501-510     Document Type: Article

References (53)

1. Agresti, A. (1990) Categorical data analysis. New York: Wiley.
2. Agresti, A. (2002) Categorical data analysis. (2nd ed.) New York: Wiley.
3. Agresti, A., & Finlay, B. (2009) Statistical methods for the social sciences. (4th ed.) Upper Saddle River, NJ: Prentice Hall.
4. Bakeman, R., Robinson, B. F., & Quera, V. (1996) Testing sequential association: Estimating exact p values using sampled permutations. Psychological Methods, 1, 4-15.
5. Bergson, J. (1978a) Do the marginal totals of the 2 × 2 table contain relevant information concerning the table proportions? Journal of Statistical Planning and Inference, 2, 43-44.
6. Bergson, J. (1978b) In dispraise of the exact test. Journal of Statistical Planning and Inference, 2, 27-42.
7. Berry, K. J., Mielke, P. W., Jr., & Mielke, H. W. (2002) The Fisher-Pitman permutation test: An attractive alternative to the F test. Psychological Reports, 90, 495-502.
8. Berry, K. J., Mielke, P. W., Jr., & Zelterman, D. (1994) Fisher's exact test of mutual independence for 2 × 2 × 2 cross-classification tables. Educational and Psychological Measurement, 54, 110-114.
9. Bishop, Y. M., Fienberg, S. E., & Holland, P. W. (1975) Discrete multivariate analysis: Theory and practice. Cambridge, MA: MIT Press.
10. Box, G. E. P., & Anderson, S. L. (1955) Permutation theory in the derivation of robust criteria and the study of departures from assumption. Journal of the Royal Statistical Society, Series B, 17, 1-34.
11. Brown, L., Sherbenou, R. J., & Johnsen, S. K. (1997) Manual of Test of Nonverbal Intelligence. (3rd ed.) Austin, TX: PRO-ED.
12. Eden, T., & Yates, F. (1933) On the validity of Fisher's z test when applied to an actual example of non-normal data. The Journal of Agricultural Science, 23, 6-17.
13. Edgington, E. S., & Onghena, P. (2007) Randomization tests. (4th ed.) Boca Raton, FL: Chapman & Hall/CRC.
14. Feinstein, A. R. (1993) Permutation tests and "statistical significance." M. D. Computing: Computers in Medical Practice, 10, 28-41.
15. Fisher, R. A. (1935) The design of experiments. Edinburgh, Scotland: Oliver & Boyd.
16. Gilbert, N. (1993) Analyzing tabular data: Loglinear and logistic models for social researchers. London: UCL Press.
17. Goodman, L. A. (1970) The multivariate analysis of qualitative data: Interactions among multiple classifications. Journal of the American Statistical Association, 65, 226-256.
18. Goodman, L. A. (1971) The analysis of multidimensional contingency tables: Stepwise procedures and direct estimation methods for building models for multiple classifications. Technometrics, 13, 33-61.
19. Grove, D. M. (1984) Discussion of "Tests of significance for 2 × 2 tables." Journal of the Royal Statistical Society, Series A, 147, 454-455.
20. Haber, M. (1990) Comments on "The test of homogeneity for 2 × 2 contingency tables: A review of and some personal opinions on the controversy" by G. Camilli. Psychological Bulletin, 108, 146-149.
21. Haberman, S. J. (1978) Analysis of qualitative data. Vol. 1. Introductory topics. New York: Academic Press.
22. Haberman, S. J. (1979) Analysis of qualitative data. Vol. 2. New developments. New York: Academic Press.
23. Hoeffding, W. (1952) The large sample power of tests based on permutations of observations. The Annals of Mathematical Statistics, 23, 169-192.
24. Hunter, M. A., & May, R. B. (1993) Some myths concerning parametric and nonparametric tests. Canadian Psychology, 34, 384-389.
25. Johnston, J. E., Berry, K. J., & Mielke, P. W., Jr. (2007) Permutation tests: Precision in estimating probability values. Perceptual and Motor Skills, 105, 915-920.
26. Kempthorne, O. (1955) The randomization theory of statistical inference. Journal of the American Statistical Association, 50, 946-967.
27. Kempthorne, O. (1978) In dispraise of the exact test: Reactions. Journal of Statistical Planning and Inference, 2, 199-213.
28. Kennedy, J. J. (1983) Analyzing qualitative data: Introductory log-linear analysis for behavioral research. New York: Praeger.
29. Kennedy, P. E. (1995) Randomization tests in econometrics. Journal of Business & Economic Statistics, 13, 85-94.
30. Kroonenberg, P. M. (2008) Applied multiway data analysis. Hoboken, NJ: Wiley.
31. Lloyd, C. J. (1988) Some issues arising from the analysis of 2 × 2 contingency tables. Australian Journal of Statistics, 30, 35-46.
32. Ludbrook, J. L. (2008) Analysis of 2 × 2 tables of frequencies: Matching test to experimental design. International Journal of Epidemiology, 37, 1430-1435.
33. Ludbrook, J. L., & Dudley, H. (1998) Why permutation tests are superior to t and F tests in biomedical research. The American Statistician, 52, 127-132.
34. May, R. B., & Hunter, M. A. (1993) Some advantages of permutation tests. Canadian Psychology, 34, 401-407.
35. Mielke, P. W., Jr., & Berry, K. J. (1988) Cumulant methods for analyzing independence of r-way contingency tables and goodness-of-fit frequency data. Biometrika, 75, 790-793.
36. Mielke, P. W., Jr., & Berry, K. J. (2007) Permutation methods: A distance function approach.(2nd ed.) New York: Springer-Verlag.
37. Mielke, P. W., Jr., Berry, K. J., & Johnston, J. E. (2007) Resampling programs for multiway contingency tables with fixed marginal frequency totals. Psychological Reports, 101, 18-24.
38. Olzak, L. A., & Wickens, T. D. (1983) The interpretation of detection data through direct multivariate frequency analysis. Psychological Bulletin, 93, 574-585.
39. Pearson, K. (1900/1948) On a criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling. Philosophical Magazine, 50, 157-175. Reprinted in E. S. Pearson (Ed.), Karl Pearson's early statistical papers. Cambridge, UK: Cambridge Univer. Press. Pp. 339-357.
40. Pearson, K. (1904/1948) Mathematical contributions to the theory of evolution: XIII. On the theory of contingency and its relation to association and normal correlation. Drapers' Company Research Memoirs, Biometric Series, 1, 1-35. Reprinted in E. S. Pearson (Ed.), Karl Pearson's early statistical papers. Cambridge, UK: Cambridge Univer. Press. Pp. 443-475.
41. Pitman, E. J. G. (1937a) Significance tests which may be applied to samples from any populations. Supplement to the Journal of the Royal Statistical Society, 4, 119-130.
42. Pitman, E. J. G. (1937b) Significance tests which may be applied to samples from any populations: II. The correlation coefficient test. Supplement to the Journal of the Royal Statistical Society, 4, 225-232.
43. Pitman, E. J. G. (1938) Significance tests which may be applied to samples from any populations: III. The analysis of variance test. Biometrika, 29, 322-335.
44. Rao, J. N. K., & Scott, A. J. (1984) On chi-squared tests for multiway contingency tables with cell proportions estimated from survey data. The Annals of Statistics, 12, 46-60.
45. Read, T. R. C., & Cressie, N. A. C. (1988) Goodness-of-fit for discrete multivariate data. New York: Springer-Verlag.
46. Vokey, J. R. (2003) Multiway frequency analysis for experimental psychologists. Canadian Journal of Experimental Psychology, 57, 257-264.
47. Wald, A., & Wolfowitz, J. (1944) Statistical tests based on permutations of the observations. The Annals of Mathematical Statistics, 15, 358-372.
48. Welch, B. L. (1937) On the z test in randomized blocks and Latin squares. Biometrika, 29, 21-52.
49. Wickens, T. D. (1989) Multiway contingency tables analysis for the social sciences. Hillsdale, NJ: Erlbaum.
50. Wickens, T. D. (1993) Analysis of contingency tables with between-subjects variability. Psychological Bulletin, 113, 191-204.
51. Wilks, S. S. (1935) The likelihood test of independence in contingency tables. The Annals of Mathematical Statistics, 6, 190-196.
52. Wilks, S. S. (1938) The large-sample distribution of the likelihood ratio for testing composite hypotheses. The Annals of Mathematical Statistics, 9, 60-62.
53. Yates, F., with Discussants. (1984) Tests of significance for 2 × 2 contingency tables. Journal of the Royal Statistical Society, Series A, 147, 426-463.