Two Simple Approaches to Overcome a Problem With the Mantel-haenszel Statistic: Comments on Wang, Bradlow, Wainer, and Muller (2008)

Journal of Educational and Behavioral Statistics

Volumn 35, Issue 4, 2010, Pages 474-488

  Sinharay, Sandip ^a   Dorans, Neil J ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

empirical Bayes; Mantel Haenszel statistic; prior distribution

Indexed keywords

EID: 78649800039     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998609359789     Document Type: Article

References (17)

1. Agresti, A. (2002). Categorical data analysis. Hoboken, NJ: Wiley.
2. Bradlow, E.T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153-168.
3. Breslow, N.E. (1981). Odds ratio estimators when the data are sparse. Biometrika, 68, 73-84.
4. Dorans, N.J., & Holland, P.W. (1993). DIF detection and description: Mantel-Haenszel and standardization. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 35-66). Hillsdale, NJ: Lawrence Erlbaum Associates.
5. Dorans, N.J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23, 355-368.
6. Holland, P.W. (1985). On the study of differential item performance without IRT. Proceedings of the 27th annual conference of the Military Testing Association (Vol. I, pp. 282-287). San Diego, CA: Navy Personnel Research and Development Center.
7. Holland, P.W., & Thayer, D.T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer and H. Braun (Eds.), Test validity (pp. 129-146). Hillsdale NJ: Lawrence Erlbaum.
8. Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
9. Parshall, C.G., & Miller, T.R. (1995). Exact versus asymptotic Mantel-Haenszel DIF statistics: A comparison of performance under small-sample conditions. Journal of Educational Measurement, 32, 302-316.
10. Sinharay, S., Dorans, N.J., Grant, M.C., & Blew, E.O. (2009). Using past data to enhance small-sample DIF estimation: A Bayesian approach. Journal of Educational and Behavioral Statistics, 34, 74-96.
11. Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer & H. Braun (Eds.), Test validity (pp. 147-169). Hillsdale NJ: Lawrence Erlbaum.
12. Wang, X., Bradlow, E., Wainer, H., & Muller, E. (2008). A Bayesian method for studying DIF: A cautionary tale filled with surprises and delights. Journal of Educational and Behavioral Statistics, 33, 363-384.
13. Zieky, M. (2008). The origins of procedures for using differential item functioning statistics at educational testing service. Paper presented at the festschrift to honor Paul Holland, Educational Testing Service, Princeton, NJ.
14. Zwick, R., & Thayer, D.T. (1996). Evaluating the magnitude of Differential Item Functioning in polytomous items. Journal of Educational and Behavioral Statistics, 21, 187-201.
15. Zwick, R., Thayer, D.T., & Lewis, C. (1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36, 1-28.
16. Zwick, R., Thayer, D.T., & Lewis, C. (2000). Using loss functions for DIF detection: An empirical Bayes approach. Journal of Educational and Behavioral Statistics, 25, 225-247.
17. Zwick, R., & Thayer, D.T. (2002). Application of an empirical Bayes enhancement of Mantel-Haenszel differential item functioning analysis to a computerized adaptive test. Applied Psychological Measurement, 26, 57-76.