Using past data to enhance small sample DIF estimation: A Bayesian approach

Journal of Educational and Behavioral Statistics

Volumn 34, Issue 1, 2009, Pages 74-96

  Sinharay, Sandip ^a   Dorans, Neil J ^a   Grant, Mary C ^a   Blew, Edwin O ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Empirical Bayes; Loss function; Mantel Haenszel statistic; Prior distribution

Indexed keywords

EID: 68049137101     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998607309021     Document Type: Article

References (17)

1. Camilli, G. (2006). Test fairness. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 221-256). Westport, CT: American Council on Education & Praeger.
2. Carlin, B. P., & Louis, T. A. (1996). Bayes and empirical Bayes methods for data analysis. London: Chapman & Hall.
3. Clauser, B. E., & Mazor, K. M. (1998). Using statistical procedures to identify differential item functioning test items. Educational Measurement: Issues and Practice, 17, 31-44.
4. Dorans, N. J., & Holland, P. W. (1993). DIF detection and description: Mantel-Haenszel and standardization. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 35-66). Hillsdale, NJ: Lawrence Erlbaum.
5. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003). Bayesian data analysis. London: Chapman & Hall.
6. Holland, P. W. (1985). On the study of differential item performance without IRT. In Proceedings of the 27th annual conference of the Military Testing Association (Vol. I, pp. 282-287). San Diego, CA: Navy Personnel Research and Development Center.
7. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum.
8. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum.
9. Ibrahim, J. G., & Chen, M. H. (2000). Power prior distributions for regression models. Statistical Sciences, 15, 46-60.
10. Lewis, C., & Thayer, D. T. (2000). An investigation of the effectiveness of Mantel-Haenszel procedures to detect DIF using pretest data from an adaptive licensure test. Unpublished manuscript.
11. Lord, F. M. (1986). Maximum likelihood and Bayesian parameter estimation in item response theory. Journal of Educational Measurement, 23, 157-162.
12. Mislevy, R. J. (1988). Exploiting auxiliary information about items in the estimation of Rasch difficulty parameters. Applied Psychological Measurement, 12, 281-296.
13. Schmitt, A. P., Holland, P. W., & Dorans, N. J. (1993). Evaluating hypothesis about differential item functioning. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 255-276). Hillsdale, NJ: Lawrence Erlbaum.
14. Sinharay, S., Dorans, N. J., Grant, M. C., Blew, E. O., & Knorr, C. M. (2006). Using past data to enhance small-sample DIF estimation: A Bayesian approach (ETS RR-06-09). Princeton, NJ: Educational Testing Service.
15. Zwick, R., & Thayer, D. T. (2002). Application of an empirical Bayes enhancement of Mantel-Haenszel DIF analysis to a computerized adaptive test. Applied Psychological Measurement, 26, 57-76.
16. Zwick, R., Thayer, D. T., & Lewis, C. (1999). An empirical Bayes approach to Mantel-Haenszel DIF analysis. Journal of Educational Measurement, 36, 1-28.
17. Zwick, R., Thayer, D. T., & Lewis, C. (2000). Using loss functions for DIF detection: An empirical Bayes approach. Journal of Educational and Behavioral Statistics, 25, 225-247.