Assessing and explaining differential item functioning using logistic mixed models

Journal of Educational and Behavioral Statistics

Volumn 30, Issue 4, 2005, Pages 443-464

  Van Den Noortgate, Wim ^a   De Boeck, Paul ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Differential item functioning; Item bias; Item response theory; Logistic mixed models; Random effects

Indexed keywords

EID: 29144506244     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986030004443     Document Type: Review

References (48)

1. Adams, R. J., Wilson, M., & Wu, M. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 47-76.
2. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459.
3. Breslow, N. E., & Clayton, D. G. (1993). Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88, 9-25.
4. Bryk, A. S., & Raudenbush, S. W. (1992). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage Publications, Inc.
5. Bryk, A. S., Raudenbush, S. W., Cheong, Y. F., & Congdon, R. T. (2001). HLM5: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International, Inc.
6. Clauser, B. E., Nungester, R. J., Mazor, K., & Ripkey, D. (1996). A comparison of alternative matching strategies for DIF detection in tests that are multidimensional. Journal of Educational Measurement, 33, 203-215.
7. Clauser, B. E., Nungester, R. J., & Swaminathan, H. (1996). Improving the matching for DIF analysis by conditioning on both test score and an educational background variable. Journal of Educational Measurement, 33, 453-464.
8. Cohen, A. S., Kim, S.-H., & Wollack, J. A. (1996). An investigation of the Likelihood Ratio Test for detection of differential item functioning. Applied Psychological Measurement, 20, 15-26.
9. De Boeck, P., & Wilson, M. (2004). Explanatory item response models: A generalized and nonlinear approach. New York: Springer.
10. De Boeck, P., Daems, P., Meulders, M., & Rymenams, R. (1997). Ontwikkeling van een toets voor de eindtermen begrijpend lezen [Construction of a test for the educational targets of reading comprehension]. Leuven/Antwerpen (Belgium): Katholieke Universiteit Leuven/Universiteit Antwerpen.
11. Fisher, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologies, 37, 359-374.
12. Fisher, G. H. (1983). Logistic latent trait models with linear constraints. Psychometrika, 48, 3-26.
13. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. London: Chapman & Hall.
14. Goldstein, H., & Rasbash, J. (1996). Improved approximations for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A, 159, 505-513.
15. Goldstein, H., Rasbash, J., Plewis, I., Draper, D., Browne, W., Yang, M., et al. (1998). A user's guide to MLwiN. Multilevel Models Project, University of London.
16. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. London: Sage.
17. Hill, P. W., & Rowe, K. J. (1996). Multilevel modelling in school effectiveness research. School Effectiveness and School Improvement, 7, 1-34.
18. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel Haenszel procedure. In H. Wainer & H. I. Braun procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Erlbaum.
19. Holland, P. W., & Wainer, H. (1993). Differential item functioning. Hillsdale, NJ: Erlbaum.
20. Hox, J. (2002). Multilevel analysis. Techniques and applications. Mahwah, NJ: Erlbaum.
21. Janssen, R., Tuerlinckx, F., Meulders, M., & De Boeck, P. (2000). A hierarchical IRT model for criterion-referenced measurement. Journal of Educational and Behavioral Statistics, 25, 285-306.
22. Kachman, S. D. (2001). Generalized linear mixed models [Web Page]. URL Nebraska Institute of Agriculture & Natural Resources, Department of Biometrics Web Site: http://biometry.unl.edu/faculty/Steve/GLMMy2001 [2002, June 25].
23. Kamata, A. (2001). Item analysis by the hierarchical generalized linear model. Journal of Educational Measurement, 38, 79-93.
24. Longford, N. T. (1993). Random coefficient models. Oxford: Clarendon Press.
25. Longford, N. T., Holland, P. W., & Thayer, D. T. (1993). Stability of the MH D-DIF statistics across populations. In P. W. Holland & H. Wainer (Eds). Differential item functioning. Hillsdale, NJ: Erlbaum.
26. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
27. Mellenbergh, G. J. (1982). Contingency table models for assessing item bias. Journal of Educational Statistics, 7, 105-118.
28. Mellenbergh, G. J. (1994). Generalized linear item response theory. Psychological Bulletin, 115, 300-307.
29. Millsap, R. E., & Everson, H. T. (1993). Methodology review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297-334.
30. Phillips, A., & Holland, P. W. (1987). Estimation of the variance of the Mantel-Haenszel log-odds-ratio. Biometrics, 43, 425-431.
31. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: The Danish Institute of Educational Research.
32. Rijmen, F., & Briggs, D. (2004). Multidimensional person variance and latent item predictors. In P. De Boeck & M. Wilson (Eds.), Explanatory item response models: A generalized and nonlinear approach (pp. 247-265). New York: Springer.
33. Rijmen, F., Tuerlinckx, F., De Boeck, P. & Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8, 185-205.
34. Rodriguez, G., & Goldman, N. (1995). An assessment of estimation procedures for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A, 158, 73-90.
35. SAS Institute. (2000). SAS/STAT User's Guide, Version 8. Cary, NC: SAS Institute, Inc.
36. Scheerens, J., & Bosker, R. J. (1997). The foundations of educational effectiveness. Oxford: Elsevier.
37. Smith, L. L., & Reise, S. P. (1998). Gender differences on negative affectivity: An IRT study of differential item functioning on the Multidimensional Personality Questionnaire Stress Reaction Scale. Journal of Personality and Social Psychology, 75, 1350-1362.
38. Snijders,T. A. B., & Bosker, R. J. (1999). Multilevel analysis. An introduction to basic and advanced multilevel modeling. London: Sage.
39. Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures, 27, 361-370.
40. Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67-113). Hillsdale, NJ: Erlbaum
41. Van Damme, J., De Fraine, B., Van Landeghem, G., Opdenakker, M.-C., & Onghena, P. (2002). A new study on educational effectiveness in secondary schools in Flanders: An introduction. School Effectiveness and School Improvement, 13, 383-397.
42. Van den Noortgate, W., De Boeck, P., & Meulders, M. (2003). Cross-classification multilevel logistic models in psychometrics. Journal of Educational and Behavioral Statistics, 28, 369-386.
43. Van den Noortgate, W., & Paek, I. (2004). Person regression models. In P. De Boeck & M. Wilson (Eds.), Explanatory item response models: A generalized and nonlinear approach. New York: Springer.
44. Verbeke, G., & Molenberghs, G. (2000). Linear mixed models for longitudinal data. New York: Springer.
45. Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
46. Wainer, H., Sireci, S. G., & Thissen, D. (1991). Differential testlet functioning: Definitions and detection. Journal of Educational Measurement, 28, 197-219.
47. Wolfinger, R., & O'Connell, M. (1993). Generalized linear mixed models: A pseudo-likelihood approach. Journal of Statistical Computation and Simulation, 48, 233-243.
48. Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense.