Detection of crossing differential item functioning: A comparison of four methods

Educational and Psychological Measurement

Volumn 67, Issue 4, 2007, Pages 565-582

  Finch, W Holmes ^a   French, Brian F ^b  

^a BALL STATE UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Confirmatory factor analysis; IRTLR; Logistic regression; Nonuniform DIF; SIBTEST

Indexed keywords

EID: 34547170052     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164406296975     Document Type: Article

References (46)

1. Ackerman, T.A. (1992). A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. Journal of Educational Measurement, 29, 67-91.
2. Agresti, A. (2002). Categorical data analysis. Hoboken, NJ: John Wiley.
3. Bentler, P.M. (1995). EQS structural equations program manual Encino, CA: Multivariate Software.
4. Bolt, D.M. (2002). A Monte Carlo comparison of parametric and nonparametric polytomous DIF detection methods. Applied Measurement in Education, 15, 113-141.
5. Candell, G.L., Drasgow, F. (1988). An iterative procedure for linking metrics and assessing item bias in item response theory. Applied Psychological Measurement, 12, 253-260.
6. Chou, C.-P., Bentler, P.M., Satorra, A. (1991). Scaled test statistics and robust standard errors for non-normal data in covariance structure analysis: A Monte Carlo study. British Journal of Mathematical and Statistical Psychology, 44, 347-357.
7. Cohen, A.S., Kim, S.H., Wollack, J.A. (1996). An investigation of the likelihood ratio test for detection of differential item functioning. Applied Psychological Measurement, 20, 15-26.
8. Finch, W.H. (2005). The MIMIC model as a method for detecting DIF: Comparison with Mantel-Haenszel, SIBTEST and the IRT likelihood ratio. Applied Psychological Measurement, 29, 278-295.
9. Finch, W.H., French, B.F. (2006, June). Type I error rate for one type of DIF detection in the presence of the other type: A Monte Carlo study. Paper presented at the International Meeting of the Psychometric Society, Montreal, QC, Canada.
10. Fleishman, J.A., Spector, W.D., Altman, B.M. (2002). Impact of differential item functioning on age and gender differences in functional disability. Journal of Gerontology: Social Sciences, 57B (5). S275 - S283.
11. Flora, D.B., Curran, P.J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491.
12. French, B.F., Finch, W.H. (2006). Confirmatory factor analytic procedures for the determination of measurement invariance. Structural Equation Modeling, 13, 378-402.
13. Hambleton, R.K., Swaminathan, H., Rogers, J.H. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
14. Holland, P.W., Thayer, D.T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Holland H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum.
15. Jodoin, M.G., Gierl, M.J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349.
16. Jreskog, K.G. (1994). On the estimation of polychoric correlations and their asymptotic covariance matrix. Psychometrika, 59, 381-389.
17. Jreskog, K.G., Srbom, D. (1988). PRELIS: A program for multivariate data screening and data summarization. A predecessor for LISREL (2 nd ed.). Mooresville, IN: Scientific Software.
18. Jreskog, K.G., Srbom, D. (1996). LISREL 8: User's reference guide. Chicago: Scientific Software.
19. Kim, S.-H., Cohen, A.S. (1998). Detection of differential item functioning under the graded response model with the likelihood ratio test. Applied Psychological Measurement, 22, 345-355.
20. Levine, D.W., Kaplan, R.M., Kripke, D.F., Bowen, D.J., Naughton, M.J., Shumaker, S.A. (2003). Factor structure and measurement invariance of the Women's Health Initiative Insomnia Rating Scale. Psychological Assessment, 15, 123-136.
21. Li, H.-H., Stout, W. (1996). A new procedure for detection of crossing DIF. Psychometrika, 61, 647-677.
22. Lord, F., Novick, M.R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
23. Lubke, G.H., Muthn, B.O. (2004). Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514-534.
24. Maller, S.J. (2001). Differential item functioning in the WISC-III: Item parameters for boys and girls in the national standardization sample. Educational and Psychological Measurement, 61, 793-817.
25. Maller, S.J., French, B.F. (2004). Factor invariance of the UNIT across deaf and standardization samples. Educational and Psychological Measurement, 64, 647-660.
26. Meade, A.W., Lautenschlager, G.J. (2004). A Monte-Carlo study of confirmatory factor analytic tests of measurement equivalence/invariance. Structural Equation Modeling, 11, 60-72.
27. Millsap, R.E. (2005). Four unresolved problems in studies of factorial invariance. In A. Maydeu-Olivares J. J. McArdle (Eds.), Contemporary psychometrics (pp. 153-172). Mahwah, NJ: Lawrence Erlbaum.
28. Muthn, B., Lehman, J. (1985). Multiple group IRT modeling: Applications to item bias analysis. Journal of Educational Statistics, 10, 133-142.
29. Muthn, B., Satorra, A. (1995). Technical aspects of Muthn's LISCOMP approach to estimation of latent variable relations with a comprehensive measurement model. Psychometrika, 60, 489-503.
30. Muthn, B., du Toit, S.H.C., Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Unpublished manuscript.
31. Muthn, B.O., Muthn, L.K. (2004). Mplus (Version 3) [Computer software]. Los Angeles: Authors.
32. Narayanan, P., Swaminathan, H. (1996). Identification of items that show nonuniform DIF. Applied Psychological Measurement, 20, 257-274.
33. Penfield, R.D. (2003). IRT-Lab: Software for research and pedagogy in item response theory. Applied Psychological Measurement, 27, 301-302.
34. Quiroga, A.M. (1992). Studies of the polychoric correlation and other correlation measures for ordinal variables. Unpublished doctoral dissertation, Acta Universitatis Upsaliensis.
35. Raju, N.S. (1988). The area between two item characteristic curves. Psychometrika, 53, 495-502.
36. Raju, N.S., Laffitte, L.J., Byrne, B.M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87, 517-529.
37. Reise, S.P., Widaman, K.F., Pugh, R.H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
38. Rogers, H.J., Swaminathan, H. (1993). A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning. Applied Psychological Measurement, 17, 105-116.
39. Shealy, R., Stout, W.F. (1993). A model-based standardization approach that separates true bias/ DIF from group differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58, 159-194.
40. Stout, W. (1999). SIBTEST Software (Version 1.0) [Computer software]. Chicago: Scientific Software.
41. Swaminathan, H., Rogers, H.J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361-370.
42. Tate, R. (2003). A comparison of selected empirical methods for assessing the structure of responses to test items. Applied Psychological Measurement, 27, 159-203.
43. Thissen, D. (2001). IRTLRDIF (Version 2.0b) [Computer software]. Chapel Hill: L. L. Thurstone Psychometric Laboratory, University of North Carolina.
44. Thissen, D., Steinberg, L., Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H. Wainer H. Braun (Eds.), Test validity (pp. 147-169). Hillsdale, NJ: Lawrence Erlbaum.
45. Thissen, D., Steinberg, L., Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland H. Wainer (Eds.), Differential item functioning (pp. 67-113). Hillsdale, NJ: Lawrence Erlbaum.
46. Wang, W.C., Yeh, L.Y. (2003). Effects of anchor item methods on differential item functioning detection with the likelihood ratio test. Applied Psychological Measurement, 27, 479-498.