Modeling DIF effects using distractor-level invariance effects: Implications for understanding the causes of DIF

Applied Psychological Measurement

Volumn 34, Issue 3, 2010, Pages 151-165

  Penfield, Randall D ^a  

^a UNIVERSITY OF MIAMI   (United States)

Author keywords

Differential distractor functioning; Differential item functioning; Multiple choice items

Indexed keywords

EID: 77951996812     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621609359284     Document Type: Article

References (38)

1. Ackerman, T. (1992). A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. Journal of Educational Measurement, 29, 67-91.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
3. Bock, R.D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
4. Camilli, G. (1992). A conceptual analysis of differential item functioning in terms of a multidimensional item response model. Applied Psychological Measurement, 16, 129-147.
5. Camilli, G., & Penfield, D.A. (1997). Variance estimation for differential test functioning based on Mantel-Haenszel statistics. Journal of Educational Measurement, 34, 123-139.
6. Camilli, G., & Shepard, L.A. (1994). Methods for identifying biased test items. Newbury Park, CA: Sage.
7. Dorans, N.J., & Kulick, E.M. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23, 355-368.
8. Dorans, N.J., Schmitt, A.P., & Bleistein, C.A. (1992). The standardization approach to assessing comprehensive differential item functioning. Journal of Educational Measurement, 29, 309-319.
9. Finch, W.H., & French, B.F. (2006, April). Detection of crossing differential item functioning: A comparison of four methods. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco.
10. Green, B.F., Crone, C.R., & Folk, V.G. (1989). A method for studying differential distractor functioning. Journal of Educational Measurement, 26, 147-160.
11. Greenberg, A.C., Penfield, R.D., & Greenfield, D.B. (2009, April). Fighting bias with statistics: Applying DIF and DDF to detect gender differences in responses to items on a preschool science assessment. Poster presented at the annual meeting of the National Council on Measurement in Education, San Diego.
12. Hanson, B.A. (1998). Uniform DIF and DIF defined by differences in item response functions. Journal of Educational and Behavioral Statistics, 23, 244-253.
13. Holland, P.W., & Thayer, D.T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum.
14. Li, H.-H., & Stout, W. (1996). A new procedure for the detection of crossing DIF. Psychometrika, 61, 647-677.
15. Lopez Rivas, G.E., Stark, S., & Chernyshenko, O.S. (2009). The effects of referent item parameters on differential item functioning detection using the free baseline likelihood ratio test. Applied Psychological Measurement, 33, 251-265.
16. Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
17. Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
18. Millsap, R.E. (2005). Four unresolved problems in studies of factorial invariance. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics (pp. 153-171). Mahwah, NJ: Lawrence Erlbaum.
19. Millsap, R.E., & Meredith, W. (1992). Inferential conditions in the statistical detection of measurement bias. Applied Psychological Measurement, 16, 389-402.
20. Penfield, R.D. (2003). Applying the Breslow-Day test of trend in odds ratio heterogeneity to the analysis of nonuniform DIF. Alberta Journal of Educational Research, 49, 231-243.
21. Penfield, R.D. (2005). DIFAS: Differential item functioning analysis system. Applied Psychological Measurement, 29, 150-151.
22. Penfield, R.D. (2007). Assessing differential step functioning in polytomous items using a common odds ratio estimator. Journal of Educational Measurement, 44, 187-210.
23. Penfield, R.D. (2008). An odds ratio approach for assessing differential distractor functioning effects under the nominal response model. Journal of Educational Measurement, 45, 247-269.
24. Penfield, R.D., & Algina, J. (2003). Applying the Liu-Agresti estimator of the cumulative common odds ratio to DIF detection in polytomous items. Journal of Educational Measurement, 40, 353-370.
25. Penfield, R.D., & Camilli, G. (2007). Differential item functioning and item bias. In S. Sinharay & C. R. Rao (Eds.), Handbook of statistics: Vol. 26. Psychometrics (pp. 125-167). New York, NY: Elsevier.
26. Raju, N.S. (1988). The area between two item characteristic curves. Psychometrika, 53, 495-502.
27. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danmarks Paedogogiske Institut.
28. Samejima, F. (1979). A new family of models for the multiple choice item (Research Report No. 79-4). Knoxville: University of Tennessee, Department of Psychology.
29. Schmitt, A.P., & Dorans, N.J. (1990). Differential item functioning for minority examinees on the SAT. Journal of Educational Measurement, 27, 67-81.
30. Shealy, R.T., & Stout, W.F. (1993). A model based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as we as item bias/DIF. Psychometrika, 58, 197-239.
31. Shih, C.-L., & Wang, W.-C. (2009). Differential item functioning detection using the multiple indicators, multiple causes method with a pure short anchor. Applied Psychological Measurement, 33, 184-199.
32. Thissen, D., & Steinberg, L. (1984). A response model for multiple choice items. Psychometrika, 49, 501-519.
33. Thissen, D., Steinberg, L., & Fitzpatrick, A.R. (1989). Multiple-choice items: The distractors are also part of the item. Journal of Educational Measurement, 26, 161-176.
34. Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67-113). Hillsdale, NJ: Lawrence Erlbaum.
35. Wang, W.-C., & Su, Y.-H. (2004). Effects of average signed area between two item characteristic curves and test purification procedures on the DIF detection via the Mantel-Haenszel method. Applied Measurement in Education, 17, 113-144.
36. Wollack, J.A., Bolt, D.M., Cohen, A.S., & Lee, Y.S. (2002). Recovery of item parameters in the nominal response model: A comparison of marginal maximum likelihood estimation and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 26, 339-352.
37. Zieky, M. (1993). Practical questions in the use of DIF statistics in item development. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 337-347). Hillsdale, NJ: Lawrence Erlbaum.
38. Zwick, R. (1990). When do item response function and Mantel-Haenszel definitions of differential item functioning coincide? Journal of Educational Statistics, 15, 185-198.