Odds ratio, delta, ETS classification, and standardization measures of DIF magnitude for binary logistic regression

Journal of Educational and Behavioral Statistics

Volumn 32, Issue 1, 2007, Pages 92-109

  Monahan, Patrick O ^a   Mchorney, Colleen A ^b   Stump, Timothy E ^c   Perkins, Anthony J ^c  

^a INDIANA UNIVERSITY   (United States)

^b MERCK RESEARCH LABORATORIES   (United States)

^c REGENSTRIEF INSTITUTE   (United States)

Author keywords

Differential item functioning; Effect sizes; Logistic regression

Indexed keywords

EID: 34147223247     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998606298035     Document Type: Article

References (39)

1. Borsboom, D., Mellenbergh, G. J., & Heerden, J. v. (2002). Different kinds of DIF: A distinction between absolute and relative forms of measurement invariance and bias. Applied Psychological Measurement, 26, 433-450.
2. Clauser, B. E., & Mazor, K. M. (1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 17(1), 31-44.
3. Clauser, B. E., Nungester, R. J., Mazor, K., & Ripkey, D. (1996). A comparison of alternative matching strategies for DIF detection in tests that are multidimensional. Journal of Educational Measurement, 33, 202-214.
4. 2 tests. Biometrics, 10, 417-451.
5. Donoghue, J. R., Holland, P. W., & Thayer, D. T. (1993). A Monte Carlo study of factors that affect the Mantel-Haenszel and standardization measures of differential item functioning. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 137-166). Hillsdale, NJ: Lawrence Erlbaum.
6. Dorans, N. J., & Holland, P. W. (1993). DIF detection and description: Mantel-Haenszel and standardization. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 35-66). Hillsdale, NJ: Lawrence Erlbaum.
7. Dorans, N. J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23, 355-368.
8. Groenvold, M., Bjorner, J. B., Klee, M. C., & Kreiner, S. (1995). Test for item bias in a quality of life questionnaire. Journal of Clinical Epidemiology, 48, 805-816.
9. Hess, B., Olejnik, S., & Huberty, C. J. (2001, April). The efficacy of two improvement-over-chance effect size measures for two-group univariate comparisons under variance heterogeneity and nonnormality. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
10. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel-Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129-145). Hillsdale, NJ: Lawrence Erlbaum.
11. Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum.
12. Hosmer, D. W., & Lemeshow, S. (2000). Applied logistic regression (2nd ed.). New York: John Wiley.
13. Huang, C.-Y., & Dunbar, S. B. (1998, April). Factors influencing the reliability of DIF detection methods. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
14. Jodoin, M. G., & Gierl, M. J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349.
15. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
16. Kwak, N., Davenport, E. C., Jr., & Davison, M. L. (1998, April). A comparative study of observed score approaches and purification procedures for detecting differential item functioning. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
17. Marshall, S. C., Mungas, D., Weldon, M., Reed, B., & Haan, M. (1997). Differential item functioning in the Mini-Mental State Examination in English- and Spanish-speaking older adults. Psychology and Aging, 12, 718-725.
18. Mazor, K. M., Kanjee, A., & Clauser, B. E. (1995). Using logistic regression and the Mantel-Haenszel with multiple ability estimates to detect differential item functioning. Journal of Educational Measurement, 32, 131-144.
19. Millsap, R. E., & Everson, H. T. (1993). Methodological review: Statistical approaches for assessing measurement bias. Applied Psychological Measurement, 17, 297-334.
20. Monahan, P. O. (2004, April). Examining the assumption of linearity of the logit in the logistic regression procedure for detecting DIF. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
21. Monahan, P. O., Stump, T. E., Finch, H., & Hambleton, R. K. (in press). Bias of exploratory and cross-validated DETECT index under unidimensionality. Applied Psychological Measurement.
22. Mosteller, F., & Tukey, J. W. (1977). Data analysis and regression: A second course in statistics. Reading, MA: Addison-Wesley.
23. Narayanan, P., & Swaminathan, H. (1996). Identification of items that show nonuniform DIF. Applied Psychological Measurement, 20, 257-274.
24. Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401.
25. Robin, F. (2001). STDIF: Standardization-DIF analysis program. Amherst: University of Massachusetts, School of Education.
26. Rogers, H. J., & Swaminathan, H. (1993). A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning. Applied Psychological Measurement, 17, 105-116.
27. Roussos, L. A., & Ozbek, O. (2006). Formulation of the DETECT population parameter and evaluation of DETECT estimator bias. Journal of Educational Measurement, 43, 215-243.
28. Roussos, L. A., Schnipke, D. L., & Pashley, P. J. (1999). A generalized formula for the Mantel-Haenszel differential item functioning parameter. Journal of Educational and Behavioral Statistics, 24, 293-322.
29. Schmitt, A. P., Holland, P. W., & Dorans, N. J. (1993). Evaluating hypotheses about differential item functioning. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 281-315). Hillsdale, NJ: Lawrence Erlbaum.
30. Swaminathan, H., & Rogers, J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361-370.
31. Swanson, D. B., Clauser, B. E., Case, S. M., Nungester, R. J., & Featherman, C. (2002). Analysis of differential item functioning (DIF) using hierarchical logistic regression models. Journal of Educational and Behavioral Statistics, 27, 53-75.
32. Taylor, J. O., Wallace, R. B., Ostfeld, A. M., & Blazer, D. G. (1998). Established populations for epidemiologic studies of the elderly, 1981-1993 (3rd ICPSR version) [Electronic version]. Ann Arbor, MI: Inter-university Consortium for Political and Social Research.
33. U.S. Department of Health and Human Services. (1997). Longitudinal study of aging, 1984-1990 (6th ICPSR version) [Electronic version]. Ann Arbor, MI: Inter-university Consortium for Political and Social Research.
34. Volk, R. J., Cantor, S. B., Steinbauer, J. R., & Cass, A. R. (1997). Item bias in the CAGE screening test for alcohol use disorders. Journal of General Internal Medicine, 12, 763-769.
35. Wainer, H. (1993). Model-based standardized measurement of an item's differential impact. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 123-135). Hillsdale, NJ: Lawrence Erlbaum.
36. Whitmore, M. L., & Schumacker, R. E. (1999). A comparison of logistic regression and analysis of variance differential item functioning detection methods. Educational and Psychological Measurement, 59, 910-927.
37. Woodard, J. L., Auchus, A. P., Godsall, R. E., & Green, R. C. (1998). An analysis of test bias and differential item functioning due to race on the Mattis Dementia Rating Scale. Journals of Gerontology. Series B, Psychological Sciences and Social Sciences, 53, P370-P374.
38. Zenisky, A. L., Hambleton, R. K., & Robin, F. (2003). Detection of differential item functioning in large-scale state assessments: A study evaluating a two-stage approach. Educational and Psychological Measurement, 63, 51-64.
39. Zumbo, B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa, Canada: Directorate of Human Resources Research and Evaluation, Department of National Defense.