Iordif: An R package for detecting differential item functioning using iterative Hybrid ordinal logistic regression/item response theory and monte Carlo simulations

Journal of Statistical Software

Volumn 39, Issue 8, 2011, Pages 1-30

  Choi, Seung W ^a   Gibbons, Laura E ^b   Crane, Paul K ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

DIF; IRT; Ordinal logistic regression; R

Indexed keywords

EID: 79952906654     PISSN: 15487660     EISSN: 15487660     Source Type: Journal    
DOI: None     Document Type: Article

References (61)

1. Agresti A (1990). Categorical Data Analysis. John Wiley & Sons, New York.
2. Andersen RB (1967). "On the Comparability of Meaningful Stimuli in Cross-Cultural Research." Sociometry, 30, 124-136.
3. Bjorner JB, Smith KJ, Orlando M, Stone C, Thissen D, Sun X (2006). IRTFIT: A Macro for Item Fit and Local Dependence Tests under IRT Models. Quality Metric Inc, Lincoln, RI.
4. Camilli G, Shepard LA (1994). Methods for Identifying Biased Test Items. Sage, Thousand Oaks.
5. Cohen J (1988). Statistical Power Analysis for the Behavioral Sciences. 2nd edition. Lawrence Earlbaum Associates, Hillsdale, NJ.
6. Cook K (1999). "A Comparison of Three Polytomous Item Response Theory Models in the Context of Testlet Scoring." Journal of Outcome Measurement, 3, 1-20.
7. Cox DR, Snell EJ (1989). The Analysis of Binary Data. 2nd edition. Chapman and Hall, London.
8. Crane PK, Cetin K, Cook K, Johnson K, Deyo R, Amtmann D (2007a). "Differential Item Functioning Impact in a Modified Version of the Roland-Morris Disability Questionnaire." Quality of Life Research, 16(6), 981-990.
9. Crane PK, Gibbons LE, Jolley L, van Belle G (2006). "Differential Item Functioning Analysis with Ordinal Logistic Regression Techniques: DIF Detect and difwithpar." Medical Care, 44(11 Supp 3), S115-S123.
10. Crane PK, Gibbons LE, Narasimhalu K, Lai JS, Cella D (2007b). "Rapid Detection of Differential Item Functioning in Assessments of Health-Related Quality of Life: The Functional Assessment of Cancer Therapy." Quality of Life Research, 16(1), 101-114.
11. Crane PK, Gibbons LE, Ocepek-Welikson K, Cook K, Cella D (2007c). "A Comparison of Three Sets of Criteria for Determining the Presence of Differential Item Functioning Using Ordinal Logistic Regression." Quality of Life Research, 16(Supp 1), 69-84.
12. Crane PK, Gibbons LE, Willig JH, Mugavero MJ, Lawrence ST, Schumacher JE, Saag MS, Kitahata MM, Crane HM (2010). "Measuring Depression and Depressive Symptoms in HIV-Infected Patients as Part of Routine Clinical Care Using the 9-Item Patient Health Questionnaire (PHQ-9)." AIDS Care, 22(7), 874-885.
13. Crane PK, Narasimhalu K, Gibbons LE, Mungas DM, Haneuse S, Larson EB, Kuller L, Hall K, van Belle G (2008a). "Item Response Theory Facilitated Cocalibrating Cognitive Tests and Reduced Bias in Estimated Rates of Decline." Journal of Clinical Epidemiology, 61(10), 1018-1027.
14. Crane PK, Narasimhalu K, Gibbons LE, Pedraza O, Mehta KM, Tang Y, Manly JJ, Reed BR, Mungas DM (2008b). "Composite Scores for Executive Function Items: Demographic Heterogeneity and Relationships with Quantitative Magnetic Resonance Imaging." Journal of International Neuropsycholigal Society, 14(5), 746-759.
15. Crane PK, van Belle G, Larson EB (2004). "Test Bias in a Cognitive Test: Differential Item Functioning in the CASI." Statistics in Medicine, 23, 241-256.
16. De Boeck P, Wilson M (2004). Explanatory Item Response Models: A Generalized Linear and Nonlinear Approach. Springer-Verlag, New York.
17. Donoghue JR, Holland PW, Thayer DT (1993). "A Monte Carlo Study of Factors That Affect the Mantel-Haenszel and Standardization Measures of Differential Item Functioning." In P Holland, HWainer (eds.), Differential Item Functioning, pp. 137-166. Erlbaum, Hillsdale, NJ.
18. Dorans NJ, Holland PW (1993). "DIF Detection and Description: Mantel-Haenszel and Standardization." In P Holland, H Wainer (eds.), Differential Item Functioning, pp. 35-66. Erlbaum, Hillsdale, NJ.
19. French AW, Miller TR (1996). "Logistic Regression and Its Use in Detecting Differential Item Functioning in Polytomous Items." Journal of Educational Measurement, 33, 315-332.
20. French BF, Maller SJ (2007). "Iterative Purification and Effect Size Use with Logistic Regression for Differential Item Functioning Detection." Educational and Psychological Measurement, 67(3), 373-393.
21. Gibbons LE, McCurry S, Rhoads K, Masaki K, White L, Borenstein AR, Larson EB, Crane PK (2009). "Japanese-English Language Equivalence of the Cognitive Abilities Screening Instrument among Japanese-Americans." International Psychogeriatrics, 21(1), 129-137.
22. Gregorich SE (2006). "Do Self-Report Instruments Allow Meaningful Comparisons across Diverse Population Groups? Testing Measurement Invariance Using the Confirmatory Factor Analysis Framework." Medical Care, 44(11 Supp 3), S78-S94.
23. Harrell Jr FE (2009). Design: Design Package. R package version 2.3-0, URL http://CRAN.R-project.org/package=Design.
24. Holland PW, Thayer DT (1988). "Differential Item Prformance and the Mantel-Haenszel Procedure." In H Wainer, HI Braun (eds.), Test Validity, pp. 129-145. Erlbaum, Hillsdale, NJ.
25. Jodoin MG, Gierl MJ (2001). "Evaluating Type I Error and Power Rates Using an Effect Size Measure with the Logistic Regression Procedure for DIF Detection." Applied Measurement in Education, 14, 329-349.
26. Jones R (2006). "Identification of Measurement Differences between English and Spanish Language Versions of the Mini-Mental State Examination: Detecting Differential Item Functioning Using MIMIC Modeling." Medical Care, 44, S124-S133.
27. 2 Item Fit Index for Polytomous IRT Models." Journal of Educational Measurement, 45(4), 391-406.
28. Kim SH, Cohen AS (1998). "Detection of Differential Item Functioning under the Graded Response Model with the Likelihood Ratio Test." Applied Psychological Measurement, 22, 345-355.
29. Kim SH, Cohen AS, Alagoz C, Kim S (2007). "DIF Detection Effect Size Measures for Polytomously Scored Items." Journal of Educational Measurement, 44(2), 93-116.
30. Li H, Stout W (1996). "A New Procedure for Detection of Crossing DIF." Psychometrika, 61, 647-677.
31. Lord FM (1980). Applications of Item Response Theory to Practical Testing Problems. Lawrence Erlbaum Associates, Hillsdale, NJ.
32. Mair P, Hatzinger R (2007). "Extended Rasch Modeling: The eRm Package for the Application of IRT Models in R." Journal of Statistical Software, 20(9), 1-20. URL http://www.jstatsoft.org/v20/i09/.
33. Maldonado G, Greenland S (1993). "Simulation Study of Confounder-Selection Strategies." American Journal of Epidemiology, 138(11), 923-936.
34. Menard S (2000). "Coeficients of Determination for Multiple Logistic Regression Analysis." The American Statistician, 54, 17-24.
35. Miller TR, Spray JA (1993). "Logistic Discriminant Function Analysis for DIF Identification of Polytomously Scored Items." Journal of Educational Measurement, 30, 107-122.
36. Millsap RE, Everson HT (1993). "Methodology Review: Statistical Approaches for Assessing Measurement Bias." Applied Psychological Measurement, 17(4), 297-334.
37. Mittlböock M, Schemper M (1996). "Explained Variation for Logistic Regression." Statistics in Medicine, 15, 1987-1997.
38. Mittlböck M, Schemper M (1999). "Computing Measures of Explained Variation for Logistic Regression Models." Computer Methods and Programs in Biomedicine, 58, 17-24.
39. Muraki E, Bock D (2005). PARSCALE 4. Scientific Software International, Inc., Lincolnwood, IL. URL http://www.ssicentral.com/.
40. Nagelkerke NJD (1991). "A Note on a General Definition of the Coeficient of Determination." Biometrika, 78, 691-692.
41. Orlando M, Thissen D (2003). "Further Investigation of the Performance of S -X2: An Item Fit Index for Use with Dichotomous Item Response Theory Models." Applied Psychological Measurement, 27(4), 289-298.
42. Penfield RD (2005). "DIFAS: Differential Item Functioning Analysis System." Applied Psy-chological Measurement, 29(2), 150-151.
43. Penfield RD (2007). "Assessing Differential Step Functioning in Polytomous Items Using a Common Odds Ratio Estimator." Journal of Educational Measurement, 44, 187-210.
44. Penfield RD, Gattamorta K, Childs RA (2009). "An NCME Instructional Module on Using Differential Step Functioning to Refine the Analysis of DIF in Polytomous Items." Educa-tional Measurement: Issues and Practice, 28(1), 38-49.
45. Perkins AJ, Stump TE, Monahan PO, McHorney CA (2006). "Assessment of Differential Item Functioning for Demographic Comparisons in the MOS SF-36 Health Survey." Quality of Life Research, 15(3), 331-348.
46. Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D (2011). "Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, Anxiety, and Anger." Under review.
47. Raju NS, Fortmann-Johnson KA, Kim W, Morris SB, Nering M L, Oshima TC (2009). "The Item Parameter Replication Method for Detecting Differential Functioning in the DFIT Framework." Applied Measurement in Education, 33(2), 133-147.
48. R Development Core Team (2010). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org/.
49. Reise SP, Widaman KF, Pugh RH (1993). "Confirmatory Factor Analysis and Item Response Theory: Two Approaches for Exploring Measurement Invariance." Psychological Bulletin, 114(3), 552-566.
50. Rizopoulos D (2006). "ltm: An R Package for Latent Variable Modeling and Item Response Theory Analyses." Journal of Statistical Software, 17(5), 1-25. URL http://www.jstatsoft.org/v17/i05/.
51. Rogers HJ, Swaminathan H (1993). "A Comparison of Logistic Regression and Mantel-Hanenszel Procedures for Detecting Differential Item Functioning." Applied Psychological Measurement, 17, 105-116.
52. Samejima F (1969). "Estimation of Latent Ability Using a Response Pattern of Graded Scores." Psychometrika Monograph, 17.
53. Shealy RT, Stout WF (1993). "An Item Response Theory Model for Test Bias and Differential Test Functioning." In PW Holland, H Wainer (eds.), Differential Item Functioning, pp. 197-239. Erlbaum, Hillsdale, NJ.
54. StataCorp (2007). Stata Statistical Software: Release 10. StataCorp LP, College Station, TX. URL http://www.stata.com/.
55. Stocking ML, Lord FM (1983). "Developing a Common Metric in Item Response Theory." Applied Psychological Measurement, 7(2), 201-210.
56. Swaminathan H, Rogers HJ (1990). "Detecting Differential Item Functioning Using Logistic Regression Procedures." Journal of Educational Measurement, 27, 361-370.
57. Thissen D (2001). IRTLRDIF: Version v.2.0b. L.L. Thurstone Psychometric Laboratory, University of North Carolina at Chapel Hill. URL http://www.unc.edu/~dthissen/dl.html.
58. Wainer H (1993). "Model-Based Standardized Measurement of an Item's Differential Impact." In P Holland, H Wainer (eds.), Differential Item Functioning. Erlbaum, Hillsdale, NJ.
59. Waller NG (1998). "EZDIF: Detection of Uniform and Nonuniform Differential Item Functioning With the Mantel-Haenszel and Logistic Regression Procedures." Applied Psychological Measurement, 22(4), 391.
60. Zumbo BD (1999). A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression Modeling as a Unitary Framework for Binary and Likert-Type (Ordinal) Item Scores. Directorate of Human Resources Research and Evaluation, Department of National Defense, Ottawa, ON.
61. Zwick R (1990). "When Do Item Response Function and Mantel-Haenszel Deffnition of Differential Item Functioning Coincide?" Journal of Educational Statistics, 15(3), 185-197.