It Might Not Make a Big DIF: Improved Differential Test Functioning Statistics That Account for Sampling Variability

Educational and Psychological Measurement

Volumn 76, Issue 1, 2016, Pages 114-140

  Chalmers, R Philip ^a   Counsell, Alyssa ^a   Flora, David B ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

differential item functioning; differential test functioning; item response theory; multiple imputation

Indexed keywords

EID: 84953426291     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164415584576     Document Type: Article

References (28)

1. Y.BenjaminiY.Hochberg (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B (Methodological), 57, 289-300.
2. A.Birnbaum (1968). Some latent trait models and their use in inferring an examinee’s ability. In (Eds.), Statistical theories of mental test scores (pp. 395-479). Reading, MA: Addison-Wesley.
3. R.D.BockM.Aitkin (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459.
4. L.Cai (2008). SEM of another flavour: Two new applications of the supplemented EM algorithm. British Journal of Mathematical and Statistical Psychology, 61, 309-329.
5. L.Cai (2010). High-dimensional exploratory item factor analysis by a Metropolis-Hastings Robbins-Monro algorithm. Psychometrika, 75, 33-57. doi:10.1007/S11336-009-9136-X
6. R.P.Chalmers (2012). mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1-29. Retrieved from http://www.jstatsoft.org/v48/i06
7. C.E.DeMars (2011). An analytic comparison of effect sizes for differential item functioning. Applied Measurement in Education, 24, 189-209. doi:10.1080/08957347.2011.580255
8. B.EfronD.V.Hinkley (1978). Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information. Biometrika, 65, 457-482.
9. D.FloraP.CurranA.HussongM.Edwards (2008). Incorporating measurement nonequivalence in a cross-study latent growth curve analysis. Structural Equation Modeling, 15, 676-704.
10. M.J.KolenR.L.Brennan (2004). Test equating, scaling, and linking (2nd ed.). New York, NY: Springer.
11. F.M.Lord (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
12. T.A.Louis (1982). Finding the observed information matrix when using the EM algorithm. Journal of the Royal Statistical Society, Series B (Methodological), 44, 226-233.
13. Z.MarjanovicE.R.GreenglassL.FiksenbaumC.M.Bell (2013). Psychometric evaluation of the financial threat scale (FTS) in the context of the great recession. Journal of Economic Psychology, 36, 1-10.
14. A.Maydeu-OlivaresH.Joe (2006). Limited information goodness-of-fit testing in multidimensional contingency tables. Psychometrika, 71,713-732. doi:10.1007/s11336-005-1295-9
15. W.Q.MeekerL.A.Escobar (1995). Teaching about approximate confidence regions based on maximum likelihood estimation. The American Statistician, 49(1), 48-53.
16. R.E.Millsap (2011). Statistical approaches to measurement invariance. New York, NY: Routledge.
17. T.C.OshimaN.S.RajuA.O.Nanda (2006). A new method for assessing the statistical significance in the differential functioning of items and tests (DFIT) framework. Journal of Educational Measurement, 43(1), 1-17.
18. I.PaekL.Cai (2014). A comparison of item parameter standard error estimation procedures for unidimensional and multidimensional IRT modeling. Educational and Psychological Measurement, 74, 58-76.
19. R Core Team. (2013). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria: Author. Retrieved from http://www.R-project.org/
20. N.S.RajuW.J.van der LindenP.F.Fleer (1995). IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19, 353-368.
21. R.SchwarzerM.Jerusalem (1995). Generalized self efficacy scale. In (Eds.), Measures in health psychology: A user’s portfolio, causal and control beliefs (pp. 35-37). Windsor, England: NFER-NELSON.
22. D.ThissenL.Steinberg (2009). Item response theory. In (Eds.), The Sage handbook of quantitative methods in psychology (pp. 148-177). Thousand Oaks, CA: Sage.
23. D.ThissenH.Wainer (1990). Confidence envelopes for item response theory. Journal of Educational Statistics, 15, 113-128.
24. H.Wainer (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum.
25. A.Wald (1943). Test of statistical hypothesis concerning several parameters when the number of observations is large. Transactions of the American Mathematical Society, 54, 426-482.
26. R.WoodD.WilsonR.GibbonsS.SchillingE.MurakiR.Bock (2003). TESTFACT 4 for Windows: Test scoring, item statistics, and full-information item factor analysis [Computer software]. Skokie, IL: Scientific Software International.
27. J.S.YangM.HansenL.Cai (2012). Characterizing sources of uncertainty in IRT scale scores. Educational and Psychological Measurement, 72, 264-290.
28. K.-H.YuanY.ChengJ.Patton (2013). Information matrices and standard errors for MLEs of item parameters in IRT. Psychometrika, 79, 232-254.