Modeling Differential Item Functioning Using a Generalization of the Multiple-Group Bifactor Model

Journal of Educational and Behavioral Statistics

Volumn 38, Issue 1, 2013, Pages 32-60

  Jeon, Minjeong ^a   Rijmen, Frank ^b   Rabe Hesketh, Sophia ^a,c  

^a University of California Berkeley   (United States)

^b EDUCATIONAL TESTING SERVICE   (United States)

^c UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

bifactor model; conditional independence; differential item functioning; EM algorithm; graphical model; multiple group bifactor model; testlets

Indexed keywords

EID: 84871665202     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998611432173     Document Type: Article

References (61)

1. Ainsworth A.Dimensionality and invariance: Assessing differential item functioning using bifactor multiple indicator multiple cause models. 2007:.
2. Bolt D.,Stout W.Differential item functioning: Its multidimensional model and resulting SIBTEST detection procedure.Behaviormetrika. 1996;23:67-95.
3. Bradlow E. T.,Wainer H.,Wang X.A Bayesian random effects model for testlets.Psychometrika. 1999;64:153-168.
4. Braeken J.,Tuerlinckx F.,De Boeck P.Copula functions for residual dependency.Psychometrika. 2007;72:393-411.
5. Browne W.,Draper D.A comparison of Bayesian and likelihood methods for fitting multilevel models.Bayesian Analysis. 2006;1:473-514.
6. Cai L.,Yang J. S.,Hansen M. P.Generalized full-information item bifactor analysis.Psychological Methods. 2011;16:221-248.
7. Clauser B. E.,Nungester R.,Mazor K.,Ripkey D.A comparison of alternative matching strategies for DIF detection in tests that are multidimensional.Journal of Educational Measurement. 1996;33:202-214.
8. De la Torre J.,Song H.Simultaneous estimation of overall and domain abilities: A higher-order IRT model approach.Applied Psychological Measurement. 2009;33:620-639.
9. DeMars C. E.Application of the bi-factor multidimensional item response theory model to testlet-based tests.Journal of Educational Measurement. 2006;43:145-168.
10. DeMars C. E.Modification of the Mantel-Haenszel and logistic regression DIF procedures to incorporate the SIBTEST regression correlation.Journal of Educational and Behavioral Statistics. 2009;34:149-170.
11. Dorans N. J.,Holland P. H.Differential item functioning. Holland P. W.Wainer H., ed. Hillsdale, NJ: Lawrence Erlbaum; 1993:67-113.
12. Fahrmeir L.,Tutz G.Multivariate statistical modelling based on generalized linear models. New York, NY: Springer; 2001:.
13. Fukuhara H.,Kamata A.A bifactor multidimensional item response theory model for differential item functioning analysis on testlet-based items.Applied Psychological Measurement. 2011;35:604-622.
14. Gibbons R. D.,Bock D.,Hedeker D.,Weiss D. J.,Segawa E.,Bhaumik D. K.,Kupfer D. J,Frank E.,Grochocinski V. J,Stover A.Full-information item bifactor analysis of graded response data.Applied Psychological Measurement. 2007;31:4-19.
15. Gibbons R. D.,Grochocinski V. J.,Weiss D. J.,Bhaumik D. K.,Kupfer D. J.,Stover A.Using computerized adaptive testing to reduce the burden of mental health assessment.Psychiatric Services. 2008;59:361-368.
16. Gibbons R. D.,Hedeker D.Full-information item bi-factor analysis.Psychometrika. 1992;57:423-436.
17. Gierl M. J.,Bisanz J.,Bisanz G.,Boughton K.,Khaliq S.Illustrating the utility of differential bundle functioning analyses to identify and interpret group differences on achievement tests.Educational Measurement: Issues and Practice. 2001;20:26-36.
18. Glas C. A. W.,Wainer H.,Bradlow E. TComputerized adaptive testing: Theory and practice. van der Linden W. J.Glas C. A. W., ed. Boston, MA: Kluwer-Nijhoff; 2000:271-287.
19. Holland P. W.,Thayer D. T.Test validity. Wainer H.Braun H., ed. Hillsdale, NJ: Lawrence Erlbaum; 1988:129-146.
20. Holzinger K. J.,Swineford F.The bi-factor method.Psychometrika. 1937;2:41-54.
21. Hunter M.,Battersby R.,Whitehead M.Relationships between psychological symptoms, somatic complaints and menopausal status.Maturitas. 1986;8:217-228.
22. Ip E. H.Locally dependent latent trait model and the Dutch identity revisited.Psychometrika. 2002;67:367-386.
23. Ip E. H.Empirically indistinguishable multidimensional IRT and locally dependent unidi-mensional item response models.British Journal of Mathematical and Statistical Psychology. 2010;63:395-416.
24. Lauritzen S. L.The EM algorithm for graphical association models with missing data.Computational Statistics and Data Analysis. 1995;19:191-201.
25. Lee Y.-S.,Cohen A.,Toro M.Examining Type I error and power for detection of differential item and testlet functioning.Asia Pacific Education Review. 2009;10:365-375.
26. Li Y.,Bolt D. M.,Fu J.A comparison of alternative models for testlets.Applied Psychological Measurement. 2006a;30:3-21.
27. Li Y.,Bolt D. M.,Fu J.A multiple-group testlet model and its application to DIF assessment. 2006b:.
28. Masters G. N.A Rasch model for partial credit scoring.Psychometrika. 1982;47:149-174.
29. Mazor K. M.,Kanjee A.,Clauser B. E.Using logistic regression and the Mantel-Haenszel with multiple ability estimates to detect differential item functioning.Journal of Educational Measurement. 1995;32:131-144.
30. McLachlan G.,Krishnan T.The EM algorithm and extensions. New York, NY: Wiley; 1997:.
31. Meilijson I.A fast improvement to the EM algorithm on its own terms.Journal of the Royal Statistical Society, Series B. 1989;51:127-138.
32. Meredith W.Measurement invariance, factor analysis and factorial invariance.Psychometrika. 1993;58:525-543.
33. Millsap R. E.,Everson H. T.Methodology review: Statistical approaches for assessing measurement bias.Applied Psychological Measurement. 1993;17:297-334.
34. Natarajan R.,Kass R. E.Reference Bayesian methods for generalized linear mixed models.Journal of the American Statistical Association. 2000;95:227-237.
35. Oshima T. C,Raju N. S.,Flowers C. P.Development and demonstration of multidimensional IRT-based internal measures of differential functioning of items and tests.Journal of Educational Measurement. 1997;34:253-272.
36. Penfield R. D.An approach for categorizing DIF in polytomous items.Applied Measurement In Education. 2007;20:335-355.
37. Rabe-Hesketh S.,Skrondal A.,Pickles A.Maximum likelihood estimation of limited and discrete dependent variable models with nested random effects.Journal of Econometrics. 2005;128:301-323.
38. Raju N. S.The area between two item characteristic curves.Psychometrika. 1988;53:495-502.
39. Reise S. P.,Morizot J.,Hays R. D.The role of the bifactor model in resolving dimensionality issues in health outcomes measures.Quality of Life Research. 2007;16:19-31.
40. Rijmen F.BNL: A Matlab toolbox for Bayesian networks with logistic regression. 2006:.
41. Rijmen FAn efficient EM algorithm for multidimensional IRT models: Full information maximum likelihood estimation in limited time. 2009:.
42. Rijmen F.Formal relations and an empirical comparison between the bi-factor, the testlet, and a second-order multidimensional IRT model.Journal of Educational Measurement. 2010;47:361-372.
43. Rijmen F.,Vansteelandt K.,De Boeck P.Latent class models for diary method data: Parameter estimation by local computations.Psychometrika. 2008;73:167-182.
44. Rogers H. J.,Swaminathan H.A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning.Applied Psychological Measurement. 1993;17:105-116.
45. Roussos L. A.,Stout W. F.Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance.Journal of Educational Measurement. 1996;33:215-230.
46. Shealy R. TAn item response theory-based statistical procedure for detecting concurrent internal bias in ability tests. 1989:.
47. Shealy R. T.,Stout W. F.An item response theory model for test bias. Washington, DC: Office of Naval Research; 1991:.
48. Shealy R. T.,Stout W. F.A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF.Psychometrika. 1993;58:159-194.
49. Sinharay S.,Dorans N. J.Two simple approaches to overcome a problem with the Mantel-Haenszel statistic: Comments on Wang, Bradlow, Wainer, and Muller.Journal of Educational and Behavioral Statistics. 2010;35:474-488.
50. Skrondal A.Design and analysis of Monte Carlo experiments: Attacking the conventional wisdom.Multivariate Behavioral Research. 2000;35:137-167.
51. Spiegelhalter D. J.,Thomas A.,Best N. G.,Gilks W. RBUGS 0.5 Bayesian Analysis using Gibbs Sampling. Manual (version II). Cambridge, England: MRC-Biostatistics Unit; 1996:.
52. Sun X.,Sun D.Estimation of the Cholesky decomposition of the covariance matrix for a conditional independent normal model.Statistics and Probability Letters. 2005;73:1-12.
53. Swaminathan H.,Rogers H. J.Detecting differential item functioning using logistic regression procedures.Journal of Educational Measurement. 1990;27:361-370.
54. Swanson D. B.,Clauser B. E.,Case S. M.,Nungester R. J.,Featherman C.Analysis of differential item functioning (DIF) using hierarchical logistic regression models.Journal of Educational and Behavioral Statistics. 2002;27:53-75.
55. Thissen D.,Steinberg L.,Wainer H.Test validity. Wainer H.Braun H. I., ed. Hillsdale, NJ: Lawrence Erlbaum; 1988:147-169.
56. Van den Noortgate W.,De Boeck P.Assessing and explaining differential item functioning using logistic mixed models.Journal of Educational and Behavioral Statistics. 2005;30:443-464.
57. Wainer H.,Bradlow E.,Wang X.Testlet response theory and its applications. New York, NY: Cambridge University Press; 2007:.
58. Wang W.,Wilson M.The Rasch testlet model.Applied Psychological Measurement. 2005;29:126-149.
59. Wang X.,Bradlow E.,Wainer H.,Muller E.A Bayesian method for studying DIF: A cautionary tale filled with surprises and delights.Journal of Educational and Behavioral Statistics. 2008;33:363-384.
60. Wolfinger R. D.1999:.
61. Zumbo B. D.A handbook on the theory and methods for differential item functioning: Logistic regression modeling as a unitary framework for binary and likert-type (ordinal) item scores. Ottawa, Canada: Directorate of Human Resources Research and Evaluation, Department of National Defense; 1999:.