IRT model selection methods for dichotomous items

Applied Psychological Measurement

Volumn 31, Issue 4, 2007, Pages 331-358

  Kang, Taehoon ^a   Cohen, Allan S ^b  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b UNIVERSITY OF GEORGIA   (United States)

Author keywords

AIC; BIC; Cross validation log likelihood; DIC; Item response theory; Likelihood ratio test; Model selection; Pseudo Bayes factor

Indexed keywords

EID: 34250176929     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621606292213     Document Type: Article

References (39)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19 (6). 716-723.
2. Allen, N.L., Jenkins, F., Kulick, E., Zelenak, C.A. (1997). Technical report of the NAEP 1996 State Assessment Program in Mathematics Washington, DC: National Center for Education Statistics.
3. Anderson, E.B. (1973). A goodness of fit test for the Rasch model. Psychometrika, 38, 123-140.
4. Baker, F.B. (1998). An investigation of the item parameter recovery characteristics of a Gibbs sampling procedure. Applied Psychological Measurement, 22 (2). 153-169.
5. Baker, F.B., Kim, S.-H. (2004). Item response theory: Parameter estimation techniques (2 nd ed.). New York: Marcel Dekker.
6. Bock, R.D., Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443-459.
7. Bolt, D.M., Cohen, A.S., Wollack, J.A. (2001). A mixture model for multiple choice data. Journal of Educational and Behavioral Statistics, 26 (4). 381-409.
8. Bolt, D.M., Lall, V.F. (2003). Estimation of compensatory and noncompensatory multidimensional item response models using Markov chain Monte Carlo. Applied Psychological Measurement, 27, 395-414.
9. Forster, M.R. (2004). Simplicity and unification in model selection. Manuscript, University of WisconsinMadison. Available at http://philosophy.wisc. edu/forster/520/Chapter%203.pdf
10. Geisser, S., Eddy, W.F. (1979). A predictive approach to model selection. Journal of the American Statistical Association, 74, 153-160.
11. Gelfand, A.E., Dey, D.K. (1994). Bayesian model choice: Asymptotics and exact calculations. Journal of the Royal Statistical Society B, 56, 501-514.
12. Ghosh, J.K., Samanta, T. (2001). Model selection: An overview. Current Science, 80, 1135-1144.
13. Janssen, R., De Boeck, P. (1999). Confirmatory analyses of componential test structure using multidimensional item response theory. Multivariate Behavioral Research, 34, 245-268.
14. Jreskog, K.G., Srbom, D. (1999). PRELIS 2: User's reference guide [Computer program] Lincolnwood, IL: Scientific Software International.
15. Kim, S.-H. (2001). An evaluation of a Markov chain Monte Carlo method for the Rasch model. Applied Psychological Measurement, 25, 163-176.
16. Lin, T.H., Dayton, C.M. (1997). Model selection information criteria for non-nested latent class models. Journal of Educational and Behavioral Statistics, 22 (3). 249-264.
17. Lord, F.M. (1975). Relative efficiency of number-right and formula scores. British Journal of Mathematical and Statistical Psychology, 28, 46-50.
18. Loyd, B.H., Hoover, H.D. (1980). Vertical equating using the Rasch model. Journal of Educational Measurement, 17, 179-193.
19. MATLAB 6.1 [Computer software]. (2001). Natick, MA: The MathWorks.
20. Mislevy, D.J., Bock, R.D. (1990). BILOG: Item analysis and test scoring with binary logistic models [Computer program]. Chicago: Scientific Software.
21. Orlando, M., Thissen, D. (2000). New item fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24, 50-64.
22. Orlando, M., Thissen, D. (2003). Further investigation of the performance of S X2: An item fit index for use with dichotomous item response theory models. Applied Psychological Measurement, 27, 289-298.
23. Ostini, R., Nering, M.L. (2005). Polytomous item response theory models. Thousand Oaks, CA: Sage.
24. Patz, R.J., Junker, B.W. (1999 a). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342-366.
25. Patz, R.J., Junker, B.W. (1999 b). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178.
26. Sahu, S.K. (2002). Bayesian estimation and model choice in item response models. Journal of Statistical Computation and Simulation, 72, 217-232.
27. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
28. Sclove, S.L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333-343.
29. Sinharay, S. (2005, April). Bayesian item fit analysis for unidimensional item response models. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
30. Smith, A.F.M. (1991). Discussion of 'posterior Bayes factors' by M. Aitken. Journal of the Royal Statistical Society B, 53, 132-133.
31. Spiegelhalter, D.J., Best, N.G., Carlin, B.P. (1998). Bayesian deviance, the effective number of parameters, and the comparison of arbitrarily complex models. Technical report, MRC Biostatistics Unit, Cambridge, UK.
32. Spiegelhalter, D.J., Best, N.G., Carlin, B.P., van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society Series BStatistical Methodology, 64, 583-616.
33. Spiegelhalter, D.J., Thomas, A., Best, N.G., Gilks, W. (1996). BUGS 0.5* Bayesian inference using Gibbs sampling manual (version ii) [Computer program]. Cambridge, UK: MRC Biostatistics Unit.
34. Spiegelhalter, D.J., Thomas, A., Best, N.G., Lunn, D. (2003). WinBUGS 1.4* user manual [Computer program]. Cambridge, UK: MRC Biostatistics Unit.
35. Suarez-Falcon, J.C., Glas, C.A.W. (2003). Evaluation of global testing procedures for item fit to the Rasch model. British Journal of Mathematical and Statistical Psychology, 56, 127-143.
36. Thissen, D. (1991). MULTILOG: Multiple, categorical item analysis and test scoring using item response theory [Computer program] Chicago: Scientific Software.
37. Western, B. (1999). Bayesian analysis for sociologists. Sociological Methods Research, 28 (1). 7-34.
38. Wollack, J.A., Bolt, D.M., Cohen, A.S., Lee, Y.-S. (2002). Recovery of item parameters in the nominal response model: A comparison of marginal maximum likelihood estimation and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 26, 339-352.
39. Zimowski, M.F., Muraki, E., Mislevy, R.J., Bock, R.D. (1996). BILOG-MG: Multiple-group IRT analysis and test maintenance for binary items. Chicago: Scientific Software International.