Estimating item response theory models using markov chain Monte Carlo methods: An NCME instructional module on

Educational Measurement: Issues and Practice

Volumn 26, Issue 4, 2007, Pages 38-51

  Kim, Jee Seon ^a   Bolt, Daniel M ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

Bayesian estimation; Goodness of fit; Item response theory models; Markov chain Monte Carlo; Model comparison

Indexed keywords

EID: 36148959043     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2007.00107.x     Document Type: Article

References (41)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B.N. Petrov & F. Csáki (Eds. Proceedings, 2nd International Symposium on Information Theory (pp. 267 281). Budapest : Akadémiai Kiadó.
2. Albert, J.H. (1992). Bayesian estimation of normal ogive item response curves using Gibbs sampling. Journal of Educational Statistics, 17, 251 269.
3. Baker, F.B. (1998). An investigation of the item parameter recovery characteristics of a Gibbs sampling approach. Applied Psychological Measurement, 22, 153 169.
4. Baker, F.B., & Kim, S-H. (2004). Item response theory: Parameter estimation techniques (2nd ed New York : Marcel Dekker.
5. Beguin, A.A., & Glas, C.A.W. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541 562.
6. Best, N., Cowles, M.K., & Vines, K. (1996). CODA*: Convergence diagnosis and output analysis software for gibbs sampling output, version 0.30. Cambridge, UK : MRC Biostatistics Unit.
7. Bolt, D.M., & Lall, V.F. (2003). Estimation of compensatory and noncompensatory multidimensional item response models using Markov chain Monte Carlo. Applied Psychological Measurement, 29, 395 414.
8. Bradlow, E.T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153 168.
9. Clayton, D.G. (1997). Generalized linear mixed models. In W.R. Gilks, S. Richardson, & D.J. Spiegelhalter (Eds. Markov chain Monte Carlo in practice (pp. 275 302). London : Chapman & Hall.
10. Congdon, P. (2001). Bayesian statistical modeling. Chichester, England : John Wiley & Sons.
11. De la Torre, J., Stark, S., & Chernyshenko, O. (2006). Markov Chain Monte Carlo estimation of item parameters for the generalized graded unfolding model. Applied Psychological Measurement, 30, 216 232.
12. Fox, J.-P., & Glas, C.A.W. (2001). Bayesian estimation of multilevel IRT models using Gibbs sampling. Psychometrika, 66, 271 288.
13. Geisser, S., & Eddy, W. (1979). A predictive approach to model selection. Journal of the American Statistical Association, 74, 153 160.
14. Gelfand, A.E., Dey, D.K., & Chang, H. (1992). Model determination using predictive distributions with implementation via sampling methods. In J.M. Bernardo, J.O. Berger, A.P. Dawid, & A.F.M. Smith (Eds. Bayesian statistics (Vol. 4, pp. 147 167). Oxford, UK : Oxford University Press.
15. Gelman, A., & Rubin, D.B. (1992). Inference from iterative simulation using multiple sequences (with discussion). Statistical Science, 7, 457 511.
16. Geweke, J. (1992) Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In J.M. Bernardo, J.O. Berger, A.P. Dawid, & A.F.M. Smith (Eds. Bayesian statistics (Vol. 4, pp. 169 193). Oxford, UK : Oxford University Press.
17. Gilks, W.R., & Wild, P. (1992). Adaptive rejection sampling for Gibbs sampling. Applied Statistics, 41, 337 348.
18. Gilks, W.R., Richardson, S., & Spiegelhalter, D.J. (1996). Markov chain Monte Carlo in practice. Boca Raton, FL : Chapman & Hall.
19. Glas, C. A. W., & Meijer, R. R. (2003). A Bayesian approach to person fit analysis in item response theory models. Applied Psychological Measurement, 27, 217 233.
20. Jeffreys, H. (1961). Theory of probability. London : Oxford University Press.
21. Johnson, M.S., & Sinharay, S. (2005). Calibration of polytomous item families using Bayesian hierarchical modeling. Applied Psychological Measurement, 29, 369 400.
22. McLeod, L., Lewis, C, & Thissen, D. (2003). A Bayesian method for the detection of item preknowledge in computerized adaptive testing. Applied Psychological Measurement, 27, 121 137.
23. Mislevy, R.J., & Bock, R.D. (1989). BILOG 3: Item analysis and test scoring with binary logistic models. Mooresville, IN : Scientific Software.
24. Neal, R.M. (2003). Slice sampling. Annals of Statistics, 31, 705 767.
25. Patz, R., & Junker, B. (1999a). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342 366.
26. Patz, R., & Junker, B. (1999b). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146 178.
27. Raftery, A.E. (1996). Hypothesis testing and model selection. In W.R. Gilks, S. Richardson, & D.J. Spiegelhalter (Eds. Markov chain Monte Carlo in practice (pp. 115 130). London : Chapman & Hall.
28. Raftery, A.E., & Lewis, S.M. (1992a). How many iterations in the Gibbs sampler? In J.M. Bernardo, J.O. Berger, A.P. Dawid, & A.F.M. Smith (Eds. Bayesian statistics (Vol. 4, pp. 765 776). Oxford, UK : Oxford University Press.
29. Raftery, A.E., & Lewis, S.M. (1992b). One long run with diagnostics: implementation strategies for Markov chain Monte Carlo. Statistical Science, 7, 493 497.
30. Robert, C.P. (1997). Mixtures of distributions: Inference and estimation. In W.R. Gilks, S. Richardson, & D.J. Spiegelhalter (Eds. Markov chain Monte Carlo in practice (pp. 441 464). London : Chapman & Hall.
31. Rupp, A.A., Dey, D.K., & Zumbo, B.D. (2004). To Bayes or not to Bayes, from whether to when: Applications of Bayesian methodology to modeling. Structural Equation Modeling, 11, 424 451.
32. Sahu, S.K. (2002). Bayesian estimation and model choice in item response models. Journal of Statistical Computation and Simulation, 72, 217 232.
33. Schwartz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461 464.
34. Sinharay, S. (2004). Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics, 29, 461 488.
35. Sinharay, S. (2005). Assessing fit of unidimensional item response theory models using a Bayesian approach. Journal of Educational Measurement, 42, 375 395.
36. Sinharay, S., Johnson, M.S., & Stern, H.S. (2006). Posterior predictive assessment of item response theory models. Applied Psychological Measurement, 30, 298 321.
37. Spiegelhalter, D.J., Best, N.G., Carlin, B.P., & van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, Series B, 64, 583 604.
38. Spiegelhalter, D.J., Thomas, A., Best, N., & Gilks, W. (1995). BUGS 0.5*: Bayesian inference using Gibbs sampling manual (version ii). Cambridge, UK : MRC Biostatistics Unit.
39. Spiegelhalter, D.J., Thomas, A., Best, N., & Lunn, D. (2003). WINBUGS Version 1.4 User's manual [Computer software manual]. Cambridge, UK : MRC Biostatistics Unit.
40. Thissen, D. (1991). MULTILOG 6.0. Chicago : Scientific Software.
41. Zwick, R., Thayer, D.T., & Lewis, C. (2000). Using loss functions for DIF detection: An empirical Bayes approach. Journal of Educational and Behavioral Statistics, 25, 225 247.