The rise of Markov chain Monte Carlo estimation for psychometric modeling

Journal of Probability and Statistics

Volumn , Issue , 2009, Pages

  Levy, Roy ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79961194222     PISSN: 1687952X     EISSN: 16879538     Source Type: Journal    
DOI: 10.1155/2009/537139     Document Type: Review

References (123)

1. Bollen K. A., Structural Equations with Latent Variables 1989 New York, NY, USA John Wiley Sons xiv+514 Wiley Series in Probability and Mathematical Statistics
2. Gorsuch R. L., Factor Analysis 1983 2nd Hillsdale, NJ, USA Lawrence Earlbaum Associates
3. Lord F. M., Applications of Item Response Theory to Practical Testing Problems 1980 Hillsdale, NJ, USA Lawrence Earlbaum Associates
4. Lazarsfeld P. F., Henry N. W., Latent Structure Analysis 1968 Boston, Mass, USA Houghton Mifflin
5. Gelman A., Carlin J. B., Stern H. S., Rubin D. B., Bayesian Data Analysis 1995 London, UK Chapman Hall xx+526 Texts in Statistical Science Series
6. Song X.-Y., Lee S.-Y., Full maximum likelihood estimation of polychoric and polyserial correlations with missing data Multivariate Behavioral Research 2003 38 1 57 79 (Pubitemid 36630351)
7. Lindley D. V., Smith A. F. M., Bayes estimates for the linear model Journal of the Royal Statistical Society. Series B 1972 34 1 41
8. Mislevy R. J., Bayes modal estimation in item response models Psychometrika 1986 51 2 177 195
9. Lindley D. V., Novick M. R., The role of exchangeability in inference The Annals of Statistics 1981 9 1 45 58
10. De Boeck P., Wilson M., Explanatory Item Response Models: A Generalized Linear and Nonlinear Approach 2004 New York, NY, USA Springer xxii+382 Statistics for Social Science and Public Policy
11. Lee S.-Y., Structural Equation Modeling: A Bayesian Approach 2007 Chichester, UK John Wiley Sons xvi+432 Wiley Series in Probability and Statistics
12. Brooks S. P., Markov chain Monte Carlo method and its application The Statistician 1998 47 1 69 100 (Pubitemid 128469062)
13. Gelfand A. E., Smith A. F. M., Sampling-based approaches to calculating marginal densities Journal of the American Statistical Association 1990 85 410 398 409
14. Gilks W. R., Richardson S., Spiegelhalter D. J., Markov Chain Monte Carlo in Practice 1996 London, UK Chapman Hall xviii+486 Interdisciplinary Statistics
15. Smith A. F. M., Roberts G. O., Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods Journal of the Royal Statistical Society. Series B 1993 55 1 3 23
16. Spiegelhalter D. J., Thomas A., Best N. G., Lunn D., WinBUGS User Manual: Version 1.4.3 2007 Cambridge, UK MRC Biostatistics Unit
17. Tierney L., Markov chains for exploring posterior distributions The Annals of Statistics 1994 22 4 1701 1762
18. Roberts G. O., Gilks W. R., Richardson S., Spiegelhalter D. J., Markov chain concepts related to sampling algorithms Markov Chain Monte Carlo in Practice 1996 London, UK Chapman Hall 45 57 Interdiscip. Statist.
19. Besag J., Spatial interaction and the statistical analysis of lattice systems Journal of the Royal Statistical Society. Series B 1974 36 192 236
20. Geman S., Geman D., Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images IEEE Transactions on Pattern Analysis and Machine Intelligence 1984 6 6 721 741 (Pubitemid 15453722)
21. Casella G., George E. I., Explaining the Gibbs sampler The American Statistician 1992 46 3 167 174
22. Hastings W. K., Monte Carlo sampling methods using Markov chains and their applications Biometrika 1970 57 1 97 109
23. Chib S., Greenberg E., Understanding the Metropolis-Hastings algorithm The American Statistician 1995 49 4 327 335 (Pubitemid 126008969)
24. Metropolis N., Rosenbluth A. W., Rosenbluth M. N., Teller A. H., Teller E., Equation of state calculations by fast computing machines The Journal of Chemical Physics 1953 21 6 1087 1092
25. Scheines R., Hoijtink H., Boomsma A., Bayesian estimation and testing of structural equation models Psychometrika 1999 64 1 37 52
26. Ansari A., Jedidi K., Bayesian factor analysis for multilevel binary observations Psychometrika 2000 65 4 475 496 (Pubitemid 33222961)
27. Lee S.-Y., Song X.-Y., Evaluation of the Bayesian and maximum likelihood approaches in analyzing structural equation models with small sample sizes Multivariate Behavioral Research 2004 39 4 653 686 (Pubitemid 40763799)
28. Ansari A., Jedidi K., Dube L., Heterogeneous factor analysis models: a Bayesian approach Psychometrika 2002 67 1 49 78
29. Zhang Z., Hamagami F., Wang L., Nesselroade J. R., Grimm K. J., Bayesian analysis of longitudinal data using growth curve models International Journal of Behavioral Development 2007 31 4 374 383 (Pubitemid 47009418)
30. Lee S.-Y., Song X.-Y., Bayesian model selection for mixtures of structural equation models with an unknown number of components The British Journal of Mathematical and Statistical Psychology 2003 56 1 145 165 (Pubitemid 37189151)
31. Zhu H.-T., Lee S.-Y., A Bayesian analysis of finite mixtures in the LISREL model Psychometrika 2001 66 1 133 152
32. Lee S.-Y., Song X.-Y., Tang N.-S., Bayesian methods for analyzing structural equation models with covariates, interaction, and quadratic latent variables Structural Equation Modeling 2007 14 3 404 434
33. Lee S.-Y., Tang N.-S., Bayesian analysis of nonlinear structural equation models with nonignorable missing data Psychometrika 2006 71 3 541 564 (Pubitemid 44788548)
34. Arminger G., Muthén B. O., A Bayesian approach to nonlinear latent variable models using the Gibbs sampler and the Metropolis-Hastings algorithm Psychometrika 1998 63 3 271 300
35. Song X.-Y., Lee S.-Y., Hser Y.-I., Bayesian analysis of multivariate latent curve models with nonlinear longitudinal latent effects Structural Equation Modeling 2009 16 2 245 266
36. Wirth R. J., Edwards M. C., Item factor analysis: current approaches and future directions Psychological Methods 2007 12 1 58 79
37. Bock R. D., Aitkin M., Marginal maximum likelihood estimation of item parameters: application of an EM algorithm Psychometrika 1981 46 4 443 459
38. Baker F. B., Kim S.-H., Item Response Theory: Parameter Estimation Techniques 2004 176 2nd New York, NY, USA Marcel Dekker xx+495 Statistics: Textbooks and Monographs
39. Bock R. D., Mislevy R. J., Adaptive EAP estimation of ability in a microcomputer environment Applied Psychological Measurement 1982 6 431 444
40. Albert J. H., Bayesian estimation of normal ogive item response curves using Gibbs sampling Journal of Educational Statistics 1992 17 251 269
41. Tanner M. A., Wong W. H., The calculation of posterior distributions by data augmentation Journal of the American Statistical Association 1987 82 398 528 550
42. Albert J. H., Chib S., Bayesian analysis of binary and polychotomous response data Journal of the American Statistical Association 1993 88 422 669 679
43. Sahu S. K., Bayesian estimation and model choice in item response models Journal of Statistical Computation and Simulation 2002 72 3 217 232 (Pubitemid 36844172)
44. Patz R. J., Junker B. W., A straightforward approach to Markov chain Monte Carlo methods for item response models Journal of Educational and Behavioral Statistics 1999 24 2 146 178
45. Patz R. J., Junker B. W., Applications and extensions of MCMC in IRT: multiple item types, missing data, and rated responses Journal of Educational and Behavioral Statistics 1999 24 4 342 366
46. Wollack J. A., Bolt D. M., Cohen A. S., Lee Y.-S., Recovery of item parameters in the nominal response model: a comparison of marginal maximum likelihood estimation and Markov chain Monte Carlo estimation Applied Psychological Measurement 2002 26 3 339 352 (Pubitemid 36703727)
47. Bradlow E. T., Wainer H., Wang X., A Bayesian random effects model for testlets Psychometrika 1999 64 2 153 168
48. Fox J.-P., Glas C. A. W., Bayesian estimation of a multilevel IRT model using Gibbs sampling Psychometrika 2001 66 2 271 288
49. Janssen R., Tuerlinckx F., Meulders M., De Boeck P., A hierarchical IRT model for criterion-referenced measurement Journal of Educational and Behavioral Statistics 2000 25 3 285 306
50. Takane Y., de Leeuw J., On the relationship between item response theory and factor analysis of discretized variables Psychometrika 1987 52 3 393 408
51. Béguin A. A., Glas C. A. W., MCMC estimation and some model-fit analysis of multidimensional IRT models Psychometrika 2001 66 4 541 561
52. Bolt D. M., Lall V. F., Estimation of compensatory and noncompensatory multidimensional item response models using Markov chain Monte Carlo Applied Psychological Measurement 2003 27 6 395 414 (Pubitemid 37514201)
53. Jackman S., Multidimensional analysis of roll call data via Bayesian simulation: identification, estimation, inference, and model checking Political Analysis 2001 9 3 227 241
54. Yao L., Boughton K. A., A multidimensional item response modeling approach for improving subscale proficiency estimation and classification Applied Psychological Measurement 2007 31 2 83 105
55. Lee S.-Y., Zhu H.-T., Statistical analysis of nonlinear structural equation models with continuous and polytomous data British Journal of Mathematical and Statistical Psychology 2000 53 2 209 232
56. Shi J.-Q., Lee S.-Y., Bayesian sampling-based approach for factor analysis models with continuous and polytomous data British Journal of Mathematical and Statistical Psychology 1998 51 2 233 252 (Pubitemid 128445045)
57. Song X.-Y., Lee S.-Y., Bayesian estimation and test for factor analysis model with continuous and polytomous data in several populations British Journal of Mathematical and Statistical Psychology 2001 54 2 237 259 (Pubitemid 33597341)
58. Song X.-Y., Lee S.-Y., Analysis of structural equation model with ignorable missing continuous and polytomous data Psychometrika 2002 67 2 261 288
59. Hoijtink H., Constrained latent class analysis using the Gibbs sampler and posterior predictive p -values: applications to educational testing Statistica Sinica 1998 8 3 691 711 (Pubitemid 128480615)
60. Hoijtink H., Notenboom A., Model based clustering of large data sets: tracing the development of spelling ability Psychometrika 2004 69 3 481 498 (Pubitemid 40131590)
61. Chung H., Flaherty B. P., Schafer J. L., Latent class logistic regression: application to marijuana use and attitudes among high school seniors Journal of the Royal Statistical Society. Series A 2006 169 4 723 743 (Pubitemid 44410935)
62. van Onna M. J. H., Bayesian estimation and model selection in ordered latent class models for polytomous items Psychometrika 2002 67 4 519 538 (Pubitemid 36256523)
63. Rupp A. A., Templin J. L., Unique characteristics of diagnostic classification models: a comprehensive review of the current state-of-the-art Measurement: Interdisciplinary Research and Perspectives 2008 6 4 219 262
64. de la Torre J., Douglas J. A., Higher-order latent trait models for cognitive diagnosis Psychometrika 2004 69 3 333 353 (Pubitemid 40131582)
65. Hartz S. M., A Bayesian framework for the unified model for assessing cognitive abilities: blending theory with practicality, Doctoral dissertation 2002 Urbana, Ill, USA Department of Statistics, University of Illinois at Urbana-Champaign
66. Henson R. A., Templin J. L., Porch F., Description of the underlying algorithm of the improved Arpeggio. Unpublished ETS Project Report, Princeton, NJ, USA, 2004
67. Templin J. L., Henson R. A., Measurement of psychological disorders using cognitive diagnosis models Psychological Methods 2006 11 3 287 305 (Pubitemid 44414072)
68. Almond R. G., DiBello L. V., Moulder B., Zapata-Rivera J.-D., Modeling diagnostic assessments with Bayesian networks Journal of Educational Measurement 2007 44 4 341 359
69. Levy R., Mislevy R. J., Specifying and refining a measurement model for a simulation-based assessment International Journal of Measurement 2004 4 333 369
70. Rupp A. A., Feature selection for choosing and assembling measurement models: a building-block-based organization International Journal of Testing 2002 2 3-4 311 360
71. Bolt D. M., Cohen A. S., Wollack J. A., A mixture item response model for multiple-choice data Journal of Educational and Behavioral Statistics 2001 26 4 381 409 (Pubitemid 33610883)
72. Cohen A. S., Bolt D. M., A mixture model analysis of differential item functioning Journal of Educational Measurement 2005 42 2 133 148 (Pubitemid 40937934)
73. Bollen K. A., Latent variables in psychology and the social sciences Annual Review of Psychology 2002 53 605 634
74. Jackman S., Estimation and inference are missing data problems: unifying social science statistics via Bayesian simulation Political Analysis 2000 8 307 332
75. Mariano L. T., Junker B. W., Covariates of the rating process in hierarchical models for multiple ratings of test items Journal of Educational and Behavioral Statistics 2007 32 3 287 314
76. Beaton A. E., The NAEP 1983-1984 technical report 1987 Princeton, NJ, USA ETS
77. Scott S. L., Ip E. H., Empirical Bayes and item-clustering effects in a latent variable hierarchical model: a case study from the National Assessment of Educational Progress Journal of the American Statistical Association 2002 97 458 409 419
78. Longford N. T., Model-based methods for analysis of data from the 1990 NAEP trial state assessment Research and Development Report 1995 95-696 Washington, DC, USA National Center for Education Statistics
79. Raudenbush S. W., Fotiu R. P., Cheong Y. F., Synthesizing results from the trial state assessment Journal of Educational and Behavioral Statistics 1999 24 4 413 438
80. Johnson M. S., Jenkins F., A Bayesian hierarchical model for large-scale educational surveys: an application to the National Assessment of Educational Progress Research Report 2005 RR-04-38 Princeton, NJ, USA ETS
81. Johnson M. S., A Bayesian hierarchical model for multidimensional performance assessments Proceedings of the Annual Meeting of the National Council on Measurement in Education June 2002 New Orleans, La, USA
82. Mislevy R. J., Bock R. D., BILOG 3 1990 2nd Mooresville, Ind, USA Scientific Software
83. Muthén L. K., Muthén B. O., Mplus Users Guide 19982006 4th Los Angeles, Calif, USA Muthén Muthén
84. Baker F. B., An investigation of the item parameter recovery characteristics of a Gibbs sampling procedure Applied Psychological Measurement 1998 22 2 153 169
85. Schilling S., Bock R. D., High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature Psychometrika 2005 70 3 533 555 (Pubitemid 41771193)
86. Muthén B. O., Beyond SEM: general latent variable modeling Behaviormetrika 2002 29 1 81 117
87. Rabe-Hesketh S., Skrondal A., Pickles A., Generalized multilevel structural equation modeling Psychometrika 2004 69 2 167 190 (Pubitemid 39603753)
88. Rabe-Hesketh S., Skrondal A., Pickles A., GLLAMM Manual 2004 2nd Berkeley, Calif, USA U.C. Berkeley Division of Biostatistics U.C. Berkeley Division of Biostatistics Working Paper Series, 160
89. Segawa E., Emery S., Curry S. J., Extended generalized linear latent and mixed model Journal of Educational and Behavioral Statistics 2008 33 4 464 484
90. Arbuckle J. L., Amos 7.0 Users Guide 2006 Chicago, Ill, USA SPSS
91. Jackman S., pscl: classes and methods for R developed in the political science computational laboratory. Department of Political Science, Stanford University. Stanford, Calif, USA. R package version 1.03, 2008, http://pscl.stanford.edu/
92. Martin A. D., Quinn K. M., Park J. H., pscl: MCMCpack. R package version 0.0-6. 2009, http://cran.r-project.org/web/packages/MCMCpack/index.html
93. Sheng Y., A MATLAB package for Markov chain Monte Carlo with a multi-unidimensional IRT model Journal of Statistical Software 2008 28 10 1 20
94. Sheng Y., Markov Chain Monte Carlo estimation of normal ogive IRT models in MATLAB Journal of Statistical Software 2008 25 8 1 15
95. Yao L., BMIRT: Bayesian Multivariate Item Response Theory 2003 Monterey, Calif, USA CTB/McGraw-Hill
96. Congdon P., Bayesian Statistical Modelling 2006 2nd Chichester, UK John Wiley Sons xiv+573 Wiley Series in Probability and Statistics
97. Gill J., Bayesian Methods: A Social and Behavioral Sciences Approach 2007 2nd New York, NY, USA Chapman Hall/CRC
98. Sturtz S., Ligges U., Gelman A., R2WinBUGS: a package for running WinBUGS from R Journal of Statistical Software 2005 12 1 16 (Pubitemid 40218003)
99. Plummer M., Best N., Cowles K., Vines K., coda: output analysis and diagnostics for MCMC. R package version 0.13-4, 2009, http://cran.r-project.org/ web/packages/coda/index.html
100. Smith B. J., boa: an R package for MCMC output convergence assessment and posterior inference Journal of Statistical Software 2007 21 11 1 37
101. Jackman S., Estimation and inference via Bayesian simulation: an introduction to Markov chain Monte Carlo American Journal of Political Science 2000 44 2 375 404
102. Kim J.-S., Bolt D. M., Estimating item response theory models using markov chain Monte Carlo methods: An NCME instructional module on Educational Measurement: Issues and Practice 2007 26 4 38 51
103. Sinharay S., Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples Journal of Educational and Behavioral Statistics 2004 29 4 461 488 (Pubitemid 40097369)
104. Swaminathan H., Hambleton R. K., Rogers H. J., Rao C. R., Sinharay S., Assessing the fit of item response models Handbook of Statistics 2007 26 Amsterdam, The Netherlands Elsevier/North-Holland 683 718
105. Glas C. A. W., Falcn J. C. S., A comparison of item-fit statistics for the three-parameter logistic model Applied Psychological Measurement 2003 27 2 87 106
106. Srbom D., Model modification Psychometrika 1989 54 3 371 384
107. Hu L., Bentler P. M., Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives Structural Equation Modeling 1999 6 1 1 55
108. Chen W.-H., Thissen D., Local dependence indexes for item pairs using item response theory Journal of Educational and Behavioral Statistics 1997 22 3 265 289 (Pubitemid 127472138)
109. Gelman A., Meng X.-L., Stern H., Posterior predictive assessment of model fitness via realized discrepancies Statistica Sinica 1996 6 4 733 807 (Pubitemid 126706389)
110. Spiegelhalter D. J., Best N. G., Carlin B. P., van der Linde A., Bayesian measures of model complexity and fit Journal of the Royal Statistical Society. Series B 2002 64 4 583 639
111. Fu J., Bolt D. M., Li Y., Evaluating item fit for a polytomous fusion model using posterior predictive checks Proceedings of the Annual Meeting of the National Council on Measurement in Education April 2005 Montréal, Canada
112. Levy R., Mislevy R. J., Sinharay S., Posterior predictive model checking for multidimensionality in item response theory Applied Psychological Measurement 2009 33 7 519 537
113. Sheng Y., Wikle C. K., Comparing multiunidimensional and unidimensional item response theory models Educational and Psychological Measurement 2007 67 6 899 919
114. Sinharay S., Assessing fit of unidimensional item response theory models using a Bayesian approach Journal of Educational Measurement 2005 42 4 375 394 (Pubitemid 43057419)
115. Sinharay S., Johnson M. S., Stern H. S., Posterior predictive assessment of item response theory models Applied Psychological Measurement 2006 30 4 298 321 (Pubitemid 43847276)
116. Bayarri M. J., Berger J. O., p values for composite null models Journal of the American Statistical Association 2000 95 452 1127 1142
117. Robins J. M., van der Vaart A., Ventura V., Asymptotic distribution of p values in composite null models Journal of the American Statistical Association 2000 95 452 1143 1172
118. Bayarri M. J., Berger J. O., Rejoinder Journal of the American Statistical Association 2000 95 1168 1170
119. Gelman A., Comment: Bayesian checking of the second levels of hierarchical models Statistical Science 2007 22 3 349 352
120. Johnson V. E., Bayesian model assessment using pivotal quantities Bayesian Analysis 2007 2 4 719 733
121. Hjort N. L., Dahl F. A., Steinbakk G. H., Post-processing posterior predictive p -values Journal of the American Statistical Association 2006 101 475 1157 1174
122. Gelman A., A Bayesian formulation of exploratory data analysis and goodness-of-fit testing International Statistical Review 2003 71 2 369 382 (Pubitemid 37052986)
123. Pearl J., Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988 San Mateo, Calif, USA Morgan Kaufmann xx+552 The Morgan Kaufmann Series in Representation and Reasoning