26 Bayesian Psychometric Modeling From An Evidence-Centered Design Perspective

Handbook of Statistics

Volumn 26, Issue , 2006, Pages 839-865

  Mislevy, Robert J ^a   Levy, Roy ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 67649383642     PISSN: 01697161     EISSN: None     Source Type: Book Series    
DOI: 10.1016/S0169-7161(06)26026-7     Document Type: Review

References (72)

1. Ackerman T.A. Graphical representation of multidimensional item response theory analysis. Applied Psychological Measurement 20 (1996) 311-329
2. Albert J.H. Bayesian estimation of normal ogive item response curves using Gibbs sampling. Journal of Educational Statistics 17 (1992) 251-269
3. Albert J.H., and Chib S. Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association 88 (1993) 669-679
4. Almond R.G., and Mislevy R.J. Graphical models and computerized adaptive testing. Applied Psychological Measurement 23 (1999) 223-237
5. Arminger G., and Muthén B.O. A Bayesian approach to nonlinear latent variable models using the Gibbs sampler and the Metropolis-Hastings algorithm. Psychometrika 63 (1998) 271-300
6. Béguin A.A., and Glas C.A.W. MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika 66 (2001) 541-562
7. Behrens J.T., Mislevy R.J., Bauer M., Williamson D.W., and Levy R. Introduction to Evidence Centered Design and lessons learned from its application in a global e-learning program. International Journal of Testing 4 (2004) 295-301
8. Bejar I.I. Generative testing: From conception to implementation. In: Irvine S.H., and Kyllonen P.C. (Eds). Item Generation for Test Development (2002), Erlbaum, Hillsdale, NJ 199-217
9. Birnbaum A. Some latent trait models and their use in inferring an examinee's ability. In: Lord F.M., and Novick M.R. (Eds). Statistical Theories of Mental Test Scores (1968), Addison-Wesley, Reading, MA 397-479
10. Bolt D.M., and Lall V.F. Estimation of compensatory and noncompensatory multidimensional item response models using Markov chain Monte Carlo. Applied Psychological Measurement 27 (2003) 395-414
11. Bradlow E.T., Wainer H., and Wang X. A Bayesian random effects model for testlets. Psychometrika 64 (1999) 153-168
12. Brooks S.P. Markov chain Monte Carlo method and its application. The Statistician 47 (1998) 69-100
13. DeMark S.D., and Behrens J.T. Using statistical natural language processing for understanding complex responses to free-response tasks. International Journal of Testing 4 (2004) 371-390
14. Dempster A.P., Laird N.M., and Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, B 39 (1977) 1-38
15. Diebolt J., and Ip E.H.S. Stochastic EM: Method and application. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds). Markov Chain Monte Carlo in Practice (1996), Chapman and Hall, London 259-273
16. Formann A.K. Constrained latent class models: Theory and applications. The British Journal of Mathematical and Statistical Psychology 38 (1985) 87-111
17. Fox J.P., and Glas C.A.W. Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika 66 (2001) 271-288
18. Gelman A. Inference and monitoring convergence. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds). Markov Chain Monte Carlo in Practice (1996), Chapman and Hall, London 131-143
19. Gelman A., Carlin J.B., Stern H.S., and Rubin D.B. Bayesian Data Analysis (1995), Chapman & Hall, London
20. Gilks W.R., Richardson S., and Spiegelhalter D.J. Introducing Markov Chain Monte Carlo. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds). Markov Chain Monte Carlo in Practice (1996), Chapman and Hall, London 1-19
21. In: Gilks W.R., Richardson S., and Spiegelhalter D.J. (Eds). Markov Chain Monte Carlo in Practice (1996), Chapman and Hall, London
22. Hambleton R.K., and Swaminathan H. Item Response Theory: Principles and Applications (1985), Kluwer, Boston
23. Hoijtink H. Constrained latent class analysis using the Gibbs sampler and posterior predictive p-values: Applications to educational testing. Statistica Sinica 8 (1998) 691-711
24. Hoijtink H., and Molenaar I.W. A multidimensional item response model: Constrained latent class analysis using the Gibbs sampler and posterior predictive checks. Psychometrika 62 (1997) 171-189
25. Holland P.W. On the sampling theory foundations of item response theory models. Psychometrika 55 (1990) 577-601
26. In: Irvine S.H., and Kyllonen P.C. (Eds). Item Generation for Test Development (2002), Erlbaum, Hillsdale, NJ
27. Jaynes E.T. Probability Theory: The Logic of Science (2003), Cambridge University Press, New York
28. Jensen F.V. An Introduction to Bayesian Networks (1996), Springer-Verlag, New York
29. Jensen F.V. Bayesian Networks and Decision Graphs (2001), Springer-Verlag, New York
30. Lauritzen S.L., and Spiegelhalter D.J. Local computations with probabilities on graphical structures and their application to expert systems (with discussion). Journal of the Royal Statistical Society, B 50 (1988) 157-224
31. Lee S.-Y. A Bayesian approach to confirmatory factor analysis. Psychometrika 46 (1981) 153-160
32. Levy R., and Mislevy R.J. Specifying and refining a measurement model for a computer based interactive assessment. International Journal of Testing 4 (2004) 333-369
33. Levy R., Behrens J.T., and Mislevy R.J. Variations in adaptive testing and their on-line leverage points. In: Williams D.D., Howell S.L., and Hricko M. (Eds). Online Assessment, Measurement and Evaluation: Emerging Practices (2006), Information Science Publishing, Hershey, PA 180-202
34. Lindley D.V., and Smith A.F.M. Bayes estimates for the linear model. Journal of the Royal Statistical Society, B 34 (1972) 1-42
35. Lord F.M., and Novick M.R. Statistical Theories of Mental Test Scores (1968), Addison-Wesley, Reading, MA
36. Martin J.K., and McDonald R.P. Bayesian estimation in unrestricted factor analysis: A treatment for Heywood cases. Psychometrika 40 (1975) 505-517
37. Martin J.D., and VanLehn K. A Bayesian approach to cognitive assessment. In: Nichols P., Chipman S., and Brennan R. (Eds). Cognitively Diagnostic Assessment (1995), Erlbaum, Hillsdale, NJ 141-165
38. Messick S. Validity. In: Linn R.L. (Ed). Educational Measurement. 3rd ed (1989), Macmillan, New York 13-103
39. Messick S. The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher 23 (1994) 13-23
40. Mislevy R.J. Bayes modal estimation in item response models. Psychometrika 51 (1986) 177-195
41. Mislevy R.J. Evidence and inference in educational assessment. Psychometrika 59 (1994) 439-483
42. Mislevy, R.J., Senturk, D., Almond, R.G., Dibello, L.V., Jenkins, F., Steinberg, L.S., Yan, D. (2002a). Modeling conditional probabilities in complex educational assessments. CSE Technical Report 580, National Center for Research on Evaluation, Standards, and Student Testing (CRESST), Los Angeles
43. Mislevy R.J., Steinberg L.S., and Almond R.G. On the roles of task model variables in assessment design. In: Irvine S., and Kyllonen P. (Eds). Generating Items for Cognitive Tests: Theory and Practice (2002), Erlbaum, Hillsdale, NJ 97-128
44. Mislevy R.J., Steinberg L.S., and Almond R.G. On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives 1 (2003) 3-62
45. Moss P. Can there be validity without reliability?. Educational Researcher 23 2 (1994) 5-12
46. Novick M.R., Jackson P.H., and Thayer D.T. Bayesian inference and the classical test theory model: Reliability and true scores. Psychometrika 36 (1971) 261-288
47. Patz R.J., and Junker B.W. A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics 24 (1999) 146-178
48. Patz R.J., and Junker B.W. Applications and extensions of MCMC for IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics 24 (1999) 342-366
49. Pearl J. Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference (1988), Kaufmann, San Mateo, CA
50. Rasch G. Probabilistic Models for some Intelligence and Attainment Tests (1960), University of Chicago Press, Chicago Reprinted 1980
51. Rowe D.B. Multivariate Bayesian Statistics: Models for Source Separation and Signal Unmixing (2003), CRC Press, Boca Raton, FL
52. Rupp A.A., Dey D.K., and Zumbo B.D. To Bayes or not to Bayes, from whether to when: Applications of Bayesian methodology to modeling. Structural Equation Modeling 11 (2004) 424-451
53. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, No. 17 (4, Pt. 2)
54. Samejima F. Some methods and approaches of estimating the operating characteristics of discrete item responses. In: Wainer H., and Messick S. (Eds). Principals (sic) of Modern Psychological Measurement (1983), Lawrence Erlbaum Associates, Hillsdale, NJ 154-182
55. Scheines R., Hoijtink H., and Boomsma A. Bayesian estimation and testing of structural equation models. Psychometrika 64 (1999) 37-52
56. Schum D.A. Evidence and Inference for the Intelligence Analyst (1987), University Press of America, Lanham, MD
57. Schum D.A. The Evidential Foundations of Probabilistic Reasoning (1994), Wiley, New York
58. Seltzer M.H., Wong W.H., and Bryk A.S. Bayesian analysis in applications of hierarchical models: Issues and methods. Journal of Educational and Behavioral Statistics 21 (1996) 131-167
59. Sheehan K., and Mislevy R.J. Integrating cognitive and psychometric models to measure document literacy. Journal of Educational Measurement 27 (1990) 255-272
60. Sinharay S. Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics 29 (2004) 461-488
61. Sinharay S., and Stern H.S. Posterior predictive model checking in hierarchical models. Journal of Statistical Planning and Inference 111 (2003) 209-221
62. Smith A.F.M., and Roberts G.O. Bayesian computation via the Gibbs sampler and related Markov chain Monte Carlo methods. Journal of the Royal Statistical Society, B 55 (1993) 3-23
63. Spiegelhalter D.J., Dawid A.P., Lauritzen S.L., and Cowell R.G. Bayesian analysis in expert systems. Statistical Science 8 (1993) 219-247
64. Spiegelhalter, D.J., Thomas, A., Best, N.G., Lunn, D. (2003). WinBUGS version 1.4: User manual. Cambridge Medical Research Council Biostatistics Unit. http://www.mrc-bsu.cam.ac.uk/bugs/
65. Stout W., Habing B., Douglas J., Kim H.R., Roussos L., and Zhang J. Conditional covariance-based nonparametric multidimensionality assessment. Applied Psychological Measurement 20 (1996) 331-354
66. Swaminathan H., and Gifford J.A. Bayesian estimation in the two-parameter logistic model. Psychometrika 50 (1985) 349-364
67. Swaminathan H., and Gifford J.A. Bayesian estimation in the three-parameter logistic model. Psychometrika 51 (1986) 589-601
68. Swaminathan H., and Rogers H.J. Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement 27 (1990) 361-370
69. Thissen D., and Wainer H. Test Scoring (2001), Lawrence Erlbaum Associates, Mahwah, NJ
70. Tierney L. Markov chains for exploring posterior distributions. Annals of Statistics 22 (1994) 1701-1728
71. Toulmin S.E. The Uses of Argument (1958), Cambridge University Press, Cambridge
72. Williamson D.W., Bauer M., Steinberg L.S., Mislevy R.J., Behrens J.T., and DeMark S.F. Design rationale for a complex performance assessment. International Journal of Testing 4 (2004) 303-332