On the use of MCMC computerized adaptive testing with empirical prior information to improve efficiency

Statistical Methods and Applications

Volumn 22, Issue 2, 2013, Pages 243-267

  Matteucci, Mariagiulia ^a   Veldkamp, Bernard P ^b  

^a UNIVERSITY OF BOLOGNA   (Italy)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Adaptive testing; Empirical prior information; Gibbs sampler; Measurement precision

Indexed keywords

EID: 84879554692     PISSN: 16182510     EISSN: 1613981X     Source Type: Journal    
DOI: 10.1007/s10260-012-0216-1     Document Type: Article

References (56)

1. Albert JH (1992) Bayesian estimation of normal ogive item response curves using Gibbs sampling. J Educ Stat 17: 251-269.
2. Ariel A, Veldkamp BP, van der linden WJ (2004) Cnstructing rotating item pools for contrained adaptive testing. J Educ Meas 41: 345-360.
3. Ariel A, van der linden WJ, Veldkamp BP (2006) A strategy for optimizing item pool management. J Educ Meas 43: 85-96.
4. Barrada JR, Abad FJ, Veldkamp BP (2009) Comparison of methods for controlling maximum exposure rates in computerized adaptive testing. Psicothema 21: 313-320.
5. Bartholomew DJ (1987) Latent variable models and factor analysis. Oxford University Press, New York.
6. Bartholomew DJ, Knott M (1999) Latent variable models and factor analysis. Arnold Publishers, London.
7. Béguin AA, Glas CAW (2001) MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika 66: 541-562.
8. Belov DI, Armstrong RD (2009) Direct and inverse problems of item pool design for computerized adaptive testing. Educ Psychol Meas 69: 533-547.
9. Birnbaum A (1968) Some latent trait models and their use in inferring an examinee's ability. In: Lord FM, Novick MR (eds) Statistical theories of mental test scores. Addison-Wesley, Reading, pp 97-479.
10. Bock RD, Mislevy RJ (1988) Adaptive EAP estimation of ability in a microcomputer environment. Appl Psychol Meas 6: 431-444.
11. Chang H-H, Ying Z (1996) A global information approach to computerized adaptive testing. Appl Psychol Meas 20: 213-229.
12. Cowles MK, Carlin BP (1996) Markov chain Monte Carlo convergence diagnostics: a comparative review. J Am Stat Assoc 91: 883-904.
13. De Jong MG, Steenkamp JBEM, Veldkamp BP (2009) A model for the construction of country-specific, yet internationally comparable short-form marketing scales. Mark Sci 28: 674-689.
14. Fox J-P, Glas CAW (2001) Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika 66: 271-288.
15. Gelman A, Carlin JB, Stern HS, Rubin DB (2004) Bayesian data analysis. 2. Chapman and Hall/CRC, Boca Raton.
16. Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6: 721-741.
17. Geweke J (1992) Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. In: Bernardo JM, Berger J, Dawid AP, Smith AFM (eds) Bayesian statistics 4. Oxford University Press, Oxford, pp 169-193.
18. Gialluca KA, Weiss DJ (1979) Efficiency of an adaptive inter-subtest branching strategy in the measurement of classroom achievement. Research report 79-6, University of Minnesota, Department of Psychology, Psychometric Methods Program, Minneapolis.
19. Guyer RD (2008) Effect of early misfit in computerized adaptive testing on the recovery of theta. Unpublished doctoral dissertation, University of Minnesota.
20. Ibrahim JG, Chen MH (2000) Power prior distributions for regression models. Stat Sci 15: 46-60.
21. Johnson VE, Albert JH (1999) Ordinal data modeling. Springer, New York.
22. Lehman EL, Casella G (1998) Theory of point estimation. 2. Springer, New York.
23. Lord FM (1952) A theory of test scores. Psychometric monograph 7.
24. Lord FM (1970) Some test theory for tailored testing. In: Holtzman WH (eds) Computer-assisted instruction, testing, and guidance. Harper and Row, New York, pp 139-183.
25. Lord FM, Novick MR (1968) Statistical theories of mental test scores. Addison-Wesley, Reading.
26. Maij-de Meij AM, Schakel L, Smid N, Verstappen N, Jaganjac A (2008) Connector ability; professional manual. PiCompany B. V., Utrecht.
27. Mislevy RJ (1986) Bayes modal estimation in item response models. Psychometrika 51: 177-195.
28. Natesan P, Limbers C, Varni JW (2010) Bayesian estimation of graded response multilevel models using Gibbs sampling: formulation and illustration. Educ Psych Meas 70: 420-439.
29. Owen RJ (1969) A Bayesian approach to tailored testing. Research report 69-92, Educational testing service, Princeton, NJ.
30. Owen RJ (1975) A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. J Am Stat Assoc 70: 351-356.
31. Patz RJ, Junker BW (1999) A straightforward approach to Markov chain Monte Carlo methods for item response models. J Educ Behav Stat 24: 146-178.
32. Reckase MD (2009) Multidimensional item response models. Springer, New York.
33. Segall DO (1996) Multidimensional adaptive testing. Psychometrika 61: 331-354.
34. Sheng Y, Wikle CK (2007) Comparing multiunidimensional and unidimensional item response theory models. Educ Psychol Meas 67: 899-919.
35. Sheng Y, Wikle CK (2008) Bayesian multidimensional IRT models with a hierarchical structure. Educ Psychol Meas 68: 413-430.
36. Sympson JB, Hetter RD (1985) Controlling item-exposure rates in computerized adaptive testing. In: Proceedings of the 27th annual meeting of the military testing association, Navy personnel research and development center, San Diego, CA, pp 973-977.
37. The MathWorks Inc (2005) MATLAB [computer program]. The MathWorks Inc, Natick, MA
38. van der Linden WJ (1998) Bayesian item selection criteria for adaptive testing. J Educ Behav Stat 22: 203-226.
39. van der Linden WJ (1999) Empirical initialization of the trait estimation in adaptive testing. Appl Psychol Meas 23: 21-29.
40. van der Linden WJ (2005) Linear models for optimal test design. Springer, New York.
41. van der Linden WJ (2008) Using response times for item selection in adaptive testing. J Educ Behav Stat 33: 5-20.
42. van der Linden WJ, Glas CAW (2000) Computerized adaptive testing: theory and practice. Kluwer, Boston.
43. van der Linden WJ, Glas CAW (2007) Statistical aspects of adaptive testing. In: Rao CR, Sinharay S (eds) Handbook of statistics (vol 27: Psychometrics). Elsevier B. V., Amsterdam, pp 801-838.
44. van der Linden WJ, Glas CAW (2010) Elements of adaptive testing. Springer, New York.
45. van der Linden WJ, Pashley PJ (2010) Item selection and ability estimation in adaptive testing. In: van der Linden WJ, Glas CAW (eds) Elements of adaptive testing. Springer, New York, pp 3-30.
46. van der Linden WJ, Veldkamp BP (2004) Constraining item exposure rates in computerized adaptive testing with shadow tests. J Educ Behav Stat 29: 273-291.
47. van der Linden WJ, Veldkamp BP (2007) Conditional item exposure control in adaptive testing using item-ineligibility probabilities. J Educ Behav Stat 32: 398-417.
48. Veerkamp WJJ, Berger MPF (1997) Some new item-selection criteria for adaptive testing. J Educ Behav Stat 22: 203-226.
49. Veldkamp BP (2010) Bayesian item selection in constrained adaptive testing using shadow tests. Psicologica 31: 149-169.
50. Veldkamp BP (2012) Application of robust optimization to automated test assembly. Ann Oper Res. doi: 10. 1007/s10479-012-1218-y (online first).
51. Veldkamp BP, van der Linden WJ (2002) Multidimensional adaptive testing with constraints on test content. Psychometrika 67: 575-588.
52. Wainer H, Dorans NJ, Eignor D, Flaugher R, Green BF, Mislevy RJ, Steinberg L (2000) Computerized adaptive testing: a primer. 2. Lawrence Erlbaum Associates, Mahwah.
53. Warm TA (1989) Weighted likelihood estimation of ability in item response theory with tests of finite length. Psychometrika 54: 427-450.
54. Woods CM, Lin N (2009) Item response theory with estimation of the latent density using Davidian curves. Appl Psychol Meas 33: 102-117.
55. Zwinderman AH (1991) A generalized Rasch model for manifest predictors. Psychometrika 56: 589-600.
56. Zwinderman AH (1997) Response models with manifest predictors. In: van der Linden WJ, Hambleton RK (eds) Handbook of modern item response theory. Springer, New York, pp 245-256.