Modeling Rule-Based Item Generation

Psychometrika

Volumn 76, Issue 2, 2011, Pages 337-359

  Geerlings, Hanneke ^a   Glas, Cees A W ^a   van der Linden, Wim J ^b  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b CTB MCGRAW HILL   (United States)

Author keywords

hierarchical modeling; item generation; item response theory; Markov chain Monte Carlo method

Indexed keywords

EID: 79954629409     PISSN: 00333123     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11336-011-9204-x     Document Type: Article

References (47)

1. Albert, J. H. (1992). Bayesian estimation of normal-ogive item response curves using Gibbs sampling. Journal of Educational and Behavioral Statistics, 17, 261-269.
2. Béguin, A. A., & Glas, C. A. W. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541-562.
3. Bormuth, J. R. (1970). On the theory of achievement test items. Chicago: University of Chicago Press.
4. Cho, S.-J., & Rabe-Hesketh, S. (2011). Alternating imputation posterior estimation of models with crossed random effects. Computational Statistics and Data Analysis, 55, 12-25.
5. De Boeck, P. (2008). Random item IRT models. Psychometrika, 73, 533-559.
6. De Boeck, P., & Wilson, M. (2004). Explanatory item response models: a generalized linear and nonlinear approach. New York: Springer.
7. Embretson, S. E. (1999). Generating items during testing: psychometric issues and models. Psychometrika, 64, 407-433.
8. Fischer, G. H. (1973). The linear logistic test model as an instrument in educational research. Acta Psychologica, 37, 359-374.
9. Fox, J.-P. (2004). Multilevel IRT model assessment. In L. A. van der Ark, M. A. Croon, & K. Sijtsma (Eds.), New developments in categorical data analysis for the social and behavioral sciences (pp. 227-252). London: Lawrence Erlbaum Associates.
10. Fox, J.-P., & Glas, C. A. W. (2001). Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika, 66, 271-288.
11. Freund, P. A., Hofer, S., & Holling, H. (2008). Explaining and controlling for the psychometric properties of computer-generated figural matrix items. Applied Psychological Measurement, 32, 195-210.
12. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2004). Bayesian data analysis. New York: Chapman & Hall.
13. Gelman, A., & Pardoe, I. (2006). Bayesian measures of explained variance and pooling in multilevel (hierarchical) models. Technometrics, 48, 241-251.
14. Geweke, J. (1992). Evaluating the accuracy of sampling-based approaches to the calculation of posterior moments. In J. M. Bernardo, J. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4: proceedings of the fourth Valencia international meeting (pp. 169-193). Oxford: Oxford University Press.
15. Glas, C. A. W. (2010). Item parameter estimation and item fit analysis. In W. J. van der Linden & C. A. W. Glas (Eds.), Elements of adaptive testing (pp. 269-288). New York: Springer.
16. Glas, C. A. W., & van der Linden, W. J. (2001). Modeling variability in item parameters in item response models (Research Report 01-11). Enschede, The Netherlands: Department of Educational Measurement and Data Analysis, University of Twente.
17. Glas, C. A. W., & van der Linden, W. J. (2003). Computerized adaptive testing with item cloning. Applied Psychological Measurement, 27, 247-261.
18. Glas, C. A. W., van der Linden, W. J., & Geerlings, H. (2010). Estimation of the parameters in an item-cloning model for adaptive testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Elements of adaptive testing (pp. 289-314). New York: Springer.
19. Griffiths, W. E., & Valenzuela, M. R. (2006). Gibbs samplers for a set of seemingly unrelated regressions. Australian and New Zealand Journal of Statistics, 48, 335-351.
20. Heidelberger, P., & Welch, P. D. (1983). Simulation run length control in the presence of an initial transient. Operations Research, 31, 1109-1144.
21. Hively, W., Patterson, H. L., & Page, S. H. (1968). A "universe-defined" system of arithmetic achievement items. Journal of Educational Measurement, 5, 275-290.
22. Holling, H., Bertling, J. P., & Zeuch, N. (2009). Automatic item generation of probability word problems. Studies in Educational Evaluation, 35, 71-76.
23. Irvine, S. H., (2002). The foundations of item generation for mass testing. In S. H. Irvine & P. C. Kyllonen (Eds.) Item generation for test development (pp. 3-34). Mahwah: Lawrence Erlbaum Associates.
24. Janssen, R., Schepers, J., & Peres, D. (2004). Models with item and item group predictors. In P. De Boeck & M. Wilson (Eds.), Explanatory item response models: A generalized linear and nonlinear approach (pp. 189-212). New York: Springer.
25. Janssen, R., Tuerlinckx, F., Meulders, M., & De Boeck, P. (2000). A hierarchical IRT model for criterion-referenced measurement. Journal of Educational and Behavioral Statistics, 25, 285-306.
26. Johnson, V. E., & Albert, J. H. (1999). Ordinal data modeling. New York: Springer.
27. Laros, J. A., & Tellegen, P. J. (1991). Construction and validation of the SON-R 5, 5-17, the Snijders-Oomen non-verbal intelligence test. Groningen: Wolters-Noordhoff.
28. Luecht, R. M. Adaptive computer-based tasks under an assessment engineering paradigm. Paper presented at the 2009 Graduate Management Admission Council Conference on Computerized Adaptive Testing, Minneapolis, Minnesota.
29. MacEachern, S. N., & Berliner, L. M. (1994). Subsampling the Gibbs sampler. The American Statistician, 48, 188-190.
30. Millman, J., & Westman, R. S. (1989). Computer-assisted writing of achievement test items: toward a future technology. Journal of Educational Measurement, 26, 177-190.
31. Mislevy, R. J., & Levy, R. (2007). Bayesian psychometric modeling from an evidence-centered design perspective. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 839-865). Amsterdam: Elsevier.
32. Osburn, H. G. (1968). Item sampling for achievement testing. Educational and Psychological Measurement, 28, 95-104.
33. Plummer, M., Best, N., Cowles, K., & Vines, K. (2006). CODA: Convergence diagnosis and output analysis for MCMC. R News, 6, 7-11. Available from http://CRAN. R-project. org/doc/Rnews/.
34. R Development Core Team (2009). R: A language and environment for statistical computing. Computer software manual. Vienna, Austria. Available from http://www. R-project. org.
35. Raftery, A. E., & Lewis, S. (1992). How many iterations in the Gibbs sampler? In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4: proceedings of the fourth Valencia international meeting (pp. 763-773). Oxford: Oxford University Press.
36. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research.
37. Rijmen, F., & De Boeck, P. (2002). The random weights linear logistic test model. Applied Psychological Measurement, 26, 271-285.
38. Rijmen, F., Tuerlinckx, F., De Boeck, P., & Kuppens, P. (2003). A nonlinear mixed model framework for item response theory. Psychological Methods, 8, 185-205.
39. Roid, G., & Haladyna, T. (1982). A technology for test-item writing. New York: Academic Press.
40. Rubin, D. B. (1976). Inference and missing data. Biometrika, 63, 581-592.
41. Sinharay, S., Johnson, M. S., & Williamson, D. M. (2003). Calibrating item families and summarizing the results using family expected response functions. Journal of Educational and Behavioral Statistics, 28, 295-313.
42. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society B, 64, 583-639.
43. Tanner, M. A. (1996). Tools for statistical inference: methods for the exploration of posterior distributions and likelihood functions. New York: Springer.
44. Tellegen, P. J., & Laros, J. A. (1993). The construction and validation of a nonverbal test of intelligence: the revision of the Snijders-Oomen tests. European Journal of Psychological Assessment, 9, 147-157.
45. van den Noortgate, W., De Boeck, P., & Meulders, M. (2003). Cross-classification multilevel logistic models in psychometrics. Journal of Educational and Behavioral Statistics, 28, 369-386.
46. van der Linden, W. J., & Glas, C. A. W. (2000). Capitalization on item calibration error in adaptive testing. Applied Measurement in Education, 13, 35-53.
47. Zellner, A. (1962). An efficient method of estimating seemingly unrelated regressions and tests of aggregation bias. Journal of the American Statistical Association, 57, 348-368.