Optimal Test Design With Rule-Based Item Generation

Applied Psychological Measurement

Volumn 37, Issue 2, 2013, Pages 140-161

  Geerlings, Hanneke ^a   van der Linden, Wim J ^b   Glas, Cees A W ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b CTB MCGRAW HILL   (United States)

Author keywords

Fisher information; hierarchical modeling; item response theory; optimal test design; rule based item generation

Indexed keywords

EID: 84874001582     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621612468313     Document Type: Article

References (34)

1. Arendasy M.Automatic generation of Rasch-calibrated items: Figural matrices test GEOM and endless-loops test EC.International Journal of Testing. 2005;5:197-224.
2. Arendasy M.,Sommer M.Using psychometric technology in educational assessment: The case of a schema-based isomorphic approach to the automatic generation of quantitative reasoning items.Learning and Individual Differences. 2007;17:366-383.
3. Bejar I. I.,Lawless R. R.,Morley M. E.,Wagner M. E.,Bennett R. E.,Revuelta J.A feasibility study of on-the-fly item generation in adaptive testing.Journal of Technology, Learning, and Assessment. 2003;2:.
4. Bejar I. I.,Yocom P.A generative approach to the modeling of isomorphic hidden-figure items.Applied Psychological Measurement. 1991;15:129-137.
5. Boer RookhuiszenR. (2011). Generation of German narrative probability exercises (Master's thesis, University of Twente, Enschede, Netherlands). Retreived from http://essay.utwente.nl.
6. Casella G.,Berger R. L.Statistical inference. Pacific Grove, CA: Duxbury Press; 2002:.
7. Dennis I.,Handley S.,Bradon P.,Evans J.,Newstead S.Item generation for test development. Irvine S. H.Kyllonen P. C., ed. Mahwah, NJ: Lawrence Erlbaum; 2002:.
8. Doebler A.The problem of bias in person parameter estimation in adaptive testing.Applied Psychological Measurement. 2012;36:255-270.
9. Fischer G. H.The linear logistic test model as an instrument in educational research.Acta Psychologica. 1973;37:359-374.
10. GeerlingsH. (2012). Psychometric methods for automated test design (Doctoral dissertation, University of Twente, Enschede, Netherlands). Retreived from http://doc.utwente.nl.
11. Geerlings H.,Glas C. A. W.,van der Linden W. J.Modeling rule-based item generation.Psychometrika. 2011;76:337-359.
12. Automatic item generation: Theory and practice. Gierl M. J.Haladyna T. M., ed. New York, NY: Routledge; 2012:.
13. Glas C. A. W.,van der Linden W. J.Computerized adaptive testing with item cloning.Applied Psychological Measurement. 2003;27:247-261.
14. Glas C. A. W.,van der Linden W. J.,Geerlings H.Elements of adaptive testing. van der Linden W. J.Glas C. A. W., ed. New York, NY: Springer; 2010:289-314.
15. Gorin J. S.,Embretson S. E.Item difficulty modeling of paragraph comprehension items.Applied Psychological Measurement. 2006;30:394-411.
16. Hambleton R. K.,Jones R. W.Item parameter estimation errors and their influence on test information functions.Applied Measurement in Education. 1994;7:171-186.
17. Hambleton R. K.,Jones R. W.,Rogers H. J.Influence of item parameter estimation errors in test development.Journal of Educational Measurement. 1993;30:143-155.
18. CPLEX 9.0. Incline Village, NV: ILOG; 2003:.
19. Irvine S. H.Item generation for test development. Irvine S. H.Kyllonen P. C., ed. Mahwah, NJ: Lawrence Erlbaum; 2002:3-34.
20. Item generation for test development. Irvine S. H.Kyllonen P. C., ed. Mahwah, NJ: Lawrence Erlbaum; 2002:.
21. Johnson M. S.,Sinharay S.Calibration of polytomous item families using Bayesian hierarchical modeling.Applied Psychological Measurement. 2005;29:369-400.
22. Tatsuoka K. K.Rule space: An approach for dealing with misconceptions based on item response theory.Journal of Educational Measurement. 1983;20:345-354.
23. Theune M.,Boer Rookhuiszen R.,op den Akker H. J. A.,Geerlings H.Proceedings of the sixth workshop on innovative use of NLP for building educational applications. Portland, OR: Association for Computational Linguistics; 2011:20-29.
24. Tsutakawa R. K.,Johnson J. C.The effect of uncertainty of item parameter estimation on ability estimates.Psychometrika. 1990;55:371-390.
25. van der Linden W. J.Linear models for optimal test design. New York, NY: Springer; 2005:.
26. van der Linden W. J.,Glas C. A. W.Capitalization on item calibration error in adaptive testing.Applied Measurement in Education. 2000;13:35-53.
27. van der Linden W. J.,Glas C. A. W.Essays on item response theory. Boomsma A.van Duijn M. A. J.Snijders T. A. B., ed. New York, NY: Springer; 2001:205-219.
28. van der Linden W. J.,Glas C. A. W.Elements of adaptive testing. New York, NY: Springer; 2010:.
29. van der Linden W. J.,Pashley P. J.Elements of adaptive testing. van der Linden W. J.Glas C. A. W., ed. New York, NY: Springer; 2010:3-30.
30. Williams H. P.Model solving in mathematical programming. Chichester, UK: John Wiley; 1993:.
31. Wolfe J. H.Optimal item difficulty for the three-parameter normal ogive response model.Psychometrika. 1981;46:461-464.
32. Xi X.Automated scoring and feedback systems: Where are we and where are we heading?.Language Testing. 2010;27:291-300.
33. ZeuchN. (2010). Rule-based item construction: Analysis with and comparison of linear logistic test models and cognitive diagnostic models with two item types (Doctoral dissertation, University of Münster, Germany). Retreived from http://miami.uni-muenster.de.
34. Zhang J.,Xie M.,Song X.,Lu T.Investigating the impact of uncertainty about item parameters on ability estimation.Psychometrika. 2011;76:97-118.