Optimal on-line calibration of testlets

Applied Optimal Designs

Volumn , Issue , 2005, Pages 21-43

  Jones, Douglas H ^a   Nediak, Mikhail S ^b,c  

^a RUTGERS UNIVERSITY   (United States)

^b MCMASTER UNIVERSITY   (Canada)

^c QUEEN S UNIVERSITY   (Canada)

Author keywords

Conjugate gradient method; D optimal design criterion; Expectation maximization (EM) algorithm; Item response functions; Markov chain monte carlo (MCMC) simulation; Spiralling design; Test constructors; Testlet; Unconstrained conjugate gradient method

Indexed keywords

EID: 80052266872     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/0470857005.ch2     Document Type: Chapter

References (33)

1. Ahuja, R. K., Magnanti, T. L. and Orlin, J. B. (1993). Network Flows: Theory, Algorithms, and Applications. Englewood Cliffs, NJ: Prentice-Hall.
2. Berger, M. P. F. (1991). On the efficiency of IRT models when applied to different sampling designs. Applied Psychological Measurement, 15, 283-306.
3. Berger, M. P. F. (1992). Sequential sampling designs for the two-parameter item response theory model. Psychometrika, 57, 521-538.
4. Berger, M. P. F. (1994). D-Optimal sequential designs for item response throe models. Journal of Educational Statistics, 19, 43-56.
5. Berger, M. P. F. and van der Linden, W. J. (1991). Optimality of sampling designs in item response theory models. In M.Wilson (ed.), Objective Measurement: Theory into Practice. Norwood, NJ: Ablex Publishing.
6. Bradlow, E. T., Wainer, H. and Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153-168.
7. Buyske, S. G. (1998a). Item calibration in computerized adaptive testing using minimal information loss. Preprint.
8. Buyske, S. G. (1998b). Optimal designs for item calibration in computerized adaptive testing. In N. Flournoy, W. F. Rosenberger and W. K. Wong (eds), New Developments and Applications in Experimental Design. Hayward, Calif.: Inst. of Math. Statistics.
9. Donev, A. N. and Atkinson, A. C. (1988). An adjustment algorithm for the construction of exact D-optimum experimental designs. Technometrics, 30, 429-433.
10. Fedorov, V. V. (1972). Theory of Optimal Experiments. New York: Academic Press. (Federov, 1972).
11. Ford, I. (1976). Optimal static and sequential design: a critical review. Unpublished doctoral dissertation, University of Glasgow.
12. Ford, I., Kitsos, D. M. and Titterington, C. P. (1989). Recent advances in nonlinear experimental design. Technometrics, 31, 49-60.
13. Ford, I., Titterington, C. P. and Wu, C. F. J. (1985). Inference and sequential design. Biometrika, 72, 545-551.
14. Gill, P. E., Murray, W. and Wright, M. H. (1981). Practical Optimization. London: Academic Press.
15. Haines, L. M. (1987). The application of the annealing algorithm to the construction of exact optimal designs for linear-regression models. Technometrics, 29, 439-447.
16. Jones, D. H., Chiang, J. and Jin, Z. (1997). Optimal designs for simultaneous item estimation. Nonlinear Analysis, Methods and Applications, 30(7), 4051-4058.
17. Jones, D. H. and Jin, Z. (1994). Optimal sequential designs for on-line item estimation. Psychometrika, 59, 57-75.
18. Jones, D. H. and Nediak, M. S. (1999). Item Parameter Calibration of LSAT Items Using MCMC Approximation of Bayes Posterior Distributions. RUTCOR Research Report, Rutgers the State University of New Jersey: Faculty of Management and RUTCOR.
19. Lord, F. M. (1980). Applications of Item Response Theory to Practical Testing Problems. Hillside, NJ: Erlbaum.
20. Mislevy, R. and Bock, D. (1990). BILOG 3.06. Lincolnwood, Ill.: Scientific Software International.
21. Mitchell, T. J. (1974). An algorithm for the construction of D-optimal experimental designs. Technometrics, 16, 203-210.
22. Muraki, E. and Bock, D. (2003) PARSCALE. Lincolnwood, Ill.: Scientific Software International.
23. Patz, R. J., and Junker, B.W. (1999). Applications and extensions of MCMC for IRT: multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342-366.
24. Prakasa Rao, B. L. S. (1987). Asymptotic Theory of Statistical Inference. New York: John Wiley & Sons, Ltd.
25. Silvey, S. D. (1980). Optimal Design. New York: Chapman and Hall.
26. Stocking, M. L. (1990). Specifying optimum examinees for item parameter estimation in item response theory. Psychometrika, 55, 461-475.
27. Thissen, D. (1991). MULTILOG User’s Guide - Version 6. Chicago, Ill.: Scientific Software, Inc.
28. Vale, C. D. (1986). Linking item parameters onto a common scale. Applied Psychological Measurement, 10, 333-344.
29. van der Linden, W. J. (1988). Optimizing Incomplete Sampling Designs for Item Response Model Parameters. Research Report No. 88-5. Enschede, The Netherlands: University of Twente.
30. Wainer, H. and Kiely, G. (1987). Item clusters and computer adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
31. Welch, W. J. (1982). Branch-and-bound search for experimental designs based on D optimality and other criteria. Technometrics, 24, 41-48.
32. Wingersky, M. S. and Lord, F. M. (1984). An investigation of methods for reducing sampling error in certain IRT procedures. Applied Psychological Measurement, 8, 347-364.
33. Wu, C. F. J. (1985). Asymptotic inference from sequential design in a nonlinear situation. Biometrika, 72, 553-558.