A Monte Carlo approach to the design, assembly, and evaluation of multistage adaptive tests

Applied Psychological Measurement

Volumn 32, Issue 2, 2008, Pages 119-137

  Belov, Dmitry I ^a,c   Armstrong, Ronald D ^b  

^a Law School Admission Council

^b RUTGERS UNIVERSITY   (United States)

^c Law School Admission Council   (United States)

Author keywords

Automated test assembly; Computer adaptive testing; Item response theory; Monte Carlo methods; Test assembly; Test construction; Testlet

Indexed keywords

EID: 38849149103     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621606297308     Document Type: Article

References (17)

1. Ahuja, R.K., Magnanti, T.L., & Orlin, J.B. (1993). Network flows: Theory, algorithms, and applications. Englewood Cliffs, NJ: Prentice Hall.
2. Armstrong, R.D., Jones, D.H., Koppel, N.B., & Pashley, P.J. (2004). Computerized adaptive testing with multiple form structures. Applied Psychological Measurement, 28, 147-164.
3. Armstrong, R.D., & Roussos, L. (2003). A method to determine targets for multi-stage adaptive tests (Computerized Testing Report No. 02-07). Newtown, PA: Law School Admission Council.
4. Belov, D.I., & Armstrong, R.D. (2005). Monte Carlo test assembly for item pool analysis and extension. Applied Psychological Measurement, 29, 239-261.
5. Boyd, A.M., Dodd, B.G., & Fitzpatrick, S.J. (2003, April). A comparison of exposure control procedures in CAT systems based on different measurement models for testlets using the verbal reasoning section of the MCAT. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
6. Breithaupt, K., Ariel, A., & Veldkamp, B. (2004, April). Balancing item exposure and optimality in automated assembly for multistage testing. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
7. Edwards, M.C., & Thissen, D. (2004, April). Multistage computerized adaptive testing: Using item response theory for design selection. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
8. Ilog, Inc. (2003). CPLEX 9.0 [Computer software and manual]. Mountain View, CA: Author. Available from http://www.ilog.com
9. Lord, F. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
10. Luecht, R.M., & Burgin, W. (2003, April). Test information targeting strategies for adaptive multistage testing designs. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
11. Luecht, R.M., & Nungester, R.J. (1998). Some practical examples of computer-adaptive sequential testing. Journal of Educational Measurement, 35, 229-247.
12. Luecht, R.M., & Nungester, R.J. (2000). Computer-adaptive sequential testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 117-128). Boston: Kluwer Academic.
13. Patsula, L.N. (1999). A comparison of computerized adaptive testing and multi-stage testing. Unpublished doctoral dissertation, University of Massachusetts, Amherst.
14. Schrage, L. (2002). Optimization modeling with LINGO (4 th ed.). Chicago, IL: LINDO Systems.
15. Wang, X., Bradlow, E.T., & Wainer, H. (2002). A general Bayesian model for testlets: Theory and applications. Applied Psychological Measurement, 26, 109-128.
16. Xing, D., & Hambleton, R. (2004). Impact of test design, item quality, and item bank size on the psychometric properties of computer-based credentialing examinations. Educational and Psychological Measurement, 64, 5-21.
17. Zenisky, A., & Hambleton, R. (2004, April). Effects of selected multi-stage design alternatives on credentialing examination outcomes. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.