Strategies for Controlling Item Exposure in Computerized Adaptive Testing with the Generalized Partial Credit Model

Applied Psychological Measurement

Volumn 28, Issue 3, 2004, Pages 165-185

  Davis, Laurie Laughlin ^a  

^a PEARSON   (United States)

Author keywords

CAT item selection; Computerized adaptive testing; Exposure control; Generalized partial credit model; Polytomous IRT

Indexed keywords

EID: 2442599424     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/0146621604264133     Document Type: Article

References (30)

1. Bejar, I. I. (1991). A methodology for scoring open-ended architectural design problems. Journal of Applied Psychology, 76, 522-532.
2. Burstein, J., Kukich, K., Wolff, S., Lu, C., & Chodorow, M. (1998, April). Computer analysis of essays. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego.
3. Burt, W., Kim, S., Davis, L. L., & Dodd, B. G. (2003, April). A comparison of item exposure control procedures using a CAT system based on the generalized partial credit model. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
4. Chang, H. H., Qian, J., & Ying, Z. (1999). A-stratified multistage CAT with b-blocking. Manuscript accepted for publication.
5. Chang, H. H., & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 213-229.
6. Chang, H. H., & Ying, Z. (1999). A-stratified multistage computerized adaptive testing. Applied Measurement in Education, 23(3), 211-222.
7. Chen, S., Ankenmann, R. D., & Spray, J. A. (1999, April). Exploring the relationship between item exposure rate and test overlap rate in computerized adaptive testing. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
8. Chen, S., Hou, L., & Dodd, B. G. (1998). A comparison of maximum likelihood estimation and expected a posteriori estimation on CAT using the partial credit model. Educational and Psychological Measurement, 53, 61-77.
9. Clauser, B. E., Margolis, M. J., Clyman, S. G., & Ross, L. P. (1997). Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches. Journal of Educational Measurement, 34, 141-161.
10. Davis, L. L., & Dodd, B. G. (2003). Item exposure constraints for testlets in the verbal reasoning section of the MCAT. Applied Psychological Measurement, 26(5), 335-356.
11. Davis, L. L., Pastor, D., Dodd, B. G., Chiang, C., & Fitzpatrick, S. (2003). An examination of exposure control and content balancing restrictions on item selection in CATs using the partial credit model. Journal of Applied Measurement, 4(1), 24-42.
12. Hetter, R. D., & Sympson, J. B. (1997). Item exposure control in CAT-ASVAB. In W. Sands, B. K. Waters, & J. R. McBride (Eds.), Computerized adaptive testing-from inquiry to operation (pp. 141-144). Washington, DC: American Psychological Association.
13. Kingsbury, G. G., & Zara, A. R. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education, 2, 359-375.
14. Koch, W. R., & Dodd, B. G. (1989). An investigation of procedures for computerized adaptive testing using partial credit scoring. Applied Measurement in Education, 2(4), 335-357.
15. Leung, C., Chang, H. H., & Hau, K. (1999, April). An enhanced stratified computerized adaptive testing design. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
16. Lunz, M. E., & Stahl, J. A. (1998, April). Patterns of item exposure using a randomized CAT algorithm. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego.
17. Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.
18. Muraki, E., & Bock, R. D. (1993). The PARSCALE computer program [Computer program]. Chicago: Scientific Software International.
19. Parshall, C. G., Davey, T., & Nering, M. L. (1998, April). Test development exposure control for adaptive testing. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego.
20. Parshall, C. G., Hogarty, K. Y., & Kromrey, J. D. (1999). Item exposure in adaptive tests: An empirical investigation of control strategies. Paper presented at the annual meeting of the Psychometric Society, Lawrence, KS.
21. Pastor, D. A., Chiang, C., Dodd, B. G., & Yockey, R. (1999, April). Performance of the SympsonHetter exposure control algorithm with a polytomous item bank. Paper presented at the annual meeting of American Educational Research Association, Montreal, Canada.
22. Pastor, D. A., Dodd, B. G., & Chang, H. H. (2002). A comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model. Applied Psychological Measurement, 26(2), 144-163.
23. Revuelta, J., & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 35, 311-327.
24. Stocking, M. L., & Lewis, C. (1998). Controlling item exposure conditional on ability in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 23(1), 57-75.
25. Stocking, M. L., & Lewis, C. (2000). Methods of controlling the exposure of items in CAT. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). Amsterdam: Kluwer Academic.
26. Sympson, J. B., & Hetter, R. D. (1985, October). Controlling item exposure rates in computerized adaptive testing. Paper presented at the annual meeting of the Military Testing Association, Navy Personnel Research and Development Center, San Diego.
27. Wainer, H. (Ed.). (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Lawrence Erlbaum.
28. Wainer, H., & Eignor, D. (2000). Caveats, pitfalls, and unexpected consequences of implementing large-scale computerized testing. In H. Wainer (Ed.), Computerized adaptive testing: A primer (2nd ed., pp. 271-299). Mahwah, NJ: Lawrence Erlbaum.
29. Way, W. D. (1998). Protecting the integrity of computerized testing item pools. Educational Measurement: Issues and Practice, 17(4), 17-27.
30. Yi, Q., & Chang, H. H. (2000). Multiple stratification CAT designs with content control. Unpublished manuscript.