Severity of organized item theft in computerized adaptive testing: A simulation study

Applied Psychological Measurement

Volumn 32, Issue 7, 2008, Pages 543-558

  Yi, Qing ^a,d   Zhang, Jinming ^b   Chang, Hua Hua ^c  

^a Harcourt Assessment Inc

^b EDUCATIONAL TESTING SERVICE   (United States)

^c UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^d Harcourt Assessment Inc   (United States)

Author keywords

Computerized adaptive testing; Item selection methods; Organized item theft; Test security

Indexed keywords

EID: 51149096171     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621607311336     Document Type: Article

References (20)

1. Chang, H., Qian, J., & Ying, Z. (2001). a-Stratified multistage computerized adaptive testing with b blocking. Applied Psychological Measurement, 25, 333-341.
2. Chang, H., & Ying, Z. (1999). a-Stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23, 211-222.
3. Chang, H., & Zhang, J. (2002). Hypergeometric family and item overlap rates in computerized adaptive testing. Psychometrika, 67, 387-398.
4. Chang, H., & Zhang, J. (2003, April). Assessing CAT security breaches by the item pooling index. Paper presented at the annual meeting of National Council on Measurement in Education, Chicago, IL.
5. Chen, S., Ankenmann, R.D., & Spray, J.A. (2003). The relationship between item exposure and test overlap in computerized adaptive testing. Journal of Educational Measurement, 40, 129-145.
6. Chen, S., & Lei, P. (2005). Controlling item exposure and test overlap in computerized adaptive testing. Applied Psychological Measurement, 29, 204-217.
7. Davey, T., & Parshall, C. (1995, April). New algorithms for item selection and exposure control with computerized adaptive testing. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
8. Graduate Management Admission Council. (2007). GMAT1basics. Retrieved from http://www.gmac.com/gmac/thegmat/gmatbasics
9. Hambleton, R.K., Zaal, N.J., & Pieters, J.P. (1991). Computerized adaptive testing: Theory, application, and standard. In R. K. Hambleton & N. J. Zaal (Eds.), Advances in educational and psychological testing: Theory and application (pp. 341-366). Boston: Kluwer Academic.
10. Hetter, R., & Sympson, B. (1997). Item exposure control in CAT-ASVAB. In W. Sands, B. Waters, & J. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 141-144). Washington, DC: American Psychological Association.
11. Hulin, C.L., Drasgow, F., & Parsons, C.K. (1983). Item response theory: Application to psychological measurement. Homewood, IL: Dow Jones-Irwin.
12. Lord, F.M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
13. Mislevy, R., & Bock, R.D. (1982). BILOG: Item analysis and test scoring with binary logistic models [Computer software]. Mooresville, IN: Scientific Software International.
14. Stocking, M., & Lewis, C. (1998). Controlling item exposure conditional on ability in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 23, 57-75.
15. Sympson, J., & Hetter, R. (1985). Controlling item-exposure rates in computerized adaptive testing. In Proceedings of the 27th Annual Meeting of the Military Testing Association (pp. 973-977). San Diego, CA: Navy Personnel Research and Development Center.
16. Thomasson, G. (1995, June). New item exposure control algorithms for computerized adaptive testing. Paper presented at the annual meeting of the Psychometric Society, Minneapolis, MN.
17. van der Linden, W.J. (2003). Some alternatives to Sympson-Hetter item-exposure control in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 28, 249-265.
18. Way, W.D. (1998). Protect the integrity of computerized testing item pools. Educational Measurement: Issues and Practice, 17 (4). 17-27.
19. Yi, Q., & Chang, H. (2003). a-Stratified multistage CAT design with content-blocking. British Journal of Mathematical and Statistical Psychology, 56, 359-378.
20. Zhang, J., & Chang, H. (2005). The effectiveness of enhancing test security by using multiple item pools (ETS Research Rep. No. RR-05-19). Princeton, NJ: ETS.