A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005

Journal of Technology, Learning, and Assessment

Volumn 5, Issue 8, 2007, Pages

  Georgiadou, Elissavet ^a   Triantafillou, Evangelos ^b   Economides, Anastasios A ^c  

^a Hellenic Openn University   (Greece)

^b ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^c UNIVERSITY OF MACEDONIA   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34248334584     PISSN: None     EISSN: 15402525     Source Type: Journal    
DOI: None     Document Type: Review

References (60)

1. Armstrong, R. & Edmonds, J. (2004, April). A study of multiple stage adaptive test designs. Paper presented at the annual meeting of National Council of Measurement in Education, (NCME), San Diego, CA.
2. Armstrong, R. & Little, J. (2003, April). The assembly of multiple form structures. Paper presented at the 2003 annual meeting of National Council of Measurement in Education, (NCME), Chicago, IL.
3. Boyd, A.M. (2003). Strategies for controlling testlet exposure rates in computerized adaptive testing systems. Unpublished PhD Thesis, The University of Texas at Austin.
4. Chang, H.H. & Ying, Z. (1999). α-Stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23(3), 211-222.
5. Chang, H.H., Qian, J. & Ying, Z. (2001). a-Stratified multistage computerized adaptive testing with b-blocking. Applied Psychological Measurement, 25(4), 333-341.
6. Chang, H.H. & van der Linden, W. J. (2003). Optimal stratification of item pools in a-stratified computerized adaptive testing. Applied Psychological Measurement, 27(4), 262-274.
7. Chang, S.W., Ansley, T.N. & Lin, S.H. (2000, April). Performance of item exposure control methods in computerised adaptive testing: Further explorations. Paper presented at the annual meeting of American Educational Research Association (AERA), New Orleans, LA
8. Chang, S.W. & Twu, B.Y. (September 1998). A comparative study of item exposure control methods in computerised adaptive testing. ACT Research Report Series, ACT-RR-98-3.
9. Chang, S.W. (1998). A comparative study of item exposure control methods in a computerized setting. Unpublished PhD Thesis, The University of Iowa, Iowa City.
10. Chang, S.W. & Harris, D. (2002, April). Redeveloping the exposure control parameters of CAT items when a pool is modified. Paper presented at the Annual Meeting of the American Educational Research Association (AERA), New Orleans.
11. Chen S.Y., Ankermann, R.D. & Spay, J.A. (1999). Exploring the relationship between item exposure rate and test overlap rate in computerised adaptive testing. ACT Research Report Series, ACT-RR-99-5.
12. Chen S.Y. & Doong S. H. (2003). Predicting item exposure parameters in computerized adaptive testing. Paper presented at the 2003 Annual Meeting of the American Educational Research Association (AERA), Chicago, IL.
13. Chen, S.Y. & Lei, RW. (2005). Controlling item exposure and test overlap in computerized adaptive testing. Applied Psychological Measurement, 29(2), 204-217.
14. Davey, T. & Parshall, C.G. (1995, April). New algorithms for item selection and exposure control with computerized adaptive testing. Paper presented at the annual meeting of the American Educational Research Association (AERA), San Francisco, CA.
15. Davey, T. & Nering, M. (2002). Controlling item exposure and maintaining item security. In C.N. Mills, M.T. Potenza, & J. J. Fremer (Eds.), Computer-Eased Testing: Building the Foundation for Future Assessments, (pp. 165-191). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
16. Davis, L. & Dodd, B. (2003). Item exposure constraints for testlets in the verbal reasoning section of the MCAT. Applied Psychological Measurement, 27(3), 335-356.
17. Davis, L. & Dodd, B. (March 2005). Strategies for controlling item exposure in computerized adaptive testing with the partial credit model. Pearson Educational Measurement Research Report 05-01.
18. Davis, L.L. (2002). Strategies for controlling item exposure in computerized adaptive testing with polytomously scored items. Unpublished PhD Thesis, University of Texas at Austin.
19. Davis, L.L. (2004). Strategies for controlling item exposure in computerized adaptive testing with the generalized partial credit model. Applied Psychological Measurement, 28(3), 165-185.
20. Deng, H. & Chang, H.H. (2001). a-Stratified computerized adaptive testing with unequal item exposure across strata. Paper presented at the annual meeting of the American Educational Research Association (AERA), Seattle WA.
21. Eggen, T. J.H.M. (2001). Overexposure and underexposure of items in computerized adaptive testing. Measurement and Research Department Reports 2001-1, Arnhem, The Netherlands: CITO Groep.
22. nd ed.) (pp. 37-59). Mahwah, NH: Lawrence Erlbaum Associates.
23. French, B. & Thompson T. (April, 2003). The evaluation of exposure control procedures for an operational CAT. Poster presented at the annual meeting of the American Educational Research Association (AERA), Chicago, IL.
24. Green, B., Bock, R., Humphreys, L., Linn, R. & Reckase, M. (1984). Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement, 21, 347-360.
25. Grolund, N.E. (1998). Assessment of student achievement, Sixth Edition. Needham Heights, MA: Allyn & Bacon.
26. Han, N. & Hambleton, R. (2004, April). Detecting exposed test items in computer-based testing. Paper presented at the meeting of the National Council of Measurement in Education (NCME), San Diego.
27. Kingsbury, G.G., & Zara, A.R. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education, 2(4), 359-375.
28. Lee, Y.H., Ip, E.H. & Fuh, C.D. (2002). A strategy for controlling item exposure in multidimensional computerized adaptive testing. Retrieved May, 05, 2005, from http://www3.stat.sinica.edu.tw/library/c_tec_ rep/c-2002-11.pdf
29. Leung, C.K., Chang, H.H. & Hau, K.T. (2002, December). Item selection in computerized adaptive testing: Improving the a-Stratified design with the Sympson-Hetter algorithm. Applied Psychological Measurement, 26(4), 376-392.
30. Linacre, J.M. (2000). Computer-adaptive testing: a methodology whose time has come. MESA Memorandum No. 69. In S. Chae, U. Kang, E. Jeon & J. M. Linacre (Eds.), Development of computerised middle school achievement test (translation from Korean). Seoul, South Korea: Komesa Press.
31. Luecht, R.M. (2003, April). Exposure control using adaptive multi-stage item bundles. Paper presented at the Annual meeting of the National Council on Measurement in Education (NCME), Chicago, IL.
32. Luecht, R.M., Nungester, R.J. & Hadadi, A. (1996, April). Heuristics based CAT: Balancing item information, content, and exposure. Paper presented at the annual meeting of the National Council on Measurement in Education (NCME), New York.
33. Luecht, R.M. & Nungester, R.J. (1998). Some practical examples of computer-adaptive sequential testing. Journal of Educational Measurement, 35(3), 229-249.
34. Luecht, R.M. & Nungester, R.J. (2000). Computer-adaptive sequential testing. In W. J. van der Linden (Ed.), Computerized Adaptive Testing: Theory and Practice, (pp. 289-309). Dordrecht, The Netherlands: Kluwer.
35. Lunz, M.E. & Stahl, J.A. (1998). Patterns of item exposure using a randomized CAT algorithm. Paper presented at the annual meeting of the National Council on Measurement in Education (NCME), San Diego, CA.
36. McBride, J.R. & Martin, J.T. (1983). Reliability and validity of adaptive ability tests in a military setting In D. J. Weiss (Ed.), New horizons in testing: Latent trait test theory and computerized adaptive testing, (pp. 224-236). New York: Academic Press.
37. Nering, M.L., Davey, T. & Thompson, T. (1998, June). A hybrid method for controlling item exposure in computerized adaptive testing. Paper presented at the annual meeting of the Psychometric Society. Urbana, IL.
38. Parshall, C., Davey, T. & Nering, M.L. (1998, April). Test development exposure control for adaptive testing. Paper presented at the annual meeting of the National Council of Measurement in Education (NCME), San-Diego, CA.
39. Parshall, C., Harmes, J.C., & Kromrey, J.D. (2000). Item exposure control in computer-adaptive testing: The use of freezing to augment stratification. Florida Journal of Educational Research, 40(1), 28-52.
40. Pastor, D.A., Dodd, B. & Chang H.H. (2002). A comparison of item selection techniques and exposure control mechanisms in cats using the generalized partial credit model. Applied Psychological Measurement, 26(2), 147-163.
41. Revuelta, J. & Ponsoda, V. (1998). A comparison of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 35(4) 311-327.
42. Segall, D.O. (1994). CAT-GATB simulation studies. San Diego, CA: Navy Personnel Research and Development Centre.
43. Stocking, M.L. (1993). Controlling item exposure rates in a realistic adaptive testing paradigm. Technical Report RR 3-2. Princeton, NJ: Educational Testing Service.
44. Stocking, M.L. & Lewis, C. (1995a). A new method of controlling item exposure in computerized adaptive testing. Research Report 95-25. Princeton, NJ: Educational Testing Service.
45. Stocking, M.L. & Lewis, C. (1995b). Controlling item exposure conditional on ability in computerized adaptive testing. Educational Testing Service Research Report 95-24, Princeton, NJ.
46. Stocking, M.L. & Lewis, C. (2000). Methods of controlling the exposure of items in CAT. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice, (pp. 163-182). Norwell MA: Kluwer.
47. th annual meeting of the Military Testing Association, (pp. 973-977). San Diego CA: Navy Personnel Research and Development Centre.
48. Thomasson, G.L. (1995). New item exposure control algorithms for computerized adaptive testing. Paper presented at the annual meeting of the Psychometric Society, Minneapolis.
49. Thissen, D. & Mislevy, R.J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: A primer, (pp. 101-133). Hillsdale NJ: Erlbaum.
50. Thompson, T. (2002, April). Employing new ideas in CAT to a simulated reading test. Paper presented at the Annual Meeting of the National Council on Measurement in Education (NCME), New Orleans, LA.
51. van der Linden, W.J. & Veldkamp, B.P. (2005, December). Constraining item exposure in computerized adaptive testing with shadow tests. Law School Admission Council Computerized Testing Report 02-03.
52. van der Linden, W.J. & Chang, H.H. (2005, August). Implementing content constraints in alpha-stratified adaptive testing using a shadow test approach. Law School Admission Council, Computerized Testing Report 01-09.
53. van der Linden, W.J. (2000). Constrained adaptive testing with shadow tests. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice, (pp. 27-52). Norwell MA: Kluwer.
54. Wainer, H. (2000). Computerized adaptive testing: A primer (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
55. Way, W.D. (1998). Protecting the integrity of computerized testing item pools. Educational Measurement: Issues and Practice, 17(4), 17-27.
56. Wise, S.L. (1997, March). Overview of practical issues in a CAT program. Paper presented at the annual meeting of the National Council on Measurement in Education (NCME), Chicago, IL.
57. Yi, Q. (2002, April). Incorporating the Sympson-Hetter exposure control method into the a-stratified method with content blocking. Paper Presented at the Annual Meeting of the American Educational Research Association (AERA), New Orleans, LA.
58. Yi, Q. & Chang, H. (2001, June). a-Stratified computerized adaptive testing with content blocking. Paper presented at the Annual Meeting of the Psychometric Society, King of Prussia, PA.
59. Yi, Q., Zhang, J. & Chang, H. (2005, April). Identifying practical indices for enhancing item pool security. Paper presented at the annual meeting of the National Council on Measurement in Education (NCME), Montreal, Canada.
60. Yi, Q., Zhang, J. & Chang, H. (2006). Assessing CAT Test Security Seventy. Applied Psychological Measurement, 30(1), 62-63.