Computerized Adaptive Testing

Technology-Enhanced Assessment of Talent

Volumn , Issue , 2011, Pages 153-189

  McCloy, Rodney A ^a   Gibby, Robert E ^b  

^a HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

^b PROCTER AND GAMBLE COMPANY   (United States)

Author keywords

Candidate preparation; Computerized adaptive tests; Physical test delivery; Test security; Unproctored internet testing

Indexed keywords

EID: 84886200713     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781118256022.ch5     Document Type: Chapter

References (47)

1. Allen, M.J., & Yen, W.M. (2002). Introduction to measurement theory. Long Grove, IL: Waveland Press.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: Author.
3. Bartram, D. (2009). The International Test Commission guidelines on computer-based and internet-delivered testing. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 11-13.
4. Carroll, J.B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
5. Chang, S.H., & Ansley, T. (2003). A comparative study of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 40, 1, 71-103.
6. Cizek, G.J. (1999). Cheating on tests: How to do it, detect it, and prevent it (pp. 90-126). Mahwah, NJ: Lawrence Erlbaum Associates.
7. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York: Harcourt Brace Jovanovich.
8. De Ayala, R.J. (2009). Theory and practice of item response theory. New York: Guilford.
9. Drasgow, F., & Olson-Buchanan, J.B. (Eds.). (1999). Innovations in computerized assessment. Mahwah, NJ: Lawrence Erlbaum Associates. Equal.
10. Employment Opportunity Commission. (1978). Uniform guidelines on employee selection procedures. Federal Register, 43(166), 38295-38309.
11. Dwight, S.A., & Donovan, J.J. (2003). Do warnings not to fake reduce faking? Human Performance, 16(1), 1-23.
12. Educational Testing Service. (1993). The GRE computer adaptive testing program (CAT): Integrating convenience, assessment, and technology. Princeton, NJ: Educational Testing Service.
13. Embretson, S.E., & Reise, S.P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates.
14. Georgiadou, E., Triantafillou, E., & Economides, A.A. (2007). A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005. Journal of Technology, Learning, and Assessment, 5(8).
15. Gibby, R.E., Ispas, D., McCloy, R.A., & Biga, A. (2009). Moving beyond the challenges to make unproctored internet testing a reality. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 64-68.
16. Green, B.F. (1983). The promise of tailored tests. In H. Wainer & S. Messick (Eds.), Principals of modern psychological measurement (pp. 69-80). Mahwah, NJ: Lawrence Erlbaum Associates.
17. Hambleton, R.K., Swaminathan, H., & Rogers, H.J. (1991). Fundamentals of item response theory. Thousand Oaks, CA: Sage.
18. Hetter, R.D., & Sympson, J.B. (1997). Item exposure control in CATASVAB. In W.A. Sands, B.K. Waters, & J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 141-144). Washington, DC: American Psychological Association.
19. International Test Commission. (2006). International guidelines on computer-based and Internet-delivered testing. International Journal of Testing, 6, 143-172.
20. Kerkvliet, J.R., & Sigmund, C. (1999). Can we control cheating in the classroom? Journal of Economic Education, 30(4), 331-343.
21. Lord, F.M., (1980). Applications of item response theory to practical testing problems. Mahwah, NJ: Lawrence Erlbaum Associates.
22. Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Wesley.
23. McBride, J.R. (1997). Research antecedents of applied adaptive testing. In W.A. Sands, B.K. Waters, & J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 47-57). Washington, DC: American Psychological Association.
24. McFarland, L.A. (2003). Warning against faking on a personality test: Effects on applicant reactions and personality test scores. International Journal of Selection and Assessment, 11(4), 265-276.
25. Meijer, R.R., & Nering, M.L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23, 187-194.
26. Moreno, K.E., & Segall, D.O. (1997). Reliability and construct validity of CAT-ASVAB. In W.A. Sands, B.K. Waters, & J.R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 169-174). Washington, DC: American Psychological Association.
27. Moreno, K.E., Wetzel, C.D., McBride, J.R., & Weiss, D.J. (1984). Relationship between corresponding Armed Services Vocational Aptitude Battery (ASVAB) and computerized adaptive testing (CAT) subtests. Applied Psychological Measurement, 8, 155-163.
28. Pastor, D.A., Dodd, B.G., & Chang, H.H. (2002). A comparison of item selection techniques and exposure control mechanisms in CATs using the generalized partial credit model. Applied Psychological Measurement, 26, 147-163.
29. Pearlman, K. (2009). Unproctored internet testing: Practical, legal, and ethical concerns. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 14-19.
30. Pommerich, M., Segall, D.O., & Moreno, K.E. (2009). The nine lives of CAT-ASVAB: Innovations and revelations. In D.J. Weiss (Ed.), Proceedings of the 2009 GMAC conference on computerized adaptive testing. Retrieved June 26, 2010, from www.psych.umn.edu/psylabs/CATCentral/
31. Sands, W.A., Waters, B.K., & McBride, J.R. (Eds.). (1997). Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association.
32. Segall, D.O. (2001, April). Measuring test compromise in high-stakes computerized adaptive testing: A verification testing approach. Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, Washington.
33. Segall, D.O. (2002). An item response model for characterizing test compromise. Journal of Educational and Behavioral Statistics, 27(2), 163-179.
34. Segall, D.O. (2003, April). An adaptive exposure control algorithm for computerized adaptive testing using a sharing item response theory model. Paper presented at the Annual meeting of the National Council on Measurement in Education, Chicago, Illinois.
35. Segall, D.O., & Moreno, K.E. (1999). Development of the CAT-ASVAB. In F. Drasgow & J.B. Olson-Buchanan (Eds.), Innovations in computerized assessment (pp. 35-65). Mahwah, NJ: Lawrence Erlbaum Associates.
36. Society for Industrial and Organizational Psychology. (2003). Principles for the validation and use of personnel selection procedures (4th ed.). Bowling Green, OH: Author.
37. Tippins, N.T. (2009). Internet alternatives to traditional proctored testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 2-10.
38. Tippins, N.T., Beaty, J., Drasgow, F., Gibson, W.M., Pearlman, K., Segall, D.O., & Shepherd, W. (2006). Unproctored internet testing in employment settings. Personnel Psychology, 59(1), 189-225.
39. Van der Linden, W.J., & Glas, C.A. W. (Eds.). (2000). Computerized adaptive testing: Theory and practice. Norwell, MA: Kluwer.
40. Van der Linden, W.J., & Hambleton, R.K. (Eds.). (1997). Handbook of modern item response theory. New York: Springer.
41. Verschoor, A.J., & Straetmans, G.J.J.M. (2010). MATHCAT: A flexible testing system in mathematics education for adults. In W.J. Van der Linden & C.A. W. Glas (Eds.), Elements of adaptive testing (pp. 137-149), New York: Springer.
42. Wainer, H. (1990). Computerized adaptive testing: A primer. Mahwah, NJ: Lawrence Erlbaum Associates.
43. Weiss, D.J. (1974). Strategies of adaptive ability measurement (Research Report No. 74-5). Minneapolis: University of Minnesota, Department of Psychology, Psychometric Models Program.
44. Weiss, D.J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, 473-492.
45. Weiss, D.J. (1983). New horizons in testing: Latent trait test theory and computerized adaptive testing. New York: Academic Press.
46. Weiss, D.J. (1985). Adaptive testing by computer. Journal of Consulting and Clinical Psychology, 53, 774-789.
47. Zickar, M.J., Overton, R.C., Taylor, L.R., & Harms, H.J. (1999). The development of a computerized adaptive selection system for computer programmers in a financial services company. In F. Drasgow & J. Olson-Buchanan (Eds.), Innovations in computerized assessment (pp. 7-33). Mahwah, NJ: Lawrence Erlbaum Associates.