Development and application of detection indices for measuring guessing behaviors and test-taking effort in computerized adaptive testing

Educational and Psychological Measurement

Volumn 71, Issue 3, 2011, Pages 437-459

  Chang, Shu Ren ^a   Plake, Barbara S ^b   Kramer, Gene A ^a   Lien, Shu Mei ^b  

^a AMERICAN DENTAL ASSOCIATION   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

computerized adaptive testing; guessing behaviors; item locations; pretest items; response time; test taking effort; testing fairness

Indexed keywords

EID: 79955562719     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164410385110     Document Type: Article

References (14)

1. Bridgeman, B., & Cline, F. (2002, April). Fairness issues in computer adaptive tests with strict time limits. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
2. Bridgeman, B., & Cline, F. (2004). Effects of differentially time-consuming tests on computerized adaptive test scores. Journal of Educational Measurement, 41, 137-148.
3. Chang, S.-R. (2006). Computerized adaptive test item response times for correct and incorrect pretest and operational items: Testing fairness and test-taking strategies (Unpublished doctoral dissertation). University of Nebraska-Lincoln, Lincoln, NE.
4. Chang, S.-R., Ferdous, A., & Plake, S.B. (2005, April). Response times for correct and incorrect item responses on computerized adaptive tests. Paper presented at the annual meeting of the American Educational Research Association (AERA), Montreal, Quebec, Canada.
5. Ferdous, A., Chang, S.-R., & Plake, S.B. (2005, April). Fairness issues of including pretest items on an operational CAT test. Paper presented at the annual meeting of the American Educational Research Association (AERA), Montreal, Quebec, Canada.
6. Hornke, L.F. (2000). Item response time in computerized adaptive testing. Psychologia: Revista de Metodologia y Psycologia Experimental, 21, 175-189.
7. Schnipke, D.L. (1995, April). Assessing speededness in computer-based tests using item response times. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
8. Schnipke, D.L. (1996, April). How contaminated by guessing are item-parameter estimates and what can be done about it? Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY.
9. Schnipke, D.L. (1999). The influence of speededness on item-parameter estimation (Computerized Testing Report No. 96-07). Princeton, NJ: Law School Admission Council.
10. Schnipke, D.L., & Scrams, D.J. (1997). Modeling item response times with a two-state mixture model: A new method of measuring speededness. Journal of Educational Measurement, 34, 213-232.
11. Schnipke, D.L., & Scrams, D.J. (2002). Exploring issues of examinee behavior: Insights gained from response-time analyses. In C. N. Mills, M. T.Potenza, J. J. Fremer, & W. C. Ward (Eds.), Computer-based testing: Building the foundation for future assessments (pp. 237-266). Mahwah, NJ: Lawrence Erlbaum.
12. Wise, S.L., & Kong, X. (2005). Response time effort: A new measure of examinee motivation in computer-based tests. Applied Measurement in Education, 18, 163-183.
13. Wise, S.L., DeMars, C.E., & Kong, X.J. (2005, April). An application of item response time: The effort-moderated IRT model. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada.
14. Wise, S.L., Pastor, D.A., & Kong, X.J. (2009). Correlates of rapid-guessing behavior in low-stakes testing: Implications for test development and measurement practice. Applied Measurement in Education, 22, 185-205.