Conceptual issues in response-time modeling

Journal of Educational Measurement

Volumn 46, Issue 3, 2009, Pages 247-272

  Van Der Linden, Wim J ^a  

^a CTB ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 69749124856     PISSN: 00220655     EISSN: 17453984     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2009.00080.x     Document Type: Article

References (49)

1. Bergstrom, B., Gershon, R., & Lunz, M. E. (1994, April). Computer-adaptive testing: Exploring examinee response time using hierarchical linear modeling. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
2. Casella, G., & Berger, L. (1990). Statistical inference. Pacific Grove, CA : Brooks/Cole.
3. Ferrando, P. J., & Lorenzo-Seva, U. (2007). An item-response model incorporating response time data in binary personality items. Applied Psychological Measurement, 31, 525 543.
4. Fox, J.-P., Klein Entink, R. H., & van der Linden, W. J. (2007). Modeling of responses and response times with the package cirt. Journal of Statistical Software, 20 (7 1 14.
5. Gaviria, J.-L. (2005). Increase in precision when estimating parameters in computer assisted testing using response times. Quality & Quantity, 39, 45 69.
6. Gulliksen, H. (1950). Theory of mental tests. New York : Wiley.
7. Hornke, L. F. (2000). Item response times in computerized adaptive testing. Psicológica, 21, 175 189.
8. Jansen, M. G. H. (1986). A Bayesian version of Rasch's multiplicative Poisson model for the number of errors on achievement tests. Journal of Educational Statistics, 11, 147 160.
9. Jansen, M. G. H. (1997a). Rasch model for speed tests and some extensions with applications to incomplete designs. Journal of Educational and Behavioral Statistics, 22, 125 140.
10. Jansen, M. G. H. (1997b). Rasch's model for reading speed with manifest exploratory variables. Psychometrika, 62, 393 409.
11. Jansen, M. G. H., & van Duijn, M. A. J. (1992). Extensions of Rasch's multiplicative Poisson model. Psychometrika, 57, 405 414.
12. Klein Entink, R. H., Fox, J.-P., & van der Linden, W. J. (2009). A multivariate multilevel approach to simultaneous modeling of accuracy and speed on test items. Psychometrika, 74, 21 48.
13. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA : Addison Wesley.
14. Luce, R. D. (1986). Response times: Their roles in inferring elementary mental organization. Oxford, UK : Oxford University Press.
15. Maris, E. (1993). Additive and multiplicative models for gamma distributed variables, and their application as psychometric models for response times. Psychometrika, 58, 445 469.
16. Masters, J. (2005, April). Comparing item response times and difficulty for calculation items. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
17. Oosterloo, S. J. (1975). Modellen voor reactie-tijden (Models for reaction times). Unpublished master's thesis, Faculty of Psychology, University of Groningen, The Netherlands.
18. Pieters, L. P. M., & van der Ven, A. H. G. S. (1982). Precision, speed, and distraction in time limit-tests. Applied Psychological Measurement, 6, 93 109.
19. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Chicago : University of Chicago Press.
20. Röhling, P. G. (2006). Effecten op responstijd bij item respons toetsen (Response-time effects with item response tests). Unpublished master's thesis, Department of Psychology, University of Amsterdam, The Netherlands.
21. Roskam, E. E. (1987). Toward a psychometric theory of intelligence. In E. E. Roskam & R. Suck (Eds. Progress in mathematical psychology (pp. 151 171). Amsterdam : North-Holland.
22. Roskam, E. E. (1997). Models for speed and time-limit tests. In W. J. van der Linden & R. K. Hambleton (Eds. Handbook of modern item response theory (pp. 187 208). New York : Springer.
23. Rouder, J. N., Sun, D., Speckman, P. L., Lu, J., & Zhou, D. (2003). A hierarchical Bayesian statistical framework for response time distributions. Psychometrika, 68, 589 606.
24. Scheiblechner, H. (1979). Specific objective stochastic latency mechanisms. Journal of Mathematical Psychology, 19, 18 38.
25. Schnipke, D. L., & Scrams, D. J. (2002). Exploring issues of examinee behavior: Insights gained from response-time analyses. In C. N. Mills, M. Potenza, J. J. Fremer & W. Ward (Eds. Computer-based testing: Building the foundation for future assessments (pp. 237 266). Hillsdale, NJ : Lawrence Erlbaum Associates.
26. Smith, R. W. (2000, April). An exploratory analysis of item parameters and characteristics that influence item response time. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
27. Swanson, D. B., Case, S. M., Ripkey, D. R., Clauser, B. E., & Holtman, M. C. (2001). Relationships among item characteristics, examinee characteristics, and response times on USMLE Step 1. Academic Medicine, 76, 114 116.
28. Swanson, D. B., Featherman, C. M., Case, S. M., Luecht, R. M., & Nungester, R. (1999, March). Relationship of response latency to test design, examinee proficiency and item difficulty in computer-based test administration. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.
29. Tatsuoka, K. K., & Tatsuoka, M. M. (1980). A model for incorporating response-time data in scoring achievement tests. In D. J. Weiss (Ed. Proceedings of the 1979 Computerized Adaptive Testing Conference (pp. 236 256). Minneapolis : University of Minnesota, Department of Psychology, Psychometric Methods Program.
30. Thissen, D. (1983). Timed testing: An approach using item response theory. In D. J. Weiss (Ed. New horizons in testing: Latent trait test theory and computerized adaptive testing pp. 179 203) New York : Academic Press.
31. Thurstone, L. L. (1937). Ability, motivation, and speed. Psychometrika, 2, 249 254.
32. van der Linden, W. J. (2005). Linear models for optimal test design. New York : Springer.
33. van der Linden, W. J. (2006). A lognormal model for response times on test items. Journal of Educational and Behavioral Statistics, 31, 181 204.
34. van der Linden, W. J. (2007). A hierarchical framework for modeling speed and accuracy on test items. Psychometrika, 73, 287 308.
35. van der Linden, W. J. (2008a). Using response times for item selection in adaptive tests. Journal of Educational and Behavioral Statistics, 33, 5 20.
36. van der Linden, W. J. (2008b). A hierarchical version of Rasch's Poisson process models for oral reading tests. Manuscript in preparation.
37. van der Linden, W. J. (2009). Predictive control of speededness in adaptive testing. Applied Psychological Measurement, 33, 25 41.
38. van der Linden, W. J. (in press). A bivariate lognormal response-time model for the detection of collusion between test takers. Journal of Educational and Behavioral Statistics, 34.
39. van der Linden, W. J., Breithaupt, K., Chuah, S. C., & Zhang, Y. (2007). Detecting differential speededness in multistage testing. Journal of Educational Measurement, 44, 117 130.
40. van der Linden, W. J., & Glas, C. A. W. (in press). Statistical tests of conditional independence between responses and response times on test items. Psychometrika, 75.
41. van der Linden, W. J., & Guo, F. (2008). Bayesian procedures for identifying aberrant response-time patterns in adaptive testing. Psychometrika, 73, 365 384.
42. van der Linden, W. J., Klein Entink, R. H., & Fox, J.-P. (2008). IRT parameter estimation with response times as collateral information. Manuscript submitted for publication.
43. van der Linden, W. J., Scrams, D. J., & Schnipke, D. L. (1999). Using response-time constraints to control for speededness in computerized adaptive testing. Applied Psychological Measurement, 23, 195 210.
44. Verhelst, N. D., Verstralen, H. H. F. M., & Jansen, M. G. (1997). A logistic model for time-limit tests. In W. J. van der Linden & R. K. Hambleton (Eds. Handbook of modern item response theory (pp. 169 185). New York : Springer.
45. Wang, T., & Hanson, B. A. (2005). Development and calibration of an item response model that incorporates response time. Applied Psychological Measurement, 29, 323 339.
46. Wise, S. L., Kong, X. J., & Pastor, D. A. (2007, April). Understanding correlates of rapid-guessing behavior in low-stakes testing: Implications for test development and measurement practice. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago.
47. Woodbury, M. A. (1951). On the standard length of a test. Psychometrika, 16, 103 106.
48. Woodbury, M. A. (1963). The stochastic model of mental test theory and an application. Psychometrika, 28, 391 393.
49. Zenisky, A. L., & Baldwin, P. (2006, April). Using response time data in test development and validation: Research with beginning computer users. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco.