Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests1

Annals of Statistics

Volumn 37, Issue 3, 2009, Pages 1466-1488

  Chang, Hua Hua ^a   Ying, Zhiliang ^a,b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Asymptotic normality; Computerized adaptive testing; Consistency; Fisher information; Item response theory; Local convergence; Logistic models; Martingale; Maximum likelihood recursion; Rasch model; Sequential design

Indexed keywords

EID: 68649098057     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/08-AOS614     Document Type: Article

References (24)

1. CHANG, H. and STOUT, W. F. (1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika 58 37-52. MR1222630
2. CHANG, H. and YING, Z. (1996). A global information approach to computerized adaptive testing. Appl. Psychol. Meas. 20 213-229.
3. CHANG, H. and YING, Z. (1999). a-stratified multistage computerized adaptive testing. Appl. Psychol. Meas. 23 211-222.
4. CHANG, H., QIAN, J. and YING, Z. (2001). a-stratified multistage CAT with b-blocking. Appl. Psychol. Meas. 25 333-341. MR1863509
5. CHENG, Y., CHANG, H. and YI, Q. (2007). Two-phase item selection procedure for flexible content balancing in CAT. Appl. Psychol. Meas. 31 467-482.
6. CHOW, Y. S. (1965). Local convergence of martingales and the law of large numbers. Ann. Math. Statist. 36 552-558. MR0182040
7. CHOW, Y. S. and TEICHER, H. (1988). Probability Theory, 2nd ed. Springer, New York. MR0953964
8. HAMBLETON, R. and SWAMINATHAN, H. (1985). Item Response Theory: Principles and Applications. Kluwer Nijhoff, Boston.
9. LORD, M. F. (1971). Robbins-Monro procedures fora testing. Educ. Psychol. Meas. 31 3-31.
10. LORD, M. F. (1980). Applications of Item Response Theory to Practical Testing Problems. Erlbaum, Hillsdale, NJ.
11. MISLEVY, R. and CHANG, H. (2000). Does adaptive testing violate local independence? Psychometrika 65 149-165. MR1763517
12. MISLEVY, R. and WU, P. K. (1996). Missing responses and Baysian IRT ability estimation: Omits, choice, time limits, and adaptive testing. Research Report RR-96-30-ONR. Educational Testing Service, Princeton, NJ.
13. OWEN, Z. J. (1975). A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. J. Amer. Statist. Assoc. 70 351-356. MR0381185
14. POLLARD, D. (1984). Convergence of Stochastic Processes. Springer, New York. MR0762984
15. RASCH, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. The Danish Institute of Educational Research, Copenhagen. Expanded edition. Univ. Chicago Press, Chicago (1980).
16. ROBBINS, H. and MONRO, S. (1951). A stochastic approximation method. Ann. Math. Statist. 22400-407. MR0042668
17. SAMEJIMA, F. (1973). A comment on Birnbaum's three-parameter logistic model in the latent trait theory. Psychometrika 38 221-233.
18. VAN DER LINDEN, W. J. (1998). Bayesian item-selection criteria for adaptive testing. Psychometrika 63 201-216. MR1626371
19. VAN DER LINDEN, W. J. and CHANG, H. (2003). Implementing content constraints in alphastratified adaptive testing using a shadow test approach. Appl. Psychol. Meas. 27 107-120. MR1973749
20. WAINER, H. (2000). Computerized Adaptive Testing: A Primer, 2nd ed. Erlbaum, Hillsdale, NJ.
21. WEISS, D. J. (1976). Adaptive testing research in Minnesota: Overview, recent results, and future directions. In Proceedings of the First Conference on Computerized Adaptive Testing (C. L. Clark, ed.) 24-35. United States Civil Service Commission, Washington, DC.
22. WU, C. F. J. (1985). Efficient sequential designs with binary data. J. Amer. Statist. Assoc. 80 974-984. MR0819603
23. YI, Q. and CHANG, H. (2003). a-stratified multistage CAT design with content-blocking. British J. Math. Statist. Psych. 56 359-378. MR2101774
24. YING, Z. and WU, C. F. J. (1997). An asymptotic theory of sequential designs based on maximum likelihood recursions. Statist. Sinica 7 75-91. MR1441145