Kullback-Leibler Information and Its Applications in Multi-Dimensional Adaptive Testing

Psychometrika

Volumn 76, Issue 1, 2011, Pages 13-39

  Wang, Chun ^a   Chang, Hua Hua ^a   Boughton, Keith A ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b CTB MCGRAW HILL   (United States)

Author keywords

Fisher information; Kullback Leibler information; Multi dimensional adaptive testing

Indexed keywords

EID: 79952244577     PISSN: 00333123     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11336-010-9186-0     Document Type: Article

References (47)

1. Adams, R. J., Wilson, M., & Wang, W. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21(1), 1-23.
2. Allen, D. D., Ni, P. S., & Haley, S. M. (2008). Efficiency and sensitivity of multidimensional computerized adaptive testing of pediatric physical functioning. Disability and Rehabilitation, 30(6), 479-484.
3. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 379-479). Reading: Addison-Welsey.
4. Bloxom, B. M., & Vale, C. D. (1987). Multidimensional adaptive testing: a procedure for sequential estimation of the posterior centroid and dispersion of theta. Paper presented at the meeting of the Psychometric Society, Montreal, Canada.
5. Chang, H. H. (1996). The asymptotic posterior normality of the latent trait for polytomous IRT models. Psychometrika, 61(3), 445-463.
6. Chang, H. H., Qian, J. H., & Ying, Z. L. (2001). a-stratified multistage computerized adaptive testing with b blocking. Applied Psychological Measurement, 25(4), 333-341.
7. Chang, H. H., & Stout, W. (1993). The asymptotic posterior normality of the latent trait in an IRT model. Psychometrika, 58(1), 37-52.
8. Chang, H. H., & Ying, Z. L. (1996). A global information approach to computerized adoptive testing. Applied Psychological Measurement, 20(3), 213-229.
9. Chang, H. H., & Ying, Z. L. (1999). a-stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23(3), 211-222.
10. Chang, H. H., & Ying, Z. L. (2008). To weight or not to weight? Balancing influence of initial items in adaptive testing. Psychometrika, 73(3), 441-450.
11. Chang, H. H., & Zhang, J. M. (2002). Hypergeometric family and item overlap rates in computerized adaptive testing. Psychometrika, 67(3), 387-398.
12. Cover, T., & Thomas, J. (1991). Elements of information theory. New York: Wiley.
13. Finkelman, M., Nering, M. L., & Roussos, L. A. (2009). A conditional exposure control method for multidimensional adaptive testing. Journal of Educational Measurement, 46(1), 84-103.
14. Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: principles and applications. Boston: Kluwer/Nijhoff.
15. Henson, R., & Douglas, J. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29(4), 262-277.
16. Haley, S. M., Ni, P. S., Ludlow, L. H., & Fragala-Pinkham, M. A. (2006). Measurement precision and efficiency of multidimensional computer adaptive testing of physical functioning using the pediatric evaluation of disability inventory. Archives of Physical Medicine and Rehabilitation, 87(9), 1223-1229.
17. Lehmann, E. L. (1986). Testing statistical hypotheses (2nd ed.). New York: Wiley.
18. Lehmann, E. L., & Casella, G. (1998). Theory of point estimation (2nd ed.). Berlin: Springer.
19. Lehmann, E. L. (1999). Elements of large-sample theory. New York: Springer.
20. Li, Y. H., & Schafer, W. D. (2005). Trait parameter recovery using multidimensional computerized adaptive testing in reading and mathematics. Applied Psychological Measurement, 29(1), 3-25.
21. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale: Erlbaum.
22. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading: Addison-Welsley.
23. Luecht, R. M. (1996). Multidimensional computerized adaptive testing in a certification or licensure context. Applied Psychological Measurement, 20(4), 389-404.
24. Mulder, J., & van der Linden, W. J. (2009). Multidimensional adaptive testing with optimal design criteria for item selection. Psychometrika, 74(2), 273-296.
25. Owen, R. J. (1969). A Bayesian approach to tailored testing (Research Report 69-92). Princeton, NJ: Educational Testing Service.
26. Owen, R. J. (1975). A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. Journal of the American Statistical Association, 70, 351-356.
27. Passos, V. L., Berger, M. P. F., & Tan, F. E. S. (2008). The d-optimality item selection criterion in the early stage of CAT: a study with the graded response model. Journal of Educational and Behavioral Statistics, 33(1), 88-110.
28. Reckase, M. D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9(4), 401-412.
29. Reckase, M. D. (1997). The past and future of multidimensional item response theory. Applied Psychological Measurement, 21(1), 25-36.
30. Reckase, M. D. (2009). Multidimensional item response theory. New York: Springer.
31. Reckase, M. D., & McKinley, R. L. (1991). The discrimination power of items that measure more than one dimension. Applied Psychological Measurement, 15(4), 361-373.
32. Renyi, A. (1961). On measurs of entropy and information. In Proceeding fourth Berkeley symposium on mathematical statististics and probability (Vol. 1, pp. 547-561).
33. Renyi, A. (1970). Probability theory. Amsterdam: North-Holland.
34. Segall, D. O. (1996). Multidimensional adaptive testing. Psychometrika, 61(2), 331-354.
35. Segall, D. O. (2001). General ability measurement: an application of multidimensional item response theory. Psychometrika, 66(1), 79-97.
36. Stocking, M. L. (1994). Three practical issues for modern adaptive testing item pools (Research Report 94-5). Princeton, NJ: Educational Testing Service.
37. Stroud, A. H., & Secrest, D. (1966). Gaussian quadrature formulas. Englewood Cliffs: Prentice-Hall.
38. Thissen, D., & Mislevy, R. J. (2000). Testing algorithms. In H. Wainer (Ed.), Computerized adaptive testing: a primer (pp. 101-133). Hillsdale: Erlbaum.
39. van der Linden, W. J. (1996). Assembling tests for the measurement of multiple traits. Applied Psychological Measurement, 20, 373-388.
40. van der Linden, W. J. (1998). Bayesian item selection criteria for adaptive testing.
41. van der Linden, W. J. (1999). Multidimensional adaptive testing with a minimum error-variance criterion. Journal of Educational and Behavioral Statistics, 24(4), 398-412.
42. van Rijn, P. W., Eggen, T., Hemker, B. T., & Sanders, P. F. (2002). Evaluation of selection procedures for computerized adaptive testing with polytomous items. Applied Psychological Measurement, 26(4), 393-411.
43. Veerkamp, W. J. J., & Berger, M. P. F. (1997). Some new item selection criteria for adaptive testing. Journal of Educational and Behavioral Statistics, 22(2), 203-226.
44. Veldkamp, B. P., & van Der Linden, W. J. (2002). Multidimensional adaptive testing with constraints on test content. Psychometrika, 67(4), 575-588.
45. Wang, C., & Chang, H. (2009). Kullback-Leibler information in multidimensional adaptive testing: theory and application. In D. J. Weiss (Ed.), www. psych. umn. edu/psylabs/CATCentral/.
46. Wang, C., & Chang, H. (2010). Item selection in multidimensional computerized adaptive testing-the new application of Kullback-Leibler information. Paper presented at 2010 International Meeting of Psychometric Society, Athens, Georgia.
47. Yi, Q., & Chang, H. H. (2003). alpha-Stratified CAT design with content blocking. British Journal of Mathematical & Statistical Psychology, 56, 359-378.