A multidimensional item response modeling approach for improving subscale proficiency estimation and classification

Applied Psychological Measurement

Volumn 31, Issue 2, 2007, Pages 83-105

  Yao, Lihua ^a   Boughton, Keith A ^a  

^a CTB MCGRAW HILL   (United States)

Author keywords

Bayesian estimation; Domain score; MCMC; Multidimensional item response theory (MIRT); OPI; Subscale scores

Indexed keywords

EID: 33846998326     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621606291559     Document Type: Article

References (29)

1. Ackerman, T. A. (1994a). Creating a test information profile in a two-dimensional latent space. Applied Psychological Measurement, 18, 257-275.
2. Ackerman, T. A. (1994b). Using multidimensional item response theory to understand what items and tests are measuring. Applied Measurement in Education, 20, 309-310.
3. Ackerman, T. A., & Davey, T. C. (1991, April). Concurrent adaptive measurement of multiple abilities. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
4. Béguin, A. A., & Glas, C. A. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541-561.
5. Be Bock, R. D., Thissen, D., & Zimowski, M. F. (1997). IRT estimation of domain scores. Journal of Educational Measurement, 34, 197-211.
6. Boughton, K. A., Yao, L., & Lewis, D. (2006, April). Reporting diagnostic subscale scores for tests composed of complex structure. In K. A. Boughton & L. Yao (Organizers). Improving diagnostic subscore estimation and classification. Symposium presented at the annual meeting of the National Council on Measurement in Education, San Francisco.
7. Davey, T., & Hirsh, T. M. (1991, April). Examinee discrimination as measurement properties of multidimensional tests. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
8. Fraser, C. H. (1987). NOHARM: An IBM PC computer program for fitting both unidimensional and multidimensional normal ogive models for latent trait theory [Computer program]. Armidale, New South Wales, Australia: Center for Behavioral Studies, the University of New England.
9. Kahraman, N., & Kamata, A. (2004). Increasing the precisions of subscale scores by using out-of-scale information. Applied Psychological Measurement, 28, 407-426.
10. Lane, S. (2005, April). Status and future directions for performance assessments in education. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
11. Muraki, E. (1999). POLYFACT Version 2 [Computer program]. Princeton, NJ: Educational Testing Service.
12. Patz, R. J., & Junker, B. W. (1999a). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342-346.
13. Patz, R. J., & Junker, B. W. (1999b). A straightforward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178.
14. Reckase, M. D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9, 401-412.
15. Reckase, M. D. (1997). The past and future of multidimensional item response theory. Applied Psychological Measurement, 21, 25-36.
16. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Applied Psychological Measurement, 7, 201-210.
17. Wainer, H., Vevea, J. L., Camacho, F., Reeve, B. B., Rosa, K., Nelson, L., et al. (2001). Augmented scores: "Borrowing Strength" to compute scores based on small numbers of items. In D. Thissen & H. Wainer (Eds.), Test scoring (pp. 343-387). Mahwah, NJ: Lawrence Erlbaum.
18. Walker, C. M., & Beretvas, S. N. (2003). Comparing multidimensional and unidimensional proficiency classifications: Multidimensional IRT as a diagnostic aid. Journal of Educational Measurement, 40, 255-275.
19. Waller, N. (2002). MicroFACT: A microcomputer factor analysis program for ordered polytomous data and mainframe size problems. St. Paul, MN: Assessment Systems Corporation.
20. Wang, W., Chen, P., & Cheng, Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116-136.
21. Wilson, D., Wood, R., & Gibbons, R. D. (1987). TESTFACT: Test scoring, item statistics, and item factor analysis [Computer program]. Moor-esville, IN: Scientific Software.
22. Yao, L. (2003). BMIRT: Bayesian multivariate item response theory [Computer software]. Monterey, CA: CTB/McGraw-Hill.
23. Yao, L. (2004a). Bayesian multivariate item response theory and BMIRT software. 2004 Proceedings of the American Statistical Association, Statistical Computing Section [CD-ROM]. Alexandria, VA: American Statistical Association.
24. Yao, L. (2004b). LinkMIRT: Linking of multivariate item response models [Computer software]. Monterey, CA: CTB/McGraw-Hill.
25. Yao, L. (2005). An investigation of scaling options in estimating parameters for multidimensional item response theory model. Manuscript submitted for publication.
26. Yao, L., & Boughton, K. A. (2005a). Multidimensional linking for test with mixed item type. Manuscript submitted for publication.
27. Yao, L., & Boughton, K. A. (2005b). Multidimensional parameter recovery from BMIRT and NOHARM. Manuscript submitted for publication.
28. Yao, L., & Schwarz R. (2006). A multidimensional partial credit model with associated item and test statistics: An application to mixed format tests. Applied Psychological Measurement 30, 469-492.
29. Yen, W. M. (1987, April). A Bayesian/IRT index of objective performance. Paper presented at the annual meeting of the Psychometric Society, June, Montreal, Québec, Canada.