Multidimensional rasch analysis of a psychological test with multiple subtests: A statistical solution for the bandwidthg-fidelity dilemma

Educational and Psychological Measurement

Volumn 69, Issue 3, 2009, Pages 369-388

  Cheng, Ying Yao ^a   Wang, Wen Chung ^b   Ho, Yi Hui ^a  

^a NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

^b THE EDUCATION UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Bandwidthg fidelity dilemma; Item response theory; Multidimensional item response model; Rasch measurement; Thinking style

Indexed keywords

EID: 65649140131     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164408323241     Document Type: Article

References (35)

1. Adams, R.J., Wilson, M., & Wang, W.-C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23. (Pubitemid 127045375)
2. Adams, R.J., Wilson, M.R., & Wu, M.L. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22, 47-76. (Pubitemid 127075108)
3. Andersen, E.B., & Madsen, M. (1977). Estimating the parameters of the latent population distribution. Psychometrika, 42, 357-374.
4. Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
5. Bock, R.D., & Mislevy, R.J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444.
6. Bock, R.D., Thissen, D., & Zimowski, M.F. (1997). IRT estimation of domain scores. Journal of Educational Measurement, 34, 197-211. (Pubitemid 127172996)
7. Camilli, G. (1988). Scale shrinkage and the estimation of latent distribution parameters. Journal of Educational Statistics, 13, 227-241.
8. Cronbach, L.J., & Gleser, G. (1965). Psychological tests and personnel decision (2 nd ed.). Urbana: University of Illinois Press.
9. Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum.
10. Kahraman, N., & Kamata, A. (2004). Increasing the precision of subscale scores by using out-of-scale information. Applied Psychological Measurement, 28, 407-426. (Pubitemid 39499100)
11. Kelderman, H. (1996). Multidimensional Rasch models for partial-credit scoring. Applied Psychological Measurement, 20, 155-168. (Pubitemid 126332633)
12. Masters, G.N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
13. Mislevy, R.J. (1984). Estimating latent distributions. Psychometrika, 49, 359-381.
14. Mislevy, R.J. (1987). Exploiting auxiliary information about examinees in the estimation of item parameters. Applied Psychological Measurement, 11, 81-91.
15. Organization for Economic Co-operation and Development. (2005). The PISA 2003 technical report. Paris: Author.
16. Ones, D.S., & Viswesvaran, C. (1996). Bandwidth-fidelity dilemma in personality measurement for personnel selection. Journal of Organizational Behavior, 17, 609-626. (Pubitemid 127000935)
17. Ormel, J., Oldehinkel, T., Brilman, E., & Van den Brink, W. (1993). Outcome of depression and anxiety in primary care: A three wave, 2 1/2 year study of psychopathology and disability. Archives of General Psychiatry, 50, 759-766. (Pubitemid 23303097)
18. Pommerich, M., Nicewander, W.A., & Hanson, B. (1999). Estimating average domain scores. Journal of Educational Measurement, 36, 199-216.
19. Rabe-Hesketh, S., & Skrondal, A. (2005). Multilevel and longitudinal modeling using Stata. College Station, TX: Stata Press.
20. Rost, J., & Carstensen, C.H. (2002). Multidimensional Rasch measurement via item component models and faceted designs. Applied Psychological Measurement, 26, 42-56. (Pubitemid 36657139)
21. SAS Institute. (1999). The NLMIXED procedure [Computer software]. Cary, NC: Author.
22. Segall, D.O. (1996). Multidimensional adaptive testing. Psychometrika, 61, 331-354. (Pubitemid 126107846)
23. Sternberg, R.J. (1988). Mental self-government: A theory of intellectual styles and their development. Human Development, 31, 197-224.
24. Sternberg, R.J., & Wagner, R.K. (1992). The Thinking Styles Inventory. Unpublished manuscript, Yale University, New Haven, CT.
25. Wainer, H., Sheehan, M., & Wang, X. (2000). Some paths toward making praxis scores more useful. Journal of Educational Measurement, 37, 113-140. (Pubitemid 33357811)
26. Wang, W.-C. (2004). Effects of anchor item methods on the detection of differential item functioning within the family of Rasch models. Journal of Experimental Education, 72, 221-261. (Pubitemid 38614853)
27. Wang, W.-C., & Chen, P.-H. (2004). Implementation and measurement efficiency of multidimensional computerized adaptive testing. Applied Psychological Measurement, 28, 295-316. (Pubitemid 39203063)
28. Wang, W.-C., Chen, P.-H., & Cheng, Y.-Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116-136. (Pubitemid 38516440)
29. Wang, W.-C., & Yeh, Y.-L. (2003). Effects of anchor item methods on differential item functioning detection with the likelihood ratio test. Applied Psychological Measurement, 27, 479-498. (Pubitemid 37514205)
30. Wang, W.-C., Wilson, M., & Adams, R.J. (1997). Rasch models for multidimensionality between and within items. In, M. Wilson, G. Engelhard, & K. Draney (Eds.), Objective measurement IV: Theory into practice (pp. 139-155). Norwood, NJ: Ablex.
31. Wright, B.D., Linacre, J.M., Gustafson, J.-E., & Martin-Löf, P. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8 (3). 370.
32. Wu, M.L., Adams, R.J., & Wilson, M.R. (1998). ConQuest [Computer software and manual]. Camber-well, Victoria, Australia: Australian Council for Educational Research.
33. Yao, L., & Boughton, K.A. (2007). A multidimensional item response modeling approach for improving subscale proficiency estimation and classification. Applied Psychological Measurement, 31, 83-105.
34. Yao, L., & Schwarz R. (2006). A multidimensional partial credit model with associated item and test statistics: An application to mixed format tests. Applied Psychological Measurement, 30, 469-492.
35. Zimowski, M.F., Muraki, E., Mislevy, R.J., & Bock, R.D. (1996). BILOG-MG: Multiple-group IRT analysis and test maintenance for binary items [Computer software and manual]. Chicago: Scientific Software international.