Evaluating scoring procedures for context-dependent item sets

Applied Measurement in Education

Volumn 16, Issue 3, 2003, Pages 207-222

  Keller, Lisa A ^a   Swaminathan, Hariharan ^b   Sireci, Stephen G ^a  

^a UNIVERSITY OF MASSACHUSETTS   (United States)

^b University of Massachusetts ^*

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0042575123     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1603_3     Document Type: Review

References (27)

1. Anastasi, A. (1961). Multiple choice items for psychological testing (2nd ed.). New York: Macmillan.
2. Bradlow, E. T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64(2), 153-168.
3. Chen, W., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22(3), 265-289.
4. Du, Z. (1998). Modeling conditional item dependencies with a three-parameter logistic testlet model, Unpublished doctoral dissertation, Columbia University.
5. Egan, K. L., Sireci, S. G., Swaminathan, H., & Sweeney, K. (1998, April). Effect of item bundling on the assessment of test dimensionality. Paper presented at the annual meeting of the National Council on Measurement in Education, San Diego, CA.
6. Ferrara, S., Huynh, H., & Baghi, H. (1997). Contextual characteristics of locally dependent open-ended item clusters on a large-scale performance assessment. Applied Measurement in Education, 12, 123-144.
7. Ferrara, S., Huynh, H., & Michaels, H. (1999). Contextual explanations of local dependence in item clusters in a large-scale hands-on science performance assessment. Journal of Educational Measurement, 36, 119-140.
8. Fitzgerald, C. T. (1998, August). Test adaptation in a large-scale certification program: Challenges, processes, and lessons learned. Paper presented at the annual meeting of the American Psychological Association, San Francisco.
9. Guilford, J. P. (1936). Psychometric Methods. New York: McGraw-Hill.
10. Lee, G. (2000). A comparison of methods for estimating conditional standard errors of measurement for testlet-based scores. Journal of Educational Measurement, 37, 91-112.
11. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
12. Pitoniak, M. J., Sireci, S. G., & Luecht, R. M. (2002). A multitrait-multimethod validity investigation of scores from a professional licensure exam. Educational and Psychological Measurement, 62, 498-516.
13. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika, Monograph Supplement No. 17.
14. Samejima, F. (1995). Acceleration model in the heterogeneous case of the graded response model. Psychometrika. 60, 549-572.
15. Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 25, 15-29.
16. Thissen, D. (1991). MULTILOG 6.3 [Computer program]. Mooresville, IN: Scientific Software.
17. Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical-response models. Journal of Educational Measurement 26, 247-260.
18. Thorndike, R. L. (Ed.). (1951). Educational Measurement. Washington, DC: American Council on Education.
19. Tuerlinckx, F., & De Boeck, P. (2001). The effect of ignoring item interactions on the estimated discrimination parameters in item response theory. Psychological Methods, 6, 181-195.
20. Wainer, H. (1995). Precision and differential item functioning on a testlet-based test: The 1991 Law School Admissions Test as an example. Applied Measurement in Education, 8(2), 157-186.
21. Wainer, H., Bradlow, E. T., & Du, Z. (1999). Testlet response theory: An analog for the 3-PL. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerize adaptive testing: Theory and practice. Boston: Kluwer-Nijhoff.
22. Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized-adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
23. Wainer, H., & Wang, X. (2000). Using a new statistical model for testlets to score TOEFL. Journal of Educational Measurement, 37, 203-220.
24. Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125-145.
25. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30(3), 187-213.
26. Zenisky, A. L., Hambleton, R. K., & Sireci, S. G. (2002). Identification and evaluation of local item dependencies in the Medical College Admissions Test. Journal of Educational Measurement, 39, 1-16.
27. Zenisky, A. L., & Sireci, S. G. (in press). Technological innovations in large-scale assessment. Applied Measurement in Education, 15, 337-362.