Estimating reliability under a generalizability theory model for test scores composed of testlets

Applied Measurement in Education

Volumn 12, Issue 3, 1999, Pages 237-255

  Lee, Guemin ^a   Frisbie, David A ^b  

^a CTB MCGRAW HILL   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0033455051     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1203_2     Document Type: Article

References (26)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1985). Standards for educational and psychological testing. Washington, DC: Author.
2. Anastasi, A. (1988). Psychological testing (6th ed.). New York: Macmillan.
3. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
4. Brennan, R. L. (1992). Elements of generalizability theory. Iowa City, IA: American College Testing.
5. Brennan, R. L. (1994). Variance components in generalizability theory. In C. R. Reynolds (Ed.), Cognitive assessment: A multidisciplinary perspective (pp. 175-207). New York: Plenum.
6. Brennan, R. L. (1998). Manual for urGENOVA (Version 1.3). (Iowa Testing Programs Occasional Paper No. 42). Iowa City: University of Iowa Press.
7. Brennan, R. L., Jarjoura, D., & Deaton, E. L. (1980). Some issues concerning the estimation and interpretation of variance components in generalizability theory (ACT Tech. Bulletin No. 36). Iowa City, IA: American College Testing.
8. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
9. Cronbach, L. J., Linn, R. L., Brennan, R. L., & Haertel, E. (1997). Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational and Psychological Measurement, 57, 373-399.
10. Cronbach, L. J., Schönemann, P., & McKie, D. (1965). Alpha coefficients for stratified-parallel tests. Educational and Psychological Measurement, 25, 291-312.
11. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). Washington, DC: American Council on Education.
12. Feldt, L. S., Forsyth, R. A., Ansley, T. N., & Alnot, S. D. (1994). Iowa Tests of Educational Development: Interpretive guide for teachers and counselors. Chicago: Riverside.
13. Frisbie, D. A., & Druva, C. A. (1986). Estimating the reliability of multiple true-false tests. Journal of Educational Measurement, 23, 99-105.
14. Hoover, H. D., Hieronymus, A.N., Frisbie, D. A., & Dunbar, S. B. (1994). Iowa Tests of Basic Skills : Interpretive guide for school administrators. Chicago: Riverside.
15. Jarjoura, D., & Brennan, R. L. (1981). Three variance components models for some measurement procedures in which unequal numbers of items fall into discrete categories (ACT Tech. Bulletin No. 37). Iowa City, IA: American College Testing.
16. Lawrence, I. M. (1995). Estimating reliability for tests composed of item sets (Research Rep. No. 95-18). Princeton, NJ: Educational Testing Service.
17. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
18. Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237-247.
19. Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical models. Journal of Educational Measurement, 26, 247-260.
20. Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement (pp. 560-620). Washington, DC: American Council on Education.
21. Wainer, H. (1995). Precision and differential item functioning on a testlet-based test: The 1991 Law School Admissions Test as an example. Applied Measurement in Education, 8, 157-186.
22. Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
23. Wainer, H., & Lewis, C. (1990). Toward a psychometrics for testlets. Journal of Educational Measurement, 27, 1-14.
24. Wainer, H., & Thissen, D. (1996). How is reliability related to the quality of test scores? What is the effect of local dependence on reliability? Educational Measurement: Issues and Practice, 75(1), 22-29.
25. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.
26. Zimmerman, D. W., Zumbo, B. D., & Lalonde, C. (1993). Coefficient alpha as an estimate of test reliability under violation of two assumptions. Educational and Psychological Measurement, 53, 33-49.