A comparison of methods of estimating conditional standard errors of measurement for testlet-based test scores using simulation techniques

Journal of Educational Measurement

Volumn 37, Issue 2, 2000, Pages 91-112

  Lee, Guemin ^a  

^a CTB MCGRAW HILL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0034196662     PISSN: 00220655     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2000.tb01078.x     Document Type: Article

References (38)

1. Agresti, A., & Coull, B. A. (1998). Approximate is better than "Exact" for interval estimation of binomial proportions. The American Statistician, 52, 119-126.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3. American Psychological Association, American Educational Research Association, & National Council on Measurement in Education (1954). Technical recommendations for psychological tests and diagnostic techniques. Psychological Bulletin, 51 (suppl.), 201-238.
4. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29-51.
5. Brennan, R. L. (1992). Elements of generalizability theory. Iowa City, IA: ACT.
6. Brennan, R. L. (1988). Raw-score conditional standard errors of measurement in generalizability theory. Applied Psychological Measurement, 22, 307-331.
7. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
8. Feldt, L. S. (1984). Some relationships between the binomial error model and classical test theory. Educational and Psychological Measurement, 44, 883-891.
9. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement. (3rd ed.). Phoenix, AZ: Oryx Press.
10. Feldt, L. S., & Qualls, A. L. (1996). Estimation of measurement error variance at specific score levels. Journal of Educational Measurement, 33, 141-156.
11. Hoover, H. D., Hieronymus, A. N., Frisbie, D. A., & Dunbar, S. B. (1994), Iowa Tests of Basic Skills: Interpretive guide for school administrators. Chicago, IL: The Riverside Publishing Company.
12. Kolen, M. J., Zeng, L., & Hanson, B. A. (1996). Conditional standard errors of measurement for scale scores using IRT. Journal of Educational Measurement, 33, 129-140.
13. Lawrence, I. M. (1995). Estimating reliability for tests composed of item sets. (RR-95-18). Princeton, NJ: ETS.
14. Lee, G. (2000). Estimating conditional standard errors of measurement for tests composed of testlets. Applied Measurement in Education, 13, 161-180.
15. Lee, G., & Frisbie, D. A. (1999). Estimating reliability under a generalizability theory model for test scores composed of testlets. Applied Measurement in Education, 12, 237-255.
16. Lee, G., Kolen, M. J., Frisbie, D. A., & Ankenmann, R. D. (in press). A comparison of the performance of dichotomous and polytomous IRT models in equating scores from tests composed of testlets. Applied Psychological Measurement.
17. Lord, F. M. (1955). Estimating test reliability. Educational and Psychological Measurement, 15, 325-336.
18. Lord, F. M. (1957). Do tests of the same length have the same standard error of measurement? Educational and Psychological Measurement, 17, 510-521.
19. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.
20. Lord, F. M., & Wingersky, M. S. (1984). Comparison of IRT true-score and equipercentile observed-score "equating." Applied Psychological Measurement, 8, 453-461.
21. Mislevy, R. J. & Bock, R. D. (1990). BILOG 3. Item analysis and test scoring with binary logistic models (2nd ed.). Mooresville, IN:Scientific Software.
22. Mollenkopf, W. G. (1949). Variation of the standard error of measurement. Psychometrika, 14, 189-229.
23. Nandakumar, R. (1991). Traditional dimensionality versus essential dimensionality. Journal of Educational Measurement, 28, 99-117.
24. Qualls-Payne, A. L. (1992). A comparison of score level estimates of the standard error of measurement. Journal of Educational Measurement, 29, 213-225.
25. Samejima, F. (1969). Estimation of a latent ability using a response pattern of graded scores. Psychometric Monograph Supplement, 17.
26. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage Publications.
27. Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237-247.
28. Thissen, D. (1991). MULTILOG Multiple categorical item analysis and test scoring using item response theory (version 6.0). Chicago, IL: Scientific Software.
29. Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical models. Journal of Educational Measurement, 26, 247-260.
30. Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement. Washington, DC: American Council on Education.
31. Wainer, H. (1995). Precision and differential item functioning on a testlet-based test: The 1991 law school admissions test as an example. Applied Measurement in Education, 8, 157-186.
32. Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
33. Wainer, H., & Lewis, C. (1990). Toward a psychometrics for testlets. Journal of Educational Measurement, 27, 1-14.
34. Wainer, H., & Thissen, D. (1996). How is reliability related to the quality of test scores? What is the effect of local dependence on reliability? Educational Measurement: Issues and Practice, 15, 22-29.
35. Wainer, H., Sireci, S. G., & Thissen, D. (1991). Differential testlet functioning: Definition and detecting. Journal of Educational Measurement, 28, 197-219.
36. Wang, T., Kolen, M. J., & Harris, D. J. (1996). Conditional standard errors, reliability and decision consistency of performance levels using polytomous IRT. Paper presented at the Annual Meeting of the American Educational Research Association, New York, NY.
37. Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125-145.
38. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187-213.