Methodology for Examining the Reliability of Group Mean Difference Scores

Journal of Educational Measurement

Volumn 40, Issue 3, 2003, Pages 207-230

  Brennan, Robert L ^a   Yin, Ping ^a   Kane, Michael T ^b  

^a UNIVERSITY OF IOWA   (United States)

^b National Conference of Bar Examiners   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0347592504     PISSN: 00220655     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2003.tb01105.x     Document Type: Article

References (27)

1. Arce-Ferrer, A. J. (1998). An investigation of standard errors of proportions for use in reporting test results with achievement levels. (Doctoral Dissertation, University of Iowa) Dissertation Abstracts International, 60(2), 398A.
2. Brennan, R. L. (1995). The conventional wisdom about group mean scores. Journal of Educational Measurement, 32, 385-396.
3. Brennan, R. L. (2001a). An essay on the history and future of reliability from the perspective of replications. Journal of Educational Measurement, 38, 295-317.
4. Brennan, R. L. (2001b). Generalizability theory. New York: Springer-Verlag.
5. Brennan, R. L. (2001c). Manual for mGENOVA. Iowa City, IA: Iowa Testing Programs, University of Iowa.
6. Brennan, R. L. (2001d). Manual for urGENOVA. Iowa City, IA: Iowa Testing Programs, University of Iowa.
7. Brennan, R. L. (2001e). Some problems, pitfalls, and paradoxes in educational measurement. Educational Measurement: Issues and Practice, 20(4), 6-18.
8. Brennan, R. L., & Kane, M. T. (1977a). An index of dependability for mastery tests. Journal of Educational Measurement, 14, 277-289.
9. Brennan, R. L., & Kane, M. T. (1977b). Signal/noise ratios for domain-referenced tests. Psychometrika, 42, 609-625.
10. Crick, J. E., & Brennan, R. L. (1983). Manual for GENOVA: A generalized analysis of variance system (American College Testing Technical Bulletin No. 43). Iowa City, IA: ACT, Inc.
11. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
12. Cronbach, L. J., Linn, R. L., Brennan, R. L., & Haertel, E. (1997). Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational and Psychological Measurement, 57, 373-399.
13. Dyer, H. S., Linn, R. L., & Patton, M. J. (1969). A comparison of four methods of obtaining discrepancy measures based on observed and predicted school system means on achievement tests. American Educational Research Journal, 6, 591-605.
14. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). Washington, DC: American Council on Education.
15. Gillmore, G. M., Kane, M. T., & Naccarato, R. W. (1978). The generalizability of student ratings of instruction: Estimation of the teacher and course components. Journal of Educational Measurement, 15, 1-14.
16. Hoover, H. D., Hieronymous, A. N., Frisbie, D. A., & Dunbar, S. B. (1993). ITBS: Interpretive guide for teachers and counselors. Chicago: Riverside.
17. Kane, M. T. (1996). The precision of measurements. Applied Measurement in Education, 9, 355-379.
18. Kane, M. T., & Brennan, R. L. (1977). The generalizability of class means. Review of Educational Research, 47, 267-292.
19. Kane, M. T., Gillmore, G. M., & Crooks, T. J. (1976). Student evaluations of teaching: The generalizability of class means. Journal of Educational Measurement, 13, 171-183.
20. Kolen, M. J., Hanson, B. A., & Brennan, R. L. (1992). Conditional standard errors of measurement for scale scores. Journal of Educational Measurement, 29, 285-307.
21. Linn, R. L., Baker, E. L., & Betebenner, D. W. (2002). Accountability systems: Implications of requirements of the No Child Left Behind Act of 2001. Educational Researcher, 31(6), 3-16.
22. Miller, T. B., & Kane, M. T. (2001). The precision of change scores under absolute and relative interpretations. Applied Measurement in Education, 14, 307-327.
23. Ting, N., Burdick, R. K., Graybill, F. A., Jeyaratnam, S., & Lu, T. C. (1990). Confidence intervals on linear combinations of variance components that are unrestricted in sign. Journal of Statistical Computational Simulation, 35, 135-143.
24. Yen, W. M. (1997). The technical quality of performance assessment: Standard errors of percents of pupils reaching standards. Educational Measurement: Issues and Practice, 16, 5-15.
25. Yen, W. M., & Ferrara, S. (1997). The Maryland school performance assessment program: Performance assessment with psychometric quality suitable for high stakes usage. Educational Measurement: Issues and Practice, 16, 5-15.
26. Yin, P., & Brennan, R. L. (2002). An investigation of difference scores for a grade-level testing program. International Journal of Testing, 2(2), 83-105.
27. Zumbo, B. D. (1999). The simple difference score as an inherently poor measure of change: some reality, much mythology. In B. Thompson (Ed.), Advances in social science methodology: Vol. 5. Greenwich, CT: JAI Press.