Using generalizability theory to assess the reliability of student ratings of academic advising

Journal of Experimental Education

Volumn 65, Issue 4, 1997, Pages 367-379

  Sun, Anji ^a   Valiga, Michael J ^a   Gao, Xiaohong ^a  

^a American College Testing Incorporated   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0031486123     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220973.1997.10806611     Document Type: Article

References (21)

1. Bohmstedt, G. W. (1983). Measurement. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research, (pp. 69-121). New York: Academic Press.
2. Brennan, R. L. (1992a). Generalizability theory. Educational Measurement: Issues and Practice, 11, 27-34.
3. Brennan, R. L. (1992b). Elements of generalizability theory (rev. ed.). Iowa City, IA: American College Testing.
4. Brennan, R. L. (1995). The conventional wisdom about group mean scores. Journal of Educational Measurement, 32 (4), 385-396.
5. Crick, J. E., & Brennan, R. L. (1982). GENOVA: A generalized analysis of variance system [FORTRAN IV computer program and manual]. Do’rchester: Computer Facilities, University of Massachusetts at Boston.
6. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
7. Cronbach, L. J., Linn, R. L., Brennan, R. L., & Haertel, E. H. (in press). Generalizability analysis for performance assessments of student achievement or school effectiveness. Educational and Psychological Measurement.
8. Dunbar, S. B., Koretz, D. M., & Hoover, H. D. (1991). Quality control in the development and use of performance assessments. Applied Measurement in Education, 4, 289-303.
9. Eason, S. (1991). Why generalizability theory yields better results than classical test theory: A primer with concrete examples. In B. Thompson (Ed.), Advances in educational research: Substantive findings, methodological developments, (Vol. 1, pp. 83-98). Greenwich, CT: JAI Press.
10. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). New York: Macmillan.
11. Gao, X., Shavelson, R. J., & Baxter, G. P. (1994). Generalizability of large-scale performance assessments in science: Promises and problems. Applied Measurement in Education, 7(4), 323-342.
12. Gillmore, G. M., Kane, M. T., & Naccarato, R. W. (1978). The generalizability of student ratings of instruction: Estimation of the teacher and course components. Journal of Educational Measurement, 75(1), 1-13.
13. Gillmore, G. M. (1983). Generalizability theory: Applications to program evaluation. In L. J. Fyans, Jr. (Ed.), Generalizability theory: Inferences and practical applications (pp. 3-16). San Francisco: Jossey-Bass.
14. Lane, S., Stone, C. A., Ankenmann, R. D., & Liu, M. (1992, April). Empirical evidence for the reliability and validity of performance assessments. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
15. Linn, R. L., & Burton, E. (1994). Performance-based assessment: Implications of task specificity. Educational Measurement: Issues and Practice, 13, 5-8,15.
16. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addi-son-Wesley.
17. Rubin, D. B. (1987). Multiple imputation for non-response in surveys. New York: Wiley.
18. Severy, L. J., Lee, N. P., Carodine, K., Powers, L., & Mason, G. R. (1994). Rating scales for the evaluation of academic advisors. NACADA Journal, 14(2), 121-129.
19. Shavelson, R. J., Baxter, G. P., & Gao, X. (1993). Sampling variability of performance assessments. Journal of Educational Measurement, 30(3), 1-18.
20. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
21. Valiga, M. J. (1990). Assessing the reliability of questionnaires and survey instruments using generalizability theory (Doctoral dissertation, University of Iowa, 1990). Dissertation Abstracts International, 51(9), 153A. (University Microfilms No. AAD91-03272)