Multiple teacher ratings: An evaluation of measurement strategies

Educational Research and Evaluation

Volumn 13, Issue 1, 2007, Pages 71-86

  Muschkin, Clara G ^a   Malone, Patrick S ^a   Bierman , Karen L ^b   Coie, John D ^a   Dodge, Kenneth A ^a   Michael Foster, E ^b   Greenberg, Mark T ^b   Lochman, John E ^c   McMahon, Robert J ^d   Pinderhughes, Ellen E ^e  

^a DUKE UNIVERSITY   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF ALABAMA   (United States)

^d UNIVERSITY OF WASHINGTON   (United States)

^e VANDERBILT UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33847074999     PISSN: 13803611     EISSN: 17444187     Source Type: Journal    
DOI: 10.1080/13803610601058215     Document Type: Article

References (27)

1. Abedi, J. (1991). Predicting graduate academic success from undergraduate academic performance: A canonical correlation study. Educational and Psychological Measurement, 51(1), 151-160.
2. Abedi, J., & Baker, E. L. (1995). A latent-variable modeling approach to assessing interrater reliability, topic generalizability, and validity of a content assessment scoring rubric. Educational and Psychological Measurement, 55(5), 701-705.
3. Adams, G. R., Ryan, B. A., Ketsetzis, M., & Keating, L. (2000). Rule compliance and peer sociability: A study of family process, school-focused interactions, and children's classroom behavior. Journal of Family Psychology, 14(2), 237-250.
4. Alvidrez, J., & Weinstein, R. S. (1999). Early teacher perceptions and later student academic achievement. Journal of Educational Psychology, 91(4), 731-746.
5. Brennan, R. L. (1992). Generalizability theory. Educational Measurement: Issues and Practices, 11(4), 27-34.
6. Buchanan, H. H., McDermott, P.A., & Schaefer, B. A. (1998). Agreement among classroom observers of children's stylistic learning behaviors. Psychology in the Schools, 35(4), 355-361.
7. Byrne, B. M., & Gavin, D. A. W. (1996). The Shavelson model revisited: Testing for the structure of academic self-concept across pre-, early-, and late adolescents. Journal of Educational Psychology, 88(2), 215-228.
8. Cicchetti, D. V., & Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. Journal of Mental Deficiency, 86(2), 127-137.
9. Cole, D. A., Martin, J. M., Peeke, L. A., Seroczynski, A. D., & Fier, J. (1999). Children's over- and underestimation of academic competence: A longitudinal study of gender differences, depression, and anxiety. Child Development, 70(2), 459-473.
10. Conduct Problems Prevention Research Group (CPPRG). (1992). A developmental and clinical model for the prevention of conduct disorders: The FAST Track Program. Development and Psychopathology, 4, 509-527.
11. Conduct Problems Prevention Research Group (CPPRG). (2002). Using the Fast Track randomized prevention trial to test the early-starter model of the development of serious conduct problems. Development and Psychopathology, 14, 925-943.
12. Fan, X., & Chen, M. (2000). Published studies of interrater reliability often overestimate reliability: Computing the correct coefficient. Educational and Psychological Measurement, 60(4), 532-542.
13. Gray, M. R., & Steinberg, L. (1999). Unpacking authoritative parenting: Reassessing a multidimensional construct. Journal of Marriage and the Family, 61, 574-587.
14. Greene, W. H. (2000). Econometric analysis (4th ed.). Upper Saddle River, NJ: Prentice Hall.
15. Holmbeck, G. N., Li, S. T., Schurman, J. V., Friedman, D., & Coakley, R. M. (2002). Collecting and managing multisource and multimethod data in studies of pediatric populations. Journal of Pediatric Psychology, 27(1), 5-18.
16. Loeber, R., Green, S. M., Lahey, B. B., & Stouthamer-Loeber, M. (1989). Optimal informants on childhood disruptive behaviors. Development and Psychopathology, 1(4), 317-337.
17. Marsh, H. W., & Yeung, A. S. (1997). Causal effects of academic self-concept on academic achievement: Structural equation models of longitudinal data. Journal of Educational Psychology, 89(1), 41-54.
18. Mitchell, S. K. (1979). Interobserver agreement, reliability, and generalizability of data collected in observational studies. Psychological Bulletin, 86(2), 376-390.
19. Muschkin, C. G. (2003). Teacher rating of student adjustment (Fast Track Project technical report). Retrieved February 15, 2005, from http://www.fasttrackproject.org/
20. Pakaslahti, L., & Keltikangas-Jarvinen, L. (2000). Comparison of peer, teacher and self-assessments on adolescent direct and indirect aggression. Educational Psychology, 20(2), 177-191.
21. Roeser, R. W., Eccles, J. S., & Freedman-Doan, C. (1999). Academic functioning and mental health in adolescence: Patterns, progressions, and routes from childhood. Journal of Adolescent Research, 14(2), 135-174.
22. Rudolph, K. D., Lambert, S. F., Clark, A. G., & Kurlakowsky, K. D. (2001). Negotiating the transition to middle school: The role of self-regulatory processes. Child Development, 72(3), 929-946.
23. Shiner, R. L. (2000). Linking childhood personality with adaptation: Evidence for continuity and change across time into late adolescence. Journal of Personality and Social Psychology, 78(2), 310-325.
24. Sun, A., & Valiga, M. J. (1997). Using generalizability theory to assess the reliability of student ratings of academic advising. Journal of Experimental Education, 65(4), 367-380.
25. Wentzel, K. R. (1994). Relations of social goal pursuit to social acceptance, classroom behavior, and perceived social support. Journal of Educational Psychology, 86(2), 173-182.
26. Werthamer-Larsson, L., Kellam, S., & Wheeler, L. (1991). Effects of first-grade classroom environment on shy behavior, aggressive behavior, and concentration problems. American Journal of Community Psychology, 19, 582-602.
27. Youngstrom, E., Loeber, R., & Stouthamer-Loeber, M. (2000). Patterns and correlates of agreement between parent, teacher, and male adolescent ratings of externalizing and internalizing problems. Journal of Consulting and Clinical Psychology, 68(6), 1038-1050.