Reliability, validity, and bias in peer evaluations of self-directed interdependent work teams

ASEE Annual Conference Proceedings

Volumn , Issue , 2001, Pages 8495-8532

  Thompson, Robert S ^a  

^a Department of Metallurgical and Materials Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

GENERALIZABILITY THEORY; PEER EVALUATION; SELF-DIRECTED PROBLEM SOLVING; TEAM PERFORMANCE;

DATA ACQUISITION; DATA REDUCTION; PROBLEM SOLVING; PROJECT MANAGEMENT; STATISTICAL METHODS; STUDENTS;

ENGINEERING EDUCATION;

EID: 8744280697     PISSN: 01901052     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (32)

1. Cliff Goodwin and Rob Wolter, "Student work group/teams: Current practices in an engineering and technology curriculum compared to models found in team development literature," presented at the ASEE 1998 Annual Technical Conference, Seattle, WA, 1998 (unpublished).
2. Jack McGourty, Peter Dominick, and Richard R. Reily, "Incorporating student peer review and feedback into the assessment process," presented at the Frontiers in Education 1998, Tempe, AZ, 1998 (unpublished).
3. Robert S. Thompson, "Repeated measures design for assessment of critical team skills in multidisciplinary teams," presented at the 2000 ASEE Conference and Exposition, St. Louis, MO, 2000 (unpublished).
4. J. Arvid Andersen, "Assessment techniques used in multidisciplinary and cross-cultural student teamwork, Session 1360," presented at the 2000 ASEE Annual Conference and Exposition, St. Louis, 2000 (unpublished).
5. D. Abson, "The effects of peer evaluation on the behavior of undergraduate students working on tutorless groups," in Group and Interactive Learning, edited by H. C. Foot, C. J. Howe, A. Anderson et al. (Computational Mechanics, South Hampton, England, 1994), Vol. 1, pp. 153-158.
6. Brian Mathews, "Assessing individual contributions: Experience of peer evaluation in major group project," British Journal of Educational Technology 25 (1), 19-28 (1994).
7. Robert S. Thompson, "Reliability, validity, user acceptance, and bias in peer evaluations on self-directed interdependent work teams," Doctoral Dissertation, University of Colorado at Denver, 2000.
8. David A. Kenny, Interpersonal perception: A social relations analysis (The Guilford Press, New York, 1994).
9. D. A. Kenny and L. La Voie, "The social relations model," in Advances in experimental social psychology, edited by L. Berkowitz (Academic Press, Orlando, FL, 1984), Vol. 18, pp. 142-182.
10. R. M. Warner, D. A. Kenny, and M. Stoto, "A new round robin analysis of variance for social interaction data," Journal of Personality and Social Psychology 37, 1742-1757 (1979).
11. Laura D. Goodwin and William L. Goodwin, "Research notes: Using generalizability theory in early childhood special education," Journal of Early Intervention 15 (2), 193-204 (1991).
12. Lee J. Cronbach, Goldine C. Gleser, Harinder Nanda et al., The dependability of behavioral measurements: Theory of generalizability for scores and profiles (John Wiley & Sons, New York, 1972).
13. Martha E. Hennen, Consensus and meta-accuracy in self-managing work groups: A social relations analysis (University of Connecticut, Storrs, CT, 1996).
14. Barbara M. Montgomery, "An interactionist analysis of small group peer assessment," Small Group Behavior 17 (1), 19-37 (1986).
15. D.A. Kenny, R. Lord, and S. Garg, A social relations analysis of peer ratings (Unpublished paper, University of Connecticut, 1983).
16. R. G. Lord, J. S. Phillips, and M. C. Rush, "Effects of sex on perceptions of emergent leadership, influence, and social power," Journal of Applied Psychology 65, 176-182 (1980).
17. David Kenny, "A general model of consensus and accuracy in interpersonal perception," Psychological Review 98, 155-163 (1991).
18. N. Anderson, Foundations of information integration theory (Academic Press, New York, 1981).
19. Jiing-Lih Farh, Albert A. Jr. Cannella, and Arthur G. Bedeian, "Peer ratings: The impact of purpose on rating quality and user acceptance," Group & Organization Studies 16 (4), 367-386 (1991).
20. Michael P. Sullivan and Raymond R. Reno, "Perceiving groups accurately," Group Dynamics: Theory, Research, and Practice 3 (3), 196-205 (1999).
21. Matthew W. Ohland and Richard A. Layton, "Comparing the reliability of two peer evaluation instruments," presented at the ASEE 2000 Annual Technical Conference, St. Louis, MO, 2000 (unpublished).
22. Linda Crocker and James Algina, Introduction to classical and modern test theory (Harcourt Brace Jovanovich, Fort Worth, 1986).
23. Richard A. Layton, "Peer evaluations in teams of predominantly minority students," presented at the ASEE 2000 Annual Technical Conference, St. Louis, MO, 2000 (unpublished).
24. Deborah B. Kaufman, Richard M. Felder, and Hugh Fuller, "Peer ratings in cooperative learning groups," presented at the 1999 ASEE Annual Conference and Exposition, Charlotte, NC, 1999 (unpublished).
25. Nancy Falchikov, "Self and peer assessment of a group project designed to promote the skills of capability," Programmed Learning & Educational Technology 25 (4), 327-339 (1988).
26. C.J.G. Gersick and J.R. Hackman, "Habitual routines in task-performing groups," Organizational Behavior and Human Decision Processes 47, 65-97 (1990).
27. J. Richard Hackman, "Groups that work (and those that don't)," in The Jossey-Bass Management Series (Jossey-Bass, San Francisco, 1990), pp. 504.
28. B. Park, M. L. DeKay, and S. Kraus, "Aggregating social behavior into person models: Perceiver-induced consistency," Journal of Personality and Social Psychology 66, 437-459 (1994).
29. J. S. Kane and E.E. Lawler, "Method of peer assessment," Psychological Bulletin 85, 555-586 (1978).
30. F.J. Landy and J.L. Farr, "Performance rating," Psychological Bulletin 87, 72-107 (1980).
31. Walter C. Borman, "Effects of instructions to avoid halo error on reliability and validity of performance evaluation ratings," Journal of Applied Psychology 60 (5), 556-560 (1975).
32. G.P. Latham, K.N. Wexley, and E.D. Pursell, "Training managers to minimize rating errors in the observations of behavior," Journal of Applied Psychology 60, 550-555 (1975).