Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer-group rating

International Journal of Science Education

Volumn 25, Issue 12, 2003, Pages 1509-1528

  Hafner, John C ^a   Hafner, Patti M ^b  

^a OCCIDENTAL COLLEGE   (United States)

^b Unified School District   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ASSESSMENT METHOD; STUDENT;

EID: 0347447439     PISSN: 09500693     EISSN: None     Source Type: Journal    
DOI: 10.1080/0950069022000038268     Document Type: Article

References (37)

1. ABEDI, J. (1991). Predicting graduate academic success from undergraduate academic performance: a canonical correlation study. Educational and Psychological Measurement, 51, 151-160.
2. ABEDI, J., and BAKER, E. L. (1995). A latent-variable modeling approach to assessing interrater reliability, topic generalizability, and validity of a content assessment scoring rubric. Educational and Psychological Measurement, 55, 701-715.
3. BAKER, E. L., ABEDI, J., LINN, R. L., and NIEMI, D. (1995). Dimensionality and generalizability of domain-independent performance assessments. The Journal of Educational Research, 89, 197-205.
4. BRELAND, H., and GRISWOLD, P. A. (1982). Use of a performance test as a criterion in a differential validity study. Journal of Educational Psychology, 74, 713-721.
5. BRELAND, H., DANOS, D., KAHN, H., KUBOTA, M., and BONNER, M. (1994). Performance versus objective testing and gender: an exploratory study of an Advanced Placement History examination. Journal of Educational Measurement, 31, 275-293.
6. BRENNAN, R. L. (1992). An NCME instructional module on generalizability theory. Educational Measurement: Issues and Practice, Winter, 27-34.
7. CRONBACH, L. J., GLESER, G. C., NANDA, H., and RAJARATNAM, N. (1972). The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles (New York: John Wiley and Sons).
8. CUSTER, R. L. (1996). Rubrics: an authentic assessment tool for technology education. The Technology Teacher, December/January, 27-37.
9. EBEL, R. L. (1972). Essentials of Educational Measurement (Englewood Cliffs, NJ: Prentice-Hall).
10. FALCHIKOV, N. (1991). Group process analysis: self and peer assessment of working together in a group. In S. Brown, and P. Dove (Eds.), Self and peer assessment. Presented at Birmingham, Standing Conference on Educational Development (Paper No. 63).
11. FINSON, K. D., and ORMSBEE, C. K. (1998). Rubrics and their use in inclusive science. Intervention in School and Clinic, 34, 79-88.
12. GATFIELD, T. (1999). Examining student satisfaction with group projects and peer assessment. Assessment and Evaluation in Higher Education, 24, 365-377.
13. HAFNER, J. C., and HAFNER, M. S. (1992). Laboratory investigations and discussions: an alternative pedagogical strategy in evolutionary biology. In R. G. Good, J. E. Trowbridge, S. S. Demastes, J. H. Wandersee, M. S. Hafner, and C. L. Cummins (Eds.), Proceedings of the 1992 Evolution Education Research Conference (Baton Rouge: Louisiana State University).
14. HERMAN, J. L., ASCHBACHER, P. R., and WINTERS, L. (1992). A Practical Guide to Alternative Assessment (Alexandria, VA: Association for Supervision and Curriculum Development).
15. HOPKINS, K. D., STANLEY, J. C., and HOPKINS, B. R. (1990). Educational and Psychological Measurement and Evaluation (7th ed.) (Englewood Cliffs, NJ: Prentice-Hall).
16. JOHNSON, R. L., PENNY, J., and GORDON, B. (2000). The relation between score resolution methods and interrater reliability: an empirical study of an analytic scoring rubric. Applied Measurement in Education, 13, 121-138.
17. KENDALL, M. G., and GIBBONS, J. D. (1990). Rank Correlation Methods (5th ed.) (London: Edward Arnold).
18. KORETZ, D., MCCAFFREY, D., KLEIN, S., BELL, R., and STECHER, B. (1994). The Reliability of Vermont Portfolio Scores in the 1992-93 SchoolYear, Report No. TM021562 (Los Angeles, CA: The Rand Corporation, National Center for Research on Evaluation, Standards, and Student Testing).
19. LEJK, M., and WYVILL, M. (2001). Peer assessment of contributions to a group project: a comparison of holistic and category-based approaches. Assessment and Evaluation in Higher Education, 26, 61-72.
20. LITTLE, R. J. A. (1988). Robust estimation of the mean and covariance matrix from data with missing values. Applied Statistics, 37, 23-28.
21. LUFT, J. (1997). Design your own rubric. Science Scope, 20, 25-27.
22. NOVAK, J. R., HERMAN, J. L., and GEARHART, M. (1996). Establishing validity for performance-based assessments: an illustration for collections of student writing. The Journal of Educational Research, 89, 220-233.
23. PATE, P. E., HOMESTEAD, E., and MCGINNIS, K. (1993). Designing rubrics for authentic assessment. Middle School Journal, 25, 25-27.
24. POMPLUN, M., and CAPPS, L. (1999). Gender differences for constructed-response mathematics items. Educational and Psychological Measurement, 59, 597-614.
25. POMPLUN, M., and SUNDBYE, N. (1999). Gender differences in constructed response reading items. Applied Measurement in Education, 12, 95-109.
26. POPHAM, W. J. (1997). What's wrong-and what's right-with rubrics. Educational Leadership, October, 72-75.
27. ROUTMAN, R. (1991). Invitations: Changing as Teachers and Learners K-12 (Portsmouth, NH: Heinemann).
28. SHAVELSON, R. J., and WEBB, N. M. (1991). Generalizability Theory: A Prime (Newbury Park, CA: Sage Publications).
29. SIMPSON, G. G., ROE, A., and LEWONTIN, R. C. (1960). Quantitative Zoology (rev. ed.) (New York: Harcourt, Brace and World).
30. SLUIJSMANS, D. M. A., MOERKERKE, G., VAN MERRIENBOER, J. J. G., and DOCHY, F. J. R. C. (2001). Peer assessment in problem based learning. Studies in Educational Evaluation, 27, 153-173.
31. SNEDECOR, G. W., and COCHRAN, W. G. (1989). Statistical Methods (8th ed.) (Ames, IA: Iowa State University Press).
32. SOKAL, R. R., and ROHLF, F. J. (1995). Biometry (3rd ed.) (New York: W. H. Freeman and Company).
33. STUHLMANN, J., DANIEL, C., DELLINGER, A., DENNY, R. K., and POWERS, T. (1999). A generalizability study of the effects of training on teachers' abilities to rate children's writing using a rubric. Journal of Reading Psychology, 20, 107-127.
34. WALSH, W. B., and BETZ, N. E. (1990). Tests and Assessment (2nd ed.) (Englewood Cliffs, NJ: Prentice-Hall).
35. WENZLAFF, T. L., FAGER, J. J., and COLEMAN, M. J. (1999). What is a rubric? Do practitioners and the literature agree? Contemporary Education, 70, 41-46.
36. WIGGINS, G. (1991). Standards, not standardization: evoking quality student work. Educational Leadership, February, 18-25.
37. ZAR, J. H. (1996). Biostatistical Analysis (3rd ed.) (Upper Saddle River, NJ: Prentice Hall).