Assessing the assessment: Rubrics training for pre-service and new in-service teachers

Practical Assessment, Research and Evaluation

Volumn 16, Issue 16, 2011, Pages 1-10

  Lovorn, Michael G ^a   Rezaei, Ali Reza ^b  

^a UNIVERSITY OF ALABAMA   (United States)

^b CALIFORNIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84859049081     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (57)

1. Anaya, G., & Cole, D. G. (2001). Latina/o student achievement: Exploring the influence of student-faculty interactions on college grades. Journal of Student Development, 42,(1), 3-14.
2. Andrade, H. L., Du, Y., Mycek, K. (2010). Rubric-referenced self-assessment and middle school students' writing. Assessment in Education: Principles, Policy & Practice, 17(2), 199-214.
3. Andrade, H. L., Wang, X., Du, Y., Akawi, R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. Journal of Educational Research, 102(4), 287-302.
4. Beyreli, L. & Ari, G. (2009). The use of analytic rubric in the assessment of writing performance: Inter-rater concordance study. Educational Sciences: Theory and Practice, 9(1), 105-125.
5. Briggs, D. (1970). The influence of handwriting on assessment. Educational Research, 13, 50-55.
6. Bull, R., & Stevens, J. (1979). The effects of attractiveness of writer and penmanship on essay grades. Journal of Occupational Psychology, 52, 53-59.
7. Chapman, V. G., & Inman, M. D. (2009). A conundrum: Rubrics or creativity/metacognitive development? Educational Horizons, 87(3), 198-202.
8. Chase, C. I. (1968). The impact of some obvious variables on essay test scores. Journal of Educational Measurement, 5, 315-318.
9. Cooper, B. S., & Gargan, A. (2009). Rubrics in education: Old term, new meanings. Phi Delta Kappan, 91(1), 54-55.
10. Dawson, C. M. (2009). Beyond checklists and rubrics: Engaging students in authentic conversations about their writing. English Journal, 98(5), 66-71.
11. De La Paz, S. (2009). Rubrics: Heuristics for developing writing strategies. Assessment for Effective Intervention, 34(3), 134-146.
12. Dunbar, N. E., Brooks, C. F. & Kubicka-Miller, T. (2006). Oral communication skills in higher education: Using a performance-based evaluation rubric to assess communication skills. Innovative Higher Education, 31(2), 115-128.
13. East, M. (2009). Evaluating the reliability of a detailed analytic scoring rubric for foreign language writing. Assessing Writing, 14(2), 88-115.
14. East, M. (2006). The impact of bilingual dictionaries on lexical sophistication and lexical accuracy in tests of L2 writing proficiency: A quantitative analysis. Assessing Writing, 11(3), 179-197.
15. Elliot, N. (2005). On a scale: A social history of writing assessment in America. New York: Peter Lang.
16. Engbers, S. K. (2009). Here we go 'round and 'round: A process of peer evaluation. Teaching English in the Two-Year College, 36(4), 397-401.
17. Feldt, L. S. & Qualls, A. L. (1999). Variability in reliability coefficients and the standard error of measurement from school district to district. Applied Measurement In Education, 12(4), 367-381.
18. Follman, J. (1993). Critical thinking and verbal ability. ACEHI Journal, 19, 71-76.
19. Gage, N. L., & Berliner, D. C. (1992). Educational Psychology. Wentzville, MO: Borgasorus Books.
20. Gallavan, N. P., & Kottler, E. (2009). Constructing rubrics and assessing progress collaboratively with social studies students. Social Studies, 100(4), 154-159.
21. Gustafson, M., & Bochner, J. (2009). Assessing critical thinking skills in students with limited English proficiency. Assessment Update, 21(4), 8-10.
22. Hitt, A. M., & Helms, E. C. (2009). Best in show: Teaching old dogs to use new rubrics. Professional Educator, 33(1), 1-15.
23. Huang, J. (2008). How accurate are ESL students' holistic writing scores on large-scale assessments? A generalizability theory approach. Assessing Writing, 13, 201-218.
24. Ishihara, N. (2009). Teacher-based assessment for foreign language pragmatics. TESOL Quarterly: A Journal for Teachers of English to Speakers of Other Languages and of Standard English as a Second Dialect, 43(3) 445-470.
25. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2, 130-144.
26. Knoch, U., Read, J., & von Randow, J. (2007). Re-training writing raters online: How does it compare with face-to-face training? Assessing Writing 12, 26-43.
27. Kohn, A. (2006). The trouble with rubrics. English Journal, 95(4), 12-15.
28. Kohn, A. (2004). What does it mean to be well educated? And more essays on standards, grading, and other follies. Boston: Beacon Press.
29. Lenski, S., & Verbruggen, F. (2010). Writing instruction and assessment for English language learners k-8. New York: Guilford Press.
30. Lumley, T., & McNamara, T. F. (1995). Rater characteristics and rater bias: Implications for training. Language Testing, 12, 54-71.
31. Mabry, L. (1999). Writing to the rubric: Lingering effects of traditional standardized testing on direct writing assessment. Phi Delta Kappan. Retrieved from http://www.pdkintl.org/kappan/kmab9905.htm
32. Malouff, J. (2008). Bias in grading. College Teaching, 56(3), 191-192.
33. Markham, L. R. (1976). Influences of handwriting on teacher evaluation of written work, American Educational Research Journal, 13, 277-283.
34. Maxwell, S. (2010). Using rubrics to support graded assessment in a competency based environment. Occasional paper. Australian Government Department of Education, National Centre for Vocational Education Research. Retrieved from http://www.eric.ed.gov.
35. McNamara, D. S., Crossley, S. A., & Phillip, M. (2010). Linguistic features of writing quality. Written Communication, 27(1), 57-86.
36. Meier, S. L., Rich, B. S., & Cady, J. (2006). Teachers' use of rubrics to score non-traditional tasks: Factors related to discrepancies in scoring. Assessment in Education: Principles, Policy and Practice, 13(1), 69-95.
37. Munoz, L. C., Frick, P. J., Kimonis, E. R., & Aucoin, K. J. (2008). Verbal ability and delinquency: Testing the moderating role of psychopathic traits. Journal of Child Psychology and Psychiatry, 49, 414-421.
38. Newell, J. A., Dahm, K. D., & Newell, H. L. (2002). Rubric development and inter-rater reliability: Issues in assessing learning outcomes. Chemical Engineering Education, 36(3), 212-15.
39. Read, B., Francis, B., & Robson, J. (2005). Gender, bias, assessment and feedback: Analyzing the written assessment of undergraduate history essays. Assessment and Evaluation in Higher Education, 30(3), 241-260.
40. Reddy, Y. M., & Andrade, H. L. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448.
41. Rezaei, A. R., & Lovorn, M. G. (2010). Reliability and validity of rubrics for assessment through writing. Assessing Writing, 15(1), 18-39.
42. Ross-Fisher, R. L. (2005). Developing effective success rubrics. Kappa Delta Pi, 41(3), 131-135.
43. Schafer, W. D., Gagné, P., & Lissitz, R. W. (2005). Resistance to confounding style and content in scoring constructed response items. Educational Measurement: Issues and Practice, 24(2), 22-28.
44. Schafer, W. D., Swanson, G., & Bene, N. (2001). Effects of teacher knowledge of rubrics on student achievement in four content areas. Applied Measurement in Education, 14(2), 151-170.
45. Silvestri, L. & Oescher, J. (2006). Using rubrics to increase the reliability of assessment in health classes. International Electronic Journal of Health Education, 9, 25-30.
46. Skaalvik, E. M., & Skaalvik, S. (2004). Self-concept and self-efficacy: A test of the internal/external frame of reference model and predictions of subsequent motivation and achievement. Psychological Reports, 95(3), 1187-1202.
47. Spandel, V. (2006). In defense of rubrics. English Journal, 96(1), 19-22.
48. Spence, L. K. (2010). Discerning writing assessment: Insights into an analytical rubric. Language Arts, 87(5), 337-352.
49. Stellmack, M. A., Konheim-Kalkstein, Y. L., Manor, J. E., Massey, A. R., & Schmitz, J. A. P. (2009). An assessment of reliability and validity of a rubric for grading APA-style introductions. Teaching of Psychology, 36(2), 102-107.
50. Stevens, D. D., & Levi, A. J. (2005). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback and promote student learning. Sterling, VA: Stylus.
51. Stuhlmann, J., Daniel, C., Dellinger, A., Denny, R. K. & Powers, T. (1999). A generalizability study of the effects of training on teachers' abilities to rate children's writing using a rubric. Reading Psychology, 20(2), 107-127.
52. Thaler, N. Kazemi, E., & Huscher, C. (2009). Developing a rubric to assess student learning outcomes using a class assignment. Teaching of Psychology, 36(2). 113-116.
53. Tomkins, M. (2003). Trouble comes in threes. Times Educational Supplement, 4547, 23.
54. Turley, E. D., & Gallagher, C. G. (2008). On the uses of rubrics: Reframing the great rubric debate. English Journal, 79(4), 87-92.
55. Wills, A. (2003). Using resource- and research-based learning as a method of in-service teacher training. Knowledge Quest, 31(5), 35-38.
56. Wilson, M. (2006). Rethinking rubrics in writing assessment. Portsmouth: Heinemann.
57. Wilson, M. (2007). Why I won't be using rubrics to respond to students' writing. English Journal, 96(4), 62-66.