Analytic or holistic: A study of agreement between different grading models

Practical Assessment, Research and Evaluation

Volumn 23, Issue 12, 2018, Pages 1-11

  Jönsson, Anders ^a   Balan, Andreia ^b  

^a KRISTIANSTAD UNIVERSITY   (Sweden)

^b NONE   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85055965887     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. Black, P., Harrison, C., Lee, C., Marshall, B. & Wiliam, D. (2004). Working inside the black box: Assessment for learning in the classroom. Phi Delta Kappan, 86, 8-21
2. Brimi, H. M. (2011). Reliability of grading high school work in English. Practical Assessment, Research & Evaluation, 16, 1-12
3. Brookhart, S. M. (2013). The use of teacher judgement for summative assessment in the USA. Assessment in Education: Principles, Policy & Practice, 20, 69-90
4. Brookhart, S. M., & Chen, F. (2015). The quality and effectiveness of descriptive rubrics. Educational Reviews, 67, 343-368
5. Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., Stevens, M. T., & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86, 803-848
6. Duncan, C. R, & Noonan, B. (2007). Factors affecting teachers' grading and assessment practices. The Alberta Journal of Educational Research, 53, 1-21
7. Eells, W. C. (1930). Reliability of repeated grading of essay type examinations. Journal of Educational Psychology, 21, 48-52
8. Gipps, C., Brown, M., McCallum, B. & McAlister, S. (1995). Intuition or Evidence? Buckingham: Open University Press
9. Isnawati, I., & Saukah, A. (2017). Teachers' grading decision making. TEFLIN Journal, 28, 155-169
10. Jonsson, A. & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2, 130-144
11. Kilday, C. R., Kinzie, M. B., Mashburn, A. J., & Whittaker, J. V. (2012). Accuracy of teacher judgments of preschoolers' math skills. Journal of Psychoeducational Assessment, 30, 148-159
12. Klapp, A. (2015). Does grading affect educational attainment? A longitudinal study. Assessment in Education: Principles, Policy & Practice, 22, 302-323
13. Korp, H. (2006). Lika chanser i gymnasiet? En studie om betyg, nationella prov och social reproduktion [Equal opportunities in upper-secondary school? A study about grades, national tests, and social reproduction]. Doctoral dissertation, Malmo: Malmo University
14. Kunnath, J. P. (2017). Teacher grading decisions: Influences, rationale, and practices. American Secondary Education, 45, 68-88
15. Malouff, J. M., & Thorsteinsson, E. B. (2016). Bias in grading: A meta-analysis of experimental research findings. Australian Journal of Education, 60, 245-256
16. McMillan, J. H. (2003). Understanding and improving teachers' classroom assessment decision making: Implications for theory and practice. Educational Measurement: Issues and Practice, 22, 34-43
17. McMillan, J. Myran, S., & Workman, D. (2002). Elementary teachers' classroom assessment and grading practices. Journal of Educational Research, 95, 203-213
18. Moss, P.A., Girard, B.J., & Haniford, L.C. (2006). Validity in Educational Assessment. Review of Research in Education, 30, 109-162
19. Nijveldt, M. J. (2007). Validity in Teacher Assessment. An Exploration of the Judgement Processes of Assessors. Doctoral dissertation, Leiden: Leiden University
20. Nijveldt, M., Beijaard, D., Brekelmans, M., Wubbels, T., & Verloop, N. (2009). Assessors' perceptions of their judgement processes: Successful strategies and threats underlying valid assessment of student teachers. Studies in Educational Evaluation, 35, 29-36
21. Parkes, J. (2013). Reliability in classroom assessment. In J. H. McMillan (Ed.), SAGE Handbook of Research on Classroom Assessment (pp. 107-123). Los Angeles, CA, London, New Dehli, Singapore, Washington DC: SAGE
22. Randall, J., & Engelhard, G. (2008), Differences between teachers' grading practices in elementary and middle schools. The Journal of Educational Research, 102, 175-185
23. Randall, J., & Engelhard, G. (2010). Examining the grading practices of teachers. Teaching and Teacher Education, 26, 1372-1380
24. Sadler, R. D. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13, 191-209
25. Starch, D., & Elliott, E. C. (1912). Reliability of grading high-school work in English. The School Review, 20, 442-457
26. Starch, D., & Elliott, E. C. (1913a). Reliability of grading work in mathematics. The School Review, 21, 254-259
27. Starch, D., & Elliott, E. C. (1913b). Reliability of grading work in history. The School Review, 21, 676-681
28. Stemler, S. E. (2004). A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research & Evaluation, 9