What’s on the syllabus? An analysis of assessment criteria in first year courses across US and Spanish universities

Educational Assessment, Evaluation and Accountability

Volumn 33, Issue 4, 2021, Pages 675-699

  Lipnevich, Anastasiya A ^a   Panadero, Ernesto ^b   Gjicali, Kalina ^c   Fraile, Juan ^d  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b BASQUE FOUNDATION FOR SCIENCE   (Spain)

^c NEW YORK UNIVERSITY   (United States)

^d UNIVERSIDAD FRANCISCO DE VITORIA   (Spain)

Author keywords

Assessment criteria; Exams; Spain; Syllabi; University students; USA

Indexed keywords

EID: 85103611192     PISSN: 18748597     EISSN: 18748600     Source Type: Journal    
DOI: 10.1007/s11092-021-09357-9     Document Type: Article

References (58)

1. Allen, J. D. (2005). Grades as valid measures of academic achievement of classroom learning. The Clearing House, 78(5), 218–223. DOI: 10.3200/TCHS.78.5.218-223
2. Angelo, T. A., & Cross, K. P. (1993). Classroom assessment techniques: A handbook for college teachers (pp. 148–153).
3. Angelo, T. A., Cross, K. P., & Rechnique, C. A. (1993). A handbook for college teachers. Jose-Bass Publishers.
4. Bers, T. H., Davis, B. D., & Taylor, B. (2000). The use of syllabi in assessments: Unobtrusive indicators and tools for faculty development. Assessment Update, 12(3), 4–7.
5. Bjork, E. L., Storm, B. C., & DeWinstanley, P. A. (2011). Learning from the consequences of retrieval: Another test effect. In A. S. Benjamin (Ed.), Successful remembering and successful forgetting: A Festschrift in Honor of Robert A. Bjork (pp. 347–364). Psychology Press.
6. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education, 5(1), 7–74.
7. Bloom, B. S. (1956). Taxonomy of educational objectives. David McKay Co., Inc.
8. Brookhart, S. M. (1991). Grading practices and validity. Educational Measurement: Issues and Practice, 10(1), 35–36.
9. Brookhart, S. M. (2009). Grading. Pearson Education.
10. Brookhart, S. M. (2011). Starting the conversation about grading. Educational Leadership, 69(3), 10–14.
11. Brookhart, S. M. (2014). How to design questions and tasks to assess student thinking. ASCD.
12. Brookhart, S. M., & Nitko, A. J. (2008). Assessment and grading in classrooms. Pearson Education.
13. Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., Stevens, M. T., & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803–848. DOI: 10.3102/0034654316672069
14. Brown, G. T., & Harris, L. R. (2014). The future of self-assessment in classroom practice: Reframing self-assessment as a core competency. Frontline Learning Research, 2(1), 22–30.
15. Brown, G., & Harris, L. R. (2018). Methods in feedback research. In A. A. Lipnevich & J. K. Smith (Eds.), Cambridge handbook of instructional feedback (pp. 97–121). Cambridge University Press.
16. Cashwell, C. S., & Young, J. S. (2004). Spirituality in counselor training: A content analysis of syllabi from introductory spirituality courses. Counseling and Values, 48(2), 96–109. DOI: 10.1002/j.2161-007X.2004.tb00237.x
17. Casner-Lotto, J., Barrington, L., & Wright, M. (2006). Are they really ready to work? Employers’ perspectives on the basic knowledge and applied skills of new entrants to the twenty-first century U.S. workforce. Report Number BED-06-WF-KF. The Conference Board, Corporate Voices for Working Families, the Partnership for Twenty-first Century Skills, and the Society for Human Resource Management.
18. Cassady, J. C., & Johnson, R. E. (2002). Cognitive test anxiety an academic performance. Contemporary Educational Psychology, 27(2), 270–295. DOI: 10.1006/ceps.2001.1094
19. Cizek, G. J., Fitzgerald, S. M., & Rachor, R. E. (1996). Teachers’ assessment practices: Preparation, isolation, and the kitchen sink. Educational Assessment, 3(2), 159–179. DOI: 10.1207/s15326977ea0302_3
20. Cross, L. H., & Frary, R. B. (1999). Hodgepodge grading: Endorsed by students and teachers alike. Applied Measurement in Education, 12(1), 53–72. DOI: 10.1207/s15324818ame1201_4
21. De Swert, K. (2012). Calculating inter-coder reliability in media content analysis using Krippendorff’s Alpha. Center for Politics and Communication, 1–15.
22. Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. DOI: 10.1177/1529100612453266
23. European Commission/EACEA/Eurydice. (2018). The European Higher Education Area in 2018: Bologna Process Implementation Report. Publications Office of the European Union.
24. Guskey, T. R. (1996). Reporting on student learning: Lessons from the past – prescriptions for the future. In T. R. Guskey (Ed.), Communicating student learning. 1996 yearbook of the association for supervision and curriculum development (pp. 13–24). Association for Supervision and Curriculum Development.
25. Guskey, T. R. (2006). Making high school grades meaningful. Phi Delta Kappan, 87(9), 670–675. DOI: 10.1177/003172170608700910
26. Guskey, T. R. (2011). Five obstacles to grading reform. Educational Leadership, 69(3), 16–21.
27. Guskey, T. R. (2019). Get set, go! Implementing successful reforms in grading and reporting. Solution Tree.
28. Hattie, J. (2012). Visible learning for teachers: Maximizing impact on learning. Routledge.
29. Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J. A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. DOI: 10.1080/00313831.2016.1258726
30. Jessop, T., & Maleckar, B. (2016). The influence of disciplinary assessment patterns on student learning: A comparative study. Studies in Higher Education, 41(4), 696–711. DOI: 10.1080/03075079.2014.943170
31. Jessop, T., & Tomas, C. (2017). The implications of programme assessment patterns for student learning. Assessment & Evaluation in Higher Education, 42(6), 990–999. DOI: 10.1080/02602938.2016.1217501
32. Karran, T. (2005). Pan-European grading scales: Lessons from national systems and the ECTS. Higher Education in Europe, 30(1), 5–22. 10.1080/03797720500087949 DOI: 10.1080/03797720500087949
33. Kornell, N., Hays, M. J., & Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(4), 989.
34. Lipnevich, A. A., McCallen, L. N., Miles, K. P., & Smith, J. K. (2014). Mind the gap! Students’ use of exemplars and detailed rubrics as formative assessment. Instructional Science, 42(4), 539–559. DOI: 10.1007/s11251-013-9299-9
35. Lipnevich, A. A., Guskey, T. R., Murano, D. M., & Smith, J. K. (2020). What do grades mean? Variation in grading criteria in American college and university courses. Assessment in Education: Principles, Policy & Practice, 27(5), 480–500.
36. O’Connor, K. (2009). Grades: When, why, what impact, and how? Education Canada, Spring, 2010, 38–41.
37. Oswald, F. L., Schmitt, N., Kim, B. H., Ramsay, L. J., & Gillespie, M. A. (2004). Developing a biodata measure and situational judgment inventory as predictors of college student performance. Journal of Applied Psychology, 89(2), 187–207. DOI: 10.1037/0021-9010.89.2.187
38. Panadero, E., & Brown, G. T. L. (2017). Teachers’ reasons for using peer assessment: Positive experience predicts use. European Journal of Psychology of Education, 32(1), 133–156. 10.1007/s10212-015-0282-5 DOI: 10.1007/s10212-015-0282-5
39. Panadero, E., Fraile, J., Fernández Ruiz, J., Castilla-Estévez, D., & Ruiz, M. A. (2019). Spanish university assessment practices: examination tradition with diversity by faculty. Assessment & Evaluation In Higher Education, 44(3), 379–397. 10.1080/02602938.2018.1512553 DOI: 10.1080/02602938.2018.1512553
40. Parkes, K. A. (2018). Instructional feedback in music. In A. A. Lipnevich & J. K. Smith (Eds.), Cambridge handbook of instructional feedback. Cambridge Press.
41. Pellegrino, J. W. (2006). Rethinking and redesigning curriculum, instruction and assessment: What contemporary research and theory suggests (pp. 1–15). Chicago: Commission on the Skills of the American Workforce.
42. Postareff, L., Lindblom-Ylänne, S., & Nevgi, A. (2007). The effect of pedagogical training on teaching in higher education. Teaching and teacher education, 23(5), 557–571. DOI: 10.1016/j.tate.2006.11.013
43. Rathbun, G. A., Leatherman, J., & Jensen, R. (2017). Evaluating the impact of an academic teacher development program: practical realities of an evidence-based study. Assessment & Evaluation in Higher Education, 42(4), 548–563. DOI: 10.1080/02602938.2016.1161004
44. Richland, L. E., Kornell, N., & Kao, L. S. (2009). The pretesting effect: Do unsuccessful retrieval attempts enhance learning? Journal of Experimental Psychology: Applied, 15(3), 243.
45. Rojstaczer, S., & Healy, C. (2012). Where A is ordinary: The evolution of American college and university grading, 1940–2009. Teachers College Record, 114(7), 1–23. DOI: 10.1177/016146811211400707
46. Royal, K. D., & Guskey, T. R. (2015). A case for differentiated grades. Medical Science Education, 25, 323–325. DOI: 10.1007/s40670-015-0127-5
47. Seipp, B. (1991). Anxiety and academic performance: A meta-analysis of findings. Anxiety, Stress, and Coping, 4(1), 27–41.
48. Smith, J. K., & Smith, L. F. (2009). The impact of framing effect on student preferences for university grading systems. Studies in Educational Evaluation, 35, 160–167. DOI: 10.1016/j.stueduc.2009.11.001
49. Stanny, C., Gonzalez, M., & McGowan, B. (2015). Assessing the culture of teaching and learning through a syllabus review. Assessment & Evaluation in Higher Education, 40(7), 898–913. DOI: 10.1080/02602938.2014.956684
50. Tippin, G. K., Lafrenier, K. D., & Page, S. (2012). Student perception of academic grading: Personality, academic orientation, and effort. Active Learning in Higher Education, 13(1), 51–61. DOI: 10.1177/1469787411429187
51. Tomas, C., & Jessop, T. (2019). Struggling and juggling: a comparison of student assessment loads across research and teaching-intensive universities. Assessment & Evaluation in Higher Education, 44(1), 1–10. DOI: 10.1080/02602938.2018.1463355
52. Turner, K., Roberts, L., Heal, C., & Wright, L. (2013). Oral presentation as a form of summative assessment in a master’s level PGCE module: The student perspective. Assessment & Evaluation in Higher Education, 38(6), 662–673. DOI: 10.1080/02602938.2012.680016
53. United States Department of Education. (2016). Transitioning to the Every Student Succeeds Act (ESSA): Frequently asked questions. Retrieved from https://www2.ed.gov/policy/elsec/leg/essa/essafaqstransition62916.pdf. Accessed 22 Mar 2021.
54. Van Zundert, M., Sluijsmans, D., & Van Merriënboer, J. (2010). Effective peer assessment processes: Research findings and future directions. Learning and Instruction, 20(4), 270–279. DOI: 10.1016/j.learninstruc.2009.08.004
55. Wächter, B. (Ed.). (2004). Higher education in a Changing Environment. Lemmens.
56. Westerheijden, E., et al. (2008). The first decade of working on the European Higher Education Area [Report by the Center for Higher Education Policy Studies].
57. Wiggins, G. (1996). Honesty and fairness: Toward better grading and reporting. In T. R. Guskey (Ed.), Communicating student learning: 1996 yearbook of the association for supervision and curriculum development (pp. 141–176). Association for Supervision and Curriculum Development.
58. Zabalza, M. A. (2003). Competencias docentes del profesorado universitario. Calidad y desarrollo profesional. Narcea.