Analysis and validation of a rubric to assess oral presentation skills in university contexts;Análisis y validación de una rúbrica para evaluar habilidades de presentación oral en contextos universitarios

Electronic Journal of Research in Educational Psychology

Volumn 9, Issue 3, 2011, Pages 1043-1062

  García Ros, Rafael ^a  

^a UNIVERSITY OF VALENCIA   (Spain)

Author keywords

Convergent validity; Higher education; Peer assessment; Reliability and validity; Rubrics; Selfregulated learning; User perceptions

Indexed keywords

EID: 84859381807     PISSN: 16995880     EISSN: 16962095     Source Type: Journal    
DOI: None     Document Type: Article

References (43)

1. Andrade, H. (2001). Using rubrics to promote thinking and learning. Educational Leadership, 57 (5), 13-18.
2. Andrade, H. (2005). Teaching with rubrics: The Good, the Bad, and the Ugly. College teaching, 53 (1), 27-31.
3. Andrade, H., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, 10 (3). Recuperado el 11 de mayo de 2009, http://pareonline.net/getvn.asp?v=10&n=3.
4. Andrade, H.; Du, Y., & Mycek, K. (2010). Rubric-referenced self-assessment and middle school students' writing. Assessment in Education: Principles, Policy & Practice, 17 (2), 199-214.
5. Baron, J., & Keller, M. (2003). Use on rubrics in online assessment. Evaluation and Assessment Conference, 23-25 novembre 2003.
6. Cho, K.; Schunn, Ch. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891-901.
7. Cothran, D. J. (2003). Students's use of and perspective on rubrics. Educational Research, Risks and Dilemmas. NZARE/AARE Conference. Auckland, Nueva Zelanda. Recupe-rado el 17 de octubre de 2009, http://www.aare.edu.au/03pap/cot03119.pdf.
8. Dornisch, M., & Sabatini, A. (2006). Limitations of web-based rubric resources: Addressing the challenges. Practical Assessment Research & Evaluation, 11(3). Recuperado el 11 de mayo de 2010, http://pareonline.net/getvn.asp?v=11&=3.
9. Falchicov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70 (3), 287-322.
10. Freeman, M. (1995). Peer assessment by groups of group work. Assessment and Evaluation in Higher Education, 20 (3), 289-299.
11. García-Ros, R., & Pérez-González (2011a). Assessment preferences of preservice teachers: analysis according to academic level and relationship with learning styles and motiva-tional orientation. Teaching in Higher Education, published online ahead of print publication, doi: 10.1080/13562517.2011.570434.
12. García-Ros, R., & Pérez-González, F. (2011b). Validez predictiva e incremental de las habili-dades de autorregulación académica en el éxito académico universitario. Revista de Psicodidáctica, 16 (2), 231-250.
13. Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer-group rating. International Journal of Science Education, 25(12), 1509-1528.
14. Huba, M.E., & Freed, J.E. (2000). Learner-Centered Assessment on College Campuses: Shift-ing the Focus from Teaching to Learning. Needham Heights, Allyn & Bacon.
15. Hugues, I., & Large, B. (1993). Staff and peer-group assessment of oral communication skills. Higher Education, 18 (3), 379-385.
16. Jonassen, D., Peck, K., & Wilson, B. (1999). Learning with technology. Upper Saddle River, NJ: Merrill/Prentice Hall.
17. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educa-tional consequences. Educational Research Review, 2 (2), 130-144.
18. Kocaküla, M. S. (2010). Development and application of a Rubric for Evaluating Students' Performance on Newton' Laws of Motion. Journal of Science Education Technology, 19 (2), 146-164.
19. Lindblom-Yläne, S.; Pihlajamäki, H., & Kotkas, T. (2006). Self-, peer and teacher-assessment of student essays. Active Learning in Higher Education, 7 (1), 51-62.
20. López-Pastor, V. M.; Fernández-Balboa, J. M.; Santos, M. L., & Fraile, A. (2011). Students' self-grading, professor's grading and negotiated final grading at three university programmes: analysis of reliability and grade difference ranges and tendencies. Assessment & Evaluation in Higher Education, published online ahead of print publication, doi: 10.1080/02602938.2010.545868.
21. Lu, J., & Law, N. (2011). Online peer assessment: effects of cognitive and affective feedback. Instructional Science, published online ahead of print publication, doi: 10.1007/s11251-011-9177-2.
22. Magin, D., & Helmore, Ph. (2001). Peer and teacher assessment of oral presentation skills: How reliable are they? Studies in Higher Education, 26 (3), 287-298.
23. Malini, Y., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35 (4), 435-448.
24. Moskal, B. (2000). Scoring rubrics: what, when and how? Practical Assessment, Research & Evaluation, 7(3). Recuperado el 11 de mayo de 2009, http://pareonline.net/getvn.asp?v=7&n=3.
25. Moskal, B. (2003). Recommendations for developing classroom performance assessments and scoring rubrics. Practical Assessment, Research & Evaluation, 8 (14). Recuperado el 11 de mayo de 2009, http://pareonline.net/getvn.asp?v=8&n=14.
26. Moskal, B., & Leydens, J. (2000). Scoring rubric development: Validity and reliability. Practical Assessment, Research & Evaluation, 7(10). Recuperado el 11 de mayo de 2009, http://pareonline.net/getvn.asp?v=7&n=10.
27. Norcini, J. J. (2003). Peer assessment of competence. Medical Education, 37(6), 539-543.
28. Popham, J. W. (1997). What's wrong-and what's right-with rubrics. Educational Leadership, 55(2), 72-75.
29. Roblyer, M. D., & Wiencke, W.R. (2003). Design and use of a rubric to assess and encourage interactive qualities in distance courses. The American journal of distance education, 17 (2), 77-98.
30. Rohrbach, S. (2008). Educational assessment in emerging areas of desing. Design Research Society Biennial Conference 2008, Sheffield, UK.
31. Sadler, P. M., & Good, E. (2006). The Impact of Self- and Peer-Grading on Student Learning. Educational Assessment, 11(1), 1-31.
32. Sander, P. (2005). Researching our students for more effective university teaching. Electronic Journal of Research in Educational Psychology, 3 (1), 113-130.
33. Schafer, W. D.; Swanson, G.; Bené, N., & Newberry, G. (2001). Effects of teacher knowledge of rubrics on student achievement in four content areas. Applied Measurement in Education, 14 (2), 151-170.
34. Schamberr, J. F., & Mahoney, S. L. (2006). Assessing and improving the quality of group critical thinking exhibited in the final projects collaborative learning groups. Journal of General Education, 55 (2), 103-137.
35. Stellmack, M. A.; Konheim-Kalskstein, Y.; Manor, J.; Massey, A. R., & Schmitz, J. A. (2009). An assessment of reliability and validity of a rubric for grading APA-style introductions. Teaching of Psychology, 36 (2), 102-107.
36. Stix, A. (1997). Creating rubrics through negotiable contracting and assessment. US Department of Education. Recuperado el 11 de mayo de 2009, http://www.interactiveclassroom.com/006%20-%20Creating%20Rubrics.pdf.
37. Struyven, K.; Dochy, F., & Janssens, S. (2005). Students' perceptions about evaluation and assessment in higher education: A review. Assessment and Evaluation in Higher Education, 30 (4), 325-341.
38. Struyven, K.; Dochy, F., & Janssens, S. (2008). The effects of hands-on experience on students' preferences for assessment methods. Journal of Teacher Education, 59 (1), 69-88.
39. Taggart, G.; Phifer, S.; Nixon, J., & Wood, L. (2001). Rubrics: A handbook for construction and use. Lanham, MD: Scarecrown Press.
40. Thaler, N.; Kazemi, E., & Huscher, C. (2009). Developing a rubric to assess student learning outcomes using a class assignment. Teaching of Psychology, 36 (2), 113-116.
41. Tierney, R., & Marielle S. (2004). What's still wrong with rubrics: focusing on the consis-tency of performance criteria across scale levels. Practical Assessment, Research & Evaluation, 9 (2). Recuperado el 11 de mayo de 2009, http://pareonline.net/getvn.asp?v=9&n=2
42. Tinsley, H.E., & Weiss, D. J. (2000). Interrater reliability an agreement. In H.E. Tinsley y S.D. Brown (Eds.), Handbook of applied multivariate statistics and mathematical modeling, 95-124. San Diego: Academic.
43. Zimmerman, B. J., & Schunk, D. H. (Eds.) (2001). Self-regulated learning and academic achievement: Theoretical perspectives (2nd Ed.) Mahwah, NJ:Lawrence Erlbaum.