Assessment of university students' oral communication competence through a reliable and valid scoring rubric;Valoración de la competencia de comunicación oral de estudiantes universitarios a través de una rúbrica fiable y válida

Revista Brasileira de Educacao

Volumn 21, Issue 64, 2016, Pages 39-60

  Verano Tacoronte, Domingo ^a   González Betancor, Sara M ^a   Bolívar Cruz, Alicia ^a   Fernández Monroy, Margarita ^a   Galván Sánchez, Inmaculada ^a  

^a UNIVERSITY OF LAS PALMAS DE GRAN CANARIA   (Spain)

Author keywords

Competence; Evaluation; Higher education; Oral skills; Scoring rubric

Indexed keywords

EID: 84953438930     PISSN: 14132478     EISSN: 1809449X     Source Type: Journal    
DOI: 10.1590/S1413-24782016216403     Document Type: Article

References (39)

1. Andrade, H. G. Teaching with rubrics: the good, the bad and the ugly. College Teaching, Taylor and Francis, Reino Unido, v. 53, n. 1, p. 27-30, 2005.
2. Andrade, H. G.; Du, Y. Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, Department of Measurement, Statistics, and Evaluation at the University of Maryland, College Park, MD, v. 10, n. 3, p. 1-11, 2005.
3. Bolívar-Cruz, A.; Dávila-Cárdenes, N.; González-Betancor, S. M.; López-Puig, A. J.; Suárez-Falcón, H.; Verano-Tacoronte, D. Las competencias transversales y el Espacio Europeo de Educación Superior (EEES): una experiencia de evaluación de la competencia de comunicación oral en la ULPGC. In: Jornadas Internacionales de Innovación Universitaria, 8., 2011, Madrid. Actas de Congreso. Madrid: Universidad Europea de Madrid.
4. Bolívar-Cruz, A.; Dávila-Cárdenes, N.; Fernández-Monroy, M.; Galván-Sánchez, I.; González-Betancor, S. M.; López-Puig, A. J.; Suárez-Falcón, H.; Verano-Tacoronte, D.; Dorta-González, P. Evaluación y fomento de la competencia de comunicación oral de los estudiantes universitarios. Revista Iberoamericana de Evaluación Educativa, Red Iberoamericana de Investigación sobre Cambio y Eficacia Escolar (RINACE), [s.n.], v. 6, n. 1, p. 17-28, 2013. Disponible en: Acceso en: 18 sept. 2013.
5. Brennan, R. L. Generalizability of performance assessments. In: Gary, W. P. (Ed.). Technical issues in large-scale performance assessment. Washington, DC: National Centre for Education Statistics, 1996. p. 19-58.
6. Brown, G. T. L.; Glasswell, K.; Harland, D. Accuracy in the scoring of writing: studies of reliability and validity using a New Zealand writing assessment system. Assessing Writing, Elsevier, Reino Unido, v. 9, p. 105-121, 2004.
7. Campbell, K. S.; Mothersbaugh, D. L.; Brammer, C.; Taylor, T. Peer versus self assessment of oral business presentation performance. Business Communication Quarterly, Sage, Reino Unido, v. 64, n. 3, p. 23-40, 2001.
8. Chase, C. I. Contemporary assessment for educators. New York: Longman, 1999.
9. Cortina, J. M. What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, American Psychological Association, Washington, DC, v. 78, p. 98-104, 1993.
10. Fernández-March, A. La evaluación orientada al aprendizaje en un modelo de formación por competencias en la educación universitaria. Revista de Docencia Universitaria, Vigo: Red Estatal de Docencia Universitaria, v. 8, n. 1, p. 11-34, 2010.
11. García-Ros, R. Análisis y validación de una rúbrica para evaluar habilidades de presentación oral en contextos universitarios. Electronic Journal of Research in Educational Psychology, Colegio Oficial de Psicología de Andalucía Oriental, v. 9, n. 25, p. 1.043-1.062, 2011.
12. Halfhill, T. R.; Nielsen, T. M. Quantifying the softer side of management education: an example using teamwork competencies. Journal of Management Education, Sage, Reino Unido, v. 31, n. 1, p. 64-80, 2007.
13. Jonsson, A.; Svingby, G. The use of scoring rubrics: reliability, validity and educational consequences. Educational Research Review, Elsevier, Reino Unido, v. 2, n. 2, p. 130-144, 2007.
14. López-Ruiz, J. I. Un giro copernicano en la enseñanza universitaria: formación por competencias. Revista de Educación, Ministerio de Educación, Cultura y Deporte, Madrid, v. 356, p. 279-301, 2011.
15. Luft, J. Design your own rubric. Science Scope, National Science Teachers Association (NSTA), Arlington, VA, February, v. 20, n. 5, p. 25-27, 1997.
16. Maes, J. D.; Weldy, T. G.; Icenogle, M. L. A managerial perspective: oral communication competency is most important for business students in the workplace. Journal of Business Communication, Association for Business Communication, Sage, Reino Unido, v. 34, n. 1, p. 67-80, 1997.
17. Magin, D.; Helmore, P. Peer and teacher assessments of oral presentation skills: how reliable are they? Studies in Higher Education, Society for Research into Higher Education, Taylor and Francis, Reino Unido, v. 26, n. 3, p. 287-298, 2001.
18. Marcelo, C. Las tecnologías para la innovación y la práctica docente. Revista Brasileira de Educação, Rio de Janeiro: ANPEd; Campinas: Autores Associados, v. 15, n. 52, p. 25-47, enero-abr. 2013. Disponible en: . Acceso en: 20 oct. 2013.
19. Martos-Montes, R.; Callejas-Aguilera, J. E.; Ramírez-Fernández, E.; Estrella-Cañada, R. Entrenamiento y evaluación de la expresión oral. Iniciación a la investigación, Universidad de Jaén, Jaén, v. e4, n. c7, p. I-VII, Número Especial, 2010.
20. Mertler, C. A. Designing scoring rubrics for your classroom. Practical Assessment, Research & Evaluation, Department of Measurement, Statistics, and Evaluation at the University of Maryland, College Park, MD, v. 7, n. 25, 2001. Disponível em: . Acesso em: 28 out. 2015.
21. Miller, G. E. The assessment of clinical skills/competence/performance. Academic Medicine, Journal of the Association of American Medical Colleges, Philadelphia, PA, v. 65, n. 9, p. 63-67, 1990.
22. Montgomery, K. Authentic assessment: a guide for elementary teachers. New York: Longman, 2001.
23. Nassif, V. M. J.; Hanashiro, D. M. M.; Torres, R. R. Fatores que influenciam na percepção das competências para o exercício da docência. Revista Brasileira de Educação, Rio de Janeiro: ANPEd; Campinas: Autores Associados, v. 15, n. 44, p. 364-412, maio/ago. 2010. Disponible en: . Acceso en: 23 oct. 2013.
24. NCA-National Communication Association. The competent speaker speech evaluation form. 2. ed. Washington, DC: National Communication Association, 2007.
25. Nitko, A. J. Educational assessment of students. 3. ed.Upper Saddle River, NJ: Merrill, 2001.
26. Ramos-álvarez, M.-M.; Luque, G. A competence-based constructivist tool for evaluation. Cultura y Educación, Fundación Infancia y Aprendizaje, Routledge, Reino Unido, v. 22, n. 3, p. 329-344, 2010.
27. Reddy, M. Y. Design and development of rubrics to improve assessment outcomes: a pilot study in a Master's level business program in India. Quality Assurance in Education, Emerald, Reino Unido, v. 19, n. 1, p. 84-104, 2011.
28. Reddy, M. Y.; Andrade, H. G. A review of rubric use in higher education. Assessment & Evaluation in Higher Education, Taylor and Francis, Reino Unido, v. 35, n. 4, p. 435-448, 2010.
29. Reinsch Jr., N. L; Shelby, A. N. What communication abilities do practitioners need? Evidence from MBA students. Business Communication Quarterly, Association for Business Communication, Blacksburg, VA, v. 60, n. 4, p. 7-29, 1997.
30. Robertson, S. L. O processo de Bolonha da Europa torna-se global: modelo, mercado, mobilidade, força intelectual ou estratégia para construção do Estado? Revista Brasileira de Educação, Rio de Janeiro: ANPEd; Campinas: Autores Associados, v. 14, n. 42, p. 407-422, set./dez. 2009. Disponible en: . Acceso en: 22 oct. 2013.
31. Smith, D. E. Training programs for performance appraisal: a review. Academy of Management Review, Academy of Management, New York, v. 11, p. 22-40, 1986.
32. Stemler, S. E. A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research & Evaluation, Department of Measurement, Statistics, and Evaluation at the University of Maryland, College Park, MD, v. 9, n. 4, s.p., 2004.
33. Stevens, M. J.; Campion, M. A. The knowledge, skill, and ability requirements for teamwork: implications for human resource management. Journal of Management, Sage, Reino Unido, v. 20, n. 2, p. 503-530, 1994.
34. Stoddart, T.; Abrams, R.; Gasper, E.; Canaday, D. Concept maps as assessment in science inquiry learning-A report of methodology. International Journal of Science Education, Taylor & Francis, Reino Unido, v. 22, p. 1.221-1.246, 2000.
35. Stuhlmann, J.; Daniel, C.; Dellinger, A.; Denny, R. K.; Powers, T. A generalizability study of the effects of training on teachers' abilities to rate children's writing using a rubric. Journal of Reading Psychology, Taylor & Francis, Reino Unido, v. 20, p. 107-127, 1999.
36. Suárez-Falcón, H.; Fernández-Monroy, M.; Galván-Sánchez, I.; Dávila-Cárdenes, N.; González-Betancor, S. M. Preparando a los universitarios para el mundo profesional: Torneo 10 en 5-Idea de Negocio. In: Jornadas Internacionales de Innovación Universitaria, 8., 2011, Madrid. Actas de Congreso. Madrid: Universidad Europea de Madrid.
37. Tinsley, H. E. A.; Weiss, D. J. Interrater reliability and agreement. In: Howard, E. A. T.; Steven, D. B. (Eds.). Handbook of applied multivariate statistics and mathematical modeling. San Diego, CA: Academic Press, 2000. p. 95-124.
38. Weigle, S. C. Investigating rater/prompt interactions in writing assessment: quantitative and qualitative approaches. Assessing Writing, Elsevier, Reino Unido, v. 6, p. 145-178, 1999.
39. Williams, L.; Rink, J. Teacher competency using observational scoring rubrics. Journal of Teaching in Physical Education, Human Kinetics, Champaign, IL, v. 22, p. 552-572, 2003.