A longitudinal quantitative investigation into the concurrent validity of self and peer assessment applied to English-Chinese bi-directional interpretation in an undergraduate interpreting course

Studies in Educational Evaluation

Volumn 58, Issue , 2018, Pages 187-196

  Han, Chao ^a  

^a SOUTHWEST UNIVERSITY   (China)

Author keywords

Concurrent validity; Consecutive interpreting; Peer assessment; Rating accuracy; Self assessment; Teacher assessment

Indexed keywords

EID: 85040562423     PISSN: 0191491X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.stueduc.2018.01.001     Document Type: Article

References (49)

1. AlFallay, I., The role of some selected psychological and personality traits of the rater in the accuracy of self- and peer-assessment. System 32:3 (2004), 407–425.
2. Aryadoust, V., Self- and peer assessments of oral presentations by first-year university students. Language Assessment Quarterly 20:3 (2015), 199–225.
3. Babaii, E., Taghaddomi, S., Pashmforoos, R., Speaking self-assessment: Mismatches between learners’ and teachers’ criteria. Language Testing 33:3 (2016), 411–437.
4. Bachman, L.F., Fundamental considerations in language testing. 1990, Oxford University Press, Oxford, UK.
5. Blanche, P., Merino, B.J., Self-assessment of foreign-language skills: Implications for teachers and researchers. Language Learning 39:3 (1989), 313–340.
6. Boud, D., Falchikov, N., Quantitative studies of student self-assessment in higher education: A critical analysis of findings. Higher Education 18:5 (1989), 529–549.
7. Butler, Y.G., Lee, J., The effects of self-assessment among young learners of English. Language Testing 27:1 (2010), 5–31.
8. Chen, Y.-M., Learning to self-assess oral performance in English: A longitudinal case study. Language Teaching Research 12:2 (2008), 235–262.
9. Cheng, W., Warren, M., Peer assessment of language proficiency. Language Testing 22:1 (2005), 93–121.
10. Choi, J.Y., Metacognitive evaluation method in consecutive interpretation for novice learners. Meta 51:2 (2006), 273–283.
11. Falchikov, N., Boud, D., Student self-assessment in higher education: A meta-analysis. Review of Educational Research 59:4 (1989), 395–430.
12. Fowler, Y., Formative assessment: Using peer and self-assessment in interpreter training. Wadensjö C., Dimitrova, B.E., Nilsson, A.-L., (eds.) The critical link 4: Professionalisation of interpreting in the community, 2007, John Benjamins, Amsterdam & Philadelphia, 253–262.
13. Gile, D., Fidelity assessment in consecutive interpretation: An experiment. Target 7:1 (1995), 151–164.
14. Gile, D., Variability in the perception of fidelity in simultaneous interpretation. Hermes 22 (1999), 51–79.
15. Han, C., Investigating rater severity/leniency in interpreter performance testing: A multifaceted Rasch measurement approach. Interpreting 17:2 (2015), 255–283.
16. Han, C., Investigating score dependability in English/Chinese interpreter certification performance testing: A generalizability theory approach. Language Assessment Quarterly 13:3 (2016), 186–201.
17. Han, C., A generalizability theory study of optimal measurement design for a summative assessment of English/Chinese consecutive interpreting. 2017 (Manuscript submitted for publication).
18. Han, C., Using rating scales to assess interpretation: Practices, problems and prospects. Interpreting 20:1 (2018), 60–96.
19. Han, C. Using analytic rating scales to assess English-Chinese bi-directional interpretation: A longitudinal Rasch analysis of scale utility and rater behavior, Linguistica Antverpiensia, New Series: Themes in Translation Studies, 16, forthcoming.
20. Han, C., Riazi, M., Investigating the effects of speech rate and accent on simultaneous interpretation: A mixed-methods approach. Across Languages and Cultures 18:2 (2017), 227–259.
21. Hartley, A., Mason, I., Peng, G., Perez, I., Peer- and self-assessment in conference interpreter training. 2003 [Retrieved from https://www.llas.ac.uk/resourcedownloads/1454/hartley.rtf last consulted June 2015].
22. Iaroslavschi, M., Becoming an interpreter: Assessment and self-assessment in untutored practice sessions. Cognition, Brain, Behavior 15:2 (2011), 229–249.
23. Knoch, U., Rating scales for diagnostic assessment of writing: What should they look like and where should the criteria come from?. Assessing Writing 16:2 (2011), 81–96.
24. Lee, Y.-H., Self-assessment as an autonomous learning tool in an interpretation classroom. Meta, 50(4), 2005.
25. Lee, J., Rating scales for interpreting performance assessment. The Interpreter and Translator Trainer 2:2 (2008), 165–184.
26. Lee, Y.-H., Comparing self-assessment and teacher's assessment in interpreter training. T&I Review 1 (2011), 87–111.
27. Lee, S.-B., Developing an analytic scale for assessing undergraduate students’ consecutive interpreting performances. Interpreting 17:2 (2015), 226–254.
28. Lee, S.-B., Exploring a relationship between students’ interpreting self-efficacy and performance: Triangulating data on interpreter performance assessment. The Interpreter and Translator Trainer, 2017, 1–22, 10.1080/1750399X.2017.1359763.
29. Lee, S.-B., University students’ experience of ‘scale-referenced’ peer assessment for a consecutive interpreting examination. Assessment and Evaluation in Higher Education 42:7 (2017), 1015–1029.
30. Lew, M.D.N., Alwis, W.A.M., Schmidt, H.G., Accuracy of students’ self-assessment and their beliefs about its utility. Assessment and Evaluation in Higher Education 35:2 (2010), 135–156.
31. Lim, H.-O., A jury of your peers: Peer assessment in consecutive interpretation pedagogy. Forum 11:1 (2013), 77–97.
32. Liu, M., Design and analysis of Taiwan's interpretation certification examination. Tsagari, D., van Deemter, R., (eds.) Assessment issues in language translation and interpreting, 2013, Peter Lang, Frankfurt, 163–178.
33. Magin, D., Helmore, P., Peer and teacher assessments of oral presentation skills: How reliable are they?. Studies in Higher Education 26:3 (2001), 287–298.
34. Messick, S., Validity. Linn, R.L., (eds.) Educational measurement, 3rd ed., 1989, American Council on Education and Macmillan, New York, 13–103.
35. Patri, M., The influence of peer feedback on self- and peer-assessment of oral skills. Language Testing 19:2 (2002), 109–131.
36. Postigo Pinazo, E., Self-assessment in teaching interpreting. TTR: Traduction, Terminologie, Redaction 21:1 (2008), 173–209.
37. Ross, S., Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing 15:1 (1998), 1–20.
38. Russo, M., Self-evaluation: The awareness of one's own difficulties as a training tool for simultaneous interpretation. The Interpreters’ Newsletter 6 (1995), 75–85.
39. Saito, H., Fujita, T., Characteristics and user acceptance of peer rating in EFL writing classrooms. Language Teaching Research 8:1 (2004), 31–54.
40. Saito, H., EFL classroom peer assessment: Training effects on rating and commenting. Language Testing 25:4 (2008), 553–581.
41. Sawyer, D.B., Fundamental aspects of interpreter education: Curriculum and assessment. 2004, John Benjamins, Amsterdam, Netherlands & Philadelphia, PA.
42. Schjoldager, A., Assessment of simultaneous interpreting. Dollerup, C., Appel, V., (eds.) Teaching translation and interpreting 3: New horizons, 1996, John Benjamins, Amsterdam & Philadelphia, 187–195.
43. Stauffer, L.K., ASL students’ ability to self assess ASL competency. Journal of Interpretation 21:1 (2011), 80–95.
44. Sullivan, K., Hall, C., Introducing students to self-assessment. Assessment and Evaluation in Higher Education 22:3 (1997), 289–305.
45. Wang, J.-H., Napier, J., Goswell, D., Carmichael, A., The design and application of rubrics to assess signed language interpreting performance. The Interpreter and Translator Trainer 9:1 (2015), 83–103.
46. Ward, M., Gruppen, L., Regehr, G., Measuring self-assessment: Current state of the art. Advances in Health Sciences Education 7:1 (2002), 63–80.
47. Witter-Merithew, A., Taylor, M., Johnson, L., Guided self-assessment and professional development planning: A model applied to interpreters in educational settings. Nettles, C., (eds.) Proceedings of the 17th national conference of the registry of interpreters for the deaf, 2001, RID Publications, Alexandria, VA, 153–226.
48. Wolfe, E.W., Jiao, H., Song, T., A family of rater accuracy models. Journal of Applied Measurement 16:2 (2015), 153–160.
49. Wu, S.-C., Assessing simultaneous interpreting: A study on test reliability and examiners’ assessment behavior. Unpublished PhD thesis, 2010, Newcastle University, UK.