The influence of second language experience and accent familiarity on oral proficiency rating: A qualitative investigation

TESOL Quarterly

Volumn 47, Issue 4, 2013, Pages 762-789

  Winke, Paula ^a   Gass, Susan ^a  

^a MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84888055351     PISSN: 00398322     EISSN: 15457249     Source Type: Journal    
DOI: 10.1002/tesq.73     Document Type: Article

References (54)

1. Bent, T., & Bradlow, A. R. (2003). The interlanguage speech intelligibility benefit. Journal of the Acoustical Society of America, 114, 1600-1610. doi:10.1121/1.1603234
2. Bowles, M. A. (2010). The think-aloud controversy in second language research. New York, NY: Routledge.
3. Bradlow, A. R., & Bent, T. (2008). Perceptual adaptation to non-native speech. Cognition, 106, 707-729. doi:10.1016/j.cognition.2007.04.005
4. Bresnahan, M. J., Ohashi, R., Nebashi, R., Liu, W. Y., & Shearman, S. M. (2002). Attitudinal and affective response toward accented English. Language and Communication, 22, 171-185. doi:10.1016/S0271-5309(01)00025-8
5. Brodkey, D. (1972). Dictation as a measure of mutual intelligibility: A pilot study. Language Learning, 22, 203-220. doi:10.1111/j.1467-1770.1972.tb00083.x
6. Brown, A. (1995). The effect of rater variables in the development of an occupation-specific language performance test. Language Testing, 12, 1-15. doi:10.1177/026553229501200101
7. Carey, M. D., Mannell, R. H., & Dunn, P. K. (2011). Does a rater's familiarity with a candidate's pronunciation affect the rating in oral proficiency interviews? Language Testing, 28, 201-219. doi:10.1177/0265532210393704
8. Cargile, A. C., & Giles, H. (1998). Language attitudes toward varieties of English: An American-Japanese context. Journal of Applied Communication Research, 26, 338-356. doi:10.1080/00909889809365511
9. Chalhoub-Deville, M. (1995). Deriving oral assessment scales across different tests and rater groups. Language Testing, 12, 16-33. doi:10.1177/026553229501200102
10. Clarke, C. M., & Garrett, M. F. (2004). Rapid adaptation to foreign-accented English. Journal of the Acoustical Society of America, 116, 3647-3658. doi:10.1121/1.1815131
11. Davies, A. (2011). Does language testing need the native speaker? Language Assessment Quarterly, 8, 291-308.
12. Derwing, T. M., & Munro, M. J. (1997). Accent, intelligibility, and comprehensibility: Evidence from four L1s. Studies in Second Language Acquisition, 19, 1-16.
13. Derwing, T. M., & Munro, M. J. (2005). Second language accent and pronunciation teaching: A research-based approach. TESOL Quarterly, 39, 379-398.
14. Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in second language research: Construction, administration, and processing (2nd ed.). New York, NY: Routledge.
15. Fayer, J. M., & Krasinski, E. (1987). Native and nonnative judgments of intelligibility and irritation. Language Learning, 37, 313-326. doi:10.1111/j.1467-1770.1987.tb00573.x
16. Flege, J. E. (1984). The detection of French accent by American listeners. Journal of the Acoustical Society of America, 76, 692-707. doi:10.1121/1.391256
17. Flege, J. E., Birdsong, D., Bialystok, E., Mack, M., Sung, H., & Tsukada, K. (2006). Degree of foreign accent in English sentences produced by Korean children and adults. Journal of Phonetics, 34, 153-175. doi:10.1016/j.wocn.2005.05.001
18. Floccia, C., Butler, J., Goslin, J., & Ellis, L. (2009). Regional and foreign accent processing in English: Can listeners adapt? Journal of Psycholinguistic Research, 38, 379-412.
19. Gass, S., & Mackey, A. (2000). Stimulated recall methodology in second language research. Mahwah, NJ: Lawrence Erlbaum.
20. Gass, S., & Varonis, E. (1984). The effect of familiarity on the comprehensibility of nonnative speech. Language Learning, 34, 65-89. doi:10.1111/j.1467-1770.1984.tb00996.x
21. Hayes-Harb, R., Smith, B. L., Bent, T., & Bradlow, A. R. (2008). The interlanguage speech intelligibility benefit for native speakers of Mandarin: Production and perception of English word-final voicing contrasts. Journal of Phonetics, 36, 664-679. doi:10.1016/j.wocn.2008.04.002
22. Hornberger, N. H., & Wang, S. C. (2008). Who are our heritage language learners? Identity and biliteracy in heritage language education in the United States. In D. M. Brinton, O. Kagan, & S. Bauckus (Eds.), Heritage language acquisition: A new field emerging (pp. 3-35). New York, NY: Routledge.
23. International Language Testing Association. (2005). Code of ethics for ILTA. Retrieved from http://www.iltaonline.com/code.pdf
24. Jenkins, J. (2000). The phonology of English as an international language: New models, new norms, new goals. Oxford, England: Oxford University Press.
25. Kennedy, S., & Trofimovich, P. (2008). Intelligibility, comprehensibility, and accentedness of L2 speech: The role of listener experience and semantic context. Canadian Modern Language Review, 64, 459-489. doi:10.3138/cmlr.64.3.459
26. Kim, Y. H. (2009). An investigation into native and non-native teachers' judgments of oral English performance: A mixed methods approach. Language Testing, 26, 187-217. doi:10.1177/0265532208101010
27. Lippi-Green, R. (1997). English with an accent: Language ideology and discrimination in the United States. New York, NY: Routledge.
28. Lumley, T., & McNamara, T. F. (1995). Rater characteristics and rater bias: Implications for training. Language Testing, 12, 238-257. doi:10.1177/026553229501200104
29. MacKay, I. R. A., Flege, J. E., & Imai, S. (2006). Evaluating the effects of chronological age and sentence duration on degree of perceived foreign accent. Applied Psycholinguistics, 27, 157-183. doi:10.1017/S0142716406060231
30. Major, R. C. (2001). Foreign accent: The ontogeny and phylogeny of second language phonology. Mahwah, NJ: Lawrence Erlbaum.
31. Major, R. C., Fitzmaurice, S. M., Bunta, F., & Balasubramanian, C. (2002). The effects of nonnative accents on listening comprehension: Implications for ESL assessment. TESOL Quarterly, 36, 173-190. doi:10.2307/3588329
32. Munro, M. J. (2008). Foreign accent and speech intelligibility. In J. G. H. Edwards & M. L. Zampini (Eds.), Phonology and second language acquisition (pp. 193-218). Philadelphia, PA: John Benjamins.
33. Munro, M. J., & Derwing, T. M. (1995). Foreign accent, comprehensibility and intelligibility in the speech of second language learners. Language Learning, 45(1), 73-97. doi:10.1111/j.1467-1770.1995.tb00963.x.
34. Munro, M. J., & Derwing, T. M. (2006). The functional load principle in ESL pronunciation instruction: An exploratory study. System, 34, 520-531. doi:10.1016/j.system.2006.09.004
35. Munro, M. J., Derwing, T. M., & Morton, S. L. (2006). The mutual intelligibility of L2 speech. Studies in Second Language Acquisition, 28, 111-131. doi:10.1017/S0272263106060049
36. Saito, H. (2008). EFL classroom peer assessment: Training effects on rating and commenting. Language Testing, 25, 553-581. doi:10.1177/0265532208094276
37. Scales, J., Wennerstrom, A., Richard, D., & Wu, S. H. (2006). Language learners' perceptions of accent. TESOL Quarterly, 40, 715-738. doi:10.2307/40264305
38. Selinker, L. (1972). Interlanguage. International Review of Applied Linguistics, 10, 209-231. doi:10.1515/iral.1972.10.1-4.209
39. Sidaras, S. K., Alexander, J. E. D., & Nygaard, L. C. (2009). Perceptual learning of systemic variation in Spanish-accented speech. Journal of the Acoustical Society of America, 125, 3306-3316.
40. Smith, L. E., & Bisazza, J. A. (1982). The comprehensibility of three varieties of English for college students in seven countries. Language Learning, 32, 259-269. doi:10.1111/j.1467-1770.1982.tb00971.x
41. Smith, L. E., & Rafiqzad, K. (1979). English for cross-cultural communication: The question of intelligibility. TESOL Quarterly, 13, 371-380. doi:10.2307/3585884
42. Tauroza, S., & Luk, J. (1997). Accent and second language listening comprehension. RELC Journal, 28(1), 54-71. doi:10.1177/003368829702800104
43. Thomas, D. R. (2006). A general inductive approach for analyzing qualitative evaluation data. American Journal of Evaluation, 27, 237-246. doi:10.1177/1098214005283748
44. Varonis, E., & Gass, S. (1982). The comprehensibility of non-native speech. Studies in Second Language Acquisition, 2, 114-136. doi:10.1017/S027226310000437X
45. Weigle, S. C. (1994). Effects of training on raters of ESL compositions. Language Testing, 11, 197-223. doi:10.1177/026553229401100206
46. Weigle, S. C. (1998). Using FACETS to model rater training effects. Language Testing, 15, 263-287. doi:10.1177/026553229801500205
47. Weil, S. A. (2001). Foreign-accented speech: Encoding and generalization. Journal of the Acoustical Society of America, 109, 2473.
48. Wigglesworth, G. (1993). Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction. Language Testing, 10, 305-335. doi:10.1177/026553229301000306
49. Wigglesworth, G. (1994). Patterns of rater behaviour in the assessment of an oral interaction test. Australian Review of Applied Linguistics, 17(2), 77-103.
50. Winke, P., Gass, S., & Myford, C. (2011). The relationship between raters' prior language study and the evaluation of foreign language speech samples (TOEFL iBT Research Report RR-11-30). Princeton, NJ: ETS.
51. Winke, P., Gass, S., & Myford, C. (in press). Raters' L2 background as a potential source of bias in rating oral language. Language Testing.
52. Xi, X., & Mollaun, P. (2009). How do raters from India perform in scoring the TOEFL iBT speaking section and what kind of training helps? (TOEFL iBT Research Report RR-09-31). Princeton, NJ: ETS.
53. Xi, X., & Mollaun, P. (2011). Using raters from India to score a large-scale speaking test. Language Learning, 61, 1222-1255. doi:10.1111/j.1467-9922.2011.00667.x
54. Zhang, B., & Elder, C. (2011). Judgments of oral proficiency by non-native and native English speaking teacher ratings: Competing or complementary constructs? Language Testing, 28, 31-50.