The MERLIN corpus: Learner language and the CEFR

Proceedings of the 9th International Conference on Language Resources and Evaluation, LREC 2014

Volumn , Issue , 2014, Pages 1281-1288

  Boyd, Adriane ^a   Hana, Jirka ^b   Nicolas, Lionel ^c   Meurers, Detmar ^a   Wisniewski, Katrin ^d   Abel, Andrea ^c   Schöne, Karin ^d   Štindlová, Barbora ^b   Vettori, Chiara ^c  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b CHARLES UNIVERSITY   (Czech Republic)

^c EURAC   (Italy)

^d DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

CEFR; Corpus annotation; Czech; German; Italian; Language proficiency; Language testing; Learner corpora

Indexed keywords

TEACHING;

CEFR; CORPUS ANNOTATIONS; CZECH; GERMAN; ITALIAN; LANGUAGE PROFICIENCY; LANGUAGE TESTING; LEARNER CORPORA;

CLASSIFICATION (OF INFORMATION);

EID: 85028669070     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (46)

1. Aharodnik, K., Chang, M., Feldman, A., and Hana, J. (2013). Automatic identification of learners' language background based on their writing in Czech. In Proceedings of the Sixth International Joint Conference on Natural Language Processing, pages 1428-1436, Nagoya, Japan, October. Asian Federation of Natural Language Processing. http://aclweb.org/anthology/I13-1200.pdf.
2. Alderson, J. (1991). Bands and scores. In Alderson, J. and North, B., editors, Language testing in the 1990s, pages 71-86. British Council/Macmillan, London.
3. Alderson, C. (1996). Do corpora have a role in language assessment. Using corpora for language research, pages 248-259.
4. Bachman, L. F. and Palmer, A. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.
5. Bestgen, Y. and Granger, S. (2011). Categorising spelling errors to assess L2 writing. International Journal of Continuing Engineering Education and Life-Long Learning, 21(2/3):235-252.
6. Braun, S. (2005). From pedagogically relevant corpora to authentic language learning contents. ReCALL, 17(1):47-64.
7. Bulté, B. and Housen, A. (2012). Defining and operationalising L2 complexity. In Housen, A., Kuiken, F., and Vedder, I., editors, Dimensions of L2 Performance and Proficiency: Complexity, Accuracy and Fluency in SLA, pages 21-46. Benjamins, Amsterdam.
8. Carlsen, C. (2010). Discourse connectives across CEFR levels: A corpus-based study. In Bartning, I., Martin, M., and Vedder, I., editors, Communicative Proficiency and Linguistic Development: intersections between SLA and language testing research, pages 191-210.
9. Carlsen, C., editor. (2013). Norsk Profil. Det europeiske rammeverket spesifisert for norsk. Et første steg. Novus, Oslo.
10. Chiarcos, C., Dipper, S., Götze, M., Leser, U., Lüdeling, A., Ritz, J., and Stede, M. (2008). A flexible framework for integrating annotations from different tools and tagsets. Traitement Automatique des Langues, 49(2):271-293.
11. Council of Europe, (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. http;//www.coe.int/lang.
12. Eckes, T., (2009). Many-Facet Rasch Measurement. Strasbourg, France.
13. Fulcher, G., Davidson, F., and Kemp, J. (2011). Effective rating scale development for speaking tests: Performance decision trees. Language Testing, 28(1):5-29.
14. Fulcher, G. (2004). Deluded by artifices? The common european framework and harmonization. Language Assessment Quarterly, 1(4):253-266.
15. Gilquin, G. and Granger, S. (2010). How can data-driven learning be used in language teaching. The Routledge handbook of corpus linguistics, pages 359-370.
16. Gilquin, G., Granger, S., and Paquot, M. (2007). Learner corpora: The missing link in eap pedagogy. Journal of English for Academic Purposes, 6(4):319-335.
17. Glaboniat, M., Müller, M., and Wertenschlag, L. (2003). "Profile deutsch" - Lernzielbeschreibungen und sprachliche Mittel für Deutsch als Fremdsprache auf vier Niveaustufen des europäischen Referenzrahmens. In Schneider, G. and Clalüna, M., editors, Mehr Sprache - mehrsprachig - mit Deutsch. Didaktische und politische Perspektiven, pages 247-255. München: iudicium verlag 2003.
18. Granger, S. (2008). Learner corpora. In Lüdeling, A. and Kytö, M., editors, Corpus linguistics. An international handbook, pages 259-275. Walter de Gruyter, Berlin, New York.
19. Granger, S. (2009). The contribution of learner corpora to second language acquisition and foreign language teaching: A critical evaluation. In Aijmer, K., editor, Corpora and Language Teaching, pages 13-32. John Benjamins.
20. Hancke, J. and Meurers, D. (2013). Exploring CEFR classification for German based on rich linguistic modeling. In Learner Corpus Research 2013. Book of Abstracts, pages 54-56, Bergen, Norway. http://purl.org/dm/papers/Hancke.Meurers-13.html.
21. Hancke, J., Meurers, D., and Vajjala, S. (2012). Readability classification for German using lexical, syntactic, and morphological features. In Proceedings of the 24th International Conference on Computational Linguistics (COLING), pages 1063-1080, Mumbay, India. http://aclweb.org/anthology/C12-1065.pdf.
22. Hancke, J. (2013). Automatic prediction of CEFR proficiency levels based on linguistic features of learner language. Master's thesis, International Studies in Computational Linguistics. Seminar für Sprachwissenschaft, Universität Tübingen.
23. Hasil, J., Hájková, E., and Hasilová, H. (2007). Brána jazyka českého otevřená. Karolinum, Prague.
24. Hawkins, J. A. and Filipović, L. (2012). Criterial features in L2 English: Specifying the reference levels of the Common European Framework. Cambridge University Press.
25. Hulstijn, J. H. (2007). The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency. The Modern Language Journal, 91:663-667.
26. Jan, E., Schönherr, T., and Dallapiazza, R. M. (1998). Tangram: Deutsch als Fremdsprache. Kurs- und Arbeitsbuch 1 A. Hueber, Munich.
27. Lu, X. (2011). A corpus-based evaluation of syntactic complexity measures as indices of college-level esl writers' language development. TESOL Quarterly, 45(1):36-62, March.
28. Lüdeling, A., Walter, M., Kroymann, E., and Adolphs, P. (2005). Multi-level error annotation in learner corpora. In Proceedings of Corpus Linguistics, Birmingham.
29. Lüdeling, A. (2008). Mehrdeutigkeiten und Kategorisierung: Probleme bei der Annotation von Lernerkorpora. In Walter, M. and Grommes, P., editors, Fortgeschrittene Lernervarietäten: Korpuslinguistik und Zweispracherwerbsforschung, pages 119-140. Max Niemeyer Verlag, Tübingen.
30. Malvern, D. D., and Richards., B. J., Chipere, N., and Duran, P. (2004). Lexical diversity and language development: Quantification and assessment. Palgrave Macmillan.
31. Meurers, D. (2013). Natural language processing and language learning. In Chapelle, C. A., editor, Encyclopedia of Applied Linguistics. Blackwell. http://purl.org/dm/papers/meurers-13.html.
32. Mezzadri, M. (2000). Rete! Book 1. Guerra Edizioni, Perugia.
33. Müller, C. and Strube, M. (2006). Multi-level annotation of linguistic data with MMAX2. Corpus technology and language pedagogy: New resources, new tools, new methods, 3:197-214.
34. North, B. (2000). The Development of a Common Framework Scale of Language Proficiency. Peter Lang, Oxford.
35. Reznicek, M., Lüdeling, A., Krummes, C., and Schwantuschke, F., (2012). Das Falko-Handbuch. Korpusaufbau und Annotationen Version 2.0. http://purl.org/net/falko-maual.pdf.
36. Reznicek, M., Lüdeling, A., and Hirschmann, H. (2013). Competing target hypotheses in the Falko corpus: A flexible multi-layer corpus architecture. In Díaz-Negrillo, A., Ballier, N., and Thompson, P., editors, Automatic Treatment and Analysis of Learner Corpus Data, pages 101-123. John Benjamins, Amsterdam.
37. Roemer, U. (2008). Corpora and language teaching. In Lüdeling, A. and Kytö, M., editors, Origin and history of corpus linguistics - corpus linguistics vis-à-vis other disciplines, Volume 1. De Gruyter Mouton.
38. Spinelli, B. and Parizzi, F. (2010). Profilo della lingua italiana. La Nuova Italia, Firenze.
39. Taylor, L. and Barker, F. (2008). Using corpora for language assessment. In Encyclopedia of language and education, pages 2377-2390. Springer.
40. Tetreault, J., Blanchard, D., and Cahill, A. (2013). A report on the first native language identification shared task. In Proceedings of the Eighth Workshop on Building Educational Applications Using NLP, Atlanta, GA, USA, June. Association for Computational Linguistics.
41. Trosborg, A. (1995). Interlanguage Requests and Apologies. de Gruyter, Berlin.
42. Vajjala, S. and Meurers, D. (2012). On improving the accuracy of readability classification using insights from second language acquisition. In Proceedings of the 7th Workshop on Innovative Use of NLP for Building Educational Applications, pages 163-173. http://aclweb.org/anthology/W12-2019.pdf.
43. Wisniewski, K., Schöne, K., Nicolas, L., Vettori, C., Boyd, A., Meurers, D., Abel, A., and Hana, J. (2013). MERLIN: An online trilingual learner corpus empirically grounding the european reference levels in authentic learner data. In ICT for Language Learning 2013, Conference Proceedings, Florence, Italy. Libreriauniversitaria.it Edizioni.
44. Wisniewski, K. (2013). The empirical validity of the CEFR fluency scale: the A2 level description. In Galaczi, E. D. and Weir, C. J., editors, Exploring Language Frameworks: Proceedings of the ALTE Krakow Conference, Studies in Language Testing, pages 253-272. Cambridge University Press, Cambridge.
45. Wisniewski, K. (2014). Die Validität der Skalen des Gemeinsamen europäischen Referenzrahmens für Sprachen. Eine empirische Untersuchung der Flüssigkeits- und Wortschatzskalen des GeRS am Beispiel des Italienischen und des Deutschen. Number 33 in Language Testing and Evaluation Series. Peter Lang, Frankfurt.
46. Zipser, F., Zeldes, A., Ritz, J., Romary, L., and Leser, U. (2011). Pepper: Handling a multiverse of formats. In 33. Jahrestagung der Deutschen Gesellschaft für Sprachwissenschaft. DGfS-CL Poster Session, Göttingen. http://purl.org/net/pepper-11.pdf.