Standard setting in relation to the common European framework of reference for languages: The case of the state examination of Dutch as a second language

Language Assessment Quarterly

Volumn 6, Issue 2, 2009, Pages 126-150

  Bechger, Timo M ^a   Kuijper, Henk ^a   Maris, Gunter ^a  

^a Cito group   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 74049145402     PISSN: 15434303     EISSN: 15434311     Source Type: Journal    
DOI: 10.1080/15434300802457521     Document Type: Article

References (34)

1. Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, UK: Oxford University Press
2. Bechger, T. M., Hemker, B. T., & Maris, G. K. J. (2001). About the cluster kappa coefficient (R&D Report No. 2001-3). Arnhem, the Netherlands: Cito. Retrieved June 2007 from http://www.cito.nl/share/poc/ reports/Report01-03.pdf
3. Berk, R. A. (1976). Determination of optimal cutting scores in criterion-referenced measurement. Journal of Experimental Education, 45, 4-9
4. Brennan, R. L., & Prediger, D. J. (1981). Coefficient kappa: Some uses, misuses, and alternatives. Educational and Psychological Measurement, 41, 687-699
5. CBS. (2002). Standaard onderwijsindeling 1998: Editie 2002/'03. Voorburg, the Netherlands: Author
6. CINOP, Citogroep, Bureau ICE, & BVE Raad. (2002, June). Naar een portfolio NT2. Taalportfolio voor leerders van het Nederlands (CINOP's Hertogenbosch). Retrieved January 2007 from http://www.taalportfolio.nl
7. Cizek, G. J., & Bunch, M. B. (2007). Standard setting: A guide to establishing and evaluating performance standards on tests. Sage: London
8. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46
9. Council of Europe. (2001). Common European Framework of Reference for Languages: learning, teaching, assessment. Cambridge, UK: Cambridge University Press. Retrieved June 2007 from http://www.coe.int/T/DG4/Linguistic/ Default-en.asp
10. Council of Europe. (2003). Relating language examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEF) (Preliminary Pilot Version of the Manual). Strasbourg, France: Language Policy Division. aRetrieved June 2007 from http://www.coe.int/ T/DG4/Linguistic/Default-en.asp
11. Dalderop, K., Liemberg, E., & Teunisse, F. (2002). Raamwerk NT2. De Bilt, the Netherlands: BVE-Raad
12. Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1-26
13. Efron, B., & Tibshirani, R. J. (1998). An introduction to the bootstrap. London: Chapman & Hall/CRC
14. Figueras, N., North, B., Takala, S., Verhelst, N., & Van Avermaet, P. (2005). Relating examinations to the Common European Framework: A manual. Language Testing, 22, 261-278
15. Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley
16. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage
17. Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 485-511). Washington, DC: American Council on Education
18. Kaftandjieva, F. (2004). Standard setting. In Reference Supplement to the preliminary pilot version of the Manual for Relating Language examinations to the CEF, Section B (DGIV/EDU/LANG(2004) 13). Strasbourg, France: Language Policy Division
19. Kane, M. (1998). Choosing between examinee-centered and test-centered standard-setting methods. Educational Assessment, 5, 129-145
20. Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking. New York: Springer
21. Kuijper, H., Bergsma, A., & Bechger, T. M. (2004a, August). Staatsexamen NT2. Het gewenste niveau Deel 1 Behoeftepeiling Programma II [State-examination Dutch as a Second Language: The desired level Study I: Assessment of requirements for Programme II]. Arnhem, the Netherlands: Citogroep
22. Kuijper, H., Bergsma, A., & Bechger, T. M. (2004b, December). Staatsexamen NT2. Het gewenste niveau. Deel 2B Cesuurindicatie Spreken en Schrijven Programma II. Aanvullend onderzoek [State examination Dutch as a second language: The desired level Study IIB: The cutscores for speaking and writing programme II]. Arnhem, the Netherlands: Citogroep
23. Kuijper, H., Bergsma, A., & Bechger, T. M. (2005a, May). Staatsexamen NT2. Het gewenste niveau. Deel 3 Behoeftepeiling Programma I [State exam Dutch as a second language Study III: Assessment of requirements for Programme I]. Arnhem, the Netherlands: Citogroep
24. Kuijper, H., Bergsma, A., & Bechger, T. M. (2005, August). Staatsexamen NT2. Het gewenste niveau. Deel 4 Cesuurindicatie Spreken en Schrijven Programma I [State-exam Dutch as a second language: Study IV: The cutscore for speaking an writing Programme I]. Arnhem, the Netherlands: Citogroep
25. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174
26. Liemberg, E., & Hulstijn, J. (1996, November). Referentiekader NT2, Concept 2. Amersfoort, the Netherlands: PROVE
27. Livingston, S. A., & Zieky, M. J. (1982). Cutscores: A manual for setting standards on performance on educational and occupational tests. Princeton, NJ: ETS
28. Maris, G., & Bechger, T. M. (2007). Scoring open ended questions. In C. R. Rao & S. Sindarya (Eds.), Handbook of statistics: Psychometrics (pp. 663-681). Amsterdam: Elsevier
29. Nederlanse Taalunie. (2006). Gemeenschappelijk Europees referentiekader voor moderne vreemde talen: Leren, onderwijzen, beoordelen [The Common European Framework of reference for Languages: Learning, teaching and assessing]. The Hague, the Netherlands. Retrieved from http:// taalunieversum.org/onderwijs/ publicaties/gemeenschappelijk-europees- referentiekader/
30. Pepe, M. S. (2000). Receiver operating characteristic methodology. Journal of the American Statistical Association, 95, 308-311
31. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics, 2, 110-114
32. Tannenbaum, R. J., & Wylie, E. C. (2003). Mapping test scores onto the Common European Framework: Setting standards of language proficiency on the TOEFL, The Test of Spoken English (TSE), The test of Written English (TWE), and the test of English for International Communication (TOEIC). Princeton, NJ: ETS
33. Trim, J. (Ed.). (2001). The Common European Framework of References for languages: A Guide for users. Strasbourg, France: Council of Europe
34. Yen, W. M., & Fitzpatrick, A. R. (2006). Item response theory. In R. L. Brennan (Ed.), Educational measurement (4th ed.) (pp. 111-153). Westport, CT: American Council on Education/Praeger