Scaling descriptors for language proficiency scales

Language Testing

Volumn 15, Issue 2, 1998, Pages 217-262

  North, Brian ^a   Schneider, Günther ^b  

^a Eurocentres Foundation   (Switzerland)

^b UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0000367192     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/026553229801500204     Document Type: Article

References (108)

1. Alderson, J. C. 1990a: Judgements in language testing, version three. Paper presented at the 9th World Congress of Applied Linguistics, Thessaloniki, Greece, April.
2. Alderson, J. C. 1990b: Testing reading comprehension skills (Part One). Reading in a Foreign Language 6, 425-438.
3. Alderson, J. C. 1991: Bands and scores. In Alderson, J. C. and North, B., editors, Language testing in the 1990s, London: Modern English Publications/British Council/Macmillan, 71-86.
4. Alderson, J. C. and Lukmani, Y. 1989: Cognition and reading: cognitive levels as embodied in test questions. Reading in a Foreign Language 5, 253-270.
5. Alderson, J. C. and North, B., editors, 1991: Language testing in the 1990s. London: Modern English Publications/British Council/Macmillan.
6. Andrich, D. 1988: Thurstone Scales. In Keeves J. P., editor, Educational research, methodology and measurement: an international handbook, Oxford/New York, Pergamon Press, 303-306.
7. Association of Language Testers in Europe (ALTE) 1998: ALTE Handbook of European Language examinations and examination systems: descriptions of examinations offered and examinations administered by members of the Association of Language Testers in Europe. Cambridge: University of Cambridge Local Examinations Syndicate.
8. Bachman, L. F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press.
9. Bachman L. F. and Palmer A. 1982: The construct validation of some components of communicative proficiency. TESOL Quarterly 16, 449-464.
10. Bachman, L. F. and Savignon S. J. 1986: The evaluation of communicative language proficiency: a critique of the ACTFL oral interview. Modern Language Journal 70, 380-390.
11. Bejar, I. 1980: A procedure for investigating the unidimensionality of achievement tests based on item parameter estimates. Journal of Educational Measurement 17, 283-296.
12. Blais, J.-G. and Laurier, M. 1995: The dimensionality of a placement test from several analytic perspectives. Language Testing 12, 72-98.
13. Brindley, G. 1986: The assessment of second language proficiency: issues and approaches. Adelaide: National Curriculum Resource Centre.
14. Brindley, G. 1989: Assessing achievement in the learner-centred curriculum, NCELTR Research Series. Sydney: Macquarie University.
15. Brindley, G. 1991: Defining language ability: the criteria for criteria. In Anivan, S., editor, Current developments in language testing, Singapore: Regional Language Centre.
16. Brindley, G. forthcoming: Describing language development? Rating scales and second language acquisition. In Bachman, L. F. and Cohen, A. D., editors, Interfaces between SLA and language testing research. Cambridge: Cambridge University Press.
17. Brown, A., Elder, C., Lumley, T., McNamara, T. and McQueen, J. 1992: Mapping abilities and skills levels using Rasch techniques. Paper presented at the 14th Language Testing Research Colloquium, Vancouver.
18. Brumfit, C. J. 1984: Communicative methodology in language teaching: the roles of fluency and accuracy. Cambridge: Cambridge University Press.
19. Brumfit, C. J. 1987: Concepts and categories in language teaching methodology. AILA Review 4, 25-31.
20. Camilli, G. 1988: Scale shrinkage and the estimation of latent distribution parameters. Journal of Educational Statistics 13, 227-241.
21. Canale, M. and Swain, M. 1980: Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1, 1-47.
22. Carroll, B. J. and West, R. 1989. ESU (English-speaking union) framework. Performance scales for English language examinations. London: Longman.
23. Carroll, J. B. 1983: Psychometric theory and language testing. In Oller, J. W., editor, Issues in language testing research. Rowley, MA: Newbury House, 80-107.
24. Chalhoub-Deville, M. 1997: Theoretical models, assessment frameworks and test construction. Language Testing 14, 3-22.
25. Choi, I. C. and Bachman, L. F. 1992: An investigation of the adequacy of three IRT models for data from two EFL reading tests. Language Testing 9, 51-78.
26. Clark, J. L. 1985: Curriculum renewal in second language learning: an overview. Canadian Modern Language Review 42, 342-360.
27. Council of Europe 1992: Transparency and coherence in language learning in Europe: objectives, assessment and certification. Proceedings of the intergovernmental symposium held at Rüschlikon, November 1991 (North, B., editor). Strasbourg: Council of Europe.
28. Clark, J. L. 1996: Modern languages: learning, teaching, assessment. A common European framework of reference. Draft 2 of a framework proposal. CC-LANG (95) 5 rev IV. Strasbourg: Council of Europe.
29. Clark, J. L. 1997: European language portfolio. Proposals for development. CC-LANG (97)1. Strasbourg: Council of Europe.
30. Cziko, G. 1984: Some problems with empirically-based models of communicative competence. Applied Linguistics 5, 23-38.
31. Dandonoli, P. and Henning, G. 1990: An investigation of the construct validity of the ACTFL proficiency guidelines and oral interview procedure. Foreign Language Annals 23, 11-22.
32. De Jong, H. A. L. 1990: Response to Masters: linguistic theory and psycho-metric models, in De Jong, H.A.L. and Stevenson D.K., Individualising the assessment of language abilities, Cleveland: Multilingual Matters, 71-82.
33. Farhady, H. 1982: Measures of language proficiency from the learner's perspective. TESOL Quarterly 16, 43-59.
34. Fillmore, C. 1979: On fluency. In Fillmore, C., Kempler, D. and Wang, W., editors, Individual differences in language ability and language behaviour, New York: Academic Press, 85-101.
35. Fulcher, G. 1987: Tests of oral performance: the need for data-based criteria. ELT Journal 41, 287-291.
36. Fulcher, G. 1993: The construction and validation of rating scales for oral tests in English as a foreign language. PhD thesis, University of Lancaster.
37. Griffin, P. E. 1989: Monitoring proficiency development in language. Paper presented at the Annual Congress of the Modern Language Teachers Association of Victoria, Monash University, 10-11 July.
38. Griffin, P. E. 1990a: Profiling literacy development: monitoring the accumulation of reading skills. Australian Journal of Education 34, 290-311.
39. Griffin, P. E. 1990b: Literacy rating scales: literacy: learning for life. Unpublished paper, Assessment Research Centre, Phillips Institute of Technology.
40. Griffin, P. E. and McKay P. 1992: Assessment and reporting in the ESL Language and Literacy in Schools Project. In National Languages and Literacy Institute of Australia, ESL development: language and literacy in schools project. Volume 2: Documents on bandscale development and language acquisition. Canberra: National Languages and Literacy Institute of Australia. Cited in Brindley, G., forthcoming, Describing language development? Rating scales and second language acquisition. In Bachman, L. F. and Cohen, A. D., editors, Interfaces between SLA and language testing research, Cambridge: Cambridge University Press.
41. Henning, G. 1992: Dimensionality and construct validity of language tests. Language Testing 9, 1-11.
42. Hulstjin, J. H. 1985: Testing second language proficiency with direct procedures. A response to Ingram. In Hyltensstam K. and Pienemann M., editors, Modelling and assessing second language development, Clevedon: Multilingual Matters, 277-282.
43. Jaeger, R. M. 1976: Measurement consequences of selected standard setting models. Florida Journal of Educational Research 18, 22-27.
44. Jaeger, R. M. 1989: Certification of student competence. In Linn, R. L., editor, Educational measurement (3rd edn), New York: American Council on Education/Macmillan, 485-514.
45. Johnson, R. A. and Wichern, D. W. 1992: Applied multivariate statistical analysis (3rd edn). Englewood Cliffs: Prentice Hall.
46. Jones, N. 1993: An item bank for testing English language proficiency: using the Rasch model to construct an objective measure. PhD thesis, University of Edinburgh.
47. Keeves J. P., editor, 1988: Educational research, methodology and measurement: an international handbook. Oxford/New York: Pergamon Press.
48. Kellerman, E., Bongearts, T. and Poulisse, N. 1987: Strategy and system in L2 referential communication. In Ellis R., Second language acquisition in context, Englewood Cliffs: Prentice Hall, 100-112.
49. Kenyon, D. M. and Stansfield, C. W. 1992: Examining the validity of a scale used in a performance assessment from many angles using the many-faceted Rasch model. Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, April. Washington, DC: Center for Applied Linguistics.
50. Languages Lead Body 1992: National standards for languages: units of competence and assessment guidance. UK Languages Lead Body, July.
51. Lantolf, J. and Frawley, W. 1985: Oral proficiency testing: a critical analysis. Modern Language Journal 69, 337-345.
52. Lantolf, J. and Frawley, W. 1988: Proficiency, understanding the construct. Studies in Second Language Acquisition 10, 181-196.
53. Lantolf, J. and Frawley, W. 1992: Rejecting the OPI again: a response to Hagen. ADFL Bulletin 23, 34-37.
54. Lennon, P. 1990: Investigating fluency in EFL: a quantitative approach. Language Learning, 40, 387-417.
55. Linacre, J. M. 1989: Multi-faceted measurement. Chicago: MESA Press.
56. Liskin-Gasparro, J. E. 1984: The ACTFL proficiency guidelines: a historical perspective. In Higgs, T. C., editor, Teaching for proficiency, the organising principle. Lincolnwood, IL: National Textbook Company, 11-42.
57. Lowe, P. 1983: The IRL oral interview: origins, applications, pitfalls and implications. Unterrichtspraxis 16, 230-244.
58. Lumley T. 1993: Reading comprehension sub-skills: teachers' perceptions of content in an EAP test. Melbourne Papers in Language Testing 2, 25-55.
59. Luoma, S. 1993: Validating the (Finnish) certificates of foreign language proficiency. Paper presented at the 15th Language Testing Research Colloquium, Cambridge and Arnhem, 2-4 August.
60. Masters, G. 1982: A Rasch model for partial credit scoring. Psychometrika 47, 149-174.
61. Matthews, M. 1990: The measurement of productive skills. Doubts concerning the assessment criteria of certain public examinations. ELT Journal 44, 117-120.
62. McNamara, T. 1995: Modelling performance: opening Pandora's box. Applied Linguistics 16, 159-179.
63. McNamara, T. 1996: Measuring second language performance. Harlow, Essex: Addison Wesley Longman.
64. Milanovic, M. and Saville, N., editors, 1996: Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate.
65. Milanovic, M., Saville, N., Pollitt, A. and Cook, A. 1992: Developing and validating rating scales for CASE: theoretical concerns and analyses. Paper presented at the 14th Annual Language Testing Research Colloquium. In Cumming, A. and Berwick, R., editors, 1996, Validation in language testing, Clevedon: Multilingual Matters, 15-38.
66. Mullis, I. V. S. 1980: Using the primary trait system for evaluating writing. Manuscript No. 10-W-51, Educational Testing Service, Princeton, NJ, reprinted December 1981.
67. North, B. 1991: Standardisation of continuous assessment grades. In Alder-son, J. C. and North, B., editors, Language testing in the 1990s, London: Modern English Publications/British Council/Macmillan, 167-177.
68. North, B. 1993a: Transparency, coherence and washback in language assessment. In Sajavaara, K., Takala, S., Lambert, D. and Morfit, C., editors, 1994, National foreign language policies: practices and prospects. University of Jyväskyla: Institute for Education Research, 157-193.
69. North, B. 1993b: The development of descriptors on scales of proficiency: perspectives, problems, and a possible methodology. NFLC Occasional Paper. Washington, DC: National Foreign Language Center, April.
70. North, B. 1994: Scales of language proficiency: a survey of some existing systems. Strasbourg: Council of Europe.
71. North, B. 1995: The development of a common framework scale of descriptors of language proficiency based on a theory of measurement. System 23, 445-465.
72. North, B. 1996: The development of a common framework scale of descriptors of language proficiency based on a theory of measurement. Unpublished PhD thesis, Thames Valley University.
73. North, B. 1997: Perspectives on language proficiency and aspects of competence. Language Teaching 30, 93-100.
74. Oller, J. W., editor, 1983: Issues in language testing research. Rowley, MA: Newbury House.
75. Oscarson, M. 1978/1979: Approaches to self-assessment in foreign language learning. Strasbourg: Council of Europe, 1978: Oxford, Pergamon, 1979.
76. Oscarson, M. 1984: Self-assessment of foreign language skills: a survey of research and development work. Strasbourg: Council of Europe.
77. Pienemann, M. and Johnston, M. 1987: Factors influencing the development of language proficiency. In Nunan, D., editor, Applying second language acquisition research, Adelaide: National Curriculum Resource Centre, 89-94.
78. Pollitt, A. 1991: Response to Alderson: bands and scores. In Alderson, J. C. and North, B., editors, Language testing in the 1990s, London: Modern English Publications/British Council/Macmillan, 87-94.
79. Pollitt, A. 1993 Reporting reading test results in grades. Paper presented at the 15th Language Testing Research Colloquium, Cambridge and Arnhem, 2-4 August.
80. Pollitt, A. and Hutchinson, C. 1987: Calibrating graded assessments; Rasch partial credit analysis of performance in writing. Language Testing 4, 72-92.
81. Pollitt, A. and Murray, N. L. 1993/1996: What raters really pay attention to. Paper presented at the 15th Language Testing Research Colloquium, Cambridge and Arnhem, 2-4 August 1993. In Milanovic, M. and Saville, N. editors, 1996, Performance testing, cognition and assessment, Cambridge: University of Cambridge Local Examinations Syndicate.
82. Richterich, R. and Schneider, G. 1992: Transparency and coherence: why and for whom? In Council of Europe, Transparency and coherence in language learning in Europe: objectives, assessment and certification, proceedings of the intergovernmental symposium held at Rüschlikon, November 1991, Strasbourg: Council of Europe, 43-50.
83. Sang, B., Schmitz, H. J., Vollmer, J. and Roeder P. M. 1986: Models of second language competence: a structural equation approach. Language Testing 3, 54-79.
84. Schärer, R. 1992: A European language portfolio - a possible format. In Council of Europe, Transparency and coherence in language learning in Europe: objectives, assessment and certification, proceedings of the intergovernmental symposium held at Rüschlikon, November 1991, Strasbourg: Council of Europe, 140-146. Reprinted in Schärer, R. and North, B. 1992: Towards a common European framework for reporting language competency. NFLC Occasional Paper. Washington, DC: National Foreign Language Center.
85. Schneider, G. and North, B. forthcoming: Assessment and self-assessment of foreign language proficiency at cross-over-points in the Swiss educational system: transparent and coherent description of foreign language competence as assessment, reporting and planning instruments. Bern: National Science Research Council.
86. Skehan, P. 1984: Issues in the testing of English for specific purposes. Language Testing 1, 202-220.
87. Skehan, P. 1995: Analysability, accessibility and ability for use. In Cook, G. and Seidelhofer, S., editors, Principle and practice in applied linguistics. Oxford: Oxford University Press.
88. Smith, P. C. and Kendall, J. M. 1963: Retranslation of expectations: an approach to the construction of unambiguous anchors for rating scales. Journal of Applied Psychology 47, 149-154.
89. Spolsky, B. 1986: A multiple choice for language testers. Language Testing 3, 147-158.
90. Spolsky, B. 1989: Conditions for second language learning. Introduction to a general theory. Oxford: Oxford University Press.
91. Spolsky, B. 1993: Testing and examinations in a national foreign language policy. In Sajavaara, K., Takala, S., Lambert, D. and Morfit, C., editors, 1994, National foreign language policies: practices and prospects, University of Jyväskyla: Institute for Education Research, 194-214.
92. Stansfield, C. W. and Kenyon, D. 1992: Comparing scales of speaking tasks by language teachers and by the ACTFL guidelines. Paper presented at the 14th Language Testing Research Colloquium Vancouver. In Cumming, A. and Berwick, R., editors, 1996, Validation in language testing, Clevedon, Avon: Multilingual Matters, 124-153.
93. Tarone, E. 1980 Communication strategies, foreigner talk and repair in interlanguage. Language Learning 30, 417-431.
94. Tarone, E. 1983/1981 Some thoughts on the notion of 'Communication strategy'. In Faerch, C. and Kasper, G., editors, 1983, Strategies in interlanguage communication, London: Longman, 63-68 (originally published in TESOL Quarterly, September 1981).
95. Thomas, J. 1983: Cross-cultural pragmatic failure. Applied Linguistics 4, 91-112.
96. Thurstone, L. L. 1928: Attitudes can be measured. American Journal of Sociology 33, 529-554. Cited in Wright, B. D. and Masters, G., 1982, Rating scale analysis, Chicago: Mesa Press, 10-15.
97. Trim, J. L. M. 1978: Some possible lines of development of an overall structure for a European unit/credit scheme for foreign language learning by adults. Strasbourg: Council of Europe.
98. Upshur, J. A. and Homburg, T. J. 1983: Some relations among language tests at successive ability levels. In Oller, J. W., editor, Issues in language testing research, Rowley, MA: Newbury House.
99. Upshur, J. A. and Turner, C. E. 1995: Constructing rating scales for second language tests. ELT Journal 49, 3-12.
100. Van Ek, J. A. 1986: Objectives for foreign language teaching: Volume I: scope. Strasbourg: Council of Europe.
101. Warm, T. A. 1989: Weighted likelihood estimation of ability in item response theory. Psychometrika 54, 427-450.
102. Wilds, C. P. 1975: The oral interview test. In Spolsky, B. and Jones, R., Testing language proficiency. Washington DC: Center for Applied Linguistics, 29-44.
103. Woods, A. and Baker, R. 1985: Item response theory. Language Testing 2, 117-140.
104. Wright, BLiskin-Gasparro J. E. D. and Grosse, M. 1993: How to set standards, Rasch Measurement, Transactions of the Rasch Measurement Special Interest Group of the American Educational Research Association 7/3, 315-316.
105. Wright, B. D. and Linacre, J. M. 1987: Research notes, Rasch Measurement, Transactions of the Rasch Measurement Special Interest Group of the American Educational Research Association 1/1, 2-3.
106. Wright, B. D. and Linacre, J. M. 1989: Research notes, Rasch Measurement, Transactions of the Rasch Measurement Special Interest Group of the American Educational Research Association 3/3, 1-3.
107. Wright, B. D. and Masters, G. 1982: Rating scale analysis. Chicago: Mesa Press.
108. Wright, B. D. and Stone, M. H. 1979: Best test design. Chicago: Mesa Press.