Linking language assessments: An example in a low stakes context

System

Volumn 28, Issue 4, 2000, Pages 555-577

  North, Brian ^a  

^a Eurocentres Foundation   (Switzerland)

Author keywords

Common European framework; Equating; Language assessments; Language proficiency; Scales; Scaling

Indexed keywords

EID: 0034407499     PISSN: 0346251X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0346-251X(00)00038-5     Document Type: Article

References (60)

1. Alderson, J.C., 1991. Bands and scores. In: Alderson and North (eds), Language Testing in Ther 1990s: Modern English Publications/British Council. Macmillan, London, pp. 71-86.
2. Bachman, L.F., 1990. Fundamental Considerations in Language Testing. OUP, Oxford.
3. Bachman, L.F., Davidson, F., Foulkes, J., 1990. A comparison of the abilities measured by the Cambridge and Educational Testing Service EFL test batteries. In: Douglas, D., Chapelle, C. (Eds.), A New Decade of Language Testing Research. Selected Papers from the 1990 Language Testing Research Colloquium, Alexandria VA, TESOL (Teachers of English to speakers of other languages), pp. 25-45.
4. Baker, R., 1997. Classical test theory and item response theory in test analysis. Extracts from: An Investigation of the Rasch Model in its Application to Foreign Language Proficiency Testing. Language Testing Update (Special Report No. 2). Lancaster Centre for Research on Language Education, Department of Linguistics and Modern English Language, Lancaster University.
5. Bernardin, H.J., Smith, P.C., 1981. A clarification of some issues regarding the development and use of Behaviourally Anchored Rating Scales (BARS). Journal of Applied Psychology 66 (4), 458-463.
6. Camilli, G., 1988. Scale shrinkage and the estimation of latent distribution parameters. Journal of Educational Statistics 13 (3), 227-241.
7. Carey, P.A., 1996. A Review of Psychometric and Consequential Issues Related to Performance Assessment (TOEFL Monograph Series MS -3, September). Educational Testing Service, Princeton, NJ.
8. Carroll, B.J., 1980. Testing Communicative Performance. Pergamon, Oxford.
9. Carroll, B.J., West, R., 1989. ESU framework. Performance Scales for English Language Examinations. Longman, Harlow.
10. Cason, G.J., Cason, C.J., 1984. A determinist theory of clinical performance rating. Evaluation and the Health Professions 7, 221-247.
11. Charny, D., 1984. The validity of using a holistic scoring to evaluate writing, a critical overview. Research in the Teaching of English 18, 65-81.
12. Clapham, C., Alderson, J.C., 1997. Constructing and Trialling the IELTS Test (IELTS Research Report No. 3). British Council/University of Cambridge Local Examinations Syndicate/International Development Program of Australian Universities and Colleges, London.
13. Council of Europe, 1996. Modern languages: Learning, teaching, assessment. A Common European Framework of Reference (CC-LANG (95) 5 Rev IV). Council of Europe, Strasbourg.
14. Cziko, G., 1984. Some problems with empirically-based models of communicative competence. Applied Linguistics 5 (1), 23-38.
15. Davidson, F., Bachman, L.F., 1990. The cambridge-TOEFL comparability study: An example of the cross-national comparison of language tests. AILA Review 7, 24-46.
16. Fulcher, G., 1995. Variable competence in second language acquisition: A problem for research methodology? System 23 (1), 25-33.
17. Fulcher, G., 1996. Testing tasks: Issues in task design and the group oral. Language Testing 13 (1), 23-52.
18. Gipps, C., 1994. Beyond Testing. Falmer Press, London.
19. Henning, G., 1987. A Guide to Language Testing: Development, Evaluation, Research. Newbury House, Cambridge.
20. Ingram, D.E., 1985. Assessing proficiency: An overview of some aspects of testing. In: Hyltenstam, K., Pienemann, M. (Eds.), Modelling and Assessing Second Language Development. Multilingual Matters, Clevedon, pp. 215-276.
21. Jacobs, H.J., Zingraf, S.A., Wormuth, D.R., Hartfiel, V.F., Hughey, J.B., 1981. Testing ESL Composition: A Practical Approach. Newbury House, Rowley, MA.
22. Jones, N., 1993 An Item Bank for Testing English Language Proficiency: Using the Rasch Model to Construct an Objective Measure. PhD thesis, University of Edinburgh.
23. Kirsch, I.S., Mosenthal, P.B., 1995. Interpreting the IEA reading literacy scales. In: Binkley, M., Rust, K., Wingleee, M. (Eds.), Methodological Issues in Comparative Educational Studies: The Case of the IEA Reading Literacy Study. US Department of Education, National Center for Education Statistics, Washington, DC, pp. 135-192.
24. Klein-Braley, C., Raatz, U., 1984. A survey of research on the c-test. Language Testing 1 (2), 134-146.
25. Linacre, J.M., 1989. Multi-Faceted Measurement. MESA Press, Chicago, IL.
26. Linn, R.L., 1993. Linking results of distinct assessments. Applied Measurement in Education 6 (1), 83-102.
27. Liskin-Gasparro, J.E., 1984. The ACTFL proficiency guidelines: Gateway to testing and curriculum. Foreign Language Annals 17 (5), 475-489.
28. McNamara, T., 1995. Modelling performance: Opening Pandora's box. Applied Linguists 16, 159-179.
29. McNamara, T., 1996. Measuring Second Language Performance. Addison Wesley Longman, Harlow, Essex.
30. Messick, S., 1989. Validity. In: Linn, R. (Ed.), Educational Measurement, 3rd Edition. American Council on Education/Macmillan, New York, pp. 13-103.
31. Mislevy, R.J., 1992. Linking educational assessments. Concepts, Issues, Methods and Prospects. Educational Testing Service, Princeton, NJ.
32. Mislevy, R.J., 1993. Foundations of a new test theory. In: Frederiksen, N., Mislevy, R.J., Bejar, I.I. (Eds.), Test Theory for a New Generation of Tests. Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 19-40.
33. Mislevy, R.J., 1995. Test theory and language learning assessment. Language Testing 12 (3), 341-369.
34. North, B., 1986. Activities for Continuous Communicative Assessment. Unpublished MA Phase 3 project, English Language Research Department, Birmingham, UK.
35. North, B., 1991. Standardisation of continuous assessment grades. In: Alderson, North (eds), Language Testing in the 1990s: Modern English Publications/British Council. Macmillan, London, pp. 167-177.
36. North, B., 1993. The Development of Descriptors on Scales of Proficiency: Perspectives, Problems, and a Possible Methodology (NFLC Occasional Paper, April). National Foreign Language Center, Washington DC.
37. North, B., 1994a. Itembanker: A testing tool for language teachers. Language Testing Update 16, 85-97.
38. North, B., 1994b. Scales of Language Proficiency: A Survey of Some Existing Systems. Council of Europe, Strasbourg.
39. North, B., 1996/2000. The Development of a Common Framework Scale of Language Proficiency. PhD thesis, Thames Valley University 1996; New York, Peter Lang 2000.
40. North, B., 2000. Scales for rating language performance: Descriptive models, Formulation Styles, and Presentation Formats (TOEFL 2000 Research Paper). Educational Testing Service, Princeton, NJ (in preparation).
41. North, B., Schneider, G., 1998. Scaling descriptors for language proficiency scales. Language Testing 15 (2), 217-262.
42. O'Loughlin, K.J., 1995 Candidate performance on direct and semi-direct versions of an oral proficiency test. Paper Presented at the 17th Annual Language Testing Research Colloquium, Long Beach, California.
43. Omaggio Hadley, A.C., 1986/1993. Teaching Language in Context: Proficiency-Oriented Instruction, 2nd Edition. Heinle & Heinle, Boston, MA.
44. Purves, A.C., 1992. Reflections on research and assessment in written composition. Research in the Teaching of English 26 (1), 108-122.
45. Sang, B., Schmitz, B., Vollmer, H.J., Baumert, J., Roeder, P.M., 1986. Models of second language competence: A structural equation approach. Language Testing 3 (1), 54-79.
46. Scarino, A., 1997a. Issues in assessing and reporting. Paper Presented at the Conference of the Modern Language Teachers' Association of Victoria, 17 July 1997.
47. Scarino, A., 1997b. Analysing the language of frameworks of outcomes for foreign language learning. In: Proceedings of the AFMLTA 11th National Languages Conference, pp. 241-258.
48. Scarino, A., Jenkins, M., 1996. A focus on learning within descriptors of language proficiency outcomes. Paper Presented at the International Language in Education Conference, December 1996.
49. Shohamy, E., 1996. Competence and performance in language testing. In: Brown, G., Malmkjoer, K., Williams, J. (Eds.), Performance and Competence in Second Language Acquisition. Cambridge University Press, Cambridge, pp. 136-151.
50. Stansfield, C.W., Kenyon, D.M., 1996. Comparing the scaling of speaking tasks by language teachers and by the ACTFL guidelines. In: Cumming, A., Berwick, R. (Eds.), Validation in Language Testing. Multilingual Matters, Clevedon, pp. 124-153.
51. Thompson, I., 1995. A study of the interrater reliability of the ACTFL oral proficiency interview in five European languages: Data from ESL, French, German, Russian and Spanish. Foreign Language Annals 28 (3), 407-422.
52. Van Ek, J.A., Trim, J.L.M., 1990. Threshold Level 1990. Council of Europe, Strasbourg.
53. Van Ek, J.A., Trim, J.L.M., 1991. Waystage 1990. Council of Europe, Strasbourg.
54. Van Ek, J.A., Trim, J.L.M., 1996. Vantage Level. Council of Europe, Strasbourg.
55. Warm, T.A., 1989. Weighted likelihood estimation of ability in item response theory. Psychometrika 54 (3), 427-450.
56. Weigle, C.S., 1998. Using FACETS to model rater training effects. Language Testing 15 (2), 263-287.
57. White, E., 1993. Holistic scoring: Past triumphs, future challenges. In: Williamson, M.M., Huot, B.A. (Eds.), Validating Holistic Scoring for Writing Assessment. Hampton Press, Cresskill, NJ, pp. 79-108.
58. Wilds, C.P., 1975. The oral interview test. In: Spolsky, B., Jones, R. (Eds.), Testing Language Proficiency. Center for Applied Linguistics, Washington, DC, pp. 29-44.
59. Woods, A., Baker, R., 1985. Item response theory. Language Testing 2 (2), 117-140.
60. Wright, B.D., Stone, M.H., 1979. Best Test Design. MESA Press, Chicago, IL.