The Rasch wars: The emergence of Rasch measurement in language testing

Language Testing

Volumn 29, Issue 4, 2012, Pages 555-576

  McNamara, Tim ^a   Knoch, Ute ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

FACETS; history of language testing; item response theory; multi faceted Rasch measurement; Rasch measurement

Indexed keywords

EID: 84867343586     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/0265532211430367     Document Type: Article

References (74)

1. AdamsR. (1989). Measurement error and its effects upon statistical analysis. Unpublished doctoral dissertation, University of Chicago.
2. Adams R.,Griffin P.,Martin L.A latent trait method for measuring a dimension in second language proficiency.Language Testing. 1987;4 (1): 9-27.
3. Adams R.,Siek Toon K.Quest: The interactive test analysis system. Melbourne: Australian Council for Educational Research; 1993:.
4. Alderson C.Innovations in language testing. Portal M., ed. Windsor, Berks: NFER-Nelson; 1986:93-105.
5. Alderson C.Reviews of English language proficiency tests. Alderson C.Krahnke K.Stansfield C., ed. Washington, DC: Teachers of English to Speakers of Other Languages; 1987:3-4.
6. Alderson C.,Clapham C.,Wall D.Language test construction and evaluation. Cambridge: Cambridge University Press; 1995:.
7. Andrich D. A.A rating scale formulation for ordered response categories.Psychometrika. 1978;43:561-573.
8. Bachman L.Modern language testing at the turn of the century: Assuring that what we count counts.Language Testing. 2000;17 (1): 1-42.
9. Bachman L.,Davidson F.,Ryan K.,Choi I.-C.An investigation into the comparability of two tests of English as a foreign language: The Cambridge TOEFL comparability study. Cambridge: Cambridge University Press; 1995:.
10. Bachman L.,Lynch B.,Mason M.Investigating variability in tasks and rater judgements in a performance test of foreign language speaking.Language Testing. 1995;12 (2): 238-257.
11. BakerR. (1987). An investigation of the Rasch model in its application to foreign language proficiency testing. Unpublished PhD thesis. University of Edinburgh, Edinburgh.
12. Baker R.Classical test theory and item response theory in test analysis. Lancaster: Centre for Research in Language Education; 1997:.
13. Bartholomew D. J.,Deary I. J.,Lawn M.Sir Godfrey Thomson: A statistical pioneer.Journal of the Royal Statistical Society. Series A (Statistics in Society). 2009;172 (2): 467-482.
14. Bonk W.,Ockey G.A many-facet Rasch analysis of the second language group oral discussion task.Language Testing. 2003;20 (1): 89-110.
15. Brindley G.,Slatyer H.Exploring task difficulty in ESL listening assessment.Language Testing. 2002;19 (4): 369-394.
16. Brown A.The effect of rater variables in the development of an occupation-specific language performance test.Language Testing. 1995;12:1-15.
17. Buck G.The appropriacy of psychometric measurement models for testing second language listening comprehension.Language Testing. 1994;11 (2): 145-170.
18. Canale M.Theoretical bases of communicative approaches to second-language teaching and testing.Applied Linguistics. 1986;1:1-47.
19. Chen Z.,Henning G.Linguistic and cultural bias in language proficiency tests.Language Testing. 1985;2 (2): 155-163.
20. Clark J. L. D.,Clifford R. T.The FSI/ILR/ACTFL proficiency scales and testing techniques: Development, current status and needed research.Studies in Second Language Acquisition. 1988;10 (2): 129-147.
21. Davidson F.Assessing second language writing in academic contexts. Hamp-Lyons L., ed. Norwood, NJ: Ablex; 1991:155-164.
22. Davidson F.,Henning G.A self-rating scale of English difficulty: Rasch scalar analysis of items and rating categories.Language Testing. 1985;2 (2): 164-179.
23. Davies A.Assessing academic English: Testing English proficiency 1950-1989 - the IELTS solution. Cambridge: Cambridge University Press; 2008:.
24. De Jong J. H. A. L.Focusing in on a latent trait: An attempt at construct validation using the Rasch model. Practice and problems in language testing 5. Papers presented at the International Language Testing Symposium; 1983Arnhem, Netherlands; 1983. 11.
25. De JongJ. H. A. L. (1991). Defining a variable of foreign language ability: An application of item response theory. Unpublished PhD thesis, Twente University, The Netherlands.
26. De Jong J. H. A. L.,Glas C. A. W.Validation of listening comprehension tests using item response theory.Language Testing. 1987;4 (2): 170-194.
27. Elder C.,Knoch U.,Barkhuizen G.,von Randow J.Individual feedback to enhance rater training: Does it work?.Language Assessment Quarterly. 2005;2 (3): 175-196.
28. Goldstein H.Consequences of using the Rasch Model for educational assessment.British Educational Research Journal. 1979;5:211-220.
29. Griffin P.New directions in language testing. Lee Y. P.Fok A. C. Y.Lord R.Low G., ed. Oxford: Pergamon; 1985:149-161.
30. Griffin P.,Adams R.,Martin L.,Tomlinson B.An algorithmic approach to prescriptive assessment in English as a second language.Language Testing. 1988;5 (1): 1-18.
31. Hambleton R. K.,Swaminathan H.,Rogers H. J.Fundamentals of item response theory. Newbury Park, CA: Sage; 1991:.
32. Hamp-Lyons L.Applying the partial credit model of Rasch analysis: Language testing and accountability.Language Testing. 1989;6 (1): 109-118.
33. Henning G.Advantages of latent trait measurement in language testing.Language Testing. 1984;1 (2): 123-133.
34. Henning G.A guide to language testing. Development, evaluation, research. Cambridge, MA: Newbury House; 1987:.
35. Henning G.An American view on ELTS. ELTS Validation Project: Proceedings of a conference held to consider the ELTS Validation Project Report. English Language Testing Service Research Report 1; 1988a; 1988a. 84.
36. Henning G.The influence of test and sample dimensionality on latent trait person ability and item difficulty calibration.Language Testing. 1988b;5 (1): 83-99.
37. Henning G.Dimensionality and construct validity of language tests.Language Testing. 1992;9 (1): 1-11.
38. Henning G.,Davidson F.Language testing research: Selected papers from the 1986 Colloquium. Bailey K.Dale T.Clifford R., ed. Monterey, CA: Defense Language Institute; 1987:.
39. Henning G.,Hudson T.,Turner J.Item response theory and the assumption of unidimensionality for language tests.Language Testing. 1985;2 (2): 141-154.
40. Ingram D. E.,Wylie E.Adult Migrant Education Program Teachers Manual. Canberra: Department of Immigration and Ethnic Affairs; 1979:.
41. Jones N.Language testing in the 1990s. Alderson C.North B., ed. London: Modern English Publications/British Council/Macmillan; 1991:247-254.
42. JonesN. (1992). An item bank for testing English language proficiency: Using the Rasch model to construct an objective measure. University of Edinburgh, Unpublished PhD thesis.
43. Lawley D. N.On problems connected with item selection and test construction.Proceedings of the Royal Society of Edinburgh. 1943;61:273-287.
44. LinacreJ. M. (1989). Many faceted Rasch measurement. Unpublished doctoral dissertation, University of Chicago.
45. Linacre J. M.Chicago: Winsteps.com; 2009:.
46. Lo Bianco J.National policy on languages. Canberra: Australian Government Publishing Service; 1987:.
47. Lunt H.,Morton J.,Wigglesworth G.Rater behaviour in performance testing: Evaluating the effect of bias feedback. Paper presented at 19th annual congress of Applied Linguistics Association of Australia; 1994University of Melbourne; 1994.
48. Lynch B.,Davidson F.,Henning G.Person dimensionality in language test validation.Language Testing. 1988;5 (2): 206-219.
49. Lynch B.,McNamara T.Using G-theory and Many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants.Language Testing. 1998;15 (2): 158-180.
50. Masters G. N.A Rasch model for partial credit scoring.Psychometrica. 1982;47:149-174.
51. McNamaraT. (1990a). Assessing the second language proficiency of health professionals. Unpublished PhD thesis, The University of Melbourne.
52. McNamara T.Item response theory and the validation of an ESP test for health professionals.Language Testing. 1990b;7 (1): 52-75.
53. McNamara T.Test dimensionality: IRT analysis of an ESP listening test.Language Testing. 1991;8 (2): 139-159.
54. McNamara T.Measuring second language performance. London & New York: Longman; 1996:.
55. McNamara T.Experimenting with uncertainty: Essays in Honor of Alan Davies. Elder C.Brown A.Grove E.Hill K.Iwashita N.Lumley T.McNamara T.O'Loughlin K., ed. Cambridge: Cambridge University Press; 2001:5-10.
56. McNamara T.,Adams R.Selected Papers of the 13th Annual Language Testing Research Colloquium (LTRC). Princeton, NJ: Educational Testing Service, International Testing and Training Program Office; 1994:.
57. North B.The development of descriptors on scales of proficiency: Perspectives, problems, and a possible methodology. Washington, DC: National Foreign Language Center; 1993:.
58. NorthB. (1995). The development of a common framework scale of descriptors of language proficiency based on a theory of measurement. Thames Valley University, Unpublished PhD thesis.
59. Nunan D.Applying second language acquisition research. Nunan D., ed. Adelaide: National Curriculum Resource Centre; 1987:143-171.
60. Perkins K.,Miller L. D.Comparative analyses of English as a Second Language reading comprehension data: Classical test theory and latent trait measurement.Language Testing. 1984;1 (1): 21-32.
61. Pollitt A.,Hutchinson C.Calibrating graded assessments: Rasch partial credit analysis of performance in writing.Language Testing. 1987;4 (1): 72-92.
62. Pollitt A.,Hutchinson C.,Entwistle N.,De Luca C.What makes exam questions difficult? An analysis of 'O' grade questions and answers. Edinburgh: Scottish Academic Press; 1985:.
63. Rasch G.Probablilistic models for some intelligence and attainment tests. Chicago: University of Chicago Press; 1960/1980 1980:.
64. Rentz R. R.,Bashaw W. L.The National Reference Scale for Reading: An application of the Rasch Model.Journal of Educational Measurement. 1977;14 (2): 161-179.
65. Skehan P.Language testing. Part II.Language Teaching. 1989;22 (1): 1-13.
66. Technology and language testing: A collection of papers from the Seventh Annual Language Testing Research Colloquium. Stansfield C. W., ed. Washington, DC: Teachers of English to Speakers of Other Languages; 1986:.
67. Stansfield C. W.,Kenyon D. M.The concept of validation in language testing. Cumming A.Berwick R., ed. Clevedon, Avon: Multilingual Matters; 1995:124-153.
68. van Weeren J. Papers presented at the International Language Testing Symposium; 1983Arnhem, Netherlands; 1983.
69. WeigleS. C. (1994). Effects of training on raters of English as a second language compositions: Quantitative and qualitative approaches. Unpublished PhD, University of California, Los Angeles.
70. Widdowson H. G.Linguistics. Oxford: Oxford University Press; 1996:.
71. Wigglesworth G.Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction.Language Testing. 1993;10 (3): 305-323.
72. Wood R.Assessment and testing. Cambridge: Cambridge University Press; 1991:.
73. Wright B. D.,Andrich D. A.Rasch and Wright: The early years.Rasch Measurement Transactions, Pre-History. 1987;:1-4.
74. Wu M. L.,Adams R.,Wilson M.Melbourne: ACER Press; 1998:.