Modern language testing at the turn of the century: Assuring that what we count counts

Language Testing

Volumn 17, Issue 1, 2000, Pages 1-42

  Bachman, Lyle F ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84990348116     PISSN: 02655322     EISSN: None     Source Type: Journal    
DOI: 10.1177/026553220001700101     Document Type: Article

References (265)

1. Adams, R. J., Griffin, P. E. and Martin, L. 1987: A latent trait method for measuring a dimension in second language proficiency. Language Testing 4(1), 9-28.
2. Alderson, J. C. 1981: Report of the discussion on communicative language testing. In Alderson, J. C. and Hughes, A., editors, Issues in language testing. ELT Documents 111. London: British Council.
3. Alderson, J. C. 1983: Response to Harrrison: who needs jam? In Hughes, A. and Porter, D., editors, Current developments in language testing. London: Academic Press, 87-92.
4. Alderson, J. C. 1991: Language testing in the 1990s: how far have we come? How much further have we to go? In Anivan, S., editor, Current developments in language testing Singapore: SEAMEO Regional Language Centre. 1-26.
5. Alderson, J. C. 1993: The state of language testing in the 1990s. In Huhta, A. Sajavaara, K. and Takala, S., editors, Language testing: new openings. Jyväskyla: University of Jyväskyla, 1-19.
6. Alderson, J. C. 1999: Reading constructs and reading assessment. In Chalhoub-Deville, M., editor, Issues in computer-adaptive testing of reading proficiency. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 49-70.
7. Alderson, J. C. and Bachman, L. F., editors, 2000: Cambridge language assessment series. Cambridge: Cambridge University Press.
8. Alderson, J. C. and Clapham, C. 1993: Examining the ELTS Test: an account of the first stage of the ELTS revision project: IELTS research report 2. London, Cambridge, Canberra: The British Council, University of Cambridge Local Examinations Syndicate, International Development Program for Australian Universities and Colleges.
9. Alderson, J. C. and Hamp-Lyons, L. 1996: TOEFL preparation courses: a study of washback. Language Testing 13(3), 280-297.
10. Alderson, J. C. and Urquhart, A. H. 1985: The effect of students” academic discipline on their performance on ESP reading tests. Language Testing 2(2), 192-204.
11. Alderson, J. C. and Wall, D. 1993: Does washback exist? Applied Linguistics 14, 115-129.
12. Alderson, J. C. and Wall, D. 1996: Special Issue: Washback. Language Testing 13(3).
13. Allen, P., Cummins, J., Mougeon, R. and Swain, M. 1983: The development of bilingual proficiency: second year report and appendices. Toronto: Modern Language Centre, Ontario Institute for Studies in Education.
14. Anderson, N., Bachman, L. F., Cohen, A. D. and Perkins, K. 1991: An exploratory study into the construct validity of a reading comprehension test: triangulation of data sources. Language Testing 8(1), 41-66.
15. Aschbacher, P. R. 1991: Performance assessment: state of activity, interest, and concerns. Applied Measurement in Education 4, 275-288.
16. Association of Language Testers in Europe. 1993: Principles of good practice for ALTE examinations. Cambridge: ALTE and University of Cambridge Local Examinations Syndicate.
17. Bachman, L. F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press.
18. Bachman, L. F. 1991: What does language testing have to offer? TESOL Quarterly 25(4), 671-704.
19. Bachman, L. F. 1997: Generalizability theory. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic Publishers, 255-262.
20. Bachman, L. F. and Clark, J. L. D. 1987: The measurement of foreign/second language proficiency. In Lambert, R. D., editor, Foreign language instruction: a national agenda. Special issue of the Annals of the American Academy of Political and Social Science, 490, March. Newbury Park, CA: Sage, 20-33.
21. Bachman, L. F. and Cohen, A. D. 1998: Language testing-SLA interfaces: an update. In Bachman, L. F. and Cohen, A. D., editors, Interfaces between second language acquisition and language testing research. Cambridge: Cambridge University Press.
22. Bachman, L. F., Davidson, F. and Milanovic, M. 1996: The use of test methods in the content analysis and design of EFL proficiency tests. Language Testing 13(2), 125-150.
23. Bachman, L. F. and Eignor, D. R. 1997: Recent advances in quantitative test analysis. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 227-242.
24. Bachman, L. F., Lynch, B. K. and Mason, M. 1995: Investigating variability in tasks and rater judgments in a performance test of foreign language speaking. Language Testing 12, 238-257.
25. Bachman, L. F. and Palmer, A. S. 1981: The construct validation of the FSI oral interview. Language Learning 31(1), 67-86.
26. Bachman, L. F. and Palmer, A. S. 1982: The construct validation of some components of communicative proficiency. TESOL Quarterly 16(4), 449-465.
27. Bachman, L. F. and Palmer, A. S. 1996: Language testing in practice: designing and developing useful language tests. Oxford: Oxford University Press.
28. Bae, J. and Bachman, L. F. 1998: A latent variable approach to listening and reading: testing factorial invariance across two groups of children in the Korean/English two-way immersion program. Language Testing 15(3), 380-414.
29. Bailey, K. M. 1996: Working for washback: a review of the washback concept in language testing. Language Testing 13(3), 257-279.
30. Bailey, K. M. and Brown, J. D. 1996: Language testing courses: what are they? In Cumming, A. and Berwick, R., editors, Validation in language testing. Clevedon: Multilingual Matters, 236-256.
31. Baker, E. L., O”Neil, H. F. and Linn, R. L. 1993: Policy and validity prospects for performance-based assessment. American Psychologist 48(12), 1210-1218.
32. Banerjee, J. and Luoma, S. 1997: Qualitative approaches to test validation. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 275-287.
33. Barnwell, D. P. 1996: A history of foreign language testing in the United States: from its beginnings to the present. Tempe, AZ: Bilingual Press.
34. Berk, R., editor, 1984: A guide to criterion-referenced test construction. Baltimore, MD: Johns Hopkins University Press.
35. Bernhardt, E. 2000: If reading is reader-based, can there be a computer-adaptive test of reading? In Chalhoub-Deville, M., editor, Issues in computer-adaptive testing of reading proficiency. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 1-10.
36. Berry, V. 1993: Personality characteristics as a potential source of language test bias. In Huhta, A. Sajavaara, K. and Takala, S., editors, Language testing: new openings. Jyväskyla: University of Jyväskyla, 114-124.
37. Berwick, R. and Ross, S. 1996: Cross-cultural pragmatics in oral proficiency interview strategies. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 34-54.
38. Bolis, R. E., Hinofotis, F. B. and Bailey, K. M. 1982: An introduction to generalizability theory in second language research. Language Learning 32, 245-258.
39. Bolt, R. F. 1992: Crossvalidation of item response curve models using TOEFL data. Language Testing 9, 79-95.
40. Brennan, R. L. and Johnson, E. G. 1995: Generalizability of performance assessments. Educational Measurement: Issues and Practice 14(4), 9-12.
41. Brown, A. 1995: The effect of rater variables in the development of an occupation-specific language performance test. Language Testing 12(1), 1-15.
42. Brown, A. and Lumley, T. 1997: Interviewer variability in specific-purpose language performance tests. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: proceedings of LTRC 96. Jyväskyla: University of Jyväskyla, 137-150.
43. Brown, J. D. 1988: Improving ESL placement tests using two perspectives. TESOL Quarterly 23, 65-83.
44. Brown, J. D., editor, 1998: New ways of classroom assessment. Alexandria, VA: TESOL.
45. Brown, J. D. 1999: The relative importance of persons, items subtests and languages to TOEFL test variance. Language Testing 16(2), 217-238.
46. Brown, J. D. and Hudson, T. 1998: The alternatives in language assessment. TESOL Quarterly 32(4), 653-675.
47. Brown, J. D., Knowles, M., Murray, D., Neu, J. and Violand-Hainer, E. 1992: TESOL research task force survey. Paper presented at the TESOL Convention, Vancouver.
48. Buck, G. 1991: The testing of listening comprehension: an introspective study. Language Testing 8, 67-91.
49. Burger, S. E. and Burger, D. L. 1994: Determining the validity of performance-based assessment. Educational Measurement: Issues and Practice, 13(1), 9-15.
50. Camp, R. 1993: Changing the model for the direct assessment of writing. In Williamson, M. M. and Huot, B. A., editors, Validating holistic scoring for writing assessment. Creskill, NJ: Hampton Press.
51. Canale, M. 1984: A communicative approach to language proficiency assessment in a minority setting. In Rivera, C., editor, Communicative competence approaches to language proficiency assessment: research and application. Clevedon: Multilingual Matters, 107-122.
52. Canale, M. 1986: The promise and threat of computerized adaptive assessment of reading comprehension. In Stansfield, C.W., Technology and language testing. Alexandria, VA: TESOL, 29-45.
53. Canale, M. and Swain, M. 1981: Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1(1), 1-47.
54. Carroll, B. J. 1981: Specifications for an English language testing service. In Alderson, J. C. and Hughes, A., editors, Issues in language testing: ELT Document 111. London: The British Council, 66-110.
55. Carroll, J. B. 1968: The psychology of language testing. In Davies, A., editor, Language testing symposium: a psycholinguistic approach. Oxford: Oxford University Press, 46-69.
56. Carroll, J. B. 1973: Foreign language testing: will the persistent problems persist? In O”Brien, M. C., editor, Testing in second language teaching: new dimensions. Dublin: ATESOL-Ireland, 6-17.
57. Chalhoub-Deville, M. 1995: Deriving oral assessment scales across different tests and rater groups. Language Testing 12(1), 16-33.
58. Chalhoub-Deville, M. 1996: Performance assessment and the components of the oral construct across different tests and rater groups. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 55-73.
59. Chalhoub-Deville, M., Alcaya, C. and Lozier, V. M. 1997: Language and measurement issues in developing computer-adaptive tests of reading ability: the University of Minnesota approach. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: Proceedings of LTRC 96. Jyväskyla: University of Jyväskyla, 545-585.
60. Chapelle, C. 1988: Field independence: a source of language test variation? Language Testing 5, 62-82.
61. Chapelle, C. 1994: Are C-tests valid measures for L2 vocabulary research? Second Language Research 10, 157-187.
62. Chapelle, C. 1999: From reading theory to testing practice. In Chalhoub-Deville, M., editor, Issues in computer-adaptive testing of reading proficiency. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 150-166.
63. Chapelle, C. A. 1997: Conceptual foundations for the design of computer-assisted language tests. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: Proceedings of LTRC 96. Jyväskyla: University of Jyväskyla, 520-525.
64. Cheng, L. 1998: Impact of public English examination change on students” perceptions and attitudes towards their English learning. Studies in Educational Evaluation 24(3), 279-301.
65. Cheng, L. 1999: Changing assessment: washback on teacher perceptions and actions. Teaching and Teacher Education 15, 253-271.
66. Clapham, C. 1993: The effect of language proficiency and background knowledge on EAP students” reading comprehension. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, pp. 141-168.
67. Clapham, C. 1996: The development of IELTS: a study of the effect of background knowledge on reading comprehension. Cambridge: University of Cambridge Local Examinations Syndicate/Cambridge University Press.
68. Clapham, C. and Alderson, J. C. in press: Constructing and trialling the IELTS test: IELTS research report 3. London, Cambridge, Canberra: The British Council, University of Cambridge Local Examinations Syndicate, International Development Program of Australian Universities and Colleges.
69. Clapham, C. and Corson, D., editors, 1997: Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic.
70. Clifford, R. T. 1981: Convergent and discriminant validation of integrated and unitary language skills: the need for a research model. In Palmer, A. S., Groot, P. J. M. and Trosper, G. A., editors, The construct validation of tests of communicative competence. Washington, DC: TESOL, 62-70.
71. Cohen, A. D. 1987: On taking tests: what the students report. Language Testing 1, 70-81.
72. Cohen, A. D. 1994: Assessing language ability in the classroom. 2nd edn. Boston, MA: Heinle and Heinle.
73. Condon, W. and Hamp-Lyons, L. 1993: Questioning the assumptions about portfolio-based assessment. College Composition and Communication 44, 176-190.
74. Cronbach, L. J. 1984: Essentials of psychological testing. 4th edn. New York: Harper & Row.
75. Crookes, G. V. and Gass, S. 1993 a: Tasks and language learning: integrating theory and practice. Clevedon: Multilingual Matters.
76. Crookes, G. V. and Gass, S. 1993 b: Tasks in a pedagogical context: integrating theory and practice. Clevedon: Multilingual Matters.
77. Cumming, A. 1996: Introduction: the concept of validation in language testing. In Cumming, A. and Berwick, R., editors, Validation in language testing. Clevedon: Multilingual Matters, 1-14.
78. Davidson, F., Turner, C. E. and Huhta, A. 1997: Language testing standards. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 303-311.
79. Davies, A. 1978: Language testing. Language teaching and linguistics abstracts 11 (3, 4), 145-159; 215-231.
80. Davies, A. 1991: Language testing in the 1990s. In Alderson, J. C. and North, B., editors, Language Testing in the 1990s. London: Macmillan, 136-149.
81. Davies, A. 1996: The role of a segmental dictionary in professional validation: constructing a dictionary of language testing. In A. Cumming and Berwick, R., editors, Validation in language testing. Clevedon: Multilingual Matters, 222-235.
82. Davies, A. 1997 a: Demands of being professional in language testing. Language Testing 14, 328-339.
83. Davies, A., editor, 1997 b: Special Issue: Ethics in language testing. Language Testing 14(3).
84. Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T. and McNamara, T. 1999: Dictionary of language testing. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
85. de Jong, J. H. A. L. 1986: Item selection from pretests in mixed ability groups. In Stansfield, C. W., editor, Technology and language testing. Arlington, VA: TESOL, 91-108.
86. Delandshere, G. and Petrosky, A. R. 1998: Assessment of complex performances: limitations of key measurement assumptions. Educational Researcher 27(2), 14-24.
87. Douglas, D. 1997: Language for specific purpose testing. In Clapham, C. and Cordon, D., editors, Encyclopedia of language and education. Volume 7. Language Testing and Assessment. Dordrecht: Kluwer Academic, 111-119.
88. Douglas, D. 2000: Assessing language for specific purposes: theory and practice. Cambridge: Cambridge University Press.
89. Douglas, D. and Myers, R. 1999: Assessing the communications skills of veterinary students: whose criteria? In Kunnan, A. J., editor, Fairness and validation in language assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
90. Douglas, D. and Selinker, L. 1985: Principles for language tests within the “discourse domains” theory of interlanguage: research, test construction and interpretation. Language Testing 2, 205-226.
91. Douglas, D. and Selinker, L. 1993: Performance on a general versus a fieldspecific test of speaking proficiency by international teaching assistants. In Douglas, D. and Chapelle, C., editors, A new decade of language testing research. Arlington, VA: TESOL, 235-256.
92. Doyé, P. 1991: Authenticity in foreign language testing. In Anivan, S., editor, Current developments in language testing. Singapore: SEAMEO Regional Language Centre, 103-110.
93. Dunbar, S. B., Koretz, D. and Hoover, H. D. 1991: Quality control in the development and use of performance assessments. Applied Measurement in Education 4, 289-304.
94. Dunkel, P. 1996: Checking the utility and appropriacy of the content and measurement models used to develop L2 listening comprehension CATS: implications for further development of comprehensive CATs. Paper presented at the Issues in computer adaptive testing of second language reading proficiency conference, Minneapolis, MN.
95. Dunkel, P. 1999: Research and development of a computer-adaptive test of listening comprehension in the less-commonly taught language Hausa. In Chalhoub-Deville, M., editor, Issues in computer-adaptive testing of reading proficiency. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 91-121.
96. Ebel, R. L. 1964: The social consequences of educational testing. Paper presented at the 1963 invitational conference on testing problems, Princeton, NJ.
97. Educational Testing Service. 1983: ETS standards for quality and fairness. Princeton, NJ: Author.
98. Elder, C. 1993: How do subject specialists construe classroom language proficiency? Language Testing 10, 233-254.
99. Erickson, M. and Molloy, J. 1983: ESP test development for engineering students. In Oller, J. W., editor, Issues in language testing research. Rowley, MA: Newbury House.
100. Fortus, R., Corriat, R. and Fund, S. 1998: Prediction of item difficulty in the English subtest of Israel's inter-university Psychometric Entrance Test. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 61-87.
101. Freedle, R. and Kostin, I. 1993: The prediction of TOEFL reading item difficulty: implications for construct validity. Language Testing 10, 133-170.
102. Freedle, R. and Kostin, I. 1999: Does the text matter in a multiple-choice test of comprehension? The case for the construct validity of TOEFL's minitalks. Language Testing 16(1), 2-32.
103. Fulcher, G. 1996: Testing tasks: issues in task design and the group oral. Language Testing 13(1), 23-51.
104. Genesee, F. and Upshur, J. A. 1996: Classroom-based evaluation in second language education. Cambridge: Cambridge University Press.
105. Ginther, A. and Chawla, P. 1997: Multimedia-words with pictures: unpacking the effects of visual accompaniments to listening comprehension items. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: Proceedings of LTRC 96. Jyväskyla: University of Jyväs-kyla, 526-528.
106. Ginther, A. and Stevens, J. 1998: Language background and ethnicity, and the internal construct validity of the Advanced Placement Spanish Language Examination. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 169-194.
107. Grabe, W. 1999: Developments in reading research and their implications for computer-adaptive reading assessment. In Chalhoub-Deville, M., editor, Issues in computer-adaptive testing of reading proficiency. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 11-48.
108. Gradman, H. L. and Spolsky, B. 1975: Reduced redundancy testing: a progress report. In Jones, R. L. and Spolsky, B., editors, Testing language proficiency. Arlington, VA: Center for Applied Linguistics, 59-66.
109. Green, B. F. 1988: Construct validity of computer-based tests. In Wainer, H. and Braun, H. I., editors, Test validity. Hillsdale, NJ: Lawrence Erlbaum, 77-86.
110. Green, B. F. 1995: Comparability of scores from performance assessments. Educational Measurement: Issues and Practice 14(4), 13-15.
111. Grotjahn, R. 1986: Test validation and cognitive psychology: some methodological considerations. Language Testing 3, 158-185.
112. Gruba, P. and Corbel, C. 1997: Computer-based testing. In Clapham, C. and Corson, D., editors, Language testing and assessment. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 141-149.
113. Guion, R. M. 1995: Commentary on values and standards in performance assessment. Educational Measurement: Issues and Practice 14(4), 25-27.
114. Hale, G. A. 1988: Student major field and text content: interactive effects on reading comprehension in the Test of English as a Foreign Language. Language Testing 5(1), 49-61.
115. Hamp-Lyons, L. 1996: Applying ethical standards to portfolio assessment of writing English as a second language. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 151-164.
116. Hamp-Lyons, L. 1997 a: Ethics in language testing. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 323-333.
117. Hamp-Lyons, L. 1997 b: Washback, impact and validity: ethical concerns. Language Testing 14, 295-303.
118. Hansen, L. 1984: Field dependence-independence and language testing: evidence from six Pacific island cultures. TESOL Quarterly 18, 311-324.
119. Harley, B., Allen, J. P., Cummins, J. and Swain, M. 1987: The development of bilingual proficiency: final report. Toronto: Modern Language Centre, Ontario Institute for Studies in Education.
120. Harley, B., Allen, J. P., Cummins, J. and Swain, M., editors, 1990: The development of second language proficiency. Cambridge: Cambridge University Press.
121. Harrison, A. 1983: Communicative testing: jam tomorrow? In Hughes, A. and Porter, D., editors, Current developments in language testing. London: Academic Press, 77-86.
122. Harrison, A. 1991 a: Language assessment as theatre: ten years of communicative testing. In Alderson, J. C. and North, B., editors, Language testing in the 1990s: the communicative legacy. London: Macmillan, 95-105.
123. Harrison, A. 1991 b: Response to Pauline Rea Dickins” paper: “what makes a grammar test communicative?”. In Alderson, J. C. and North, B., editors, Language testing in the 1990s. London: Macmillan, 132-135.
124. Herman, J. L., Aschbacher, P. R. and Winters, L. 1992: A practical guide to alternative assessment. Alexandria, VA: Association for Supervision and Curriculum Development.
125. Hill, K. 1993: The effect of test-taker characteristics on reactions to and performance on an oral English proficiency test. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 209-230.
126. Hudson, T. 1991: Relationships among IRT item discrimination and item fit indices in criterion-referenced language testing. Language Testing 8, 160-181.
127. Hudson, T. 1993 a: Surrogate indices for item information functions for criterion-referenced language testing. Language Testing 10, 171-191.
128. Hudson, T. 1993 b: Testing the specificity of ESP reading skills. In Douglas, D. and Chapelle, C., editors, A new decade of language testing research. Arlington, VA: TESOL, 58-82.
129. Hudson, T., Detmer, E. and Brown, J. D. 1992: A framework for testing cross-cultural pragmatics. Honolulu: Second Language Teaching and Curriculum Center, University of Hawaii at Manoa.
130. Hudson, T., Detmer, E. and Brown, J. D. 1995: Developing prototypic measures of cross-cultural pragmatics. Honolulu: Second Language Teaching and Curriculum Center, University of Hawaii at Manoa.
131. Hudson, T. and Lynch, B. K. 1984: A criterion-referenced approach to ESL achievement testing. Language Testing 1, 171-201.
132. Hulin, C. L., Drasgow, F. and Parsons, C. K. 1983: Item response theory: application to psychological measurement. Homewood, IL: Dow Jones-Irwin.
133. Jakobovits, L. A. 1970: Foreign language learning: a psycholinguistic analysis of the issues. Rowley, MA: Newbury House.
134. Kohonen, V. 1997: Authentic assessment as an integration of language learning, teaching, evaluation and the teacher's professional growth. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: Proceedings of LTRC 96. Jyväskyla: University of Jyväskyla, 7-22.
135. Kormos, J. 1999: Simulating conversations in oral-proficiency assessment: a conversation analysis of role plays and non-scripted interviews in language exams. Language Testing 16, 163-188.
136. Kunnan, A. J. 1992: An investigation of a criterion-referenced test using G-theory, and factor and cluster analysis. Language Testing 9, 30-49.
137. Kunnan, A. J. 1995: Test taker characteristics and test performance: a structural modeling approach. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
138. Kunnan, A. J. 1997: Connecting fairness with validation in language assessment. In Huhta, A., Kohonen, V., Kurki-Suonio, L. and Luoma, S., editors, Current developments and alternatives in language assessment: proceedings of LTRC96. Jyväskyla: University of Jyväskyla, 85-105.
139. Kunnan, A. J. 1998 a: Approaches to validation in language assessment. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 1-18.
140. Kunnan, A.J., editor, 1998 b: Special Issue: Structural equation modeling. Language Testing 15(3).
141. Kunnan, A. J., editor, 1998 c: Validation in language assessment: selected papers from the 17th Language Testing Research Colloquium, Long Beach. Mahwah, NJ: Lawrence Erlbaum.
142. Lado, R. 1961: Language Testing. New York: McGraw-Hill.
143. Laufer, B. and Nation, P. 1999: A vocabulary-size test of controlled productive ability. Language Testing 16, 33-51.
144. Laurier, M. 1991: What we can do with computerized adaptive testing. and what we cannot do! In Anivan, S., editor, Current developments in language testing. Singapore: SEAMEO Regional Language Centre, 244-355.
145. Lazaraton, A. 1996: Interlocutor support in oral proficiency interviews: the case of CASE. Language Testing 13, 151-172.
146. Lehmann, R. H. 1983: Rating the quality of student writing: findings from the IEA study of achievement in written composition. In Huhta, A., Sajavaara, K. and Takala, S., editors, Language testing: new openings. Jyväskyla: University of Jyväskyla, 186-204.
147. Lewkowicz, J. A. 1997: Authentic for whom? Does authenticity really matter? In Huhta, A., Kohonen, V. and Luoma, S., editors, Current developments and alternatives in language assessment. Jyväskyla: University of Jyväskyla.
148. Lewkowicz, J. A. 2000: Authenticity in language testing: some outstanding questions. Language Testing 17, 43-64.
149. Linn, R. L. 1994: Performance assessment: policy promises and technical measurement standards. Educational Researcher 23(9), 4-14.
150. Linn, R. L., Baker, E. L. and Dunbar, S. B. 1991: Complex, performance-based assessment: expectations and validation criteria. Educational Researcher 20(8), 15-21.
151. Linn, R. L. and Burton, E. 1994: Performance-based assessment: implications of task specificity. Educational Measurement: Issues and Practice, 13(1), 5-8, 15-15.
152. Long, M. H. and Crookes, G. V. 1992: Three approaches to task-based syllabus design. TESOL Quarterly, 26(1), 27-56.
153. Lukmani, Y. 1996: Linguistic accuracy versus coherence in academic degree programs: a report on stage 1 of the project. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 130-150.
154. Lumley, T. and McNamara, T. F. 1995: Rater characteristics and rater bias: implications for training. Language Testing 12(1), 54-71.
155. Lynch, B. K. 1997: In search of the ethical test. Language Testing 14, 315-327.
156. Lynch, B. K. and Davidson, F. 1994: Criterion-referenced language test development: linking curricula, teachers and tests. TESOL Quarterly, 28 727-743.
157. Lynch, B. K. and Davidson, F. 1997: Criterion referenced testing. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 263-273.
158. Lynch, B. K., Davidson, F. and Henning, G. 1988: Person dimensionality in language test validation. Language Testing 5(2), 206-219.
159. Lynch, B. K. and McNamara, T. F. 1998: Using g-theory and many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants. Language Testing 15(2), 158-180.
160. Madaus, G. F. 1983: The courts, validity and minimum competency testing. Boston, MA: Kluwer-Nijhoff.
161. Marcoulides, G. A. 1996: Estimating variance components in generaliz-ability theory: the covariance structure analysis approach. Structural Equation Modeling 3, 290-299.
162. Marcoulides, G. A. 1999: Generalizability theory: picking up where the Rasch IRT model leaves off? In Embretson, S. E. and Hershberger, S. L., editors, The new rules of measurement: what every psychologist and educator should know. Mahwah, NJ: Lawrence Erlbaum, 129-152.
163. Marcoulides, G. A. and Drezner, Z. 1997: A method for analyzing performance assessments. In Wilson, M., Draney, K. and Engelhard, G., editors, Objective measurement: theory into practice. Norwood, NJ: Ablex, 261-277.
164. McNamara, T.F. 1990 a: Assessing the second language proficiency of health professionals. Unpublished PhD dissertation, University of Melbourne, Melbourne.
165. McNamara, T. F. 1990 b: Item response theory and the validation of an ESP test for health professionals. Language Testing 7(1), 52-76.
166. McNamara, T. F. 1991: Test dimensionality: IRT analysis of an ESP listening test. Language Testing 8(2), 139-159.
167. McNamara, T. F. 1996: Measuring second language performance. London: Longman.
168. McNamara, T. F. 1997: Performance testing. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7. Language testing and assessment. Dordrecht: Kluwer Academic, 131-139.
169. McNamara, T. F. and Lumley, T. 1997: The effect of interlocutor and assessment mode variables in overseas assessments of speaking skills in occupational settings. Language Testing 14(2), 140-156.
170. Meara, P. and Buxton, B. 1987: An alternative to multiple-choice vocabulary tests. Language Testing 4, 142-151.
171. Mehrens, W. A. 1992: Using performance assessment for accountability purposes. Educational Measurement: Issues and Practice 11(1), 3-9, 20-20.
172. Messick, S. 1989: Validity. In Linn, R. L., editor, Educational measurement. 3rd edn. New York: American Council on Education/Macmillan, 13-103.
173. Messick, S. 1994: The interplay of evidence and consequences in the validation of performance assessments. Educational Researcher 23(2), 13-23.
174. Messick, S. 1995: Standards of validity and the validity of standards in performance assessment. Educational Measurement: Issues and Practice 14(4), 5-8.
175. Milanovic, M., editor, 1995-2000: Studies in language testing. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
176. Milanovic, M., Saville, N. and Shuhong, S. 1996: A study of the decision-making behaviour of composition markers. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 99-114.
177. Morrow, K. 1977: Techniques of evaluation for a notional syllabus. London: Royal Society of Arts.
178. Morrow, K. 1979: Communicative language testing: revolution or evolution? In Brumfit, C. J. and Johnson, K., editors, The communicative approach to language teaching. Oxford: Oxford University Press, 9-25.
179. Moss, P. A. 1992: Shifting conceptions of validity in educational measurement: implications for performance assessment. Review of Educational Research 62, 229-258.
180. Munby, J. 1978: Communicative syllabus design. Cambridge: Cambridge University Press.
181. Nation, P. 1990: Teaching and learning vocabulary. Boston, MA: Heinle and Heinle.
182. Newman, F., Brandt, R. and Wiggins, G. 1998: An exchange of views on “semantics, psychometrics, and assessment reform: a close look at ‘authentic’ assessments”. Educational Researcher 27(6), 19-22.
183. Nitko, A. J. 1983: Educational tests and measurement: an introduction. New York: Harcourt Brace Jovanovich.
184. Norris, J. M., Brown, J. D., Hudson, T. and Yoshioka, J. 1998: Designing second language performance assessments. Honolulu: University of Hawaii at Manoa.
185. North, B. 1996: The development of a common framework scale of descriptors of language proficiency based on a theory of measurement. Unpublished PhD dissertation, Thames Valley University, London.
186. Norton, B. 1997: Accountability in language assessment. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 313-322.
187. Nunan, D. 1989: Designing tasks for the communicative classroom. Cambridge: Cambridge University Press.
188. Oller, J. W. 1976: Evidence of a general language proficiency factor: an expectancy grammar. Die neuren Sprachen 76, 165-174.
189. Oller, J. W. 1979: Language tests at school. London: Longman.
190. O”Malley, J. M. and Pierce, L. V. 1996: Authentic assessment for English language learners. New York: Addison-Wesley.
191. Perkins, K. and Brutten, S.R., 1993: A model of ESL reading comprehension difficulty. In Huhta, A., Sajavaara, K. and Takala, S., editors, Language testing: new openings. Jyväskyla: University of Jyväskyla, 205-218.
192. Perkins, K., Gupta, L. and Tammana, R. 1995: Predicting item difficulty in a reading comprehension test with an artificial neural network. Language Testing 12(1), 34-53.
193. Perkins, K. and Linville, S. E. 1987: A construct definition study of a standardized EFL vocabulary test. Language Testing 4, 125-141.
194. Pienemann, M., Johnson, J. and Brindley, G. 1988: Constructing an acquisition-based procedure for language assessment. Studies in Second Language Acquisition 10, 217-243.
195. Pollitt, A. 1997: Rasch measurement in latent trait models. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 243-254.
196. Pollitt, A. and Murray, N. L. 1996: What raters really pay attention to. In Milanovic, M. and Saville, N., editors, Performance testing, cognition and assessment. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press, 74-91.
197. Purpura, J. E. 1993: The development and construct validation of an instrument designed to investigate selected cognitive background characteristics of test-takers. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 111-140.
198. Purpura, J. E. 1997: An analysis of the relationships between test takers” cognitive and metacognitive strategy use and second language test performance. Language Learning 47, 289-325.
199. Purpura, J. E. 1998: Investigating the effects of strategy use and second language test performance with high- and low-ability groups: a structural equation modelling approach. Language Testing 15(3), 333-379.
200. Purpura, J. E. 1999: Modeling the relationships between test takers” reported cognitive and metacognitive strategy use and performance on language tests. Cambridge: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
201. Rea Dickins, P. M. 1991 a: Response to Andrew Harrison's paper: “language assessment as theatre”. In Alderson, J. C. and North, B., editors, Language testing in the 1990s. London: Macmillan, 106-111.
202. Rea Dickins, P. M. 1991 b: What makes a grammar test communicative? In Alderson, J. C. and North, B., editors, Language testing in the 1990s. London: Macmillan, 113-131.
203. Read, J. 1993: The development of a new measure of L2 vocabulary knowledge. Language Testing 10, 355-371.
204. Read, J. 1997: Assessing vocabulary in a second language. In Clapham, C. and Corson, D., editors, Encyclopedia of Language and Education. Volume 7: Language Testing and Assessment. Dordrecht: Kluwer Academic, 99-107.
205. Read, J. 1998: Validating a test to measure depth of vocabulary knowledge. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 41-60.
206. Read, J. 2000: Assessing vocabulary knowledge and use. Cambridge: Cambridge University Press.
207. Riley, G. L. and Lee, J. F. 1996: A comparison of recall and summary protocols as measures of second language reading comprehension. Language Testing 13(2), 173-190.
208. Ross, S. and Berwick, R. 1992: The discourse accommodation in oral proficiency interviews. Studies in Second Language Acquisition 14, 159-176.
209. Sasaki, M. 1996: Second language proficiency, foreign language aptitude, and intelligence: quantitative and qualitative analyses. New York: Peter Lang.
210. Savignon, S. J. 1972: Communicative competence: an experiment in foreign language teaching. Philadelphia, PA: Center for Curriculum Development.
211. Savignon, S. J. 1983: Communicative competence: theory and classroom practice. 1st edn. Reading, MA: Addison-Wesley.
212. Sawaki, Y. 1999: Reading in print and from computer screens: comparability of reading tests administered as paper-and-pencil and computer-based tests. Unpublished manuscript, Department of Applied Linguistics and TESL, University of California, Los Angeles.
213. Schmitt, N. 1999: The relationship between TOEFL vocabulary items and meaning, association, collocation and word-class knowledge. Language Testing 16, 189-216.
214. Schoonen, R., Vergeer, M. and Eiting, M. 1997: The assessment of writing ability: expert readers versus lay readers. Language Testing 14, 157-184.
215. Shavelson, R. J., Baxter, G. P. and Pine, J. 1992: Performance assessments: political rhetoric and measurement reality. Educational Researcher 21(4), 22-27.
216. Shohamy, E. 1993 a: The exercise of power and control in the rhetorics of testing. In Huhta, A., Sajavaara, K. and Takala, S., editors, Language testing: new openings. Jyväskyla: University of Jyväskyla, 23-38.
217. Shohamy, E. 1993 b: The power of tests: the impact of language tests on teaching and learning, NFLC Occasional Papers. Washington, DC: National Foreign Language Center.
218. Shohamy, E. 1994: The validity of direct versus semi-direct oral tests. Language Testing 11(2), 99-123.
219. Shohamy, E. 1997: Testing methods, testing consequences: are they ethical? Language Testing 14, 340-349.
220. Shohamy, E. 1999: Critical language testing: uses and consequences of tests, responsibilities of testers and rights of test-takers. Paper presented at the 21st Annual Language Testing Research Colloquium, Tsukuba, Japan.
221. Shohamy, E., Donitsa-Schmidt, S. and Ferman, I. 1997: Test impact revisited: washback effect over time. Language Testing 13(3), 298-317.
222. Shohamy, E. and Reves, T. 1985: Authentic language tests: where from and where to? Language Testing 2(1), 48-59.
223. Skehan, P. 1988: Language testing: survey article, Part 1. Language teaching abstracts 21(4), 211-221.
224. Skehan, P. 1989: Language testing: survey article, Part 2. Language teaching abstracts 22(1), 1-13.
225. Skehan, P. 1991: Progress in language testing: the 1990s. In Alderson, J. C. and North, B., editors, Language testing in the 1990s. London: Macmillan, 3-21.
226. Skehan, P. 1998: A cognitive approach to language learning. Oxford: Oxford University Press.
227. Solano-Flores, G. and Shavelson, R. J. 1997: Development of performance assessment in science: conceptual, practical, and logistical concerns. Educational Measurement: Issues and Practice 16(3), 16-25.
228. Sparks, R. L., Artzer, M., Ganschow, L., Siebenhar, D., Plageman, M. and Patton, J. 1998: Differences in native-language skills, foreign-language aptitude, and foreign language grades among high-, average-, and low-proficiency foreign-language learners: two studies. Language Testing 15(2), 181-216.
229. Spolsky, B. 1981: Some ethical questions about language testing. In Klein-Braley, C. and Stevenson, D. K., editors, Practice and problems in language testing. Frankfurt: Peter Lang, 5-21.
230. Spolsky, B. 1985: The limits of authenticity in language testing. Language Testing 2(1), 31-40.
231. Spolsky, B. 1995: Measured words. Oxford: Oxford University Press.
232. Spolsky, B. 1997: The ethics of gatekeeping tests: what have we learned in a hundred years? Language Testing 14, 242-247.
233. Spolsky, B., Sigurd, B., Sato, M., Walker, E. and Aterburn, C. 1968: Preliminary studies in the development of techniques for testing overall second language proficiency. In Upshur, J. A. and Fata, J., editors, Problems in foreign language testing: Language Learning Special Issue, No. 3. Ann Arbor, MI: Research Club in Language Learning, 79-98.
234. Stansfield, C. W. 1993: Ethics, standards and professionalism in language testing. Issues in Applied Linguistics 4(2), 15-30.
235. Stansfield, C. W. and Hansen, J. 1983: Field dependence-independence as a variable in second language cloze performance. TESOL Quarterly 17, 29-38.
236. Stansfield, C. W. and Kenyon, D. M. 1992: Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview. System, 20 347-364.
237. Storey, P. 1997: Examining the test-taking process: a cognitive perspective on the discourse cloze test. Language Testing 14(2), 214-231.
238. Swanson, D. B., Norman, G. R. and Linn, R.L. 1995: Performance-based assessment: lessons from the health professions. Educational Researcher 24(5), 5-11.
239. Task Force on Testing Standards. 1995: Report of the task force on testing standards (TFTS) to the International Language Testing Association (ILTA). Melbourne: International Language Testing Association.
240. Terwilliger, J. 1997: Semantics, psychometrics and assessment reform: a close look at “authentic” assessments. Educational Researcher 26(8), 24-27.
241. Terwilliger, J. 1998: Rejoinder: response to Wiggins and Newman. Educational Researcher 26(6), 22-23.
242. TESOL. 1999: The ESL Standards for Pre-K-12 Students: available on the internet at: http://www.tesol.edu/assoc/k12standards/it/01.html.
243. Upshur, J. A. 1979: Functional proficiency theory and a research role for language tests. In Briere, E. and Hinofotis, F. B., editors, Concepts in language testing: some recent studies. Washington, DC: TESOL, 75-100.
244. Upshur, J. A. and Turner, C. E. 1999: Systematic effects in the rating of second language speaking ability: test method and learner discourse. Language Testing 16, 82-111.
245. van Lier, L. 1989: Reeling, writhing, drawling, stretching, and fainting in coils: oral proficiency interviews as conversation. TESOL Quarterly 23, 489-508.
246. van Weeren, J. and Theunissen, T. J. J. 1987: Testing pronunciation: an application of generalizability theory. Language Learning 37, 109-122.
247. Wall, D. 1996: Introducing new tests into traditional systems: insights from general education and from innovation theory. Language Testing 13(3), 334-354.
248. Wall, D. 1997: Impact and washback in language testing. In Clapham, C. and Corson, D., editors, Encyclopedia of language and education. Volume 7: Language testing and assessment. Dordrecht: Kluwer Academic, 291-302.
249. Wall, D. and Alderson, J. C. 1993: Examining washback: the Sri Lankan impact study. Language Testing 10, 41-69.
250. Weigle, S.C. 1994: Effects of training on raters of ESL compositions: quantitative and qualitative approaches. Unpublished PhD dissertation, University of California, Los Angeles.
251. Weigle, S. C. 1998: Using FACETS to model rater training effects. Language Testing 15(2), 263-267.
252. Weir, C. J. 1983: The Associated Examining Board's Test in English for Academic Purposes: an exercise in content validation. In Hughes, A. and Porter, D., editors, Current developments in language testing. London: Academic Press, 147-153.
253. Widdowson, H. G. 1978: Teaching language as communication. Oxford: Oxford University Press.
254. Widdowson, H. G. 1979: Explorations in applied linguistics. Oxford: Oxford University Press.
255. Widdowson, H. G. 1983: Learning purpose and language use. Oxford: Oxford University Press.
256. Wiggins, G. 1989: A true test: toward more authentic and equitable assessment. Phi Delta Kappan May, 703-713.
257. Wiggins, G. 1993: Assessment: authenticity, context and validity. Phi Delta Kappan November, 200-214.
258. Wigglesworth, G. 1997: An investigation of planning time and proficiency level on oral test discourse. Language Testing 14(1), 85-106.
259. Wigglesworth, G. 1998: The effect of planning time on second language test discourse. In Kunnan, A. J., editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum, 91-110.
260. Wijgh, I. F. 1996: A communicative test in analysis: strategies in reading authentic texts. In Cumming, A. and Berwick, R., editors, Validation in language testing. Clevedon: Multilingual Matters, 154-170.
261. Working Group on a Code of Practice for Language Testers 1999: Code of ethics for ILTA: draft 5 (with annotations). Language Testing Update 25, 7-15.
262. Wu, Y. 1998: What do tests of listening comprehension test? A retrospection study of EFL test-takers performing a multiple-choice task. Language Testing 15(1), 21-44.
263. Young, R. 1995: Conversational styles in language proficiency interviews. Language Learning 45, 3-42.
264. Young, R. and He, A., editors, 1998: Talking and testing. Amsterdam: John Benjamins.
265. Young, R. and Milanovic, M. 1992: Discourse validation in oral proficiency interviews. Studies in Second Language Acquisition 14, 403-424.