Research methods in language testing

Handbook of Research in Second Language Teaching and Learning

Volumn , Issue , 2005, Pages 833-855

  Lumley, Tom ^a   Brown, Annie ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33750742417     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781410612700-62     Document Type: Chapter

References (189)

1. Alderson, J. C., & Hamp-Lyons, L. (1996). TOEFL preparation courses: A study of washback. Language Testing, 13(3), 280-297.
2. Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge, UK: Cambridge University Press.
3. Alderson, J. C., Percsich, R., & Szabo, G. (2000). Sequencing as an item type. Language Testing, 17(4), 422-447.
4. Anastasi, A. (1976). Psychological testing. New York: Macmillan.
5. Anderson, N. J., Bachman, L. F., Perkins, K., & Cohen, A. (1991). An exploratory study into the construct validity of a reading comprehension test: Triangulation of data sources. Language Testing, 3(1), 41-66.
6. Bachman, L. F. (2000). Language testing at the turn of the century: Assuring that what we count counts. Language Testing, 17(1), 1-42.
7. Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice. Oxford, UK: Oxford University Press.
8. Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, UK: Oxford University Press.
9. Bachman, L. F., Davidson, F., Ryan, K., & Choi, I. C. (1994). An investigation into the comparability of two tests of english as a foreign language: The Cambridge-TOEFL comparability study. Cambridge, UK: Cambridge University Press.
10. Bachman, L. F., Lynch, B., & Mason, M. (1995). Investigating variability in tasks and rater judgments in a performance Test of Foreign Language Speaking. Language Testing, 12(2), 238-257.
11. Bae, J., & Bachman, L. F. (1998). A latent variable approach to listening and reading: Testing factorial invariance across two groups of children in the Korean/English two-way immersion program. Language Testing, 15(3), 380-414.
12. Baker, R. (1987). An Investigation of the Rasch Model in its Application to Foreign Language Proficiency Testing. Unpublished doctoral dissertation, University of Edinburgh.
13. Baker, R. (1997). Classical test theory and item response theory in test analysis, Language Testing Update, Special Report 2. Lancaster, UK: Lancaster University.
14. Banerjee, J., Clapham, C., Clapham, P., & Wall, D. (Eds.) (1999). The ILTA language testing bibliography 1991-1999. Available at http://www.surrey.ac.uk/ELI/ilta/ilta.html
15. Banerjee, J., & Luoma, S. (1997). Qualitative approaches to test validation. In C. Clapham, & D. Corson, (Eds.), Encyclopaedia of language and education. vol 7: Language testing and assessment (pp. 275-287). Dortrecht, The Netherlands: Kluwer.
16. Beglar, D., & Hunt, A. (1999). Revising and validating the 2000 Word Level and University Word Level Vocabulary Tests. Language Testing, 16(2), 131-162.
17. Berry, V. (1997). Personality characteristics as a potential source of language test bias. In A. Huhta, K. Sajavaara, & S. Takala (Eds.), Language testing: New openings (pp. 115-122). Jyvaskyla, Finland: University of Jyvaskyla.
18. Berry, V. (1995). A qualitative analysis of factors affecting learner performances in group oral tests. Paper presented at the 17th Language Testing Research Colloquium, Long Beach, CA.
19. Blais, J. G., & Laurier, M. D. (1995). The dimensionality of a placement test from several analytical perspectives. Language Testing, 12(1), 72-98.
20. Boldt, R. F., & Oltman, P. K. (1993). Multimethod construct validation of the Test of Spoken English. TOEFL Research Report RR-46. Princeton, NJ: Educational Testing Service.
21. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. Mahwah, NJ: Lawrence Erlbaum Associates.
22. Bradshaw, J. (1990). Test-takers' reactions to a placement test. Language Testing, 7(1), 13-30.
23. Breen, M. P., Barratt-Pugh, C. B., Derewianka, H., House, C., Hudson, T. Lumley, & M. Rohl (1997). Profiling ESL children: How teachers interpret and use national and state assessment frameworks. Vols 1-3. Canberra: Department of Employment, Education, Training & Youth Affairs.
24. Brennan, R. L. (1983). Elements of generalizability theory. Iowa City, IA: The American College Testing Program.
25. Brindley, G. (1998). Outcomes-based assessment and reporting in language learning programmes: A review of the issues. Language Testing, 15(1), 45-85.
26. Brown, A. (1994). LSP testing: The role of linguistic and real-world criteria. In R. Khoo (Ed.), LSP: Problems and prospects (pp. 202-215). Singapore: SEAMEO-Regional Language Centre.
27. Brown, A. (1993). The role of test-taker feedback in the development of an occupational language proficiency test. Language Testing, 10(3), 277-303.
28. Brown, A. (1995). The effect of rater variables in the development of an occupation-specific language performance test. Language Testing, 12(1), 1-15.
29. Brown, A. (2000). An investigation of the rating process in the IELTS speaking module. In R. Tulloh (Ed.), Research Reports 1999, Vol. 3 (pp. 49-85). Sydney: ELICOS.
30. Brown, A. (2003). Interviewer variation and the co-construction of speaking proficiency. Language Testing, 20(1), 1-25.
31. Brown, A. (2004). Discourse analysis in language testing. In D. Boxer & A. Cohen, (Eds.), Studying speaking to inform second language learning, (pp. 253-282). Clevedon, UK: Multilingual Matters.
32. Brown, A., Hill, K., & Iwashita, N. (2000). Is learner progress in LOTE learning comparable across languages? In C. Elder (Ed.), Defining standards and monitoring progress in learning languages other than English. Australian Review of Applied Linguistics, 23(2), 35-60.
33. Brown, A., & Iwashita, N. (1996). Language background and item difficulty: The development of a computer-adaptive test of Japanese. System, 24(2), 199-206.
34. Brown, A., Iwashita, N., McNamara, T., & O'Hagan, S. (2003). An examination of rater orientations and test-taker performance on English for academic purposes speaking tasks. Unpublished project report. Princeton, NJ.: Educational Testing Service.
35. Brown, A., & Lumley, T. (1997). Interviewer variability in specific-purpose language performance tests. In A. Huhta, V. Kohonen, L. Kurki-Suonio, & S. Luoma (Eds.), Current developments and alternatives in language assessment: Proceedings of LTRC 96. (pp. 137-150). Jyvaskyla: University of Jyvaskyla.
36. Brown, J. D. (1984). A norm-referenced engineering reading test. In A. K. Pugh & J. M. Ulijn (Eds.), Reading for professional purposes: Studies and practices in native and foreign languages (pp. 213-222). London: Heinemann.
37. Brown, J. D. (1991). Do English and ESL faculties rate writing samples differently? TESOL Quarterly, 25(4), 587-603.
38. Brown, J. D. (1999). The relative importance of persons, items, subtests, and languages to TOEFL test variance. Language Testing, 16(2), 217-238.
39. Brown, J. D., & Bailey, K. M. (1984). A categorical instrument for scoring second language writing skills. Language Learning, 34(2), 21-42.
40. Brown, J. D., & Hudson, T. (1998). Alternatives in language assessment. TESOL Quarterly, 32(4), 653-675.
41. Brown, J. D., & Ross, J. (1996). Decision dependability of subtests, tests, and the overall TOEFL. In M. Milanovic & N. Saville (Eds.), Performance testing, cognition and assessment: Selected papers from the 15th Language Testing Research Colloquium, Cambridge and Arnhem (pp. 231-265). Cambridge, UK: Cambridge University Press and University of Cambridge Local Examinations Syndicate.
42. Buck, G. (1990). The testing of second language listening comprehension. Unpublished doctoral dissertation, University of Lancaster.
43. Buck, G. (1991). The testing of listening comprehension: An introspective study. Language Testing, 8(1), 67-91.
44. Campbell, D. T., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
45. Chalhoub-Deville, M. (1999). Issues in computer-adaptive testing of reading proficiency. Cambridge, UK: Cambridge University Press and University of Cambridge Local Examinations Syndicate.
46. Cheng, L. (1997). How does washback influence teaching? Implications for Hong Kong. Language and Education 235,11(1), 38-54.
47. Clapham, C., & Alderson, J. C. (Eds.) (1996). Constructing and trialing the IELTS test. IELTS Research Report 3. Cambridge, UK: The British Council, The University of Cambridge Local Examinations Syndicate, and the International Development Program of Australian Universities and Colleges.
48. Clapham, C. (1996). The development of IELTS: A study of the effect of background knowledge on reading comprehension. Cambridge, UK: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
49. Clark, J. L. D., & Gifford, R. T. (1988). The FSI/ILR/ACTFL proficiency scales and testing techniques: Development, current status, and needed research. Studies in Second Language Acquisition, 10, 129-147.
50. Cohen, A. D. (1984). On taking language tests: What the students report. Language Testing, 1(1), 70-81.
51. Cohen, A. D. (1994). English for academic pruposes in Brazil: The issue of summary tasks. In C. Hill & K. Parry (Eds.), From testing to assessment: English as an international language (pp. 174-204). London: Longman.
52. Cohen, A. D. (1998). Strategies and processes in test-taking and SLA. In L. Bachman & A. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp 90-111). Cambridge, UK: Cambridge University Press.
53. Congdon, P. J., & McQueen, J. (2000). The stability of rater severity in large-scale assessment programs. Journal of Educational Measurement, 37(2), 163-178.
54. Cumming, A. (1990). Expertise in evaluating second language compositions. Language Testing, 7(1), 31-51.
55. Cumming, A., Kantor, R., & Powers, D. E. (2001). Scoring TOEFL essays and TOEFL 2000 prototype writing tasks: An investigation into raters' decision making and development of a preliminary analytic framework. TOEFL Monograph Series, MS-22. Princeton, NJ: Educational Testing Service.
56. Davies, A., Brown, A., Elder, E., Hill, K., Lumley, T., & McNamara, T. F. (1999). Dictionary of language testing: Studies in language testing, 7. Cambridge, UK: Cambridge University Press/University of Cambridge Local Examinations Syndicate.
57. deJong, J. H. A. L., & Glas, C. A. W. (1987). Validation of listening comprehension tests using item response theory. Language Testing, 4(2), 170-194.
58. Dollerup, C., Glahn, E., & Hansen, C. R. (1994). 'Sprogtest': A smart test (or how to develop a reliable and anonymous EFL reading test). Language Testing, 11(1), 65-82.
59. Douglas, D. (2000). Assessing languages for specific purposes. (Cambridge Language Assessment Series.) Cambridge, UK: Cambridge University Press.
60. Elder, C. (1993). How do subject specialists construe classroom language proficiency? Language Testing, 10(3), 235-254.
61. Elder, C. (1996). The effect of language background on –foreign— language performance: The case of Chinese, Modern Greek, and Italian. Language Learning, 46(2), 233-282.
62. Elder, C. (1998). What counts as bias in language testing? Melbourne papers in Language Testing, 7(1), 1-42.
63. Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215-251.
64. Ericsson, K. A., & Simon, H. A. (1987). Verbal reports on thinking. In C. Faerch & G. Kasper, (Eds.), Introspection in second language research (pp. 24-53). Clevedon, UK: Multilingual Matters.
65. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (2nd ed.). Cambridge, MA: MIT Press.
66. Faerch, C., & Kasper, G. (Eds.). (1987). Introspection in second language research. Clevedon, UK: Multilingual Matters.
67. Fulcher, G. (1996). Testing tasks: Issues in task design and the group oral. Language Testing, 13(1), 23-52.
68. Fulcher, G. (1997). An English language placement test: Issues in reliability and validity. Language Testing, 14(2), 113-39.
69. Gattullo, F. (2000). Formative assessment in ELT primary (elementary) classrooms: An Italian case study. Language Testing, 17(2), 278-288.
70. Giles, H., Coupland, N., & Coupland, J. (Eds.). (1991). Contexts of accommodation: Developments in applied sociolinguistics. Cambridge, UK: Cambridge University Press.
71. Green, A. (1998). Verbal protocol analysis in language testing research: A handbook, Studies in Language Testing, 5. Cambridge, UK: Cambridge University Press and University of Cambridge Local Examinations Syndicate.
72. Gruba, P. (1999). The role of digital video media in second language listening comprehension. Unpublished doctoral dissertation, The University of Melbourne.
73. Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
74. Hamilton, J., Lopes, M., McNamara, T., & Sheridan, E. (1993). Rating scales and native speaker performance on a communicatively oriented EAP test. Language Testing, 10(3), 337-354.
75. Hamp-Lyons, L., & Condon, W. (2000). Assessing the portfolio: Principles for practice, theory, and research. Cresskill, NJ: Hampton Press.
76. Hamp-Lyons, L., & Mathias, S. P. (1994). Examining expert judgments of task difficulty on essay tests. Journal of Second Language Writing, 3(1), 49-68.
77. Hatch, E., & Lazaraton, A. (1991). The research manual: Design and statistics for applied linguistics. New York: Newbury House.
78. He, A. W. (1998). Answering questions in LPIs: A case study. In R. Young & A. W. He (Eds.), Talking and testing: Discourse approaches to language proficiency interviews (pp. 101-116). Amsterdam: Benjamins.
79. Henning, G. (1984). Advantages of latent trait measurement in language testing. Language Testing 1(2), 123-133.
80. Henning, G. (1987). A guide to language testing: Development, evaluation, research. Cambridge, MA: Newbury House.
81. Henning, G., Schedl, M., & Suomi, B. K. (1995). Analysis of proposed revisions of the test of spoken English. TOEFL Research Report No. 48, ETS rR 95-1. Princeton, NJ: Education Testing Service.
82. Henning, G., Hudson, T., & Turner, J. (1985). Item response theory and the assumption of unidimensionality for language tests. Language Testing, 2,141-154.
83. Hill, C., & Parry, K. (Eds.). (1994). From testing to assessment. London: Longman.
84. Hill, K. (1997). Who should be the judge? The use of non-native speakers as raters on a test of English as an international language. In A. Huhta, V. Kohonen, L. Kurki-Suonio, & S. Luoma (Eds.), Current developments and alternatives in language assessment (pp. 275-290). Jyvaskyla: University of Jyvaskyla.
85. Holland, P. W., & Wainer, H. I. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum Associates.
86. Homburg, T. J., & Spaan, M. C. (1981). ESL reading proficiency assessment: Testing strategies. In M. Hines & W. Rutherford (Eds.), On TeSOL '81 (pp. 25-33). Washington, DC: TESOL.
87. Huot, B. A. (1988). The validity of holistic scoring: A comparison of the talk-aloud protocols of expert and novice holistic raters. Unpublished doctoral dissertation, Indiana University of Pennsylvania.
88. Huot, B. A. (1993). The influence of holistic scoring procedures on reading and rating student essays. In M. M. Williamson & B. A. Huot (Eds.), Validating holistic scoring for writing assessment: Theoretical and empirical foundations (pp. 206-236). Cresskill, NJ: Hampton Press.
89. Iwashita, N., McNamara, T., & Elder, C. (2001). Can we predict task difficulty in an oral proficiency test? Exploring the potential of an information-processing approach to task design. Language Learning 21, 401-436.
90. Jin, K-A., McNamara, T., & Brown, A. (2002). Developing an assessment tool and training program for Korean middle school English teachers: Classroom communicative competence project. Seoul: Korea Institute of Curriculum and Evaluation.
91. Johnson, M. (2001). The art of nonconversation: A re-examination of the validity of the oral proficiency interview. New Haven CT: Yale University Press.
92. Johnson, M., & Tyler, A. (1998). Re-analyzing the OPI: How much does it look like natural conversation? In R. Young & A. W. He (Eds.), Talking and testing: Discourse approaches to language proficiency interviews (pp. 27-51). Amsterdam: Benjamins.
93. Katona, L. (1998). Meaning negotiation in the Hungarian oral proficiency examination of English. In R. Young & A. W. He (Eds.), Talking and testing: Discourse approaches to the assessment of oral proficiency (pp. 239-267). Amsterdam: Benjamins.
94. Kunnan, A. J. (1998). An introduction to structural equation modeling for language assessment research. Language Testing, 15(3), 295-352.
95. Kunnan, A. J. (1995). Test-taker characteristics and test performance: A structural modeling approach. Cambridge, UK: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
96. Lado, R. (1961). Language testing. London: Longman.
97. Lazaraton, A. (1991). A conversation analysis of the structure and interaction in the language interview. Unpublished doctoral dissertation, University of California, Los Angeles.
98. Lazaraton, A. (1992). The structural organisation of a language interview: A conversation analytic perspective. System, 20, 373-386.
99. Lazaraton, A. (1996a). Interlocutor support in oral proficiency interviews: The case of CASE. Language Testing, 13,151-172.
100. Lazaraton, A. (1996b). A qualitative approach to monitoring examiner conduct in the Cambridge Assessment of Spoken English (CASE). In M. Milanovic & N. Saville (Eds.), Performance testing, cognition, and assessment: Selected papers from the 15th Language Testing Research Colloquium (pp. 18-33). Cambridge, UK: Cambridge University Press.
101. Lazaraton, A. (1997). Preference organization in oral proficiency interviews: The case of language ability assessments. Research on Language and Social Interaction, 30(1), 53-72.
102. Lemann, N. (1999). The big test: The secret history of the American meritocracy. New York: Farrar, Strauss & Giroux.
103. Leung, C., & Teasdale, A. (1997). What do teachers mean by speaking and listening? A contextualised study. In A. Huhta, V. Kohonen, L. Kurki-Suonio, & S. Luoma (Eds.), Current developments and alternatives in language assessment: Proceedings of LTRC 96 (pp. 291-326). Jyvaskyla: University of Jyvaskyla.
104. Lewkowicz, J. (2000). Authenticity in language testing: Some outstanding questions. Language Testing 17(1), 43-64.
105. Li, X. (1990). How powerful can a language test be? The MET in China. Journal of Multilingual and Multicultural Development, 11(5), 393-404.
106. Linacre, J. M., & Wright, B. (1992-1996). FACETS. Chicago, IL: MESA Press.
107. Linacre, J. M. (1989). Many-faceted Rasch measurement. Chicago, IL: MESA Press.
108. Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15-21.
109. Lumley, T. (1998). Perceptions of language-trained raters and occupational experts in a test of occupational English language proficiency. English for Specific Purposes, 17(4), 347-367.
110. Lumley, T. (2000). The process of the assessment of writing performance: The rater's perspective. Unpublished doctoral dissertation, The University of Melbourne.
111. Lumley, T. (2002). –Assessment criteria in a large-scale writing test: What do they really mean to the raters?— Language Testing, 19(3), 246-276.
112. Lumley, T., & Brown, A. (1996). Specific-purpose language performance tests: Task and interaction. In G. Wigglesworth & C. Elder (Eds.), The testing cycle: New perspectives. Australian Review of Applied Linguistics Series S. No. 13. (pp. 105-136). Canberra: ANU Printing Services.
113. Lumley, T., & Brown, A. (1998). An investigation of the authenticity of discourse in a specific-purpose language performance test and its relevance to test validity. In E. S. L. Li & G. James (Eds.), Testing and evaluation in second language education (pp. 22-33). Hong Kong: Language Centre, Hong Kong University of Science and Technology.
114. Lumley, T., & McNamara, T. F. (1995). Rater characteristics and rater bias: Implications for training. Language Testing, 12(1), 54-71.
115. Lumley, T., & Stoneman, B. (2000). Conflicting perspectives on the role of test preparation in relation to learning. Hong Kong Journal of Applied Linguistics, 5(1), 50-80.
116. Lynch, B. K. (1996). Language program evaluation: Theory and practice. Cambridge Applied Linguistics Series. Cambridge, UK: Cambridge University Press.
117. Lynch, B. K. (2001). Rethinking assessment from a critical perspective. Language Testing, 18(4), 351-372.
118. McNamara, T. F. (1990). Assessing the second language proficiency of health professionals. Unpublished doctoral dissertation, University of Melbourne.
119. McNamara, T. F. (1991). Test dimensionality: IRT analysis of an ESP listening test. Language Testing, 8(2), 45-65.
120. McNamara, T. F. (1996). Measuring second language performance. London: Longman.
121. McNamara, T. F. (2001). Language assessment as social practice: Challenges for research. Language Testing, 18(4), 333-350.
122. McNamara, T. F., & Adams, R. J. (1994). Exploring rater characteristics with Rasch techniques. In Selected papers of the 13th Language Testing Research Colloquium (LTRC). Princeton, NJ: Educational Testing Service.
123. McNamara, T. F., & Lumley, T. (1997). The effect of interlocutor and assessment mode variables in offshore assessments of speaking skills in occupational settings. Language Testing, 14(2), 140-156.
124. McNamara, T., Hill, K., & May, L. (2002). Discourse and assessment. Annual Review of Applied Linguistics, 22, 221-242.
125. Meiron, B. E. (1998). Rating oral proficiency tests: A triangulated study of rater thought processes. Unpublished master's thesis, University of California at Los Angeles.
126. Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer & H. I. Braun (Eds.), Test validity. Hillsdale, NJ: Lawrence Erlbaum Associates.
127. Messick, S. A. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed.). (pp. 13-103). New York: Macmillan.
128. Messick, S. A. (1994). The interplay of evidence and consequences in the validation of performance assessment. Educational Researcher, 23(2), 13-23.
129. Messick, S. A. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256.
130. Moss, P. A. (1994). Can there be validity without reliability? Educational Researcher, 23(2), 5-12.
131. Nation, P. (1983). Testing and teaching vocabulary. Guidelines, 5,12-25.
132. Nation, P. (1990). Teaching and learning vocabulary. Boston: Heinle & Heinle.
133. O'Loughlin, K. (1992). Do English and ESL teachers rate essays differently? Melbourne Papers in Language Testing, 1(2), 19-44.
134. O'Loughlin, K. (1995). Lexical density in candidate output on direct and semidirect versions of an oral proficiency test. Language Testing, 12(2), 217-237.
135. O'Loughlin, K. (2002). The impact of gender in oral proficiency testing. Language Testing, 19(2), 169-192.
136. O'Sullivan, B. (2002). Learner acquaintanceship and oral proficiency test pair-task performance. Language Testing, 19(3), 277-295.
137. O'Sullivan, B., Weir, C. J., & Saville, N. (2002). Using observation checklists to validate speaking-test tasks. Language Testing, 19(1), 33-56.
138. Oxford, R. (1990). Language learning strategies: What every teacher should know. New York: Newbury House.
139. Perrett, G. (1990). The language testing interview: A reappraisal. In J. H. A. L. de Jong & D. K. Stevenson (Eds.), Individualizing the assessment of language abilities (pp. 225-238). Clevedon, UK: Multilingual Matters.
140. Pollitt, A., & Hutchinson, C. (1987). Calibrating graded assessments: Rasch partial credit analysis of performance in writing. Language Testing, 4(1), 72-92.
141. Pollitt, A. (1984). Item banking. Issues in Educational Assessment Occasional Papers. Edinburgh, UK: Her Majesty's Stationery Office.
142. Powers, D. E., Schedl, M. A., & Wilson, S. (1999). Validating the revised test of spoken English against a criterion of communicative success. Language Testing, 16(4), 399-425.
143. Purpura, J. E. (1997). An analysis of the relationships between test-takers' cognitive and metacognitive strategy use and second language test performance. Language Learning, 42(2), 289-325.
144. Purpura, J. E. (1998). Investigating the effects of strategy use and second language test performance with high- and low-ability test-takers: A structural equation modeling approach. Language Testing, 15(3), 333-379.
145. Purpura, J. E. (1999). Learner strategy use and performance on language tests: A structural equation modeling approach. Studies in Language Testing Series, Vol. 8. Cambridge, UK: University of Cambridge Local Examinations Syndicate and Cambridge University Press.
146. Rea-Dickins, P., & Gardner, S. (2000). Snares or silver bullets: Disentangling the construct of formative assessment. Language Testing, 17(2), 215-243.
147. Rea-Dickins, P. (2001). Mirror, mirror on the wall: Identifying proceses of classroom assessment. Language Testing, 18(4), 429-462.
148. Ross, S. (1996). Formulae and inter-interviewer variation in oral proficiency interview discourse. Prospect, 11(3), 3-16.
149. Ross, S. (1992). Accommodative questions in oral proficiency interviews. Language Testing, 9,173-186.
150. Ross, S. (1998). Divergent frame interpretations in oral proficiency interview interaction. In R. Young & A. W. He (Eds.), Talking and testing: Discourse approaches to the assessment of oral proficiency (pp. 333-353). Amsterdam: Benjamins.
151. Ross, S., & Berwick, R. (1992). The discourse of accommodation in oral proficiency interviews. Studies in Second Language Acquisition, 14,159-176.
152. Ryan, K. E., & Bachman, L. F. (1992). Differential item functioning on two tests of EFL proficiency. Language Testing, 9(1), 12-29.
153. Sasaki, M. (2000). Effects of cultural schemata on students' test-taking processes for cloze tests: A multiple data approach. Language Testing, 17(1), 85-114.
154. Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer. Newbury Park, CA: Sage.
155. Shohamy, E. (1993). The power of tests: The impact of language tests on teaching and learning. Washington, DC: The National Foreign Language Center at Johns Hopkins University.
156. Shohamy, E. (1997). Testing methods, testing consequences: Are they ethical? Are they fair? Language Testing, 14(3), 340-349.
157. Shohamy, E. (2001a). The power of tests: A critical perspective on the uses of language tests. New York: Pearson Education Ltd.
158. Shohamy, E. (2001b). Democratic assessment as an alternative. Language Testing, 18(4), 373-391.
159. Skehan, P. (1998). A cognitive approach to language learning. Oxford UK: Oxford University Press.
160. Spada, N., & Fröhlich, M. (1995). COLT: Communicative Orientation of Language Teaching observation scheme: Coding conventions and applications. Sydney, Australia: National Centre for English Language Teaching and Research.
161. Spolsky, B. (1995). Measured words. Oxford UK: Oxford University Press.
162. Stansfield, C. W., & Kenyon, D. M. (1992). Research on the comparability of the oral proficiency interview and the simulated oral proficiency interview. System, 20(3), 347-364.
163. Swain, M. (2001). Examining dialogue: Another approach to content specification and to validating inferences drawn from test scores. Language Testing, 18(3), 275-302.
164. Takala, S., & Kaftandjieva, F. (2000). Test fairness: A DIF analysis of an L2 vocabulary test. Language Testing, 17(3), 323-340.
165. Teasdale, A., & Leung, C. (2000). Teacher assessment and psychometric theory: A case of paradigm crossing? Language Testing, 17(2), 163-184.
166. Torrance, H., & Pryor, J. (1998). Investigating formative assessment: Teaching, learning, and assessment in the classroom. Buckingham, UK: Open University Press.
167. Tulloh, R. (Ed.). (2003). International English Language Testing System Research Reports 2003, Vol 4. Canberra: IELTS Australia.
168. Tulloh, R. (1999). International English Language Testing System Research Reports 1999, Vol. 3. Sydney: ELICOS.
169. van Lier, L. (1989). Reeling, writhing, drawling, stretching, and fainting in coils: Oral proficiency interviews as conversations. TESOL Quarterly, 23, 480-508.
170. Vaughan, C. (1991). Holistic assessment: What goes on in the rater's mind? In L. Hamp-Lyons (Ed.). Assessing second language writing in academic contexts (pp. 111-125). Norwood, NJ: Ablex.
171. Wall, D., & Alderson, J. C. (1993). Examining washback: The Sri Lankan impact study. Language Testing, 10(1), 41-69.
172. Wall, D., Clapham, C., & Alderson, J. C. (1994). Evaluating a placement test. Language Testing, 11 (3), 321-244.
173. Weigle, S. C. (1994). Effects of training on raters of ESL compositions. Language Testing, 11(2), 197-223.
174. Weigle, S. C. (1998). Using FACETS to model rater training effects. Language Testing, 15(2), 263-287.
175. Weir, C. J. (1983). Identifying the language needs of overseas students in tertiary education in the United Kingdom. Unpublished doctoral dissertation, University of London Institute of Education.
176. Weir, C. J. (1988). The specification, realisation, and validation of an English language proficiency test. In A. Hughes (Ed.), Testing English for university study. ELT Document 127 (pp. 45-110). Oxford, UK: Modern English Press.
177. Weir, C., & Roberts, J. (1994). Evaluation in ELT. Oxford, UK: Blackwell.
178. Wigglesworth, G. (1997). An investigation of planning time and proficiency level on oral test discourse. Language Testing, 14(1), 85-106.
179. Woods, S. (Ed.) (1998). International English Language Testing System Research Reports 1997, Vol. 1. Sydney: ELICOS.
180. Woods, A., & Baker, R. (1985). Item response theory. Language Testing, 2(2), 117-140.
181. Wright, B. D., & Masters, G. N. (1982). Rating scale analysis. Chicago, IL: MeSA Press.
182. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: MESA Press.
183. Wu, Y. (1998). What do tests of listening comprehension test? A retrospection study of EFL test-takers performing a multiple-choice task. Language Testing 15(1), 21-44.
184. Young, R., & He, A. W. (1998). Talking and testing: Discourse approaches to the assessment of oral proficiency. Amsterdam: Benjamins.
185. Yoshida-Morise, Y. (1998). The use of communication strategies in language proficiency interviews. In R. Young & A. W. He (Eds.), Talking and testing: Discourse approaches to the assessment of oral proficiency (pp. 205-238). Amsterdam: Benjamins.
186. Young, R. (1995). Conversational styles in language proficiency interviews. Language Learning, 45, 3-42
187. Young, R., & Halleck, G. B. (1998). –Let them eat cake!— or how to avoid losing your head in cross-cultural conversations. In R. Young, & A. W. He (Eds.), Talking and testing: Discourse approaches to the assessment of oral proficiency (pp. 355-382). Amsterdam: Benjamins.
188. Young, R., & Milanovic, M. (1992). Discourse variation in oral proficiency interviews. Studies in Second Language Acquisition, 14(4), 403-424.
189. Zhang, W. (1998). The rhetorical patterns found in Chinese EFL student writers' examination essays in English and the influence of these patterns on rater response. Unpublished doctoral dissertation, Hong Kong Polytechnic University.