Validating the revised test of spoken English against a criterion of communicative success

Language Testing

Volumn 16, Issue 4, 1999, Pages 399-425

  Powers, Donald E ^a   Schedl, Mary A ^a   Leung, Susan Wilson ^a   Butler, Frances A ^b  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34248755699     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/026553229901600401     Document Type: Article

References (30)

1. AERA/APA/NCME 1985: Standards for educational and psychological testing. Washington, DC: American Psychological Association.
2. Bachman, L. F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press.
3. Butler, F., Eignor, D., Jones, S., McNamara, T. and Suomi, B. In press: A TOEFL 2000 framework for testing speaking. Princeton, NJ: Educational Testing Service.
4. Butler, F. A. and Stevens, R. 1998: Initial steps in the validation of the second language proficiency descriptors for public high schools, colleges, and universities in California. Los Angeles, CA: University of California, Center for the Study of Evaluation, Graduate School of Education and Information Studies.
5. Canale, M. and Swain M. 1980: Theoretical basis of communicative approaches to second language teaching and testing. Applied Linguistics 1, 1-47.
6. Chapelle, C., Grabe, W. and Berns, M. 1997: Communicative language proficiency: definition and implications for TOEFL-2000. TOEFL Monograph Series MS-10. Princeton, NJ: Educational Testing Service.
7. Clark, J. L. D. and Swinton, S. S. 1980: The Test of Spoken English as a measure of communicative ability in English-medium instructional settings. TOEFL Research Report No. 7. Princeton, NJ: Educational Testing Service.
8. CTB/McGraw-Hill 1985: Listening test: examiner's manual levels 1 through 6. Monterey, CA: McGraw-Hill.
9. Dickson, W. P. and Patterson, J. H. 1981: Evaluating referential communication games for teaching speaking and listening skills. Communication Education 30, 11-21.
10. Douglas, D. and Smith, J. (with Schedl, M., Netten, G. and Miller, M.). 1997: Theoretical underpinnings of the Test of Spoken English revision project. ETS Research Memorandum RM-97-2. Princeton, NJ: Educational Testing Service.
11. Duran, R. P., Canale, M., Penfield, J., Stansfield, C. W. and Liskin-Gasparro, J. E. 1985: TOEFL from a communicative viewpoint on language proficiency: a working paper. TOEFL Research Report No. 17, ETS RR 85-8. Princeton, NJ: Educational Testing Service.
12. Educational Testing Service 1994: Test development documentation for the revised test of spoken English. Unpublished manuscript.
13. Feldt, L. S. and Brennan, R. L. 1989: Reliability. In Linn, R. L., editor, Educational measurement. 3rd edition. New York: Macmillan, 105-146.
14. Fulcher, G. 1987: Tests for oral performance: the need for data-based criteria. ELT Journal 41, 287-291.
15. Fulcher, G. 1996: Does thick description lead to smart tests? A data-based approach to rating scale construction. Language Testing 13, 208-238.
16. Henning, G. and Cascallar, E. 1992: A preliminary study of the nature of communicative competence. TOEFL Research Report No. 36, ETS RR 92-17. Princeton, NJ: Educational Testing Service.
17. Henning, G., Schedl, M. and Suomi, B. K. 1995: Analysis of proposed revisions of the Test of Spoken English. TOEFL Research Report No. 48, ETS RR 95-1. Princeton, NJ: Educational Testing Service.
18. Lieb-Brilhart, B. 1965: The relationship between some aspects of communicative speaking and communicative listening. Journal of Communication 15, 35-46.
19. Mattran, K. J. 1977: Native speaker reactions to speakers of ESL: implications for adult basic education oral English proficiency testing. TESOL Quarterly 11, 407-414.
20. McNamara, T. F. 1997. 'Interaction' in second language performance assessment: whose performance? Applied Linguistics 18, 446-466.
21. Messick, S. 1989: Validity. In Linn, R. L. editor, Educational Measurement. 3rd edition. New York: Macmillan, 13-104.
22. Powers, D. E., Schedl, M. A., Wilson Leung, S. and Butler, F. 1999. Validating the revised Test of Spoken English against a criterion of communicative success. TOEFL Research Report No. 63, ETS RR 99-5. Princeton, NJ: Educational Testing Service.
23. Powers, D. E. and Stansfield, C. W. 1983: The Test of Spoken English as a measure of communicative competency in the health professions: validation and standard setting. TOEFL Research Report No. 13. Princeton, NJ: Educational Testing Service.
24. Rubin, D. L. 1992: Nonlanguage factors affecting undergraduate judgments of non-native English-speaking teaching assistants. Research in Higher Education 33, 511-531.
25. Siegel, S. 1956: Nonparametric statistics for the behavioral sciences. New York: McGraw Hill.
26. Stansfield, C. W. 1986: Toward communicative competence testing: proceedings of the second TOEFL invitational conference. TOEFL Research Report No. 21. Princeton, NJ: Educational Testing Service.
27. Stansfield, C. W. and Kenyon, D. M. 1995: Comparing the scaling of speaking tasks by language teachers and by the ACTFL guidelines. In Cumming, A. and Berwick, R editors. Validation in language testing. Philadelphia: Multilingual Matters, 124-153.
28. Stricker, L. J. (1997.) Using just noticeable differences to interpret Test of Spoken English scores. TOEFL Research Report No. 58, ETS RR 97-4. Princeton, NJ: Educational Testing Service.
29. Upshur, J. A. and Turner, C. E. 1995: Constructing rating scales for second language tests. ELT Journal 49, 3-12.
30. Yule, G. 1997: Referential communication tasks. Mahwah, NJ: Lawrence Erlbaum.