Factor structure of the TOEFL Internet-based test

Language Testing

Volumn 26, Issue 1, 2009, Pages 005-030

  Sawaki, Yasuyo ^a   Stricker, Lawrence J ^a   Oranje, Andreas H ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Construct validity; ESL; Factor analysis; Integrated task; Language assessment; Score reporting; TOEFL

Indexed keywords

EID: 68049121626     PISSN: 02655322     EISSN: 14770946     Source Type: Journal    
DOI: 10.1177/0265532208097335     Document Type: Article

References (43)

1. Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2, 1-34.
2. Bachman, L. F., Davidson, F., Ryan, K., & Choi, I.-C. (1995). An investigation into the comparability of two tests of English as a foreign language: The Cambridge-TOEFL comparability study. Cambridge: Cambridge University Press.
3. Bachman, L. F., & Palmer, A. (1981). The construct validation of the FSI oral interview. Language Learning, 31, 67-86.
4. Bachman, L. F., & Palmer, A. (1982). The construct validation of some components of communicative proficiency. TESOL Quarterly, 16, 449-465.
5. Bachman, L. F., & Palmer, A. (1996). Language testing in practice. Oxford: Oxford University Press.
6. Bagozzi, R.P., & Yi, Y. (1992). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16, 74-94.
7. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
8. Carr, N. T. (2003). An investigation into the structure of text characteristics and reader abilities in a test of second language reading. Unpublished doctoral dissertation. Los Angeles: University of California Press.
9. Carroll, J. B. (1983). Psychometric theory and language testing. In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 80-107). Rowley, MA: Newbury House.
10. Chapelle, C., Enright, M. K., & Jamieson, J. (Eds.) (2008). Building a validity argument for the Test of English as a Foreign Language. New York: Routledge.
11. Chapelle, C., Grabe, W., & Berns, M. (2000). Communicative language proficiency: Definition and implications for TOEFL 2000 (TOEFL Monograph Series MS-10). Princeton, NJ: Educational Testing Service.
12. Chen, F. F., West, S. G., & Sousa, K. H. (2006). Comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41, 189-225.
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
14. Davidson, F. D. (1988). An exploratory modeling of the trait structures of some existing language test datasets. Unpublished doctoral dissertation. Los Angeles: University of California Press.
15. Educational Testing Service (2003). TOEFL test and score data summary: 2002-03 test year data. Princeton, NJ: Educational Testing Service.
16. Farhady, H. (1983). On the plausibility of the unitary language proficiency factor. In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 11-28). Rowley, MA: Newbury House.
17. Hale, G. A., Rock, D.A., & Jirele, T. (1989). Confirmatory factor analysis of the Test of English as a Foreign Language (TOEFL Research Report No. 32). Princeton, NJ: Educational Testing Service.
18. Hale, G. A., Stansfield, C. W., Rock, D. A., Hicks, M. M., Butler, F. A., & Oller, J. W. Jr. (1988). Multiple-choice cloze items and the Test of English as a Foreign Language (TOEFL Research Report No. 26). Princeton, NJ: Educational Testing Service.
19. Hoyle, R. H., & Panter, A. T. (1995). Writing about structural equation models. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 158-176). Thousand Oaks, CA: Sage.
20. Jöreskog, K. G. (1993). Testing structural equation models. In K. A. Bollen, & J. S. Long (Eds.), Testing structural equation models (pp. 294-316). Newbury Park, CA: Sage.
21. Jöreskog, K., & Sörbom, D. (2003a). PRELIS (Version 2.54) [Computer software]. Chicago, IL: Scientific Software International.
22. Jöreskog, K., & Sörbom, D. (2003b). LISREL (Version 8.54) [Computer software]. Chicago, IL: Scientific Software International.
23. Kline, R. B. (1998). Principles and practice of structural equation modeling. New York: Guilford.
24. Kunnan, A. (1995). Test taker characteristics and test performance: A structural equation modeling approach. Cambridge: Cambridge University Press.
25. Lewkowicz, J. A. (1997). The integrated testing of a second language. In C. Clapham, & D. Corson (Eds.), Encyclopedia of language and education, Vol. 7: Language testing and assessment (pp. 121-130). Dordrecht, The Netherlands: Kluwer Academic.
26. Manning, W. H. (1987). Development of cloze-elide tests of English as a second language (TOEFL Research Report RR-87-18). Princeton, NJ: Educational Testing Service.
27. McLeod, L. D., Swygert, K. A., & Thissen, D. (2001). Factor analysis for items scored in two categories. In D. Thissen, & H. Wainer (Eds.), Test scoring (pp. 189-216). Mahwah, NJ: Lawrence Erlbaum.
28. Oller, J. W., Jr. (1976). Evidence of a general language proficiency factor: An expectancy grammar. Die Neuen Sprachen, 76, 165-74.
29. Oller, J. W., Jr. (1983). A consensus for the eighties? In J. W. Oller, Jr. (Ed.), Issues in language testing research (pp. 351-356). Rowley, MA: Newbury House.
30. Oller, J. W., Jr., & Hinofotis, F. A. (1980). Two mutually exclusive hypotheses about second language ability: Factor analytic studies of a variety of language subtests. In J. W. Oller, Jr., & K. Perkins (Eds.), Research in language testing (pp. 13-23). Rowley, MA: Newbury House.
31. Raykov, T., and Marcoulides, G. A. (2000). A first course in structural equation modeling. Mahwah, NJ: Lawrence Erlbaum.
32. Rindskopf, D., & Rose, T. (1988). Some theory and applications of confirmatory second-order factor analysis. Multivariate Behavioral Research, 23, 51-67.
33. Sawaki, Y., Stricker, L., & Oranje, A. (2008). Factor Structure of the TOEFL(R) Internet-Based Test (iBT): Exploration in a Field Trial Sample. (TOEFL iBT Research Report No. TOEFLiBT-04). Princeton, NJ: ETS.
34. Sasaki, M. (1996). Second language proficiency, foreign language aptitude, and intelligence: Quantitative and qualitative analyses. New York: Lang.
35. Satorra, A. (1990). Robustness issues in structural equation modeling: Areview of recent developments. Quality & Quantity, 24, 367-86.
36. Satorra, A., & Bentler, P. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, pp. 507-514.
37. Shin, S.-K. (2005). Did they take the same test? Examinee language proficiency and the structure of language tests. Language Testing, 22, 31-57.
38. Swinton, S. S., & Powers, D. E. (1980). Factor analysis of the Test of English as a Foreign Language for several language groups (TOEFL Research Report No. 6). Princeton, NJ: Educational Testing Service.
39. Stricker, L. J., & Rock, D. A. (2005). Factor analysis of New Generation TOEFL. Unpublished analysis memorandom. Princeton, NJ: Educational Testing Service.
40. Stricker, L. J., Rock, D. A., & Lee, Y.-W. (2005). Factor structure of the LanguEdge test across language groups (TOEFL Monograph Series MS-32). Princeton, NJ: Educational Testing Service.
41. Urquhart, S., & Weir, C. J. (1998). Reading in a second language: Process, product and practice. London: Longman.
42. Weir, C. J. (1990). Communicative language testing. (2nd ed.). New York: Prentice Hall.
43. Wesche, B. (1987). Second language performance testing: The Ontario test of ESL as an example. Language Testing, 4, 28-37.