Generalizability: A journey into the nature of empirical research in applied linguistics

Language Learning and Language Teaching

Volumn 12, Issue , 2006, Pages 165-207

  Bachman, Lyle F ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41149113417     PISSN: 15699471     EISSN: None     Source Type: Book Series    
DOI: None     Document Type: Chapter

References (76)

1. Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: OUP.
2. Bachman, L. F. (2004a). Linking observations to interpretations and uses in TESOL research. TESOL Quarterly, 38(4), 723-728.
3. Bachman, L. F. (2004b). Statistical analyses for language assessment. Cambridge: CUP.
4. Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2(1), 1-34.
5. Bachman, L. F. & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford: OUP.
6. Bickhard, M. H. (2001). The tragedy of operationalism. Theory and Psychology, 11(1), 35-44.
7. Boorsboom, D. (2003). The theoretical status of latent variables. Psychological Review, 110(2), 203-219.
8. Boyd, R. (2002). Scientific realism. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Summer 2002 Edition): http://plato.stanford.edu/archives/win2004/entries/scientific-realism/.
9. Brewer, J. & Hunter, A. (1989). Multimethod research: A synthesis of approaches. Newbury Park, CA: Sage.
10. Campbell, D. T. & Stanley, J. (1963). Experimental and quasi-experimental designs for research. Chicago, IL: Rand McNally.
11. Chalhoub-Deville, M. (2003). Second language interaction: Current perspectives and future trends. Language Testing, 20(4), 369-383.
12. Chalhoub-Deville, M. & Deville, C. (forthcoming). Old, borrowed, and new thoughts in second language testing. In R. L. Brennan (Ed.), Educational measurement (4th ed.). New York: American Council on Education and Macmillan Publishing Company.
13. Chalmers, D. (1996). The conscious mind: In search of a fundamental theory. Oxford: OUP.
14. Chapelle, C. (1998). Construct definition and validity inquiry in SLA research. In L. F. Bachman & A. D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 32-70). New York, NY: CUP.
15. Chapelle, C. A. (this volume). L2 vocabulary acquisition theory: The role of inference, dependability and generalizability in assessment. In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
16. Churchland, P. M. (1996). The engine of reason, the seat of the soul. Cambridge, MA: The MIT Press.
17. Creswell, J. W. (2003). Research design: Qualitative, quantitative and mixed approaches. Thousand Oaks, CA: Sage.
18. Damasio, A. R. (1994). Descartes' error: Emotion, reason and the human brain. New York, NY: Grosset/Putnam.
19. Davies, A. (1997a). Demands of being professional in language testing. Language Testing, 14, 328-339.
20. Davies, A. (1997b). Special issue: Ethics in language testing. Language Testing, 14(3).
21. Davies, A. (2004). Special issue: The ethics of language assessment. Language Assessment Quarterly, 1(2/3).
22. Dennett, D. C. (1991). Consciousness explained. New York, NY: Little, Brown & Co.
23. Deville, C. & Chalhoub-Deville, M. (this volume). Old and new thoughts on test score variability: Implications for reliability and validity. In M. Chalhoub-Deville, C. A. Chapelle & P. A. Duff (Eds.), Inferences and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
24. Douglas, D. & Selinker, L. (1985). Principles for language tests within the 'discourse domains' theory of interlanguage: Research, test construction and interpretation. Language Testing, 2, 205-226.
25. Duff, P. A. (this volume). Beyond generalizability: Contextualization, complexity, and credibility in applied linguistics research. In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
26. Erickson, F. & Schulz, J. (1981). When is context? Some issues in the analysis of social competence. In J. Green & C. Wallat (Eds.), Ethnography and language in educational settings. Norwood, NJ: Ablex.
27. Gregg, K. R. (1993). Taking explanations seriously; or, let a couple of flowers bloom. Applied Linguistics, 14, 276-294.
28. Guba, E. G. & Lincoln, Y. S. (1982). Epistemological and methodological bases of naturalistic inquiry. Education Communication and Technology, 30(4), 233-252.
29. Hamp-Lyons, L. (1997a). Ethics in language testing. In C. Clapham & D. Corson (Eds.), Encyclopedia of language and education (Vol. 7: Language testing and assessment, pp. 323-333). Dordrecht: Kluwer Academic.
30. Hamp-Lyons, L. (1997b). Washback, impact and validity: Ethical concerns. Language Testing, 14, 295-303.
31. Hart, W. D. (1988). The engines of the soul. Cambridge: CUP.
32. Headland, T. N., Pike, K. L., & Harris, M. (Eds.). (1990). Emics and etics: The insider/outsider debate. Dallas, TX: Summer Institute of Linguistics.
33. Heider, K. G. (1988). The Rashomon effect: When ethnographers disagree. American Anthropologist, 90(1), 73-81.
34. Hymes, D. (1974). Foundations in sociolinguistics: An ethnographic approach. Philadelphia, PA: University of Pennsylvania Press.
35. Johnson, R. B. & Christensen, L. B. (2004). Educational research: Quantitative, qualitative and mixed approaches. Boston, MA: Allyn and Bacon.
36. Johnson, R. B. & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26.
37. Jordan, G. (2004). Theory construction in second language acquisition research. Amsterdam: John Benjamins.
38. Kane, M. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319-342.
39. Kane, M. (2004). Certification testing as an illustration of argument-based validation. Measurement: Interdisciplinary Research and Perspectives, 2(3), 135-170.
40. Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational measurement: issues and practice, 18(2), 5-17.
41. Kirk, J. & Miller, M. L. (1999). Reliability and validity in qualitative research. Newbury Park, CA: Sage Publications.
42. Koenig, J. A. & Bachman, L. F. (Eds.). (2004). Keeping score for all: The effects of inclusion and accommodation policies on large-scale educational assessment. Washington, DC: National Research Council, National Academies Press.
43. Kunnan, A. J. (Ed.). (2000). Fairness and validation in language assessment: Selected papers from the 19th language testing research colloquium, Orlando. Cambridge: CUP.
44. Labov, W. (1990). Sociolinguistic patterns. Philadelphia, PA: University of Pennsylvania Press.
45. Lantolf, J. P. (1996). Second language theory building: Letting all the flowers bloom. Language Learning, 46, 713-749.
46. Larsen-Freeman, D. (this volume). Functional grammar: On the value and limitations of dependability, inference, and generalizability. In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
47. Llosa, L. (2005). Building and supporting a validity argument for a standards-based classroom assessment of English proficiency. Unpublished PhD dissertation, University of California, Los Angeles.
48. Long, M. H. (1990). The least a second language acquisition theory needs to explain. TESOL Quarterly, 24, 649-666.
49. Long, M. H. (1993). Assessment strategies for SLA theories. Applied Linguistics, 14, 225-249.
50. Lynch, B. K. (1996). Language program evaluation: Theory and practice. Cambridge: CUP.
51. Markee, N. (this volume). A conversation analytic perspective on the role of quantification in second language acquisition research. In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
52. Mathison, S. (1988). Why triangulate? Educational Researcher, 17(2), 13-17.
53. Maxwell, J. A. (1992). Understanding and validity in qualitative research. Harvard Educational Review, 62(3), 279-299.
54. McNamara, T. (this volume). Validity and values: Inferences and generalizability in language testing. In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
55. Messick, S. (1981). Constructs and their vicissitudes in educational and psychological measurement. Psychological Bulletin, 89, 575-588.
56. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3 ed., pp. 13-103). New York, NY: American Council on Education and Macmillan Publishing Company.
57. Miller, A. (2004). Realism. In E. N. Zalte (Ed.), The Stanford encyclopedia of philosophy (Winter 2004 Edition): http://plato.stanford.edu/archives/win2004/entries/realism/.
58. Mislevy, R. J. (2003). Substance and structure in assessment arguments. Law, Probability and Risk, 2, 237-258.
59. Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1(1), 3-62.
60. Ochs, E. (1979). Transcription as theory. In E. Ochs & B. B. Schieffelin (Eds.), Developmental pragmatics (pp. 47-72). New York, NY: Academic Press.
61. Ochs, E. (1988). Culture and language development: Language acquisition and language socialization in a Samoan village. Cambridge: CUP.
62. Ochs, E. & Capps, L. (2001). Living narrative. Cambridge, MA: Harvard University Press.
63. Ockey, G. J. (2005). DIF techniques to investigate the validity of math word problems for English language learners. PhD Qualifying Paper, University of California, Los Angeles.
64. Sasaki, M. (1996). Second language proficiency, foreign language aptitude, and intelligence: Quantitative and qualitative analyses. New York, NY: Peter Lang.
65. Sasaki, M. (2000). Effects of cultural schemata on students' test-taking processes for cloze tests: A multiple data source approach. Language Testing, 17(1), 85-114.
66. Sawaki, Y. (2003). A comparison of summary and free-recall as reading comprehension tasks in a web-based placement test of Japanese as a foreigh language. Unpublished PhD dissertation, University of California, Los Angeles.
67. Schumann, J. H. (1984). Art and science in second language acquisition research. In A. Z. Guiora (Ed.), An epistemology for the language sciences (language learning, special issue) (pp. 49-76). Ann Arbor.
68. Schumann, J. H. (1993). Some problems with falsification: An illustration from SLA research. Applied Linguistics, 14, 295-306.
69. Swain, M. (1993). Second language testing and second language acquisition: Is there a conflict with traditional psychometrics? Language Testing, 10(2), 193-207.
70. Swain, M. (this volume). Verbal protocols: What does it mean for research to use speaking as a data collection tool? In M. Chalhoub-Deville, C. A. Chapelle, & P. A. Duff (Eds.), Inference and generalizability in applied linguistics: Multiple perspectives. Amsterdam: John Benjamins.
71. Tashakkori, A. & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage.
72. Tashakkori, A. & Teddlie, C. (Eds.). (2003). Handbook of mixed methods in social and behavioral research. Thousand Oaks, CA: Sage.
73. Toulmin, S. E. (2003). The uses of argument (Updated ed.). Cambridge: CUP.
74. Weigle, S. C. (1994). Effects of training on raters of ESL compositions. Language Testing, 11(2), 197-223.
75. Weigle, S. C. (1998). Using facets to model rater training effects. Language Testing, 15(2), 263-267.
76. Weigle, S. C. (2002). Assessing writing. Cambridge: CUP.