The value and practice of research synthesis for language learning and teaching

Language Learning and Language Teaching

Volumn 13, Issue , 2006, Pages 1-50

  Norris, John M ^a   Ortega, Lourdes ^a  

^a UNIVERSITY OF HAWAII   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85122842208     PISSN: 15699471     EISSN: None     Source Type: Book Series    
DOI: None     Document Type: Chapter

References (93)

1. Baumann, J. F., & Duffy-Hester, A. M. (2002). Making sense of classroom worlds: Methodology in teacher research. In M. L. Kamil, P. B. Mosenthal, P. D. Pearson & R. Barr (Eds.), Methods of literacy research: The methodology chapters from the handbook of reading research, volume III (pp. 1-22). Mahwah, NJ: Lawrence Erlbaum.
2. Brown, J. D., & Rodgers, T. S. (2002). Doing second language research. Oxford: Oxford University Press.
3. Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378-399.
4. Chapelle, C., & Duff, P. (2003). Some guidelines for conducting quantitative and qualitative research in TESOL. TESOL Quarterly, 37, 157-178.
5. Chaudron, C. (1988). Second language classrooms: Research on teaching and learning. Cambridge, UK: Cambridge University Press.
6. Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
7. Cohen, J. (1977). Statistical power analysis for the behavioral sciences (rev. ed.). New York: Academic Press.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
9. Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997-1003.
10. Cooper, H. (1998). Synthesizing research: A guide for literature reviews (3rd ed.). Thousand Oaks, CA: Sage.
11. Cooper, H. (2003). Editorial. Psychological Bulletin, 129, 3-9.
12. Cooper, H., & Hedges, L. V. (Eds.). (1994a). The handbook of research synthesis. New York: Russell Sage Foundation.
13. Cooper, H., & Hedges, L. V. (1994b). Research synthesis as a scientific enterprise. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 3-14). New York: Russell Sage Foundation.
14. Cortina, J. M., & Nouri, H. (2000). Effect size for ANOVA designs. Thousand Oaks, CA: Sage.
15. Crookes, G. (1993). Action research for second language teachers: Going beyond teacher research. Applied Linguistics, 14, 130-144.
16. Doyle, L. H. (2003). Synthesis through meta-ethnography: Paradoxes, enhancements, and possibilities. Qualitative Research, 3, 321-344.
17. Eisenhart, M. (1998). On the subject of interpretive reviews. Review of Educational Research, 68, 391-399.
18. Ellis, N. (2000). Editor's statement. Language Learning, 50 (3), xi-xiii.
19. Ginsburg, M. B. (2003). Series Editor's Introduction: Dialogue isn't necessarily more efficient, but it's more democratic and, therefore, more effective. In M. B. Ginsburg and J. M. Gorostiaga (Eds.), Limitations and possibilities of dialogue among researchers, policy makers, and practitioners (pp. ix-xi). New York: RoutledgeFalmer.
20. Ginsburg, M. B., & Gorostiaga, J. M. (2003). Dialogue about educational research, policy, and practice: To what extent is it possible and who should be involved? In M. B. Ginsburg and J. M. Gorostiaga (Eds.), Limitations and possibilities of dialogue among researchers, policy makers, and practitioners (pp. 1-36). New York: RoutledgeFalmer.
21. Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Hawthorne, NY: Aldine de Gruyter.
22. Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3-8.
23. Glass, G. V. (1999). Meta-analysis at 25. Unpublished manuscript of talk delivered on July 15,1999, in Washington D.C. Retrieved on March 14, 2005, from http://glass.ed.asu.edu/gene/papers/meta25.html.
24. Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
25. Gleser, L. J., & Olkin, I. (1994). Stochastically dependent effect sizes. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 339-355). New York: Russell Sage Foundation.
26. Goldschneider, J., & DeKeyser, R. M. (2001). Explaining the “natural order of L2 morpheme acquisition” in English: A meta-analysis of multiple determinants. Language Learning, 51, 1-50.
27. Grant, C. A., & Grauer, E. (1999). (Re)viewing a review: A case history of the Review of Educational Research. Review of Educational Research, 69, 384-396.
28. Greene, J. P. (1997). A meta-analysis of the Rossell and Baker review of bilingual education research. Bilingual Research Journal, 22(2 & 3), no page numbers. Available at: http://brj.asu.edu/articlesv2/green.html
29. Greenhouse, J. B., & Iyengar, S. (1994). Sensitivity analysis and diagnostics. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 383-398). New York: Russell Sage Foundation.
30. Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (Eds.). (1997). What if there were no significance tests? Mahwah, NJ: Erlbaum.
31. Hedges, L., & Olkin, I. (1985). Statistical methods for meta-analysis. New York: Academic Press.
32. Henning, G. (1986). Quantitative methods in language acquisition research. TESOL Quarterly, 20, 701-709.
33. Hinkel, E. (Ed.). (2005). Handbook of research in second language teaching and learning. Mahwah, NJ: Lawrence Erlbaum.
34. Hodson, R. (2004). A meta-analysis of workplace ethnographies: Race, gender, and employee attitudes and behaviors. Journal of Contemporary Ethnography, 33, 4-38.
35. Hornberger, N. (Ed.). (in press). Encyclopedia of language education (2nd ed.). New York: Springer.
36. Hunt, M. (1997). How science takes stock: The story of meta-analysis. New York: Russell Sage Foundation.
37. Jackson, G. B. (1980). Methods for integrative reviews. Review of Educational Research, 50, 438-460.
38. Krashen, S., Long, M. H., & Scarcella, R. (1979). Accounting for child-adult differences in second language rate and attainment. TESOL Quarterly, 13, 573-582.
39. Kupfersmid, J. (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635-642.
40. Lane, D. (2005). Hyperstat online. Web site. Downloaded December 10, 2005, at http://davidmlane.com/hyperstat/effect_size.html.
41. Lather, P. (1999). To be of use: The work of reviewing. Review of Educational Research, 69, 2-7.
42. Lazaraton, A. (2000). Current trends in research methodology and statistics in applied linguistics. TESOL Quarterly, 34, 175-181.
43. Light, R., & Pillemer, D. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.
44. Light, R. J., Singer, J. D., & Willett, J. B. (1994). The visual presentation and interpretation of meta-analysis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 439-453). New York: Russell Sage Foundation.
45. Light, R. J., & Smith, P. V. (1971). Accumulating evidence: Procedures for resolving contradictions among research studies. Harvard Educational Review, 41, 429-471.
46. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
47. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
48. Long, M. H. (1983). Does second language instruction make a difference? A review of the research. TESOL Quarterly, 17, 359-382.
49. Long, M. H. (1990). Maturational constraints on language development. Studies in Second Language Acquisition, 12, 251-286.
50. Loschky, L., & Bley-Vroman, R. (1993). Grammar and task-based methodology. In G. Crookes & S. Gass (Eds.), Tasks and language learning: Integrating theory and practice (pp. 123-167). Philadelphia, PA: Multilingual Matters.
51. MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk. Volume II: The database (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
52. Marinova-Todd, S. H., Marshall, D. B., & Snow, C. E. (2000). Three misconceptions about age and L2 learning. TESOL Quarterly, 34, 9-34.
53. Masgoret, A.-M., & Gardner, R. C. (2003). Attitudes, motivation, and second language learning: A meta-analysis of studies conducted by Gardner and associates. Language Learning, 53, 123-163.
54. Masters, J. C., Cantor, N. E., & Hedges, L. V. (1988). Editorial. Psychological Bulletin, 103(1), 3-4.
55. Miller, N., & Pollock, V. E. (1994). Meta-analytic synthesis for theory development. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 457-483). New York: Russell Sage Foundation.
56. Nicholas, H., Lightbown, P. M., & Spada, N. (2001). Recasts as feedback to language learners. Language Learning, 51, 719-758.
57. Noblit, G. W., & Hare, R. D. (1988). Meta-ethnography: Synthesizing qualitative studies. Newbury Park, CA: Sage.
58. Norris, J. M. (forthcoming). Validity evaluation in language assessment. New York: Peter Lang.
59. Norris, J. M., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning, 50, 417-528.
60. Norris, J. M., & Ortega, L. (2003). Defining and measuring SLA. In C. Doughty & M. H. Long (Eds.), Handbook of second language acquisition (pp. 717-761). Malden, MA: Blackwell.
61. Ortega, L. (2003). Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics, 24, 492-518.
62. Ortega, L. (2005). For what and for whom is our research? The ethical as transformative lens in instructed SLA. Modern Language Journal, 89, 427-443.
63. Orwin, R. G. (1994). Evaluating coding decisions. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 139-162). New York: Russell Sage Foundation.
64. Paterson, B. L., Thorne, S. E., Canam, C., & Jillings, C. (2001). Meta-study of qualitative health research: A practical guide to meta-analysis and meta-synthesis. Thousand Oaks, CA: Sage.
65. Patton, M. (1997). Utilization-focused evaluation: The new century text. Thousand Oaks, CA: Sage.
66. Ragin, C. C., Drass, K. A., & Davey, S. (2003). Fuzzy-set/qualitative comparative analysis. Available at www.Fsqca.Com (Version 1.1). Tucson, Arizona: Department of Sociology, University of Arizona.
67. Reichelt, M. (2001). A critical review of foreign language writing research on pedagogical approaches. Modern Language Journal, 85, 578-598.
68. Rolstad, K., Mahoney, K. S., & Glass, G. V. (2005). Weighing the evidence: A meta-analysis of bilingual education in Arizona. Bilingual Research Journal, 29(1), 43-67.
69. Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638-641.
70. Rosenthal, R. (1990). How are we doing in soft psychology? American Psychologist, 45, 775-777.
71. Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. Hedges (Eds.), Handbook of research synthesis (pp. 231-244). New York: Russell Sage Foundation.
72. Rosenthal, R., & DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59-82.
73. Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (2000). Contrasts and effect sizes in behavioral research. Cambridge, UK: Cambridge University Press.
74. Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing, 15, 1-20.
75. Rossell, C., & Baker, K. (1996). The educational effectiveness of bilingual education. Research in the Teaching of English, 30, 7-74.
76. Rossell, C., & Kuder, J. (2005). Meta-murky: A rebuttal to recent meta-analyses of bilingual education. In J. Söhn (Ed.), The effectiveness of bilingual school programs for immigrant children (pp. 43-76). Berlin: Wissenschaftszentrum Berlin für Sozialforschung (Social Science Research Center).
77. Sandelowski, M., Docherty, S., & Emden, C. (1997). Qualitative metasynthesis: Issues and techniques. Research in Nursing and Health, 20, 365-376.
78. Shanahan, T. (2002). Research synthesis: Making sense of the accumulation of knowledge in reading. In M. L. Kamil, P. B. Mosenthal, P. D. Pearson & R. Barr (Eds.), Methods of literacy research: The methodology chapters from the handbook of reading research. Volume III (pp. 133-150). Mahwah, NJ: Lawrence Erlbaum.
79. Shohamy, E. (2000). The relationship between language testing and second language acquisition, revisited. System, 28, 541-553.
80. Slavin, R. E. (1986). Best evidence synthesis: An alternative to meta-analytic and traditional reviews. Educational Researcher, 15(9), 5-11.
81. Slavin, R. E., & Cheung, A. (2005). A synthesis of research on language of reading instruction for English language learners. Review of Educational Research, 75, 247-284.
82. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32(9), 752-760.
83. Spada, N. (1997). Form-focussed instruction and second language acquisition: A review of classroom and laboratory research. Language Teaching, 29, 1-15.
84. Stock, W. (1994). Systematic coding for research synthesis. In H. Cooper & L. Hedges (Eds.), The handbook of research synthesis (pp. 125-138). New York: Russell Sage Foundation.
85. Tashakkori, A., & Teddlie, C. (Eds.). (2003). The handbook of mixed methods in social and behavioral research. Thousand Oaks, CA: Sage.
86. Thomas, M. P., & Collier, V. P. (2002). A national study of school effectiveness for language minority students' long term academic achievement: Final report. Washington, DC: Center for Research on Education, Diversity, and Excellence.
87. Truscott, J. (1996). Review article: The case against grammar correction in L2 writing classes. Language Learning, 46, 327-369.
88. Truscott, J. (1999). What's wrong with oral grammar correction. Canadian Modern Language Review, 55, 437-456.
89. Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6-20.
90. Willig, A. C. (1985). A meta-analysis of selected studies on the effectiveness of bilingual education. Review of Educational Research, 55, 269-317.
91. Wittgenstein, L. (1969/1972). Über Gewissheit [On certainty]. New York: Harper & Row Publishers [Edition by G. E. M. Anscombe & G. H. von Wright, originally published in 1969 by Blackwell].
92. Wortman, P. M. (1994). Research synthesis as a scientific enterprise. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 97-109). New York: Russell Sage Foundation.
93. Yin, R. K., & Heald, K. A. (1975). Using the case survey method to analyze policy studies. Administrative Science Quarterly, 20, 371-381.