Statistical power, P values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research

Advancing Quantitative Methods in Second Language Research

Volumn , Issue , 2015, Pages 23-46

  Plonsky, Luke ^a  

^a NORTHERN ARIZONA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85111329524     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4324/9781315870908-3     Document Type: Chapter

References (29)

1. Cohen, J. (1968). Multiple regression as a general data-analytic system. Psychological Bulletin, 70, 426-443.
2. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
3. Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 97-1003.
4. Cumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York: Routledge.
5. Cunnings, I. (2012). An overview of mixed-effects statistical models for second language researchers. Second Language Research, 28, 369-382.
6. Egbert, J., & Plonsky, L. (in press). Success in the abstract: Exploring linguistic and stylistic predictors of conference abstract ratings. Corpora.
7. Ellis, N. C. (2000). Editorial statement. Language Learning, 50, xi-xiii.
8. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191.
9. Granena, G. (2013). Individual differences in sequence learning ability and second language acquisition in early childhood and adulthood. Language Learning, 63, 665-705.
10. Kline, R. B. (2013). Beyond significance testing: Statistics reform in the behavioral sciences (2nd ed.). Washington, DC: American Psychological Association.
11. Larson-Hall, J., & Herrington, R. (2010). Improving data analysis in second language acquisition by utilizing modern developments in applied statistics. Applied Linguistics, 31, 368-390.
12. Larson-Hall, J., & Plonsky, L. (2015). Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65, Supp. 1, 125-157.
13. Loewen, S., Lavolette, B., Spino, L. A., Papi, M., Schmidtke, J., Sterling, S., et al. (2014). Statistical literacy among applied linguists and second language acquisition researchers TESOL Quarterly, 48, 360-388.
14. Mackey, A., & Sachs, R. (2012). Older learners in SLA research: A first look at working memory, feedback, and L2 development. Language Learning, 62, 704-740.
15. Norris, J.M. (in press). Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65, Supp. 1.
16. Norris, J. M., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning, 50(3), 417-528.
17. Norris, J. M., & Ortega, L. (2006). The value and practice of research synthesis for language learning and teaching. In J. M. Norris & L. Ortega (Eds.), Synthesizing research on language learning and teaching (pp. 3-50). Amsterdam: John Benjamins.
18. Oswald, F. L., & Plonsky, L. (2010). Meta-analysis in second language research: Choices and challenges. Annual Review of Applied Linguistics, 30, 85-110.
19. Plonsky, L. (2013). Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35, 655-687.
20. Plonsky, L. (2014). Study quality in quantitative L2 research (1990-2010): A methodological synthesis and call for reform. Modern Language Journal, 98, 450-470.
21. Plonsky, L., & Gass, S. (2011). Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61, 325-366.
22. Plonsky, L., Egbert, J., & LaFlair, G. T. (in press). Bootstrapping in applied linguistics: Assessing its potential using shared data. Applied Linguistics.
23. Plonsky, L., & Oswald, F. L. (2014). How big is ‘big’? Interpreting effect sizes in L2 research. Language Learning, 64, 878-912.
24. Porte, G. (2010). Appraising research in second language learning: A practical approach to critical analysis of quantitative research (2nd ed.). Philadelphia/Amsterdam: John Benjamins.
25. Rosnow, R. L. & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
26. Sagan, C. (1996). The demon-haunted world. New York: Random House.
27. Stukas, A. A., & Cumming, G. (in press). Interpreting effect sizes: Towards a quantitative cumulative social psychology. European Journal of Social Psychology.
28. Taylor, A.M., Stevens, J. R., & Asher, J. W. (2006). The effects of explicit reading strategy training on L2 reading comprehension: A meta-analysis. In J. M. Norris & L. Ortega (Eds.), Synthesizing research on language learning and teaching (pp. 213-244). Amsterdam: John Benjamins.
29. Thompson, B. (1992). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434-438.