메뉴 건너뛰기




Volumn 23, Issue 1, 2013, Pages 98-122

A comprehensive review of reporting practices in psychological journals: Are effect sizes really enough?

Author keywords

confidence interval; effect size; NHST; publication bias; significance testing; statistical power

Indexed keywords


EID: 84873882647     PISSN: 09593543     EISSN: 14617447     Source Type: Journal    
DOI: 10.1177/0959354312436870     Document Type: Article
Times cited : (45)

References (149)
  • 2
    • 0002092075 scopus 로고
    • Misuse of statistics is unethical
    • In, Altman, D. G., Gore, S. M., (Eds.), London, UK: BMJ Books
    • Altman D. G. (1982). Misuse of statistics is unethical. In Altman D. G. Gore S. M. (Eds.), Statistics in practice (pp. 1–2). London, UK: BMJ Books.
    • (1982) Statistics in practice , pp. 1-2
    • Altman, D.G.1
  • 6
    • 36148988366 scopus 로고    scopus 로고
    • But what do the numbers really tell us? Arbitrary metrics and effect size reporting in sport psychology research
    • Andersen M. B. McCullagh P. Wilson G. J. (2007). But what do the numbers really tell us? Arbitrary metrics and effect size reporting in sport psychology research. Journal of Sport & Exercise Psychology, 29, 664–672.
    • (2007) Journal of Sport & Exercise Psychology , vol.29 , pp. 664-672
    • Andersen, M.B.1    McCullagh, P.2    Wilson, G.J.3
  • 8
    • 0000494437 scopus 로고
    • Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship?
    • Atkinson D. R. Furlang M. J. Wampold B. E. (1982). Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship? Journal of Counseling Psychology, 29, 189–194.
    • (1982) Journal of Counseling Psychology , vol.29 , pp. 189-194
    • Atkinson, D.R.1    Furlang, M.J.2    Wampold, B.E.3
  • 9
    • 68749097016 scopus 로고    scopus 로고
    • Standardized or simple effect size: What should be reported?
    • Baguley T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603–617.
    • (2009) British Journal of Psychology , vol.100 , pp. 603-617
    • Baguley, T.1
  • 10
    • 0013987268 scopus 로고
    • The test of significance in psychological research
    • Bakan D. (1966). The test of significance in psychological research. Psychological Bulletin, 66, 423–437.
    • (1966) Psychological Bulletin , vol.66 , pp. 423-437
    • Bakan, D.1
  • 12
    • 0002487281 scopus 로고
    • Publication bias
    • In, Cooper, H., Hedges, L. V., (Eds.), New York, NY: Russell Sage Foundation
    • Begg C. B. (1994). Publication bias. In Cooper H. Hedges L. V. (Eds.), The handbook of research synthesis (pp. 399–409). New York, NY: Russell Sage Foundation.
    • (1994) The handbook of research synthesis , pp. 399-409
    • Begg, C.B.1
  • 13
    • 30544447613 scopus 로고    scopus 로고
    • Researchers misunderstand confidence intervals and standard error bars
    • Belia S. Fidler F. Williams J. Cumming G. (2005). Researchers misunderstand confidence intervals and standard error bars. Psychological Methods, 10, 389–396.
    • (2005) Psychological Methods , vol.10 , pp. 389-396
    • Belia, S.1    Fidler, F.2    Williams, J.3    Cumming, G.4
  • 15
    • 0001064264 scopus 로고
    • Mathematical vs. scientific importance
    • Boring E. G. (1919). Mathematical vs. scientific importance. Psychological Bulletin, 16, 335–338.
    • (1919) Psychological Bulletin , vol.16 , pp. 335-338
    • Boring, E.G.1
  • 16
    • 0007222167 scopus 로고    scopus 로고
    • Confidence intervals as an alternative to significance testing
    • Brandståtter E. (1999). Confidence intervals as an alternative to significance testing. Methods of Psychological Research Online, 14, 33–46.
    • (1999) Methods of Psychological Research Online , vol.14 , pp. 33-46
    • Brandståtter, E.1
  • 17
    • 84965710849 scopus 로고
    • Constructing psychological knowledge: Reflections on science, scientists and epistemology in the APA Publication Manual
    • Budge G. Katz B. (1995). Constructing psychological knowledge: Reflections on science, scientists and epistemology in the APA Publication Manual. Theory & Psychology, 5, 217–231.
    • (1995) Theory & Psychology , vol.5 , pp. 217-231
    • Budge, G.1    Katz, B.2
  • 18
    • 34547458548 scopus 로고    scopus 로고
    • A call for statistical reform in Educational Administration Quarterly
    • Byrd J. K. (2007). A call for statistical reform in Educational Administration Quarterly. Educational Administration Quarterly, 43, 381–391.
    • (2007) Educational Administration Quarterly , vol.43 , pp. 381-391
    • Byrd, J.K.1
  • 19
    • 0042071207 scopus 로고    scopus 로고
    • Exploring the APA Fifth Edition Publication Manual's impact on the analytic preferences of journal editorial board members
    • Capraro M. M. Capraro R. M. (2003). Exploring the APA Fifth Edition Publication Manual's impact on the analytic preferences of journal editorial board members. Educational and Psychological Measurement, 63, 554–565.
    • (2003) Educational and Psychological Measurement , vol.63 , pp. 554-565
    • Capraro, M.M.1    Capraro, R.M.2
  • 20
    • 2342664903 scopus 로고    scopus 로고
    • Statistical power and the testing of null hypotheses: A review of contemporary management research and recommendations for future studies
    • Cashen L. H. Geiger S. W. (2004). Statistical power and the testing of null hypotheses: A review of contemporary management research and recommendations for future studies. Organizational Research Methods, 7, 151–167.
    • (2004) Organizational Research Methods , vol.7 , pp. 151-167
    • Cashen, L.H.1    Geiger, S.W.2
  • 21
    • 36049040706 scopus 로고    scopus 로고
    • Students’ misconceptions of statistical inference: A review of the empirical evidence from research on statistics education
    • Castro Sotos A. E. Vanhoof S. Van den Noortgate W. Onghena P. (2007). Students’ misconceptions of statistical inference: A review of the empirical evidence from research on statistics education. Educational Research Review, 2, 98–113.
    • (2007) Educational Research Review , vol.2 , pp. 98-113
    • Castro Sotos, A.E.1    Vanhoof, S.2    Van den Noortgate, W.3    Onghena, P.4
  • 22
    • 2442692780 scopus 로고    scopus 로고
    • Empirical evidence for selective reporting of outcomes in randomized trials–Comparison of protocols to published articles
    • Chan A. W. Hróbjartsson A. Haahr M. T. Gøtzsche P. C. Altman D. G. (2004). Empirical evidence for selective reporting of outcomes in randomized trials–Comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457–2465.
    • (2004) Journal of the American Medical Association , vol.291 , pp. 2457-2465
    • Chan, A.W.1    Hróbjartsson, A.2    Haahr, M.T.3    Gøtzsche, P.C.4    Altman, D.G.5
  • 23
    • 0346618054 scopus 로고    scopus 로고
    • The account taken of statistical power in research published in the British Journal of Psychology
    • Clark-Carter D. (1997). The account taken of statistical power in research published in the British Journal of Psychology. British Journal of Psychology, 88, 71–83.
    • (1997) British Journal of Psychology , vol.88 , pp. 71-83
    • Clark-Carter, D.1
  • 26
    • 0039802908 scopus 로고
    • The earth is round (p <.05)
    • Cohen J. (1994). The earth is round (p <.05). American Psychologist, 49, 997–1003.
    • (1994) American Psychologist , vol.49 , pp. 997-1003
    • Cohen, J.1
  • 27
    • 0142136688 scopus 로고    scopus 로고
    • How meta-analysis increases statistical power
    • Cohn L. D. Becker B. J. (2003). How meta-analysis increases statistical power. Psychological Methods, 8, 243–253.
    • (2003) Psychological Methods , vol.8 , pp. 243-253
    • Cohn, L.D.1    Becker, B.J.2
  • 28
    • 68249111665 scopus 로고    scopus 로고
    • Datenanalyse: Das Null-Ritual und der Umgang mit Effekten in der Zeitschrift für Sportpsychologie
    • [Data analysis: The null ritual and the use of effect sizes]
    • Conzelmann A. Raab M. (2009). Datenanalyse: Das Null-Ritual und der Umgang mit Effekten in der Zeitschrift für Sportpsychologie [Data analysis: The null ritual and the use of effect sizes]. Zeitschrift für Sportpsychologie, 16, 43–54.
    • (2009) Zeitschrift für Sportpsychologie , vol.16 , pp. 43-54
    • Conzelmann, A.1    Raab, M.2
  • 31
    • 67649550108 scopus 로고    scopus 로고
    • Confidence intervals: Better answers to better questions
    • Cumming G. Fidler F. (2009). Confidence intervals: Better answers to better questions. Journal of Psychology, 217, 15–26.
    • (2009) Journal of Psychology , vol.217 , pp. 15-26
    • Cumming, G.1    Fidler, F.2
  • 33
    • 0035535636 scopus 로고    scopus 로고
    • A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions
    • Cumming G. Finch S. (2001). A primer on the understanding, use, and calculation of confidence intervals that are based on central and noncentral distributions. Educational and Psychological Measurement, 61, 532–574.
    • (2001) Educational and Psychological Measurement , vol.61 , pp. 532-574
    • Cumming, G.1    Finch, S.2
  • 34
    • 33748773893 scopus 로고    scopus 로고
    • Confidence intervals and replication: Where will the next mean fall?
    • Cumming G. Maillardet R. (2006). Confidence intervals and replication: Where will the next mean fall? Psychological Methods, 11, 217–227.
    • (2006) Psychological Methods , vol.11 , pp. 217-227
    • Cumming, G.1    Maillardet, R.2
  • 35
    • 13544271270 scopus 로고    scopus 로고
    • Replication and researchers’ understanding of confidence intervals and standard error bars
    • Cumming G. Williams J. Fidler F. (2004). Replication and researchers’ understanding of confidence intervals and standard error bars. Understanding Statistics, 3, 299–311.
    • (2004) Understanding Statistics , vol.3 , pp. 299-311
    • Cumming, G.1    Williams, J.2    Fidler, F.3
  • 36
    • 37149009077 scopus 로고    scopus 로고
    • Meta-analyses: Some very good steps toward a bit longer journey
    • Dalton D. R. Dalton C. M. (2008). Meta-analyses: Some very good steps toward a bit longer journey. Organizational Research Methods, 11, 127–147.
    • (2008) Organizational Research Methods , vol.11 , pp. 127-147
    • Dalton, D.R.1    Dalton, C.M.2
  • 38
    • 3042555481 scopus 로고    scopus 로고
    • Alternatives to null hypothesis significance testing
    • Retrieved from
    • Denis D. (2003). Alternatives to null hypothesis significance testing. Theory & Science, 4, 1. Retrieved from http://theoryandscience.icaap.org/content/vol4.1/02_denis.html
    • (2003) Theory & Science , vol.4 , pp. 1
    • Denis, D.1
  • 42
    • 26444433586 scopus 로고
    • Bayesian statistical inference for psychological research
    • Edwards W. Lindman H. Savage L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70, 193–242.
    • (1963) Psychological Review , vol.70 , pp. 193-242
    • Edwards, W.1    Lindman, H.2    Savage, L.J.3
  • 43
    • 38649096607 scopus 로고    scopus 로고
    • The value of RCT evidence depends on the quality of statistical analysis
    • Faulkner C. Fidler F. Cumming G. (2008). The value of RCT evidence depends on the quality of statistical analysis. Behaviour Research and Therapy, 46, 270–281.
    • (2008) Behaviour Research and Therapy , vol.46 , pp. 270-281
    • Faulkner, C.1    Fidler, F.2    Cumming, G.3
  • 44
    • 66949127594 scopus 로고    scopus 로고
    • Is psychological research really as good as medical research? Effect size comparisons between psychology and medicine
    • Ferguson C. J. (2009). Is psychological research really as good as medical research? Effect size comparisons between psychology and medicine. Review of General Psychology, 13, 130–136.
    • (2009) Review of General Psychology , vol.13 , pp. 130-136
    • Ferguson, C.J.1
  • 45
    • 84861217389 scopus 로고    scopus 로고
    • Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses
    • doi:, 10.1037/a0024445
    • Ferguson C. J. Brannick M. T. (2012). Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychological Methods, 17, 120–128. doi: 10.1037/a0024445
    • (2012) Psychological Methods , vol.17 , pp. 120-128
    • Ferguson, C.J.1    Brannick, M.T.2
  • 46
    • 0036382805 scopus 로고    scopus 로고
    • The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial
    • Fidler F. (2002). The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62, 749–770.
    • (2002) Educational and Psychological Measurement , vol.62 , pp. 749-770
    • Fidler, F.1
  • 48
    • 34250863894 scopus 로고    scopus 로고
    • Lessons learned from statistical reform efforts in other disciplines
    • Fidler F. Cumming G. (2007). Lessons learned from statistical reform efforts in other disciplines. Psychology in the Schools, 44, 441–449.
    • (2007) Psychology in the Schools , vol.44 , pp. 441-449
    • Fidler, F.1    Cumming, G.2
  • 51
    • 1642296555 scopus 로고    scopus 로고
    • Editors can lead researchers to confidence intervals, but can–t make them think
    • Fidler F. Thomason N. Cumming G. Finch S. Leeman J. (2004). Editors can lead researchers to confidence intervals, but can–t make them think. Psychological Science, 15, 119–126.
    • (2004) Psychological Science , vol.15 , pp. 119-126
    • Fidler, F.1    Thomason, N.2    Cumming, G.3    Finch, S.4    Leeman, J.5
  • 52
    • 84993683954 scopus 로고    scopus 로고
    • Reporting of statistical inference in the Journal of Applied Psychology: Little evidence of reform
    • Finch S. Cumming G. Thomason N. (2001). Reporting of statistical inference in the Journal of Applied Psychology: Little evidence of reform. Educational and Psychological Measurement, 61, 181–210
    • (2001) Educational and Psychological Measurement , vol.61 , pp. 181-210
    • Finch, S.1    Cumming, G.2    Thomason, N.3
  • 54
    • 0036921737 scopus 로고    scopus 로고
    • Past and future APA guidelines for statistical practice
    • Finch S. Thomason N. Cumming G. (2001). Past and future APA guidelines for statistical practice. Theory & Psychology, 12, 825–853.
    • (2001) Theory & Psychology , vol.12 , pp. 825-853
    • Finch, S.1    Thomason, N.2    Cumming, G.3
  • 55
    • 0003493777 scopus 로고
    • (11th ed.)., Edinburgh, UK: Oliver & Boyd,. (Original work published 1925)
    • Fisher R. A. (1950). Statistical methods for research workers (11th ed.). Edinburgh, UK: Oliver & Boyd. (Original work published 1925)
    • (1950) Statistical methods for research workers
    • Fisher, R.A.1
  • 56
    • 0004245434 scopus 로고
    • (5th ed.)., Edinburgh, UK: Oliver & Boyd,. (Original work published 1935)
    • Fisher R. A. (1951). The design of experiments (5th ed.). Edinburgh, UK: Oliver & Boyd. (Original work published 1935)
    • (1951) The design of experiments
    • Fisher, R.A.1
  • 57
    • 0039318171 scopus 로고
    • A problem with confidence intervals
    • Frick R. W. (1995). A problem with confidence intervals. American Psychologist, 50, 1102–1103.
    • (1995) American Psychologist , vol.50 , pp. 1102-1103
    • Frick, R.W.1
  • 59
    • 0023049334 scopus 로고
    • Confidence intervals rather than P values: Estimation rather than hypothesis testing
    • Gardner M. J. Altman D. G. (1986). Confidence intervals rather than P values: Estimation rather than hypothesis testing. British Medical Journal, 292, 746–750.
    • (1986) British Medical Journal , vol.292 , pp. 746-750
    • Gardner, M.J.1    Altman, D.G.2
  • 60
    • 47349130247 scopus 로고    scopus 로고
    • Publication bias in empirical sociological research: Do arbitrary significance levels distort published results?
    • Gerber A. S. Malhotra N. (2008). Publication bias in empirical sociological research: Do arbitrary significance levels distort published results? Sociological Methods & Research, 37, 3–30.
    • (2008) Sociological Methods & Research , vol.37 , pp. 3-30
    • Gerber, A.S.1    Malhotra, N.2
  • 61
    • 0001473354 scopus 로고
    • The superego, the ego, and the id in statistical reasoning
    • In, Keren, G., Lewis, C., (Eds.), Hillsdale, NJ: Erlbaum
    • Gigerenzer G. (1993). The superego, the ego, and the id in statistical reasoning. In Keren G. Lewis C. (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311–339). Hillsdale, NJ: Erlbaum.
    • (1993) A handbook for data analysis in the behavioral sciences: Methodological issues , pp. 311-339
    • Gigerenzer, G.1
  • 62
    • 78650110574 scopus 로고    scopus 로고
    • Personal reflections on theory and psychology
    • Gigerenzer G. (2010). Personal reflections on theory and psychology. Theory & Psychology, 20, 733–743.
    • (2010) Theory & Psychology , vol.20 , pp. 733-743
    • Gigerenzer, G.1
  • 63
    • 12444292914 scopus 로고    scopus 로고
    • The null ritual: What you always wanted to know about significance testing but were afraid to ask
    • In, Kaplan, D., (Ed.), Thousand Oaks, CA: Sage
    • Gigerenzer G. Krauss S. Vitouch O. (2004). The null ritual: What you always wanted to know about significance testing but were afraid to ask. In Kaplan D. (Ed.), The Sage handbook of quantitative methodology for the social sciences (pp. 391–408). Thousand Oaks, CA: Sage.
    • (2004) The Sage handbook of quantitative methodology for the social sciences , pp. 391-408
    • Gigerenzer, G.1    Krauss, S.2    Vitouch, O.3
  • 65
    • 0002384074 scopus 로고    scopus 로고
    • Meta-analysis
    • In, Rothman, K., Greenland, S., (Eds.), Philadelphia, PA: Lippincott-Raven
    • Greenland S. (1998). Meta-analysis. In Rothman K. Greenland S. (Eds.), Modern epidemiology (pp. 287–318). Philadelphia, PA: Lippincott-Raven.
    • (1998) Modern epidemiology , pp. 287-318
    • Greenland, S.1
  • 66
    • 0016437295 scopus 로고
    • Consequences of prejudice against the null hypothesis
    • Greenwald A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20.
    • (1975) Psychological Bulletin , vol.82 , pp. 1-20
    • Greenwald, A.G.1
  • 68
    • 0002812166 scopus 로고    scopus 로고
    • In praise of the null hypothesis statistical test
    • Hagen R. L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15–24.
    • (1997) American Psychologist , vol.52 , pp. 15-24
    • Hagen, R.L.1
  • 69
    • 22944470064 scopus 로고    scopus 로고
    • Vorgehensweise in der deutschsprachigen psychologischen Forschung: Eine Analyse empirischer Arbeiten der Jahre 2001 und 2002
    • [Procedures in German empirical research: An analysis of some psychological journals of the years 2001 and 2002]
    • Hager W. (2005). Vorgehensweise in der deutschsprachigen psychologischen Forschung: Eine Analyse empirischer Arbeiten der Jahre 2001 und 2002 [Procedures in German empirical research: An analysis of some psychological journals of the years 2001 and 2002]. Psychologische Rundschau, 56, 191–200.
    • (2005) Psychologische Rundschau , vol.56 , pp. 191-200
    • Hager, W.1
  • 70
    • 0029882206 scopus 로고    scopus 로고
    • Statistical power: Concepts, procedures, and applications
    • Hallahan M. Rosenthal R. (1996). Statistical power: Concepts, procedures, and applications. Behaviour Research and Therapy, 34, 489–499.
    • (1996) Behaviour Research and Therapy , vol.34 , pp. 489-499
    • Hallahan, M.1    Rosenthal, R.2
  • 71
    • 0038606580 scopus 로고    scopus 로고
    • Misinterpretations of significance: A problem students share with their teachers?
    • Haller H. Krauss S. (2002). Misinterpretations of significance: A problem students share with their teachers? Methods of Psychological Research Online, 7, 1–20.
    • (2002) Methods of Psychological Research Online , vol.7 , pp. 1-20
    • Haller, H.1    Krauss, S.2
  • 72
    • 33846646502 scopus 로고    scopus 로고
    • Inductive inference or inductive behavior: Fisher and Neyman–Pearson approaches to statistical testing in psychological research (1940–1960)
    • Halpin P. F. Stam H. J. (2006). Inductive inference or inductive behavior: Fisher and Neyman–Pearson approaches to statistical testing in psychological research (1940–1960). American Journal of Psychology, 119, 625–653.
    • (2006) American Journal of Psychology , vol.119 , pp. 625-653
    • Halpin, P.F.1    Stam, H.J.2
  • 73
    • 0004740821 scopus 로고    scopus 로고
    • Significance testing introduction and overview
    • In, Harlow, L. L., Mulaik, S. A., Steiger, J. H., (Eds.), Mahwah, NJ: Erlbaum
    • Harlow L. L. (1997). Significance testing introduction and overview. In Harlow L. L. Mulaik S. A. Steiger J. H. (Eds.), What if there were no significance tests? (pp. 37–64). Mahwah, NJ: Erlbaum.
    • (1997) What if there were no significance tests? , pp. 37-64
    • Harlow, L.L.1
  • 76
    • 57649201601 scopus 로고    scopus 로고
    • What are effect sizes and why do we need them?
    • Hedges L. V. (2008). What are effect sizes and why do we need them? Child Development Perspectives, 2, 167–171.
    • (2008) Child Development Perspectives , vol.2 , pp. 167-171
    • Hedges, L.V.1
  • 77
    • 33747081621 scopus 로고    scopus 로고
    • Effect-size measures and meta-analytic thinking in counseling psychology research
    • Henson R. K. (2006). Effect-size measures and meta-analytic thinking in counseling psychology research. The Counseling Psychologist, 34, 601–629.
    • (2006) The Counseling Psychologist , vol.34 , pp. 601-629
    • Henson, R.K.1
  • 78
    • 34248191722 scopus 로고    scopus 로고
    • Probability as certainty: Dichotomous thinking and the misuse of p values
    • Hoekstra R. Finch S. Kiers H. A. L. Johnson A. (2006). Probability as certainty: Dichotomous thinking and the misuse of p values. Psychonomic Bulletin & Review, 13, 1033–1037.
    • (2006) Psychonomic Bulletin & Review , vol.13 , pp. 1033-1037
    • Hoekstra, R.1    Finch, S.2    Kiers, H.A.L.3    Johnson, A.4
  • 79
    • 85047698182 scopus 로고    scopus 로고
    • The historical growth of statistical significance testing in psychology–and its future prospects
    • Hubbard R. Ryan P. A. (2000). The historical growth of statistical significance testing in psychology–and its future prospects. Educational and Psychological Measurement, 60, 661–681.
    • (2000) Educational and Psychological Measurement , vol.60 , pp. 661-681
    • Hubbard, R.1    Ryan, P.A.2
  • 82
    • 0023879367 scopus 로고
    • Uniform requirements for manuscripts submitted to biomedical journals
    • International Committee of Medical Journal Editors. (1988). Uniform requirements for manuscripts submitted to biomedical journals. Annals of Internal Medicine, 108, 258–265.
    • (1988) Annals of Internal Medicine , vol.108 , pp. 258-265
  • 83
    • 0242458903 scopus 로고    scopus 로고
    • Effect size use in studies of learning disabilities
    • Ives B. (2003). Effect size use in studies of learning disabilities. Journal of Learning Disabilities, 36, 490–504.
    • (2003) Journal of Learning Disabilities , vol.36 , pp. 490-504
    • Ives, B.1
  • 84
    • 76549120731 scopus 로고    scopus 로고
    • Interpreting significance: The differences between statistical significance, effect size, and practical importance
    • Kalinowski P. Fidler F. (2010). Interpreting significance: The differences between statistical significance, effect size, and practical importance. Newborn and Infant Nursing Reviews, 10, 50–54.
    • (2010) Newborn and Infant Nursing Reviews , vol.10 , pp. 50-54
    • Kalinowski, P.1    Fidler, F.2
  • 86
    • 0035285884 scopus 로고    scopus 로고
    • Statistical techniques employed in AERJ and JCP articles from 1988 to 1977: A methodological review
    • Kieffer K. M. Reese R. J. Thompson B. (2001). Statistical techniques employed in AERJ and JCP articles from 1988 to 1977: A methodological review. Journal of Experimental Education, 69, 280–309.
    • (2001) Journal of Experimental Education , vol.69 , pp. 280-309
    • Kieffer, K.M.1    Reese, R.J.2    Thompson, B.3
  • 87
    • 33845356620 scopus 로고    scopus 로고
    • Beyond statistical significance: A decision theory for science
    • Killeen P. R. (2006). Beyond statistical significance: A decision theory for science. Psychonomic Bulletin & Review, 13, 549–562.
    • (2006) Psychonomic Bulletin & Review , vol.13 , pp. 549-562
    • Killeen, P.R.1
  • 88
    • 0030517592 scopus 로고    scopus 로고
    • Practical significance: A concept whose time has come
    • Kirk R. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746–759.
    • (1996) Educational and Psychological Measurement , vol.56 , pp. 746-759
    • Kirk, R.1
  • 90
    • 21144481580 scopus 로고
    • Statistical power analysis of rehabilitation counseling research
    • Kosciulek J. F. Szymanski E. M. (1993). Statistical power analysis of rehabilitation counseling research. Rehabilitation Counseling Bulletin, 36, 212–219.
    • (1993) Rehabilitation Counseling Bulletin , vol.36 , pp. 212-219
    • Kosciulek, J.F.1    Szymanski, E.M.2
  • 92
    • 77954029057 scopus 로고    scopus 로고
    • What to believe: Bayesian methods for data analysis
    • Kruschke J. K. (2010). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14, 293–300.
    • (2010) Trends in Cognitive Sciences , vol.14 , pp. 293-300
    • Kruschke, J.K.1
  • 93
    • 34548032852 scopus 로고    scopus 로고
    • Statistical power calculations
    • Lenth R. V. (2007). Statistical power calculations. Journal of Animal Science, 85, E24–E29.
    • (2007) Journal of Animal Science , vol.85 , pp. E24-E29
    • Lenth, R.V.1
  • 94
    • 70349286316 scopus 로고    scopus 로고
    • Sample sizes and effect sizes are negatively correlated in meta-analyses: Evidence and implications of a publication bias against nonsignificant findings
    • Levine T. R. Asada K. J. Carpenter C. (2009). Sample sizes and effect sizes are negatively correlated in meta-analyses: Evidence and implications of a publication bias against nonsignificant findings. Communication Monographs, 76, 286–302.
    • (2009) Communication Monographs , vol.76 , pp. 286-302
    • Levine, T.R.1    Asada, K.J.2    Carpenter, C.3
  • 95
    • 41149155256 scopus 로고    scopus 로고
    • A critical assessment of null hypothesis significance testing in quantitative communication research
    • Levine T. R. Weber R. Hullett C. Park H. S. Lindsey L. L. M. (2008). A critical assessment of null hypothesis significance testing in quantitative communication research. Human Communication Research, 34, 171–187.
    • (2008) Human Communication Research , vol.34 , pp. 171-187
    • Levine, T.R.1    Weber, R.2    Hullett, C.3    Park, H.S.4    Lindsey, L.L.M.5
  • 96
    • 0000876735 scopus 로고
    • Publication prejudices: An experimental study of confirmatory bias in the peer review system
    • Mahoney M. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1, 161–175.
    • (1977) Cognitive Therapy and Research , vol.1 , pp. 161-175
    • Mahoney, M.J.1
  • 98
    • 2542567331 scopus 로고    scopus 로고
    • The persistence of underpowered studies in psychological research: Causes, consequences and remedies
    • Maxwell S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences and remedies. Psychological Methods, 9, 147–163.
    • (2004) Psychological Methods , vol.9 , pp. 147-163
    • Maxwell, S.E.1
  • 99
    • 41549115181 scopus 로고    scopus 로고
    • Sample size planning for statistical power and accuracy in parameter estimation
    • Maxwell S. E. Kelley K. Rausch J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537–563.
    • (2008) Annual Review of Psychology , vol.59 , pp. 537-563
    • Maxwell, S.E.1    Kelley, K.2    Rausch, J.R.3
  • 100
    • 0016838298 scopus 로고
    • The composition and function of ethical committees
    • May W. W. (1975). The composition and function of ethical committees. Journal of Medical Ethics, 1, 23–29.
    • (1975) Journal of Medical Ethics , vol.1 , pp. 23-29
    • May, W.W.1
  • 103
    • 0017816556 scopus 로고
    • Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology
    • Meehl P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834.
    • (1978) Journal of Consulting and Clinical Psychology , vol.46 , pp. 806-834
    • Meehl, P.E.1
  • 104
    • 0030099604 scopus 로고    scopus 로고
    • The perceptions and usage of statistical power in applied psychology and management research
    • Mone M. A. Mueller G. C. Mauland W. (1996). The perceptions and usage of statistical power in applied psychology and management research. Personnel Psychology, 49, 103–120.
    • (1996) Personnel Psychology , vol.49 , pp. 103-120
    • Mone, M.A.1    Mueller, G.C.2    Mauland, W.3
  • 107
    • 0034203345 scopus 로고    scopus 로고
    • Null hypothesis significance testing: A review of an old and continuing controversy
    • Nickerson R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241–301.
    • (2000) Psychological Methods , vol.5 , pp. 241-301
    • Nickerson, R.S.1
  • 109
    • 38849105611 scopus 로고    scopus 로고
    • Sweating the small stuff in educational psychology: How effect size and power reporting failed to change from 1969 to 1999, and what that means for the future of changing practices
    • Osborne J. W. (2008). Sweating the small stuff in educational psychology: How effect size and power reporting failed to change from 1969 to 1999, and what that means for the future of changing practices. Educational Psychology, 28, 151–160.
    • (2008) Educational Psychology , vol.28 , pp. 151-160
    • Osborne, J.W.1
  • 110
    • 0037915256 scopus 로고
    • Classical statistical hypothesis testing within the context of Bayesian theory
    • Overall J. E. (1969). Classical statistical hypothesis testing within the context of Bayesian theory. Psychological Bulletin, 71, 285–292.
    • (1969) Psychological Bulletin , vol.71 , pp. 285-292
    • Overall, J.E.1
  • 111
    • 4944264101 scopus 로고    scopus 로고
    • Two steps forward, one step back: Effect size reporting in gifted education research from 1995–2000
    • Paul K. M. Plucker J. A. (2004). Two steps forward, one step back: Effect size reporting in gifted education research from 1995–2000. Roeper Review, 26, 68–72.
    • (2004) Roeper Review , vol.26 , pp. 68-72
    • Paul, K.M.1    Plucker, J.A.2
  • 112
    • 85007782075 scopus 로고    scopus 로고
    • Debunking the myth of the “highly significant” result: Effect sizes in gifted education research
    • Plucker J. A. (1997). Debunking the myth of the “highly significant” result: Effect sizes in gifted education research. Roeper Review, 20, 122–126.
    • (1997) Roeper Review , vol.20 , pp. 122-126
    • Plucker, J.A.1
  • 113
    • 79957645252 scopus 로고    scopus 로고
    • Eta squared and partial eta squared as measures of effect size in educational research
    • Richardson J. T. E. (2011). Eta squared and partial eta squared as measures of effect size in educational research. Educational Research Review, 6, 135–147.
    • (2011) Educational Research Review , vol.6 , pp. 135-147
    • Richardson, J.T.E.1
  • 114
    • 67649562332 scopus 로고    scopus 로고
    • Effect sizes: Why, when, and how to use them
    • Rosnow R. L. Rosenthal R. (2009). Effect sizes: Why, when, and how to use them. Journal of Psychology, 217, 6–14.
    • (2009) Journal of Psychology , vol.217 , pp. 6-14
    • Rosnow, R.L.1    Rosenthal, R.2
  • 115
    • 0025007388 scopus 로고
    • Statistical power of psychological research: What have we gained in 20 years?
    • Rossi J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646–656.
    • (1990) Journal of Consulting and Clinical Psychology , vol.58 , pp. 646-656
    • Rossi, J.S.1
  • 116
    • 0000724985 scopus 로고    scopus 로고
    • Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers
    • Schmidt F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115–129.
    • (1996) Psychological Methods , vol.1 , pp. 115-129
    • Schmidt, F.L.1
  • 117
    • 0001994477 scopus 로고    scopus 로고
    • Eight common but false objections to the discontinuation of significance testing in the analysis of research data
    • In, Harlow, L. L., Mulaik, S. A., Steiger, J. H., (Eds.), Mahwah, NJ: Erlbaum
    • Schmidt F. L. Hunter J. E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In Harlow L. L. Mulaik S. A. Steiger J. H. (Eds.), What if there were no significance tests? (pp. 37–64). Mahwah, NJ: Erlbaum.
    • (1997) What if there were no significance tests? , pp. 37-64
    • Schmidt, F.L.1    Hunter, J.E.2
  • 118
    • 0000324575 scopus 로고
    • Do studies of statistical power have an effect on the power of studies?
    • Sedlmeier P. Gigerenzer G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 107, 309–316.
    • (1989) Psychological Bulletin , vol.107 , pp. 309-316
    • Sedlmeier, P.1    Gigerenzer, G.2
  • 119
    • 0007376064 scopus 로고
    • Data-dredging procedures in survey research
    • Selvin H. C. Stuart A. (1966). Data-dredging procedures in survey research. American Statistician, 20, 20–23.
    • (1966) American Statistician , vol.20 , pp. 20-23
    • Selvin, H.C.1    Stuart, A.2
  • 120
    • 0002143262 scopus 로고
    • Rationality in psychological research: The good-enough principle
    • Serlin R. C. Lapsley D. K. (1985). Rationality in psychological research: The good-enough principle. American Psychologist, 40, 73–83.
    • (1985) American Psychologist , vol.40 , pp. 73-83
    • Serlin, R.C.1    Lapsley, D.K.2
  • 121
    • 0001432010 scopus 로고
    • Rational appraisal of psychological research and the good-enough principle
    • In, Keren, G., Lewis, C., (Eds.), Hillsdale, NJ: Erlbaum.,: Vol. 1. Methodological issues
    • Serlin R. C. Lapsley D. K. (1993). Rational appraisal of psychological research and the good-enough principle. In Keren G. Lewis C. (Eds.), A handbook of data analysis in behavioural sciences: Vol. 1. Methodological issues (pp. 199–228). Hillsdale, NJ: Erlbaum.
    • (1993) A handbook of data analysis in behavioural sciences , pp. 199-228
    • Serlin, R.C.1    Lapsley, D.K.2
  • 122
    • 70349485386 scopus 로고    scopus 로고
    • The use of meta-analysis in psychology: A superior vintage or the casting of old wine in new bottles?
    • Shercliffe R. J. Stahl W. Tuttle M. P. (2009). The use of meta-analysis in psychology: A superior vintage or the casting of old wine in new bottles? Theory & Psychology, 19, 413–430.
    • (2009) Theory & Psychology , vol.19 , pp. 413-430
    • Shercliffe, R.J.1    Stahl, W.2    Tuttle, M.P.3
  • 123
    • 79957843427 scopus 로고    scopus 로고
    • Choosing the best correction formula for the Pearson r2 effect size
    • Skidmore S. T. Thompson B. (2011). Choosing the best correction formula for the Pearson r 2 effect size. Journal of Experimental Education, 79, 257–278.
    • (2011) Journal of Experimental Education , vol.79 , pp. 257-278
    • Skidmore, S.T.1    Thompson, B.2
  • 124
    • 18244378268 scopus 로고    scopus 로고
    • Use of tests of statistical significance and other analytic choices in a school psychology journal: Review of practices and suggested alternatives
    • Snyder P. A. Thompson B. (1998). Use of tests of statistical significance and other analytic choices in a school psychology journal: Review of practices and suggested alternatives. School Psychology Quarterly, 13, 335–348.
    • (1998) School Psychology Quarterly , vol.13 , pp. 335-348
    • Snyder, P.A.1    Thompson, B.2
  • 125
    • 0002935408 scopus 로고
    • Publication bias and their possible effects on inference drawn from tests of significance–or vice versa
    • Sterling T. D. (1959). Publication bias and their possible effects on inference drawn from tests of significance–or vice versa. Journal of the American Statistical Association, 54, 30–34.
    • (1959) Journal of the American Statistical Association , vol.54 , pp. 30-34
    • Sterling, T.D.1
  • 126
    • 21844523713 scopus 로고
    • Publication bias revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa
    • Sterling T. D. Rosenbaum W. L. Weinkam J. J. (1995). Publication bias revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49, 108–112.
    • (1995) The American Statistician , vol.49 , pp. 108-112
    • Sterling, T.D.1    Rosenbaum, W.L.2    Weinkam, J.J.3
  • 127
    • 0030923529 scopus 로고    scopus 로고
    • Publication bias: Evidence of delayed publication in a cohort study of clinical research projects
    • Stern J. M. Simes R. J. (1997). Publication bias: Evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal, 315, 640–645.
    • (1997) British Medical Journal , vol.315 , pp. 640-645
    • Stern, J.M.1    Simes, R.J.2
  • 129
    • 78649692113 scopus 로고    scopus 로고
    • A comprehensive review of effect size reporting and interpreting practices in academic journals in education and psychology
    • Sun S. Pan W. Wang L. L. (2010). A comprehensive review of effect size reporting and interpreting practices in academic journals in education and psychology. Journal of Educational Psychology, 102, 989–1004.
    • (2010) Journal of Educational Psychology , vol.102 , pp. 989-1004
    • Sun, S.1    Pan, W.2    Wang, L.L.3
  • 130
    • 21344491489 scopus 로고
    • The use of statistical significance tests in research: Bootstrap and other alternatives
    • Thompson B. (1993). The use of statistical significance tests in research: Bootstrap and other alternatives. Journal of Experimental Education, 61, 361–377.
    • (1993) Journal of Experimental Education , vol.61 , pp. 361-377
    • Thompson, B.1
  • 131
    • 79957902492 scopus 로고    scopus 로고
    • AERA editorial policies regarding statistical significance testing: Three suggested reforms
    • Thompson B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25, 26–30.
    • (1996) Educational Researcher , vol.25 , pp. 26-30
    • Thompson, B.1
  • 133
    • 0033447390 scopus 로고    scopus 로고
    • If statistical significance tests are broken/misused, what practices should supplement or replace them?
    • Thompson B. (1999a). If statistical significance tests are broken/misused, what practices should supplement or replace them? Theory & Psychology, 10, 167–183.
    • (1999) Theory & Psychology , vol.10 , pp. 167-183
    • Thompson, B.1
  • 134
    • 0001521189 scopus 로고    scopus 로고
    • Improving research clarity and usefulness with effect size indices as supplements to statistical significance tests
    • Thompson B. (1999b). Improving research clarity and usefulness with effect size indices as supplements to statistical significance tests. Exceptional Children, 65, 329–337.
    • (1999) Exceptional Children , vol.65 , pp. 329-337
    • Thompson, B.1
  • 135
    • 0036003730 scopus 로고    scopus 로고
    • Statistical,” “practical,” and “clinical”: How many kinds of significance do counselors need to consider?
    • Thompson B. (2002a). “Statistical,” “practical,” and “clinical”: How many kinds of significance do counselors need to consider? Journal of Counseling and Development, 80, 64–71.
    • (2002) Journal of Counseling and Development , vol.80 , pp. 64-71
    • Thompson, B.1
  • 136
    • 84996149945 scopus 로고    scopus 로고
    • What future quantitative social science research could look like: Confidence intervals for effect sizes
    • Thompson B. (2002b). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 25–32.
    • (2002) Educational Researcher , vol.31 , pp. 25-32
    • Thompson, B.1
  • 137
    • 0031350798 scopus 로고    scopus 로고
    • Statistical significance testing practices in the Journal of Experimental Education
    • Thompson B. Snyder P. A. (1997). Statistical significance testing practices in the Journal of Experimental Education. Journal of Experimental Education, 66, 75–83.
    • (1997) Journal of Experimental Education , vol.66 , pp. 75-83
    • Thompson, B.1    Snyder, P.A.2
  • 138
    • 0032352330 scopus 로고    scopus 로고
    • Statistical significance and reliability analyses in recent Journal of Counseling & Development research articles
    • Thompson B. Snyder P. A. (1998). Statistical significance and reliability analyses in recent Journal of Counseling & Development research articles. Journal of Counseling & Development, 76, 436–441.
    • (1998) Journal of Counseling & Development , vol.76 , pp. 436-441
    • Thompson, B.1    Snyder, P.A.2
  • 139
    • 84972526421 scopus 로고
    • The philosophy of multiple comparisons
    • Tukey J. W. (1991). The philosophy of multiple comparisons. Statistical Science, 6, 100–116.
    • (1991) Statistical Science , vol.6 , pp. 100-116
    • Tukey, J.W.1
  • 140
  • 141
    • 0033248508 scopus 로고    scopus 로고
    • Statistical significance testing as it relates to practice: Use within professional psychology: Research and practice
    • Vacha-Haase T. Ness C. N. (1999). Statistical significance testing as it relates to practice: Use within professional psychology: Research and practice. Professional Psychology: Research and Practice, 30, 104–105.
    • (1999) Professional Psychology: Research and Practice , vol.30 , pp. 104-105
    • Vacha-Haase, T.1    Ness, C.N.2
  • 143
    • 0040291320 scopus 로고    scopus 로고
    • Reporting practices and APA editorial policies regarding statistical significance and effect size
    • Vacha-Haase T. Nilsson J. E. Reetz D. R. Lance T. S. Thompson B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory & Psychology, 10, 413–425.
    • (2000) Theory & Psychology , vol.10 , pp. 413-425
    • Vacha-Haase, T.1    Nilsson, J.E.2    Reetz, D.R.3    Lance, T.S.4    Thompson, B.5
  • 145
    • 37349085481 scopus 로고    scopus 로고
    • A practical solution to the pervasive problems of p values
    • Wagenmakers E. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.
    • (2007) Psychonomic Bulletin & Review , vol.14 , pp. 779-804
    • Wagenmakers, E.J.1
  • 146
    • 33846693850 scopus 로고    scopus 로고
    • Is the Pearson r2 biased, and if so, what is the best correction formula?
    • Wang Z. Thompson B. (2007). Is the Pearson r 2 biased, and if so, what is the best correction formula? Journal of Experimental Education, 75, 109–125.
    • (2007) Journal of Experimental Education , vol.75 , pp. 109-125
    • Wang, Z.1    Thompson, B.2
  • 147
    • 0001653457 scopus 로고    scopus 로고
    • Statistical methods in psychology journals: Guidelines and explanation
    • Wilkinson L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanation. American Psychologist, 54, 594–604.
    • (1999) American Psychologist , vol.54 , pp. 594-604
    • Wilkinson, L.1
  • 149
    • 30344450785 scopus 로고    scopus 로고
    • Statistical power of studies examining the cognitive effects of subthalamic nucleus deep brain stimulation in Parkinson's disease
    • Woods S. P. Rippeth J. D. Conover E. Carey C. L. Parsons T. D. Troster A. I. (2006). Statistical power of studies examining the cognitive effects of subthalamic nucleus deep brain stimulation in Parkinson's disease. Clinical Neuropsychologist, 20, 27–38.
    • (2006) Clinical Neuropsychologist , vol.20 , pp. 27-38
    • Woods, S.P.1    Rippeth, J.D.2    Conover, E.3    Carey, C.L.4    Parsons, T.D.5    Troster, A.I.6


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.