메뉴 건너뛰기




Volumn 21, Issue 3, 2017, Pages 269-275

Do p values lose their meaning in exploratory analyses? It depends how you define the familywise error rate

Author keywords

Confirmatory research; Exploratory research; Familywise error rate; P values; Type I errors

Indexed keywords


EID: 85029437999     PISSN: 10892680     EISSN: 19391552     Source Type: Journal    
DOI: 10.1037/gpr0000123     Document Type: Article
Times cited : (156)

References (36)
  • 1
    • 85021855749 scopus 로고    scopus 로고
    • The earth is flat (p > 0.05): Significance thresholds and the crisis of unreplicable research
    • Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017). The earth is flat (p > 0.05): Significance thresholds and the crisis of unreplicable research. PeerJ, 5, e3544. http://dx.doi.org/10.7717/peerj.3544
    • (2017) PeerJ , vol.5
    • Amrhein, V.1    Korner-Nievergelt, F.2    Roth, T.3
  • 2
    • 85027920365 scopus 로고    scopus 로고
    • When to use the Bonferroni correction
    • Armstrong, R. A. (2014). When to use the Bonferroni correction. Ophthalmic & Physiological Optics, 34, 502-508. http://dx.doi.org/10.1111/opo .12131
    • (2014) Ophthalmic & Physiological Optics , vol.34 , pp. 502-508
    • Armstrong, R.A.1
  • 3
    • 0035049158 scopus 로고    scopus 로고
    • Adjusting for multiple testing-When and how?
    • Bender, R., & Lange, S. (2001). Adjusting for multiple testing-When and how? Journal of Clinical Epidemiology, 54, 343-349. http://dx.doi.org/ 10.1016/S0895-4356(00)00314-0
    • (2001) Journal of Clinical Epidemiology , vol.54 , pp. 343-349
    • Bender, R.1    Lange, S.2
  • 4
    • 84993968518 scopus 로고    scopus 로고
    • Significance testing needs a taxonomy: Or how the Fisher, Neyman-Pearson controversy resulted in the inferential tail wagging the measurement dog
    • Bradley, M. T., & Brand, A. (2016). Significance testing needs a taxonomy: Or how the Fisher, Neyman-Pearson controversy resulted in the inferential tail wagging the measurement dog. Psychological Reports, 119, 487-504. http://dx.doi.org/10.1177/0033294116662659
    • (2016) Psychological Reports , vol.119 , pp. 487-504
    • Bradley, M.T.1    Brand, A.2
  • 6
    • 41049113064 scopus 로고    scopus 로고
    • Data splitting as a countermeasure against hypothesis fishing: With a case study of predictors for low back pain
    • Dahl, F. A., Grotle, M., Saltyte Benth, J., & Natvig, B. (2008). Data splitting as a countermeasure against hypothesis fishing: With a case study of predictors for low back pain. European Journal of Epidemiology, 23, 237-242. http://dx.doi.org/10.1007/s10654-008-9230-x
    • (2008) European Journal of Epidemiology , vol.23 , pp. 237-242
    • Dahl, F.A.1    Grotle, M.2    Saltyte Benth, J.3    Natvig, B.4
  • 7
    • 84894636668 scopus 로고    scopus 로고
    • The meaning of "significance" for different types of research [Translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, Han L
    • de Groot, A. D. (2014). The meaning of "significance" for different types of research [Translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, Han L. J. van der Maas]. Acta Psychologica, 148, 188-194. (Original work published 1956) http://dx .doi.org/10.1016/j.actpsy.2014.02.001
    • (2014) J. van der Maas]. Acta Psychologica , vol.148 , pp. 188-194
    • de Groot, A.D.1
  • 8
    • 3342943178 scopus 로고    scopus 로고
    • Do multiple outcome measures require p-value adjustment?
    • Feise, R. J. (2002). Do multiple outcome measures require p-value adjustment? BMC Medical Research Methodology, 2, 8. http://dx.doi.org/10 .1186/1471-2288-2-8
    • (2002) BMC Medical Research Methodology , vol.2 , pp. 8
    • Feise, R.J.1
  • 10
    • 84944472740 scopus 로고    scopus 로고
    • Planned hypothesis tests are not necessarily exempt from multiplicity adjustment
    • Frane, A. V. (2015). Planned hypothesis tests are not necessarily exempt from multiplicity adjustment. Journal of Research Practice, 1, 2.
    • (2015) Journal of Research Practice , vol.1 , pp. 2
    • Frane, A.V.1
  • 11
    • 84907936683 scopus 로고    scopus 로고
    • The statistical crisis in science
    • Gelman, A., & Loken, E. (2014). The statistical crisis in science. American Scientist, 102, 460. http://dx.doi.org/10.1511/2014.111.460
    • (2014) American Scientist , vol.102 , pp. 460
    • Gelman, A.1    Loken, E.2
  • 13
    • 84868588306 scopus 로고    scopus 로고
    • Lopsided reasoning on lopsided tests and multiple comparisons
    • Hurlbert, S. H., & Lombardi, C. M. (2012). Lopsided reasoning on lopsided tests and multiple comparisons. Australian & New Zealand Journal of Statistics, 54, 23-42. http://dx.doi.org/10.1111/j.1467-842X.2012 .00652.x
    • (2012) Australian & New Zealand Journal of Statistics , vol.54 , pp. 23-42
    • Hurlbert, S.H.1    Lombardi, C.M.2
  • 14
    • 85020463768 scopus 로고    scopus 로고
    • Reproducibility in psychological science: When do psychological phenomena exist?
    • Iso-Ahola, S. E. (2017). Reproducibility in psychological science: When do psychological phenomena exist? Frontiers in Psychology, 8, 879. http://dx.doi.org/10.3389/fpsyg.2017.00879
    • (2017) Frontiers in Psychology , vol.8 , pp. 879
    • Iso-Ahola, S.E.1
  • 15
    • 55749112061 scopus 로고    scopus 로고
    • Familywise error in multiple comparisons: Disentangling a knot through a critique of O'Keefe's arguments against alpha adjustment
    • Matsunaga, M. (2007). Familywise error in multiple comparisons: Disentangling a knot through a critique of O'Keefe's arguments against alpha adjustment. Communication Methods and Measures, 1, 243-265. http:// dx.doi.org/10.1080/19312450701641409
    • (2007) Communication Methods and Measures , vol.1 , pp. 243-265
    • Matsunaga, M.1
  • 16
    • 34249734829 scopus 로고    scopus 로고
    • p value fetishism and use of the Bonferroni adjustment
    • Morgan, J. F. (2007). p value fetishism and use of the Bonferroni adjustment. Evidence-Based Mental Health, 10, 34-35. http://dx.doi.org/10 .1136/ebmh.10.2.34
    • (2007) Evidence-Based Mental Health , vol.10 , pp. 34-35
    • Morgan, J.F.1
  • 18
    • 0034203345 scopus 로고    scopus 로고
    • Null hypothesis significance testing: A review of an old and continuing controversy
    • Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241-301. http://dx.doi.org/10.1037/1082-989X.5.2.241
    • (2000) Psychological Methods , vol.5 , pp. 241-301
    • Nickerson, R.S.1
  • 20
    • 84901708710 scopus 로고    scopus 로고
    • Registered reports: A method to increase the credibility of published results
    • Nosek, B. A., & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45, 137-141. http://dx.doi.org/10.1027/1864-9335/a000192
    • (2014) Social Psychology , vol.45 , pp. 137-141
    • Nosek, B.A.1    Lakens, D.2
  • 21
    • 0041823630 scopus 로고    scopus 로고
    • Colloquy: Should familywise alpha be adjusted?
    • O'Keefe, D. J. (2003). Colloquy: Should familywise alpha be adjusted? Human Communication Research, 29, 431-447.
    • (2003) Human Communication Research , vol.29 , pp. 431-447
    • O'Keefe, D.J.1
  • 22
    • 84859877999 scopus 로고    scopus 로고
    • Responses to Matsunaga: It takes a family-a well-defined family-to underwrite familywise corrections
    • O'Keefe, D. J. (2007). Responses to Matsunaga: It takes a family-a well-defined family-to underwrite familywise corrections. Communication Methods and Measures, 1, 267-273. http://dx.doi.org/10.1080/ 19312450701641383
    • (2007) Communication Methods and Measures , vol.1 , pp. 267-273
    • O'Keefe, D.J.1
  • 23
    • 80955161892 scopus 로고    scopus 로고
    • Epistemic risk: Empirical science and the fear of being wrong
    • Parascandola, M. (2010). Epistemic risk: Empirical science and the fear of being wrong. Law, Probability & Risk, 9, 201-214. http://dx.doi.org/10 .1093/lpr/mgq005
    • (2010) Law, Probability & Risk , vol.9 , pp. 201-214
    • Parascandola, M.1
  • 24
    • 0032542897 scopus 로고    scopus 로고
    • What's wrong with Bonferroni adjustments
    • Perneger, T. V. (1998). What's wrong with Bonferroni adjustments. British Medical Journal, 316, 1236-1238. http://dx.doi.org/10.1136/bmj.316 .7139.1236
    • (1998) British Medical Journal , vol.316 , pp. 1236-1238
    • Perneger, T.V.1
  • 25
    • 0025031812 scopus 로고
    • No adjustments are needed for multiple comparisons
    • Rothman, K. J. (1990). No adjustments are needed for multiple comparisons. Epidemiology, 1, 43-46. http://dx.doi.org/10.1097/00001648-199 001000-00010
    • (1990) Epidemiology , vol.1 , pp. 43-46
    • Rothman, K.J.1
  • 26
    • 18144385438 scopus 로고    scopus 로고
    • Multiplicity in randomised trials: I. Endpoints and treatments
    • Schulz, K. F., & Grimes, D. A. (2005). Multiplicity in randomised trials: I. Endpoints and treatments. Lancet, 365, 1591-1595. http://dx.doi.org/10 .1016/S0140-6736(05)66461-6
    • (2005) Lancet , vol.365 , pp. 1591-1595
    • Schulz, K.F.1    Grimes, D.A.2
  • 28
    • 0003107478 scopus 로고
    • Hypothesis testing, theory building, and the philosophy of science
    • Serlin, R. C. (1987). Hypothesis testing, theory building, and the philosophy of science. Journal of Counseling Psychology, 34, 365-371. http:// dx.doi.org/10.1037/0022-0167.34.4.365
    • (1987) Journal of Counseling Psychology , vol.34 , pp. 365-371
    • Serlin, R.C.1
  • 29
    • 80555145867 scopus 로고    scopus 로고
    • False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant
    • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. http://dx.doi.org/10.1177/0956797611417632
    • (2011) Psychological Science , vol.22 , pp. 1359-1366
    • Simmons, J.P.1    Nelson, L.D.2    Simonsohn, U.3
  • 31
    • 84892463327 scopus 로고    scopus 로고
    • The alleged crisis and the illusion of exact replication
    • Stroebe, W., & Strack, F. (2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9, 59-71. http://dx.doi.org/10.1177/1745691613514450
    • (2014) Perspectives on Psychological Science , vol.9 , pp. 59-71
    • Stroebe, W.1    Strack, F.2
  • 33
    • 85012299288 scopus 로고    scopus 로고
    • Null hypothesis significance testing and Type I error: The domain problem
    • Trafimow, D., & Earp, B. D. (2017). Null hypothesis significance testing and Type I error: The domain problem. New Ideas in Psychology, 45, 19-27. http://dx.doi.org/10.1016/j.newideapsych.2017.01.002
    • (2017) New Ideas in Psychology , vol.45 , pp. 19-27
    • Trafimow, D.1    Earp, B.D.2
  • 34
    • 84959064433 scopus 로고    scopus 로고
    • Limitations of significance testing in clinical research: A review of multiple comparison corrections and effect size calculations with correlated measures
    • Vasilopoulos, T., Morey, T. E., Dhatariya, K., & Rice, M. J. (2016). Limitations of significance testing in clinical research: A review of multiple comparison corrections and effect size calculations with correlated measures. Anesthesia and Analgesia, 122, 825-830. http://dx.doi .org/10.1213/ANE.0000000000001107
    • (2016) Anesthesia and Analgesia , vol.122 , pp. 825-830
    • Vasilopoulos, T.1    Morey, T.E.2    Dhatariya, K.3    Rice, M.J.4
  • 35
    • 85029414383 scopus 로고    scopus 로고
    • September 1. [Comment]
    • Wagenmakers, E. J. (2016, September 1). [Comment]. Retrieved from https://www.psychologicalscience.org/observer/why-preregistrationmakes- me-nervous/comment-page-1#
    • (2016)
    • Wagenmakers, E.J.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.