메뉴 건너뛰기




Volumn 19, Issue 3, 2014, Pages 409-427

Outlier removal, sum scores, and the inflation of the type i error rate in independent samples t tests: The power of alternatives and recommendations

Author keywords

Nonparametric tests; Outliers; Power; Robust statistics; Type I error

Indexed keywords

COMPUTER SIMULATION; HUMAN; NONPARAMETRIC TEST; STATISTICAL MODEL; STATISTICS;

EID: 84925803887     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/met0000014     Document Type: Article
Times cited : (121)

References (73)
  • 5
    • 80052861742 scopus 로고    scopus 로고
    • The (mis)reporting of statistical results in psychology journals
    • Bakker, M., & Wicherts, J. M. (2011). The (mis)reporting of statistical results in psychology journals. Behavior Research Methods, 43, 666-678. doi:10.3758/s13428-011-0089-5
    • (2011) Behavior Research Methods , vol.43 , pp. 666-678
    • Bakker, M.1    Wicherts, J.M.2
  • 8
    • 84928505666 scopus 로고
    • You can't classify all of the people all of the time
    • Bergman, L. R. (1988). You can't classify all of the people all of the time. Multivariate Behavioral Research, 23, 425-441. doi:10.1207/s15327906mbr2304_1
    • (1988) Multivariate Behavioral Research , vol.23 , pp. 425-441
    • Bergman, L.R.1
  • 9
    • 0034393195 scopus 로고    scopus 로고
    • The nonparametric Behrens-Fisher problem: Asymptotic theory and small-sample approximation
    • Brunner, E., & Munzel, U. (2000). The nonparametric Behrens-Fisher problem: Asymptotic theory and small-sample approximation. Biometrical Journal, 42, 17-25. doi:10.1002/(SICI)1521-4036(200001)42: 1<17::AID-BIMJ17>3.0.CO;2-U
    • (2000) Biometrical Journal , vol.42 , pp. 17-25
    • Brunner, E.1    Munzel, U.2
  • 11
    • 0010013086 scopus 로고
    • The subjective nature of outlier rejection procedures
    • Collett, D., & Lewis, T. (1976). The subjective nature of outlier rejection procedures. Applied Statistics, 25, 228-237.
    • (1976) Applied Statistics , vol.25 , pp. 228-237
    • Collett, D.1    Lewis, T.2
  • 15
    • 34247281165 scopus 로고    scopus 로고
    • On the consistency of individual classification using short scales
    • Emons, W. H. M., Sijtsma, K., & Meijer, R. R. (2007). On the consistency of individual classification using short scales. Psychological Methods, 12, 105-120. doi:10.1037/1082-989X.12.1.105
    • (2007) Psychological Methods , vol.12 , pp. 105-120
    • Emons, W.H.M.1    Sijtsma, K.2    Meijer, R.R.3
  • 16
    • 55349126094 scopus 로고    scopus 로고
    • Modern robust statistical methods: An easy way to maximize the accuracy and power of your research
    • Erceg-Hurn, D. M., & Mirosevich, V. M. (2008). Modern robust statistical methods: An easy way to maximize the accuracy and power of your research. American Psychologist, 63, 591-601. doi:10.1037/0003-066X.63.7.591
    • (2008) American Psychologist , vol.63 , pp. 591-601
    • Erceg-Hurn, D.M.1    Mirosevich, V.M.2
  • 17
    • 84869028702 scopus 로고    scopus 로고
    • A vast graveyard of undead theories: Publication bias and psychological science's aversion to the null
    • Ferguson, C. J., & Heene, M. (2012). A vast graveyard of undead theories: Publication bias and psychological science's aversion to the null. Perspectives on Psychological Science, 7, 555-561. doi:10.1177/1745691612459059
    • (2012) Perspectives on Psychological Science , vol.7 , pp. 555-561
    • Ferguson, C.J.1    Heene, M.2
  • 21
    • 0034089015 scopus 로고    scopus 로고
    • Heterogeneity of variance in clinical data
    • Grissom, R. J. (2000). Heterogeneity of variance in clinical data. Journal of Consulting and Clinical Psychology, 68, 155-165. doi:10.1037/0022-006X.68.1.155
    • (2000) Journal of Consulting and Clinical Psychology , vol.68 , pp. 155-165
    • Grissom, R.J.1
  • 23
    • 84867083761 scopus 로고    scopus 로고
    • Assumptions for well-known statistical techniques: Disturbing explanations for why they are seldom checked
    • Hoekstra, R., Kiers, H. A. L., & Johnson, A. (2012). Assumptions for well-known statistical techniques: Disturbing explanations for why they are seldom checked. Frontiers in Psychology, 3, Article 137. doi: 10.3389/fpsyg.2012.00137
    • (2012) Frontiers in Psychology , vol.3
    • Hoekstra, R.1    Kiers, H.A.L.2    Johnson, A.3
  • 27
    • 33846563409 scopus 로고    scopus 로고
    • Why most published research findings are false
    • Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2, Article e124. doi:10.1371/journal.pmed.0020124
    • (2005) PLoS Medicine , vol.2
    • Ioannidis, J.P.A.1
  • 28
    • 84869055322 scopus 로고    scopus 로고
    • Why science is not necessarily self-correcting
    • Ioannidis, J. P. A. (2012). Why science is not necessarily self-correcting. Perspectives on Psychological Science, 7, 645-654. doi:10.1177/1745691612464056
    • (2012) Perspectives on Psychological Science , vol.7 , pp. 645-654
    • Ioannidis, J.P.A.1
  • 29
    • 84861748584 scopus 로고    scopus 로고
    • Measuring the prevalence of questionable research practices with incentives for truth-telling
    • Advance online publication. Retrieved from
    • John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth-telling. Psychological Science. Advance online publication. Retrieved from http://ssrn.com/abstract=1996631
    • (2012) Psychological Science
    • John, L.K.1    Loewenstein, G.2    Prelec, D.3
  • 34
    • 0033148722 scopus 로고    scopus 로고
    • Power, Type I, and Type III error rates of parametric and nonparametric statistical tests
    • MacDonald, P. (1999). Power, Type I, and Type III error rates of parametric and nonparametric statistical tests. Journal of Experimental Education, 67, 367-379. doi:10.1080/00220979909598489
    • (1999) Journal of Experimental Education , vol.67 , pp. 367-379
    • MacDonald, P.1
  • 35
    • 0002322469 scopus 로고
    • On a test of whether one of two random variables is stochastically larger than the other
    • Mann, H. B., & Whitney, D. R. (1947). On a test of whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18, 50-60. doi:10.1214/aoms/1177730491
    • (1947) Annals of Mathematical Statistics , vol.18 , pp. 50-60
    • Mann, H.B.1    Whitney, D.R.2
  • 36
    • 58149368765 scopus 로고
    • The unicorn, the normal curve, and other improbable creatures
    • Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166. doi:10.1037/0033-2909.105.1.156
    • (1989) Psychological Bulletin , vol.105 , pp. 156-166
    • Micceri, T.1
  • 37
    • 0026249647 scopus 로고
    • Short report: Reaction time analysis with outlier exclusion: Bias varies with sample size
    • Miller, J. (1991). Short report: Reaction time analysis with outlier exclusion: Bias varies with sample size. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 43(A), 907-912. doi: 10.1080/14640749108400962
    • (1991) Quarterly Journal of Experimental Psychology: Human Experimental Psychology , vol.43 A , pp. 907-912
    • Miller, J.1
  • 41
    • 33144474928 scopus 로고    scopus 로고
    • The power of outliers (and why researchers should always check for them)
    • Retrieved from
    • Osborne, J. W., & Overbay, A. (2004). The power of outliers (and why researchers should always check for them). Practical Assessment, Research & Evaluation, 9, Article 6. Retrieved from http://PAREonline.net/getvn.asp?v=9&n=6
    • (2004) Practical Assessment, Research & Evaluation , vol.9
    • Osborne, J.W.1    Overbay, A.2
  • 42
    • 84869036789 scopus 로고    scopus 로고
    • Is the replicability crisis overblown?. Three arguments examined
    • Pashler, H., & Harris, C. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531-536. doi:10.1177/1745691612463401
    • (2012) Perspectives on Psychological Science , vol.7 , pp. 531-536
    • Pashler, H.1    Harris, C.R.2
  • 44
    • 33746341926 scopus 로고
    • The "file drawer problem" and tolerance for null results
    • Rosenthal, R. (1979). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638-641. doi:10.1037/0033-2909.86.3.638
    • (1979) Psychological Bulletin , vol.86 , pp. 638-641
    • Rosenthal, R.1
  • 45
    • 84859052902 scopus 로고    scopus 로고
    • Variance heterogeneity in published psychological research: A review and a new index
    • Ruscio, J., & Roche, B. (2012). Variance heterogeneity in published psychological research: A review and a new index. Methodology, 8, 1-11. doi:10.1027/1614-2241/a000034
    • (2012) Methodology , vol.8 , pp. 1-11
    • Ruscio, J.1    Roche, B.2
  • 46
    • 0002273972 scopus 로고    scopus 로고
    • The graded response model.
    • W. J. van der Linden & R. K. Hambleton (Eds.)
    • Samejima, F. (1997). The graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85-100). doi:10.1007/978-1-4757-2691-6_5
    • (1997) Handbook of modern item response theory , pp. 85-100
    • Samejima, F.1
  • 47
    • 84872636119 scopus 로고
    • An approximate distribution of estimates of variance components
    • Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110-114. doi:10.2307/3002019
    • (1946) Biometrics Bulletin , vol.2 , pp. 110-114
    • Satterthwaite, F.E.1
  • 48
    • 11944273917 scopus 로고
    • A more realistic look at the robustness and Type II error properties of the t test to departures from population normality
    • Sawilowsky, S. S., & Blair, R. C. (1992). A more realistic look at the robustness and Type II error properties of the t test to departures from population normality. Psychological Bulletin, 111, 352-360. doi: 10.1037/0033-2909.111.2.352
    • (1992) Psychological Bulletin , vol.111 , pp. 352-360
    • Sawilowsky, S.S.1    Blair, R.C.2
  • 49
    • 84924962924 scopus 로고
    • Maximum Z scores and outliers
    • Shiffler, R. E. (1988). Maximum Z scores and outliers. American Statistician, 42, 79-80. doi:10.2307/2685269
    • (1988) American Statistician , vol.42 , pp. 79-80
    • Shiffler, R.E.1
  • 50
    • 80555145867 scopus 로고    scopus 로고
    • False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant
    • Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359-1366. doi:10.1177/0956797611417632
    • (2011) Psychological Science , vol.22 , pp. 1359-1366
    • Simmons, J.P.1    Nelson, L.D.2    Simonsohn, U.3
  • 54
    • 55149097618 scopus 로고    scopus 로고
    • New York, NY: Random House
    • Taleb, N. N. (2007). The black swan. New York, NY: Random House.
    • (2007) The black swan
    • Taleb, N.N.1
  • 58
    • 0000576729 scopus 로고
    • The significance of the difference between two means when the population variances are unequal
    • Welch, B. L. (1938). The significance of the difference between two means when the population variances are unequal. Biometrika, 29, 350-362.
    • (1938) Biometrika , vol.29 , pp. 350-362
    • Welch, B.L.1
  • 59
    • 84870267223 scopus 로고
    • The generalization of "Student's" problem when several different population variances are involved
    • Welch, B. L. (1947). The generalization of "Student's" problem when several different population variances are involved. Biometrika, 34, 28-35.
    • (1947) Biometrika , vol.34 , pp. 28-35
    • Welch, B.L.1
  • 61
    • 80355136445 scopus 로고    scopus 로고
    • Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results
    • Wicherts, J. M., Bakker, M., & Molenaar, D. (2011). Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS ONE, 6, Article e26828. doi: 10.1371/journal.pone.0026828
    • (2011) PLoS ONE , vol.6
    • Wicherts, J.M.1    Bakker, M.2    Molenaar, D.3
  • 63
    • 33748495104 scopus 로고    scopus 로고
    • Modelpassing van de verkorte profile of mood states en meetinvariantie over mannen en vrouwen [Model fit of the shortened Profile of Mood States and measurement invariance across men and women]
    • Wicherts, J. M., & Vorst, H. C. M. (2004). Modelpassing van de verkorte profile of mood states en meetinvariantie over mannen en vrouwen [Model fit of the shortened Profile of Mood States and measurement invariance across men and women]. Nederlands Tijdschrift voor de Psychologie, 59, 12-21. doi:10.1007/BF03062320
    • (2004) Nederlands Tijdschrift voor de Psychologie , vol.59 , pp. 12-21
    • Wicherts, J.M.1    Vorst, H.C.M.2
  • 65
    • 0000844447 scopus 로고    scopus 로고
    • How many discoveries have been lost by ignoring modern statistical methods
    • Wilcox, R. R. (1998). How many discoveries have been lost by ignoring modern statistical methods. American Psychologist, 53, 300-314. doi: 10.1037/0003-066X.53.3.300
    • (1998) American Psychologist , vol.53 , pp. 300-314
    • Wilcox, R.R.1
  • 67
    • 0001884644 scopus 로고
    • Individual comparisons by ranking methods
    • Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bulletin, 1, 80-83. doi:10.2307/3001968
    • (1945) Biometrics Bulletin , vol.1 , pp. 80-83
    • Wilcoxon, F.1
  • 69
    • 0015968862 scopus 로고
    • The two-sample trimmed t for unequal population variances
    • Yuen, K. K. (1974). The two-sample trimmed t for unequal population variances. Biometrika, 61, 165-170. doi:10.1093/biomet/61.1.165
    • (1974) Biometrika , vol.61 , pp. 165-170
    • Yuen, K.K.1
  • 71
    • 0009308007 scopus 로고
    • A note on the influence of outliers on parametric and nonparametric tests
    • Zimmerman, D. W. (1994). A note on the influence of outliers on parametric and nonparametric tests. Journal of General Psychology, 121, 391-401. doi:10.1080/00221309.1994.9921213
    • (1994) Journal of General Psychology , vol.121 , pp. 391-401
    • Zimmerman, D.W.1
  • 72
    • 0032332579 scopus 로고    scopus 로고
    • Invalidation of parametric and nonparametric statistical tests by concurrent violation of two assumptions
    • Zimmerman, D. W. (1998). Invalidation of parametric and nonparametric statistical tests by concurrent violation of two assumptions. Journal of Experimental Education, 67, 55-68. doi:10.1080/00220979809598344
    • (1998) Journal of Experimental Education , vol.67 , pp. 55-68
    • Zimmerman, D.W.1
  • 73
    • 0000524051 scopus 로고
    • Parametric alternatives to the Student t test under violation of normality and homogeneity of variance
    • Zimmerman, D. W., & Zumbo, B. D. (1992). Parametric alternatives to the Student t test under violation of normality and homogeneity of variance. Perceptual and Motor Skills, 74, 835-844. doi:10.2466/pms.1992.74.3.835
    • (1992) Perceptual and Motor Skills , vol.74 , pp. 835-844
    • Zimmerman, D.W.1    Zumbo, B.D.2


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.