Reducing Bias and Error in the Correlation Coefficient Due to Nonnormality

Educational and Psychological Measurement

Volumn 75, Issue 5, 2015, Pages 785-804

  Bishara, Anthony J ^a   Hittner, James B ^a  

^a Department of Teacher Education and Department of Sociology and Anthropology   (United States)

Author keywords

correlation; nonnormal; normality; Pearson; Spearman; transformation

Indexed keywords

EID: 84940923490     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164414557639     Document Type: Article

References (55)

1. S.ArndtC.TurveyN.C.Andreasen (1999). Correlating and predicting psychiatric symptom ratings: Spearman’s r versus Kendall’s tau correlation. Journal of Psychiatric Research, 33, 97-104.
2. T.BeasleyS.EricksonD.Allison (2009). Rank-based inverse normal transformations are increasingly used, but are they merited?Behavior Genetics, 39, 580-595. doi:10.1007/s10519-009-9281-0
3. W.H.BeasleyL.DeSheaL.E.ToothakerJ.L.MendozaD.E.BardJ.Rodgers (2007). Bootstrapping to test for nonzero population correlation coefficients using univariate sampling. Psychological Methods, 12, 414-433. doi:10.1037/1082-989X.12.4.414
4. W.H.BeasleyJ.L.Rodgers (2009). Resampling methods. In R.E.MillsapA.Maydeu-Olivares (Eds.), The SAGE handbook of quantitative methods in psychology (pp. 362-386). London, England: SAGE.
5. G.L.Berry (1981). The Weibull distribution as a human performance descriptor. IEEE Transactions on Systems, Man, & Cybernetics, 11, 501-504. doi:10.1109/TSMC.1981.4308727
6. A.J.BisharaJ.B.Hittner (2012). Testing the significance of a correlation with non-normal data: Comparison of Pearson, Spearman, transformation, and resampling approaches. Psychological Methods, 17, 399-417. doi:10.1037/a0028087
7. R.BlairS.Lawson (1982). Another look at the robustness of the product-moment correlation coefficient to population non-normality. Florida Journal of Educational Research, 24, 11-15.
8. M.J.BlancaJ.ArnauD.López-MontielR.BonoR.Bendayan (2013). Skewness and kurtosis in real data samples. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 9(2), 78-84.
9. C.I.Bliss (1967). Statistics in biology. New York, NY: McGraw-Hill.
10. G.Blom (1958). Statistical estimates and transformed beta-variables. New York, NY: John Wiley.
11. D.D.Boos (2003). Introduction to the bootstrap world. Statistical Science, 18, 168-174.
12. G.E.P.BoxD.R.Cox (1964). An analysis of transformations. Journal of the Royal Statistical Society. Series B (Methodological), 26, 211-252.
13. D.S.Calkins (1974). Some effects of non-normal distribution shape on the magnitude of the Pearson product moment correlation coefficient. Interamerican Journal of Psychology, 8, 261-288.
14. W.Chan (2009). Bootstrap standard error and confidence intervals for the difference between two squared multiple correlation coefficients. Educational and Psychological Measurement, 69, 566-584. doi:10.1177/0013164408324466
15. J.CohenP.CohenS.WestL.Aiken (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum.
16. M.R.DoughertyR.P.ThomasR.BrownJ.S.ChrabaszczJ.W.Tidwell (2015). An introduction to the general monotone model with application to two problematic datasets. Sociological Methodology. Advance online publication. doi:10.1177/0081175014562589
17. W.DunlapM.BurkeT.Greer (1995). The effect of skew on the magnitude of product-moment correlations. Journal of General Psychology, 122, 365-377.
18. S.EdgellS.Noon (1984). Effect of violation of normality on the t test of the correlation coefficient. Psychological Bulletin, 95, 576-583.
19. B.Efron (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1-26.
20. B.Efron (1988). Bootstrap confidence intervals: Good or bad?Psychological Bulletin, 104, 293-296.
21. B.EfronR.J.Tibshirani (1993). An introduction to the bootstrap. New York, NY: Chapman & Hall.
22. A.Field (2000). Discovering statistics using SPSS for Windows. Thousand Oaks, CA: SAGE.
23. J.J.Filliben (1975). The probability plot correlation coefficient test for normality. Technometrics, 17, 111-117.
24. R.A.Fisher (1915). Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika, 10, 507-521.
25. R.A.FisherF.Yates (1938). Statistical tables for biological, agricultural and medical research. Oxford England: Oliver & Boyd.
26. R.Fowler (1987). Power and robustness in product-moment correlation. Applied Psychological Measurement, 11, 419-428.
27. L.GayG.MillsP.Airasian (2009). Educational research: Competencies for analysis and applications (9th ed.). Upper Saddle River, NJ: Merrill/Pearson.
28. P.Good (2009). Robustness of Pearson correlation. Interstat, 15(5), 1-6.
29. 0: ρ = 0. Psychological Methods, 1, 184-198.
30. M.KendallJ.D.Gibbons (1990). Rank correlation methods (5th ed.). New York, NY: Oxford University Press.
31. C.A.J.KlaassenJ.A.Wellner (1997). Efficient estimation in the bivariate normal copula model: Normal margins are least favourable. Bernoulli, 3, 55-77.
32. H.O.Lancaster (1957). Some properties of the bivariate normal distribution considered in the form of a contingency table. Biometrika, 44, 289-292. doi:10.1093/biomet/44.1-2.289.
33. W.LeeJ.L.Rodgers (1998). Bootstrapping correlation coefficients using univariate and bivariate sampling. Psychological Methods, 3(1), 91-103.
34. G.D.Logan (1992). Shapes of reaction-time distributions and shapes of learning curves: A test of the instance theory of automaticity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 883-914. doi:10.1037/0278-7393.18.5.883
35. T.Micceri (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156-166. doi:10.1037/0033-2909.105.1.156.
36. J.C.NunnallyI.H.Bernstein (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
37. I.OlkinJ.W.Pratt (1958). Unbiased estimation of certain correlation coefficients. Annals of Mathematical Statistics, 29, 201-211.
38. J.Osborne (2010). Improving your data transformations: Applying the Box-Cox transformation. Practical Assessment, Research, & Evaluation, 15(12), 1-9.
39. M.A.PadillaA.Veprinsky (2012). Correlation attenuation due to measurement error: A new approach using the bootstrap procedure. Educational and Psychological Measurement, 72, 827-846. doi:10.1177/0013164412443963
40. M.A.PadillaA.Veprinsky (2014). Bootstrapped deattenuated correlation: Nonnormal distributions. Educational and Psychological Measurement, 74, 823-830. doi:10.1177/0013164414531780
41. M.PuthM.NeuhäuserG.D.Ruxton (2014). Effective use of Pearson’s product-moment correlation coefficient. Animal Behaviour, 93, 183-189.
42. R Core Team. (2014). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
43. J.Rasmussen (1987). Estimating correlation coefficients: Bootstrap and parametric approaches. Psychological Bulletin, 101, 136-139. doi:10.1037/0033-2909.101.1.136
44. B.RosnerR.J.Glynn (2007). Interval estimation for rank correlation coefficients based on the probit transformation with extension to measurement error correction of correlated ranked data. Statistics in Medicine, 26, 633-646.
45. J.RuscioW.Kaczetow (2008). Simulating multivariate nonnormal data using an iterative algorithm. Multivariate Behavioral Research, 43, 335-381.
46. G.Shieh (2010). Estimation of the simple correlation coefficient. Behavior Research Methods, 42, 906-917.
47. S.R.SolomonS.S.Sawilowsky (2009). Impact of rank-based normalizing transformations on the accuracy of test scores. Journal of Modern Applied Statistical Methods, 8, 448-462.
48. M.Triola (2010). Elementary statistics (11th ed.). Boston, MA: Addison-Wesley/Pearson Education.
49. J.W.Tukey (1962). The future of data analysis. Annals of Mathematical Statistics, 33, 1-67. doi:10.1214/aoms/1177704711.
50. B.L.Van der Waerden (1952). Order tests for the two-sample problem and their power. Indagationes Mathematicae, 14, 453-458.
51. T.Van Zandt (2000). How to fit a response time distribution. Psychonomic Bulletin and Review, 7, 424-465.
52. C.M.Woods (2007). Confidence intervals for gamma-family measures of ordinal association. Psychological Methods, 12, 185-204.
53. D.ZimmermanB.Zumbo (1993). Significance testing of correlation using scores, ranks, and modified ranks. Educational and Psychological Measurement, 53, 897-904.
54. D.ZimmermanB.ZumboR.Williams (2003). Bias in estimation and hypothesis testing of correlation. Psicológica, 24(1), 133-158.
55. K.H.ZouW.J.Hall (2002). On estimating a transformation correlation coefficient. Journal of Applied Statistics, 29, 745-760. doi:10.1080/02664760120098801