Evaluating correlations in studies of personality and behavior: Beyond the number of significant findings to be expected by chance

Journal of Research in Personality

Volumn 43, Issue 6, 2009, Pages 1053-1063

  Sherman, Ryne A ^a   Funder, David C ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Data analysis; Family wise error rate; Randomization tests; Statistical significance

Indexed keywords

EID: 70350110849     PISSN: 00926566     EISSN: 10957251     Source Type: Journal    
DOI: 10.1016/j.jrp.2009.05.010     Document Type: Article

References (39)

1. Blackman M.C., and Funder D.C. Self-esteem as viewed from the outside: A peer and gender perspective. Journal of Social Behavior and Personality 11 1 (1996) 115-126
2. Block J. On the number of significant findings to be expected by chance. Psychometrika 25 4 (1960) 369-380
3. Block J. The Q-Sort method in personality assessment and psychiatric research (1961), Charles C. Thomas, Springfield, IL
4. Block J. The Q-Sort method in personality assessment and psychiatric research (1978), Consulting Psychologists Press, Palo Alto, CA
5. Block J. The Q-Sort in character appraisal: Encoding subjective impressions of persons quantitatively (2008), American Psychological Association, Washington, DC
6. Brozek J., and Tiede K. Reliable and questionable significance in a series of statistical tests. Psychological Bulletin 49 (1952) 339-341
7. Cohen J. Things I have learned (so far). American Psychologist 45 12 (1990) 1304-1312
8. Cohen J. The earth is round (p < .05). American Psychologist 49 12 (1994) 997-1003
9. Costa P.T., and McCrae R.R. The NEO personality inventory manual (1985), Psychological Assessment Resources, Inc., Odessa, FL
10. Cournot A.A. Exposition de la Théorie des Chances et des Probabilitiés (1843), Hachette, Paris Reprinted 1984 as Vol. I of Cournot's Oeuvres Complètes, ed. B. Bru. Paris: Vrin.
11. Creed A.T., and Funder D.C. Social anxiety: from the inside and outside. Personality and Individual Differences 25 (1998) 19-33
12. Creed A.T., and Funder D.C. The two faces of private self-consciousness: Self-report, peer-report, and behavioral correlates. European Journal of Personality 12 (1998) 411-431
13. Eaton L.G., and Funder D.C. The creation and consequences of the social world: An interactional analysis of extraversion. European Journal of Personality 17 (2003) 375-395
14. Eaton L.G., and Funder D.C. Emotional experience in daily life: Valence, variability, and rate of change. Emotion 1 4 (2001) 413-421
15. Edgington E.S. Statistical inference: The distribution free approach (1969), McGraw-Hill, New York
16. Efron B. Bootstrap confidence intervals: Good or bad?. Psychological Bulletin 104 2 (1988) 293-296
17. Fast L.A., and Funder D.C. Personality as manifest in word use: Correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology 94 2 (2008) 334-346
18. Fast, L. A., Funder, D.C. (in press). Gender differences in the correlates of self-referent word use: Authority, entitlement, and depressive symptoms. Journal of Personality.
19. Fisher R.A. The design of experiments (1935), Oliver & Boyd, Oxford, England
20. Funder D.C. On the accuracy of personality judgment: A realistic approach. Psychological Review 102 (1995) 652-670
21. Funder D.C. Persons, situations and person-situation interactions. In: John O.P., Robins R., and Pervin L. (Eds). Handbook of personality. 3rd ed. (2008), Guilford, New York 568-580
22. Funder D.C. Persons, behaviors, and situations: An agenda for personality psychology in the postwar era. Journal of Research in Personality 43 2 (2009) 120-126
23. Funder, D.C. (in press). Naive and obvious questions. Perspectives on Psychological Science.
24. Funder D.C., Furr R.M., and Colvin C.R. The riverside behavioral Q-sort: A tool for the description of social behavior. Journal of Personality 68 3 (2000) 451-489
25. Funder D.C., Kolar D.C., and Blackman M.C. Agreement among judges of personality: Interpersonal relations, similarity, and acquaintanceship. Journal of Personality and Social Psychology 69 4 (1995) 656-672
26. Furr R.M., and Funder D.C. A multimodal analysis of personal negativity. Journal of Personality and Social Psychology 74 (1998) 1580-1591
27. Furr R.M., and Funder D.C. Situational similarity and behavioral consistency: Subjective, objective, variable-centered and person-centered approaches. Journal of Research in Personality 38 (2004) 421-447
28. Grosberg, J. (2009). Statistics101 (version 1.3.3) [computer software, ].
29. Markey P.M., Funder D.C., and Ozer D.J. Complementarity of interpersonal behaviors in dyadic interactions. Personality and Social Psychology Bulletin 29 (2003) 1082-1090
30. Miller R.G. Simultaneous statistical inference (1966), Wiley, New York
31. R Development Core Team, (2009). R: A language and environment for statistical computing [Computer software]. Vienna, Austria: R Foundation for Statistical Computing.
32. Rasmussen J.L. Bootstrap confidence intervals: Good or bad: comment on efron (1988) and strube (1988) and further evaluation. Psychological Bulletin 104 2 (1988) 297-299
33. Rodgers J.L. The bootstrap, the jackknife, and the randomization test: A sampling taxonomy. Multivariate Behavioral Research 34 4 (1999) 441-456
34. Rosenthal R., and Rubin D.B. Multiple contrasts and ordered Bonferroni procedures. Journal of Educational Psychology 76 (1984) 1028-1034
35. Sakoda J.M., Cohen B.H., and Beall G. Test of significance for a series of statistical tests. Psychological Bulletin 51 (1954) 172-175
36. Schimmack U., Oishi S., Furr R.M., and Funder D.C. Personality and life satisfaction: A facet level analysis. Personality and Social Psychology Bulletin 30 (2004) 1062-1075
37. Spain J.S., Eaton L.G., and Funder D.C. Perspectives on personality: The relative accuracy of self versus others for the prediction of emotion and behavior. Journal of Personality 68 (2000) 837-867
38. Westfall P.H., and Young S.S. Resampling-based multiple testing: Examples and methods for p-value adjustment (1993), John Wiley & Sons Inc., New York
39. Wilkinson B. A statistical consideration in psychological research. Psychological Bulletin 48 (1951) 156-158