Mini Meta-Analysis of Your Own Studies: Some Arguments on Why and a Primer on How

Social and Personality Psychology Compass

Volumn 10, Issue 10, 2016, Pages 535-549

  Goh, Jin X ^a   Hall, Judith A ^a   Rosenthal, Robert ^b  

^a NORTHEASTERN UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADOPTION; EFFECT SIZE; HUMAN; META ANALYSIS; PUBLICATION; SCIENTIST;

EID: 84991058686     PISSN: None     EISSN: 17519004     Source Type: Journal    
DOI: 10.1111/spc3.12267     Document Type: Article

References (53)

1. Bonett, D. G. (2008). Meta-analytic interval estimation for Pearson correlations. Psychological Methods, 13, 173–189.
2. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2005). Comprehensive Meta-analysis (version 3). Englewood, NJ: Biostat.
3. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to Meta-analysis. United Kingdom: Wiley.
4. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1, 97–111.
5. Braver, S. L., Thoemmes, F. J., & Rosenthal, R. (2014). Continuously cumulating meta-analysis and replicability. Perspectives on Psychological Science, 9, 333–342.
6. Carter, J. D., Hall, J. A., Carney, D. R., & Rosip, J. C. (2006). Individual differences in the acceptance of stereotyping. Journal of Research in Personality, 40, 1103–1118.
7. Case, C. R., Conlon, K. E., & Maner, J. K. (2015). Affiliation-seeking among the powerless: Lacking power increases social affiliative motivation. European Journal of Social Psychology, 45, 378–385.
8. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences (2nd edn). Hillsdale, NJ: Lawrence Erlbaum Associates.
9. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.
10. Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The Handbook of Research Synthesis and Meta-analysis (2nd edn), (pp. 357–376). New York, NY: Russell Sage Foundation.
11. Cumming, G. (2013). Understanding the New Statistics: Effect Sizes, Confidence Intervals, and Meta-analysis. New York, NY: Routledge.
12. Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29.
13. DiMatteo, M. R. (2004). Social support and patient adherence to medical treatment: A meta-analysis. Health Psychology, 23, 207–218.
14. Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1, 170–177.
15. Goh, J. X., Schlegel, K., Tignor, S. M., & Hall, J. A. (2016). Who is interested in personality? The Interest in Personality Scale and its correlates. Personality and Individual Differences, 101, 185–191.
16. Hall, J. A., Blanch, D. C., Horgan, T. G., Murphy, N. A., Rosip, J. C., & Mast, M. S. (2009). Motivation and interpersonal sensitivity: Does it matter how hard you try? Motivation and Emotion, 33, 291–302.
17. Hall, J. A., Goh, J. X., Schmid Mast, M., & Hagedorn, C. (2016). Individual differences in accurately judging personality from text. Journal of Personality, 84, 433–445.
18. Hall, J. A., Roter, D. L., Milburn, M. A., & Daltroy, L. H. (1996). Patient's health as a predictor of physician and patient behavior in medical visits: A synthesis of four studies. Medical Care, 34, 1205–1218.
19. Hall, J. A., Ship, A. N., Ruben, M. A., Curtin, E. M., Roter, D. L., Clever, S. L., Smith, C. C., & Pounds, K. (2015). Clinically relevant correlates of accurate perception of patients' thoughts and feelings. Health Communication, 30, 423–429.
20. Hedges, L. V., Cooper, H., & Bushman, B. J. (1992). Testing the null hypothesis in meta-analysis: A comparison of combined probability and confidence interval procedures. Psychological Bulletin, 111, 188–194.
21. Higgins, J. P., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327, 557–560.
22. Horgan, T. G., Schmid Mast, M., Hall, J. A., & Carter, J. D. (2004). Gender differences in memory for the appearance of others. Personality and Social Psychology Bulletin, 30, 185–196.
23. 2 index?. Psychological Methods, 11, 193–206.
24. Hugenberg, K., & Bodenhausen, G. V. (2004). Ambiguity in social categorization: The role of prejudice and facial affect in race categorization. Psychological Science, 15, 342–345.
25. John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532.
26. Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., … & Nosek, B. A. (in press). Reducing Implicit Racial Preferences: II. Intervention effectiveness across time. Journal of Experimental Psychology: General.
27. Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863.
28. Lamarche, V. M., & Murray, S. L. (2014). Selectively myopic? Self-esteem and attentional bias in response to potential relationship threats. Social Psychological & Personality Science, 5, 786–795.
29. Lim, D., & DeSteno, D. (2016). Suffering and compassion: The links among adverse life experiences, empathy, compassion, and prosocial behavior. Emotion, 16, 175–182.
30. Lindsay, D. S. (2015). Replication in psychological science. Psychological Science, 26, 1827–1832.
31. Lipsey, M. W. & Wilson, D. B. (2001). Practical Meta-analysis. Thousand Oaks, CA: Sage publications.
32. Maner, J. K. (2014). Let's put our money where our mouth is: If authors are to change their ways, reviewers (and editors) must change with them. Perspectives on Psychological Science, 9, 343–351.
33. McNemar, Q. (1962). Psychological Statistics, 3rd edn. New York: Wiley.
34. Morris, S. B., & DeShon, R. P. (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105–125.
35. Mosteller, F. M., & Bush, R. R. (1954). Selected quantitative techniques. In G. Lindzey (Ed.), Handbook of Social Psychology: Volume I. Theory and Method. Cambridge, MA: Addison-Wesley.
36. Pool, E., Brosch, T., Delplanque, S., & Sander, D. (2016). Attentional bias for positive emotional stimuli: A meta-analytic investigation. Psychological Bulletin, 142, 79–106.
37. Prentice, D. A., & Miller, D. T. (1992). When small effects are impressive. Psychological Bulletin, 112, 160–164.
38. Rosenthal, R. (1978). Combining results of independent studies. Psychological Bulletin, 85, 185–193.
39. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641.
40. Rosenthal, R. (1991). Meta-analytic Procedures for Social Research (rev. ed.). Newbury Park, CA: Sage Publications.
41. Rosenthal, R., Hall, J. A., DiMatteo, M. R., Rogers, P. L., & Archer, D. (1979). Sensitivity to Nonverbal Communication: The PONS Test. Baltimore: The Johns Hopkins University Press.
42. Rosenthal, R., & Rosnow, R. L. (2008). Essentials of Behavioral Research (3rd edn). New York: McGraw-Hill.
43. Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (2000). Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach. New York: Cambridge University Press.
44. Rosenthal, R., & Rubin, D. B. (1994). The counternull value of an effect size: A new statistic. Psychological Science, 5, 329–334.
45. Rosnow, R. L., & Rosenthal, R. (2009). Effect sizes: Why, when, and how to use them. Journal of Psychology, 217, 6–14.
46. Rule, N. O., Tskhay, K. O., Brambilla, M., Riva, P., Andrzejewski, S. A., & Krendl, A. C. (2015). The relationship between anti-gay prejudice and the categorization of sexual orientation. Personality and Individual Differences, 77, 74–80.
47. Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers. Psychological Methods, 1, 115–129.
48. Shadish, W. R., & Haddock, C. K. (2009) Combining estimates of effect size. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The Handbook of Research Synthesis and Meta-analysis (2nd edn) (pp. 257–277). New York, NY: Russell Sage Foundation.
49. Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014). P-curve: A key to the file-drawer. Journal of Experimental Psychology: General, 143, 534–547.
50. Ueno, T., Fastrich, G. M., & Murayama, K. (2016). Meta-analysis to integrate effect sizes within an article: Possible misuse and Type I error inflation. Journal of Experimental Psychology: General, 145, 643–654.
51. Vazire, S. (2016). Editorial. Social Psychological & Personality Science, 7, 3–7.
52. Williams, L. A., & DeSteno, D. (2008). Pride and perseverance: The motivational role of pride. Journal of Personality and Social Psychology, 94, 1007–1017.
53. Williams, M. J., & Tiedens, L. Z. (2016). The subtle suspension of backlash: A meta-analysis of penalties for women's implicit and explicit dominance behavior. Psychological Bulletin, 142, 165–197.