Estimating the Difference Between Published and Unpublished Effect Sizes: A Meta-Review

Review of Educational Research

Volumn 86, Issue 1, 2016, Pages 207-236

  Polanin, Joshua R ^a   Tanner Smith, Emily E ^a   Hennessy, Emily A ^a  

^a VANDERBILT UNIVERSITY   (United States)

Author keywords

effect size; meta analysis; meta review; publication bias

Indexed keywords

EID: 84957889265     PISSN: 00346543     EISSN: 19351046     Source Type: Journal    
DOI: 10.3102/0034654315582067     Document Type: Article

References (128)

1. S.AhnA.J.AmesN.D.Myers (2012). A review of meta-analyses in education: Methodological strengths and weaknesses. Review of Educational Research, 82, 436–476. doi:10.3102/0034654312458162
2. R.G.*AstillK.B.Van der HeijdenM.H.Van IJzendoornE.J.Van Someren (2012). Sleep, cognition, and behavioral problems in school-age children: A century of research meta-analyzed. Psychological Bulletin, 138, 1109–1138. doi:10.1037/a0028204
3. R.L.*Bangert-Drowns (1993). The word processor as an instructional tool: A meta-analysis of word processing in writing instruction. Review of Educational Research, 63, 69–93. doi:10.3102/00346543063001069
4. R.L.*Bangert-DrownsM.M.HurleyB.Wilkinson (2004). The effects of school-based writing-to-learn interventions on academic achievement: A meta-analysis. Review of Educational Research, 74, 29–58. doi:10.3102/00346543074001029
5. R.L.*Bangert-DrownsC.L.C.KulikJ.A.KulikM.Morgan (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61, 213–238. doi:10.3102/00346543061002213
6. L.BaxK.G.Moons (2011). Beyond publication bias. Journal of Clinical Epidemiology, 64, 459–462. doi:10.1016/j.jclinepi.2010.09.003
7. B.J.Becker (2005). Failsafe N or file-drawer number. In (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 111–126). Chichester, England: Wiley.
8. M.BorensteinL.V.HedgesJ.HigginsH.R.Rothstein (2009). Introduction to meta-analysis. Chichester, England: John Wiley.
9. H.*BöschF.SteinkampE.Boller (2006). Examining psychokinesis: The interaction of human intention with random number generators-A meta-analysis. Psychological Bulletin, 132, 497–523. doi:10.1037/0033-2909.132.4.497
10. N.A.*Bowman (2011). Promoting participation in a diverse democracy a meta-analysis of college diversity experiences and civic engagement. Review of Educational Research, 81, 29–68. doi:10.3102/0034654310383047
11. J.M.*CantorR.BlanchardL.K.RobichaudB.K.Christensen (2005). Quantitative reanalysis of aggregate data on IQ in sexual offenders. Psychological Bulletin, 131, 555–568. doi:10.1037/0033-2909.131.4.555
12. A.W.ChanA.HróbjartssonM.T.HaahrP.C.GøtzscheD.G.Altman (2004). Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles. Journal of the American Medical Association, 291, 2457–2465. doi:10.1001/jama.291.20.2457
13. M.W.L.Cheung (2013). Multivariate meta-analysis as structural equation models. Structural Equation Modeling, 20, 429–454. doi:10.1080/10705511.2013.797827
14. H.*CooperA.B.AllenE.A.PatallA.L.Dent (2010). Effects of full-day kindergarten on academic achievement and social development. Review of Educational Research, 80, 34–70. doi:10.3102/0034654309359185
15. H.*CooperJ.C.RobinsonE.A.Patall (2006). Does homework improve academic achievement? A synthesis of research, 1987–2003. Review of Educational Research, 76, 1–62. doi:10.3102/00346543076001001
16. H.*CooperJ.C.ValentineK.CharltonA.Melson (2003). The effects of modified school calendars on student achievement and on school and community attitudes. Review of Educational Research, 73, 1–52. doi:10.3102/00346543073001001
17. J.*Cornelius-White (2007). Learner-centered teacher-student relationships are effective: A meta-analysis. Review of Educational Research, 77, 113–143. doi:10.3102/003465430298563
18. G.Cumming (2014). The new statistics. Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966
19. J.M.*CurrierR.A.NeimeyerJ.S.Berman (2008). The effectiveness of psychotherapeutic interventions for bereaved persons: A comprehensive quantitative review. Psychological Bulletin, 134, 648–661. doi:10.1037/0033-2909.134.5.648
20. E.L.*DeciR.KoestnerR.M.Ryan (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627–668. doi:10.1037/0033-2909.125.6.627
21. E.DecullierV.LhéritierF.Chapuis (2005). Fate of biomedical research protocols and publication bias in France: Retrospective cohort study. British Medical Journal, 331, 19–25. doi:10.1136/bmj.38488.385995.8F
22. K.*DindiaM.Allen (1992). Sex differences in self-disclosure: A meta-analysis. Psychological Bulletin, 112, 106–124. doi:10.1037//0033-2909.112.1.106
23. K.S.*DouglasL.S.GuyS.D.Hart (2009). Psychosis as a risk factor for violence to others: A meta-analysis. Psychological Bulletin, 135, 679–706. doi:10.1037/a0016311
24. D.M.*DushM.L.HirtH.E.Schroeder (1989). Self-statement modification in the treatment of child behavior disorders: A meta-analysis. Psychological Bulletin, 106, 97–106. doi:10.1037/0033-2909.106.1.97
25. S.DuvalR.Tweedie (2000). Trim and fill: A simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463. doi:10.1111/j.0006-341X.2000.00455.x
26. K.DwanD.G.AltmanJ.A.ArnaizJ.BloomA.W.ChanE.CroninP.R..Williamson (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS One, 3, e3081. doi:10.1371/journal.pone.0003081
27. A.H.*EaglyR.D.AshmoreM.G.MakhijaniL.C.Longo (1991). What is beautiful is good, but..: A meta-analytic review of research on the physical attractiveness stereotype. Psychological Bulletin, 110, 109–128. doi:10.1037/0033-2909.110.1.109
28. A.H.*EaglyS.ChenS.ChaikenK.Shaw-Barnes (1999). The impact of attitudes on memory: An affair to remember. Psychological Bulletin, 125, 64–89. doi:10.1037/00332909.125.1.64
29. A.H.*EaglyM.C.Johannesen-SchmidtM.L.Van Engen (2003). Transformational, transactional, and laissez-faire leadership styles: A meta-analysis comparing women and men. Psychological Bulletin, 129, 569–591. doi:10.1037/0033-2909.129.4.569
30. A.H.*EaglyV.J.Steffen (1986). Gender and aggressive behavior: A meta-analytic review of the social psychological literature. Psychological Bulletin, 100, 309–330. doi:10.1037/0033-2909.100.3.309
31. P.J.EasterbrookJ.A.BerlinR.GopalanD.R.Matthews (1991). Publication bias in clinical research. The Lancet, 337, 867–872. doi:10.1016/0140-6736(91)90201-Y
32. M.EggerG.D.SmithM.SchneiderC.Minder (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634. doi:10.1136/bmj.315.7109.629
33. H.A.*ElfenbeinN.Ambady (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203–235. doi:10.1037//0033-2909.128.2.203
34. O.*ErelB.Burman (1995). Interrelatedness of marital relations and parent-child relations: A meta-analytic review. Psychological Bulletin, 118, 108–132. doi:10.1037/0033-2909.118.1.108
35. A.*Feingold (1988). Matching for attractiveness in romantic partners and same-sex friends: A meta-analysis and theoretical critique. Psychological Bulletin, 104, 226–235. doi:10.1037/0033-2909.104.2.226
36. C.J.FergusonM.T.Brannick (2012). Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychological Methods, 17, 120–128. doi:10.1037/a0024445
37. C.J.FergusonM.Heene (2012). A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7, 555–561. doi:10.1177/1745691612459059
38. Z.FisherE.Tipton (2015). Package robumeta (Version 1.1) [Computer software]. Retrieved from http://cran.r-project.org/web/packages/robumeta/robumeta.pdf
39. J.*Frattaroli (2006). Experimental disclosure and its moderators: A meta-analysis. Psychological Bulletin, 132, 823–865. doi:10.1037/0033-2909.132.6.823
40. L.R.*GlasmanD.Albarracín (2006). Forming attitudes that predict future behavior: A meta-analysis of the attitude-behavior relation. Psychological Bulletin, 132, 778–882. doi:10.1037/0033-2909.132.5.778
41. D.H.*GliessmanR.C.PughD.E.DowdenT.F.Hutchins (1988). Variables influencing the acquisition of a generic teaching skill. Review of Educational Research, 58, 25–46. doi:10.3102/00346543058001025
42. S.*GrabeJ.S.Hyde (2006). Ethnicity and body dissatisfaction among women in the United States: A meta-analysis. Psychological Bulletin, 132, 622–640. doi:10.1037/0033-2909.132.4.622
43. S.*GrabeL.M.WardJ.S.Hyde (2008). The role of the media in body image concerns among women: A meta-analysis of experimental and correlational studies. Psychological Bulletin, 134, 460–476. doi:10.1037/0033-2909.134.3.460
44. A.G.Greenwald (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20. doi:10.1037/h0076157
45. R.M.HarbordM.EggerJ.A.C.Sterne (2006). A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Statistics in Medicine, 25, 3443–3457. doi:10.1002/sim.2380
46. J.*HattieJ.BiggsN.Purdie (1996). Effects of learning skills interventions on student learning: A meta-analysis. Review of Educational Research, 66, 99–136. doi:10.3102/00346543066002099
47. L.V.HedgesE.TiptonM.C.Johnson (2010). Robust variance estimation in meta-regression with dependent effect size estimates. Research Synthesis Methods, 1, 39–65. doi:10.1002/jrsm.5
48. L.V.HedgesJ.Vevea (2005). Selection method approaches. In (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 145–174). Chichester, England: Wiley.
49. J.P.T.HigginsS.Green (2011). Cochrane handbook for systematic reviews of interventions (Version 5.1). London, England: The Cochrane Collaboration. Retrieved from http://handbook.cochrane.org/
50. J.P.T.HigginsS.G.Thompson (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539–1558. doi:10.1002/sim.1186
51. S.HopewellM.ClarkeS.Mallett (2005). Grey literature and systematic reviews. In (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 48–72). Chichester, England: Wiley.
52. S.HopewellK.LoudonM.J.ClarkeA.D.OxmanK.Dickersin (2009). Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database of Systematic Reviews, (1), 1–25. doi:10.1002/14651858.MR000006.pub3
53. A.B.*Hostetter (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137, 297–315. doi:10.1037/a0022128
54. J.P.Ioannidis (1998). Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. Journal of the American Medical Association, 279, 281–286. doi:10.1001/jama.279.4.281
55. J.P.Ioannidis (2005). Why most published research findings are false. PLoS Medicine, 2, e124. doi:10.1371/journal.pmed.0020124
56. J.P.IoannidisM.R.MunafoP.Fusar-PoliB.A.NosekS.P.David (2014). Publication and other reporting biases in cognitive sciences: Detection, prevalence, and prevention. Trends in Cognitive Sciences, 18, 235–241. doi:10.1016/j.tics.2014.02.010
57. J.P.IoannidisT.A.Trikalinos (2007). An exploratory test for an excess of significant findings. Clinical Trials, 4, 245–253. doi:10.1177/1740774507079441
58. S.*JaffeeJ.S.Hyde (2000). Gender differences in moral orientation: A meta-analysis. Psychological Bulletin, 126, 703–726. doi:10.1037/0033-2909.126.5.703
59. R.E.*JohnsonC.H.ChangR.G.Lord (2006). Moving from cognition to behavior: What the research says. Psychological Bulletin, 132, 381–415. doi:10.1037/0033-2909.132.3.381
60. T.A.*JudgeC.J.ThoresenJ.E.BonoG.K.Patton (2001). The job satisfaction–job performance relationship: A qualitative and quantitative review. Psychological Bulletin, 127, 376–407. doi:10.1037/0033-2909.127.3.376
61. F.*JufferM.H.Van IJzendoorn (2007). Adoptees do not lack self-esteem: A meta-analysis of studies on self-esteem of transracial, international, and domestic adoptees. Psychological Bulletin, 133, 1067–1083. doi:10.1037/0033-2909.133.6.1067
62. J.S.*KimD.M.Quinn (2013). The Effects of Summer Reading on Low-Income Children’s Literacy Achievement From Kindergarten to Grade 8: A Meta-Analysis of Classroom and Home Interventions. Review of Educational Research, 83, 386–431. doi:10.3102/0034654313483906
63. A.M.*KoenigA.H.EaglyA.A.MitchellT.Ristikari (2011). Are leader stereotypes masculine? A meta-analysis of three research paradigms. Psychological Bulletin, 137, 616–642. doi:10.1037/a0023557
64. J.A.*KulikC.L.C.Kulik (1988). Timing of feedback and verbal learning. Review of Educational Research, 58, 79–97. doi:10.3102/00346543058001079
65. J.A.KulikC.L.C.Kulik (1989). Meta-analysis in education. International Journal of Educational Research, 13, 321–340. doi:10.1037/0003-066X.48.12.1181
66. M.*LaFranceM.A.HechtE.L.Paluck (2003). The contingent smile: A meta-analysis of sex differences in smiling. Psychological Bulletin, 129, 305–334. doi:10.1037/0033-2909.129.2.305
67. K.*LanajC.H.ChangR.E.Johnson (2012). Regulatory focus and work-related outcomes: A review and meta-analysis. Psychological Bulletin, 138, 998–1034. doi:10.1037/a0027723
68. P.A.*LauerM.AkibaS.B.WilkersonH.S.ApthorpD.SnowM.L.Martin-Glenn (2006). Out-of-school-time programs: A meta-analysis of effects for at-risk students. Review of Educational Research, 76, 275–313. doi:10.3102/00346543076002275
69. C.J.LeeC.R.SugimotoG.ZhangB.Cronin (2013). Bias in peer review. Journal of the American Society for Information Science and Technology, 64, 2–17. doi:10.1002/asi.22784
70. T.R.LevineK.J.AsadaC.Carpenter (2009). Sample sizes and effect sizes are negatively correlated in meta-analyses: Evidence and implications of a publication bias against nonsignificant findings. Communication Monographs, 76, 286–302. doi:10.1080/03637750903074685
71. M.W.Lipsey (2009). Identifying interesting variables and analysis opportunities. In (Eds.), The handbook of research synthesis and meta-analysis (pp. 147–158). New York, NY: Sage.
72. M.W.LipseyD.B.Wilson (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181–1209. doi:10.1037/0003-066X.48.12.1181
73. M.W.LipseyD.B.Wilson (2001). Applied social research methods: Vol. 49. Practical meta-analysis. Thousand Oaks, CA: Sage.
74. Y.*LouP.C.AbramiS.d’Apollonia (2001). Small group and individual learning with technology: A meta-analysis. Review of Educational Research, 71, 449–521. doi:10.3102/00346543071003449
75. Y.*LouP.C.AbramiJ.C.SpenceC.PoulsenB.ChambersS.d’Apollonia (1996). Within-class grouping: A meta-analysis. Review of Educational Research, 66, 423–458. doi:10.3102/00346543066004423
76. H.*LyttonD.M.Romney (1991). Parents’ differential socialization of boys and girls: A meta-analysis. Psychological Bulletin, 109, 267–296. doi:10.1037/0033-2909.109.2.267
77. L.M.*MarulisS.B.Neuman (2010). The effects of vocabulary intervention on young children’s word learning: A meta-analysis. Review of Educational Research, 80, 300–335. doi:10.3102/0034654310377087
78. E.B.*McClure (2000). A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychological Bulletin, 126, 424–453. doi:10.1037/0033-2909.126.3.424
79. S.A.*MetzgerM.J.Wu (2008). Commercial teacher selection instruments: The validity of selecting teachers through beliefs, attitudes, and values. Review of Educational Research, 78, 921–940. doi:10.3102/0034654308323035
80. N.*MorJ.Winquist (2002). Self-focused attention and negative affect: A meta-analysis. Psychological Bulletin, 128, 638–662. doi:10.1037/0033-2909.128.4.638
81. J.*MurrayD.P.FarringtonI.Sekol (2012). Children’s antisocial behavior, mental health, drug use, and educational performance after parental incarceration: A systematic review and meta-analysis. Psychological Bulletin, 138, 175–210. doi:10.1037/a0026407
82. J.C.*NesbitO.O.Adesope (2006). Learning with concept and knowledge maps: A meta-analysis. Review of Educational Research, 76, 413–448. doi:10.3102/00346543076003413
83. R.G.Orwin (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8, 157–159. doi:10.2307/1164923
84. E.A.*PascoeL.Smart Richman (2009). Perceived discrimination and health: A meta-analytic review. Psychological Bulletin, 135, 531–554. doi:10.1037/a0016059
85. E.A.*PatallH.CooperJ.C.Robinson (2008a). Parent involvement in homework: A research synthesis. Review of Educational Research, 78, 1039–1101. doi:10.3102/0034654308325185
86. E.A.*PatallH.CooperJ.C.Robinson (2008b). The effects of choice on intrinsic motivation and related outcomes: A meta-analysis of research findings. Psychological Bulletin, 134, 270–300. doi:10.1037/0033-2909.134.2.270
87. A.R.*PennyR.Coe (2004). Effectiveness of consultation on student ratings feedback: A meta-analysis. Review of Educational Research, 74, 215–253. doi:10.3102/00346543074002215
88. J.L.PetersA.J.SuttonD.R.JonesK.R.AbramsL.Rushton (2006). Comparison of two methods to detect publication bias in meta-analysis. Journal of the American Medical Association, 295, 676–680. doi:10.1001/jama.295.6.676
89. T.D.PigottJ.C.ValentineJ.R.PolaninR.T.WilliamsD.D.Canada (2013). Outcome-reporting bias in education research. Educational Researcher, 42, 424–432. doi:10.3102/0013189X13507104
90. J.R.PolaninT.D.Pigott (2015). The use of meta-analytic statistical significance testing. Research Synthesis Methods, 6, 63-73. doi:10.1002/jrsm.1124
91. Z.*QinD.W.JohnsonR.T.Johnson (1995). Cooperative versus competitive efforts and problem solving. Review of Educational Research, 65, 129–143. doi:10.3102/00346543065002129
92. M.G.*RhodesJ.S.Anastasi (2012). The own-age bias in face recognition: A meta-analytic and theoretical review. Psychological Bulletin, 138, 146–174. doi:10.1037/a0025750
93. M.G.*RhodesS.K.Tauber (2011). The influence of delaying judgments of learning on metacognitive accuracy: A meta-analytic review. Psychological Bulletin, 137, 131–148. doi:10.1037/a0021705
94. B.*RindP.TromovitchR.Bauserman (1998). A meta-analytic examination of assumed properties of child sexual abuse using college samples. Psychological Bulletin, 124, 22–53. doi:10.1037/0033-2909.124.1.22
95. G.W.*RitterJ.H.BarnettG.S.DennyG.R.Albin (2009). The effectiveness of volunteer tutoring programs for elementary and middle school students: A meta-analysis. Review of Educational Research, 79, 3–38. doi:10.3102/0034654308325690
96. R.Rosenthal (1991). Meta-analysis: A review. Psychosomatic Medicine, 53, 247–271.
97. J.A.*Ross (1988). Controlling variables: A meta-analysis of training studies. Review of Educational Research, 58, 405–437. doi:10.3102/00346543058004405
98. H.R.RothsteinM.BorensteinA.J.Sutton (2005). Publication bias in meta-analysis. Prevention, assessment and adjustments. Chichester, England: Wiley.
99. G.RückerG.SchwarzerJ.Carpenter (2008). Arcsine test for publication bias in meta-analyses with binary outcomes. Statistics in Medicine, 27, 746–763. doi:10.1002/sim.2971
100. A.H.E.SchildM.Voracek (2015). Finding your way out of the forest without a trail of bread crumbs: Development and evaluation of two novel displays of forest plots. Research Synthesis Methods, 6, 74-86.
101. P.*SedlmeierJ.EberthM.SchwarzD.ZimmermannF.HaarigS.JaegerS.Kunze (2012). The psychological effects of meditation: A meta-analysis. Psychological Bulletin, 138, 1139–1171. doi:10.1037/a0028168
102. M.C.*SetoM.L.Lalumiere (2010). What is so special about male adolescent sexual offending? A review and test of explanations through meta-analysis. Psychological Bulletin, 136, 526–575. doi:10.1037/a0019700
103. U.SimonsohnD.Nelson, LeifJ.P.Simmons (2014). P-curve: A key to the file drawer. Journal of Experimental Psychology, 143, 534–547. doi:10.1037/a0033242
104. M.L.Smith (1980). Publication bias and meta-analysis. Evaluation in Education, 4, 22–24. doi:10.1016/0191-765X(80)90004-X
105. T.B.*SmithM.E.McCulloughJ.Poll (2003). Religiousness and depression: Evidence for a main effect and the moderating influence of stressful life events. Psychological Bulletin, 129, 614–636. doi:10.1037/0033-2909.129.4.614
106. G.W.*SosaD.E.BergerA.T.SawJ.C.Mary (2011). Effectiveness of computer-assisted instruction in statistics a meta-analysis. Review of Educational Research, 81, 97–128. doi:10.3102/0034654310378174
107. J.F.*SowisloU.Orth (2013). Does low self-esteem predict depression and anxiety? A meta-analysis of longitudinal studies. Psychological Bulletin, 139, 213–240. doi:10.1037/a0028931
108. N.M.*Steblay (1987). Helping behavior in rural and urban environments: A meta-analysis. Psychological Bulletin, 102, 346–356. doi:10.1037/0033-2909.102.3.346
109. J.A.C.SterneB.J.BeckerM.Egger (2005). The funnel plot. In (Eds.), Publication bias in meta-analysis: Prevention, assessment and adjustments (pp. 75–98). Chichester, England: Wiley.
110. E.*SticeH.ShawC.N.Marti (2006). A meta-analytic review of obesity prevention programs for children and adolescents: The skinny on interventions that work. Psychological Bulletin, 132, 667–691. doi:10.1037/0033-2909.132.5.667
111. A.J.Sutton (2009). Publication bias. In (Eds.), The handbook of research synthesis and meta-analysis (pp. 435–543). New York, NY: Sage.
112. H.L.*SwansonM.Hoskyn (1998). Experimental intervention research on students with learning disabilities: A meta-analysis of treatment outcomes. Review of Educational Research, 68, 277–321. doi:10.3102/00346543068003277
113. E.E.Tanner-SmithJ.R.Polanin (2014). A retrospective analysis of dissemination biases in the brief alcohol intervention literature. Psychology of Addictive Behaviors. Advanced online publication. doi:10.1037/adb0000014
114. E.E.Tanner-SmithE.Tipton (2014). Robust variance estimation with dependent effect sizes: Practical considerations including a software tutorial in Stata and SPSS. Research Synthesis Methods, 4, 13–30. doi:10.1002/jrsm.1091
115. C.J.*ThoresenS.A.KaplanA.P.BarskyC.R.WarrenK.de Chermont (2003). The affective underpinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914–945. doi:10.1037/0033-2909.129.6.914
116. N.R.*ToosiL.G.BabbittN.AmbadyS.R.Sommers (2012). Dyadic interracial interactions: A meta-analysis. Psychological Bulletin, 138, 1–27. doi:10.1037/a0025767
117. C.J.Torgerson (2006). Publication bias: The Achilles’ heel of systematic reviews?British Journal of Educational Studies, 54, 89–102. doi:10.1111/j.1467-8527.2006.00332.x
118. D.H.*UttalN.G.MeadowE.TiptonL.L.HandA.R.AldenC.WarrenN.S.Newcombe (2013). The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin, 139, 352–402. doi:10.1037/a0028446
119. D.D.*VachonD.R.LynamJ.A.Johnson (2014). The (non) relation between empathy and aggression: Surprising results from a meta-analysis. Psychological Bulletin, 140, 751–773. doi:10.1037/a0035236
120. E.*Van den BusscheW.Van den NoortgateB.Reynvoet (2009). Mechanisms of masked priming: A meta-analysis. Psychological Bulletin, 135, 452–477. doi:10.1037/a0015329
121. M.H.*Van IjzendoornF.JufferC.W.K.Poelhuis (2005). Adoption and cognitive development: A meta-analytic comparison of adopted and nonadopted children’s IQ and school performance. Psychological Bulletin, 131, 301–316. doi:10.1037/0033-2909.131.2.301
122. S.*Veenman (1996). Effects of multigrade and multi-age classes reconsidered. Review of Educational Research, 66, 323–340. doi:10.3102/00346543066003323
123. P.P.*VitalianoJ.ZhangJ.M.Scanlan (2003). Is caregiving hazardous to one’s physical health? A meta-analysis. Psychological Bulletin, 129, 946–972. doi:10.1037/0033-2909.129.6.946
124. T.L.*WebbP.Sheeran (2006). Does changing behavioral intentions engender behavior change? A meta-analysis of the experimental evidence. Psychological Bulletin, 132, 249–268. doi:10.1037/0033-2909.132.2.249
125. J.R.*WeiszC.A.McCartyS.M.Valeri (2006). Effects of psychotherapy for depression in children and adolescents: A meta-analysis. Psychological Bulletin, 132, 132–149. doi:10.1037/0033-2909.132.1.132
126. W.*WoodS.LundgrenJ.A.OuelletteS.BuscemeT.Blackstone (1994). Minority influence: A meta-analytic review of social influence processes. Psychological Bulletin, 115, 323–346.
127. W.*WoodJ.M.Quinn (2003). Forewarned and forearmed? Two meta-analysis syntheses of forewarnings of influence appeals. Psychological Bulletin, 129, 119–138. doi:10.1037/0033-2909.129.1.119
128. W.*WoodF.Y.WongJ.G.Chachere (1991). Effects of media violence on viewers’ aggression in unconstrained social interaction. Psychological Bulletin, 109, 371–383. doi:10.1037/0033-2909.109.3.371