A meta-meta-analysis: Empirical review of statistical power, type I error rates, effect sizes, and model selection of meta-analyses published in psychology

Multivariate Behavioral Research

Volumn 45, Issue 2, 2010, Pages 239-270

  Cafri, Guy ^a   Kromrey, Jeffrey D ^b   Brannick, Michael T ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953668723     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1080/00273171003680187     Document Type: Article

References (162)

1. Achenbach, T., Krukowski, R., Dumenci, L., & Ivanova, M. (2005). Assessment of adult psy- chopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin, 131, 361-382.
2. Ackerman, P., Beier, M., & Boyle, M. (2005). Working memory and intelligence: The same or different constructs? Psychological Bulletin, 131, 30-60.
3. Ackerman, P., & Heggestad, E. (1997). Intelligence, personality, and interests: Evidence for over- lapping traits. Psychological Bulletin, 121, 219-245.
4. Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005). Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review. Journal of Applied Psychology, 90, 94-107.
5. Aguinis, M. C., Sturman, M. C., & Pierce, C. A. (2008). Comparison of three meta-analytic procedures for estimating moderating effects of categorical variables. Organizational Research Methods, 11, 9-34.
6. Albarracín, D., Gillette, J., Earl, A., Glasman, L., Durantini, M., & Ho, M. (2005). A test of major assumptions about behavior change: A comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychological Bulletin, 131, 856-897.
7. Albarracín, D., Johnson, B., Fishbein, M., & Muellerleile, P. (2001). Theories of reasoned action and planned behavior as models of condom use: A meta-analysis. Psychological Bulletin, 127, 142-161.
8. Archer, J. (2000). Sex differences in aggression between heterosexual partners: A meta-analytic review. Psychological Bulletin, 126, 651-680.
9. Bakermans-Kranenburg, M., van IJzendoorn, M., & Juffer, F. (2003). Less is more: Meta-analyses of sensitivity and attachment interventions in early childhood. Psychological Bulletin, 129, 195-215.
10. Bangert-Drowns, R. L. (1986). Review of developments in meta-analysis method. Psychological Bulletin, 99, 388-399.
11. Bashore, T., & Ridderinkhof, K. (2002). Older age, traumatic brain injury, and cognitive slowing: Some convergent and divergent findings. Psychological Bulletin, 128, 151-198.
12. Becker, B. J. (1987). Applying tests of combined significance in meta-analysis. Psychological Bulletin, 102, 164-171.
13. Bettencourt, B., Charlton, K., Dorr, N., & Hume, D. (2001). Status differences and in-group bias: A meta-analytic examination of the effects of status stability, status legitimacy, and group permeability. Psychological Bulletin, 127, 520-542.
14. Bettencourt, B., & Miller, N. (1996). Gender differences in aggression as a function of provocation: A meta-analysis. Psychological Bulletin, 119, 422-447.
15. Birge, R. T. (1932). The calculation of errors by the method of least squares. Reviews of Modern Physics, 40, 207-227.
16. Bogg, T., & Roberts, B. (2004). Conscientiousness and health-related behaviors: A meta-analysis of the leading behavioral contributors to mortality. Psychological Bulletin, 130, 887-919.
17. Bond, R., & Smith, P. (1996). Culture and conformity: A meta-analysis of studies using Asch's (1952b, 1956) line judgment task. Psychological Bulletin, 119, 111-137.
18. Bonta, J., Law, M., & Hanson, K. (1998). The prediction of criminal and violent recidivism among mentally disordered offenders: A meta-analysis. Psychological Bulletin, 123, 123-142.
19. Brown, S. (1996). A meta-analysis and review of organizational research on job involvement. Psychological Bulletin, 120, 235-255.
20. Burt, D., Zembar, M., & Niederehe, G. (1995). Depression and memory impairment: A metaanalysis of the association, its pattern, and specificity. Psychological Bulletin, 117, 285-305.
21. Byrnes, J., Miller, D., & Schafer, W. (1999). Gender differences in risk taking: A meta-analysis. Psychological Bulletin, 125, 367-383.
22. Cacioppo, J., Petty, R., Feinstein, J., & Jarvis, W. (1996). Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. PsychologicalBulletin, 119,197-253.
23. ® macro for statistical power calculations in meta-analysis. Behavior Research Methods, 41, 235-246.
24. Cantor, J., Blanchard, R., Robichaud, L., & Christensen, B. (2005). Quantitative reanalysis of aggregate data on IQ in sexual offenders. Psychological Bulletin, 131, 555-568.
25. Cohen, J. (1962). The statistical power of abnormal-social psychological research. Journal of Abnormal and Social Psychology, 65, 145-153.
26. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
27. Cohen, J. (1994). The earth is round (p <.05). American Psychologist, 49, 997-1003.
28. Connell, A., & Goodman, S. (2002). The association between psychopathology in fathers versus mothers and children's internalizing and externalizing behavior problems: A meta-analysis. Psychological Bulletin, 128, 746-773.
29. Cooper, H., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York, NY: Russell Sage Foundation.
30. Cooper-Hakim, A., & Viswesvaran, C. (2005). The construct of work commitment: Testing an integrative framework. Psychological Bulletin, 131, 241-259.
31. Deci, E., Koestner, R., & Ryan, R. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125, 627-668.
32. DeNeve, K., & Cooper, H. (1998). The happy personality: A meta-analysis of 137 personality traits and subjective well-being. Psychological Bulletin, 124, 197-229.
33. DePaulo, B., Lindsay, J., Malone, B., Muhlenbruck, L., Charlton, K., & Cooper, H. (2003). Cues to deception. Psychological Bulletin, 129, 74-118.
34. Dickerson, S., & Kemeny, M. (2004). Acute stressors andcortisol responses: A theoretical integration and synthesis of laboratory research. Psychological Bulletin, 130, 355-391.
35. Eagly, A., Chen, S., Chaiken, S., & Shaw-Barnes, K. (1999). The impact of attitudes on memory: An affair to remember. Psychological Bulletin, 125, 64-89.
36. Eagly, A., Johannesen-Schmidt, M., & van Engen, M. (2003). Transformational, transactional, and laissez-faire leadership styles: A meta-analysis comparing women and men. Psychological Bulletin, 129, 569-591.
37. Eagly, A., Karau, S., & Makhijani, M. (1995). Gender and the effectiveness of leaders: A meta- analysis. Psychological Bulletin, 117, 125-145.
38. Eisenberger, R., Pierce, W., & Cameron, J. (1999). Effects of reward on intrinsic motivation- Negative, neutral, and positive: Comment on Deci, Koestner, and Ryan (1999). Psychological Bulletin, 125, 677-691.
39. Elfenbein, H., & Ambady, N. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203-235.
40. Erel, O., & Burman, B. (1995). Interrelatedness of marital relations and parent-child relations: A meta-analytic review. Psychological Bulletin, 118, 108-132.
41. Erel, O., Oberman, Y., & Yirmiya, N. (2000). Maternal versus nonmaternal care and seven domains of children's development. Psychological Bulletin, 126, 727-747.
42. Erez, A., Bloom, M. C., & Wells, M. T. (1996). Using random rather than fixed effects models in meta-analysis: Implications for situational specificity and validity generalization. Personnel Psychology, 49, 275-305.
43. Friedman, M., & Brownell, K. (1995). Psychological correlates of obesity: Moving to the next research generation. Psychological Bulletin, 117, 3-20.
44. Garb, H., & Schramke, C. (1996). Judgment research and neuropsychological assessment: A narrative review and meta-analyses. Psychological Bulletin, 120, 140-153.
45. Gerrard, M., Gibbons, F., & Bushman, B. (1996). Relation between perceived vulnerability to HIV and precautionary sexual behavior. Psychological Bulletin, 119, 390-409.
46. Gerrard, P. D., Smith, D. R., & Weerakkody, G. (1998). Limits of retrospective power analysis. Journal of Wildlife Management, 62, 801-807.
47. Gershoff, E. (2002). Corporal punishment by parents and associated child behaviors and experiences: A meta-analytic and theoretical review. Psychological Bulletin, 128, 539-579.
48. Gigone, D., & Hastie, R. (1997). Proper analysis of the accuracyof group judgments. Psychological Bulletin, 121, 149-167.
49. Goodman, S. N., & Berlin, J. A. (1994). The use of predicted confidence intervals when planning experiments and the misuse of power when interpreting results. Annals of Internal Medicine, 121, 200-206.
50. Grant, K., Compas, B., Stuhlmacher, A., Thurm, A., McMahon, S., & Halpert, J. (2003). Stressors and child and adolescent psychopathology: Moving from markers to mechanisms of risk. Psychological Bulletin, 129, 447-466.
51. Gray-Little, B., & Hafdahl, A. (2000). Factors influencing racial comparisons of self-esteem: A quantitative review. Psychological Bulletin, 126, 26-54.
52. Hall, J., Coats, E., & LeBeau, L. (2005). Nonverbal behavior and the vertical dimension of social relations: A meta-analysis. Psychological Bulletin, 131, 898-924.
53. Hays, W. L. (1994). Statistics (5th ed.). Belmont, CA: Thompson Learning.
54. Hedges, L. V. (1994). Fixed effects models. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 285-299). New York, NY: Russell Sage Foundation
55. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.
56. Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods, 6, 203-217.
57. Hedges, L. V., & Pigott, T. D. (2004). The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426-445.
58. Hedges, L. V., & Vevea, J. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
59. Heller, D., Watson, D., & Hies, R. (2004). The role of person versus situation in life satisfaction: A critical examination. Psychological Bulletin, 130, 574-600.
60. Hoenig, J. M., & Heisey, D. M. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. American Statistician, 55, 19-24.
61. Hogarty, K. Y., & Kromrey, J. D. (2003). RETR_PWR: An SAS macro for retrospective statistical power analysis. Behavior Research Methods, Instruments, & Computers, 34, 585-589.
62. Holden, G., & Miller, P. (1999). Enduring and different: A meta-analysis of the similarity in parents' child rearing. Psychological Bulletin, 125, 223-254.
63. Hunter, J. E., & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings (1st ed.). Newbury Park, CA: Sage.
64. Hunter, J. E., & Schmidt, F. L. (2000). Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment, 8,275-292.
65. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings (2nd ed.). Newbury Park, CA: Sage.
66. Ito, T., Miller, N., & Pollock, V. (1996). Alcohol and aggression: A meta-analysis on the moderating effects of inhibitory cues, triggering events, and self-focused attention. Psychological Bulletin, 120,60-82.
67. Jaffee, S., & Hyde, J. (2000). Gender differences in moral orientation: A meta-analysis. Psychological Bulletin, 126, 703-726.
68. Johnson, B. T. (1993). DSTAT 1.10: Software for the meta-analytic review of research literatures. Hillsdale, NJ: Erlbaum.
69. Jorgensen, R., Johnson, B., Kolodziej, M., & Schreer, G. (1996). Elevated blood pressure and personality: A meta-analytic review. Psychological Bulletin, 120, 293-320.
70. Jost, J., Glaser, J., Kruglanski, A., & Sulloway, F. (2003). Political conservatism as motivated social cognition. Psychological Bulletin, 129, 339-375.
71. Judge, T., Thoresen, C., Bono, J., & Patton, G. (2001). The job satisfaction-job performance relationship: A qualitative and quantitative review. Psychological Bulletin, 127, 376-407.
72. Juslin, P., & Laukka, P. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129, 770-814.
73. Karney, B., & Bradbury, T. (1995). The longitudinal course of marital quality and stability: A review of theory, methods, and research. Psychological Bulletin, 118, 3-34.
74. Keel, P., & Klump, K. (2003). Are eating disorders culture-bound syndromes? Implications for conceptualizing their etiology. Psychological Bulletin, 129, 747-769.
75. Keil, C., & Cortina, J. (2001). Degradation of validity over time: A test and extensionof Ackerman's model. Psychological Bulletin, 127, 673-697.
76. Kisamore, J. L., & Brannick, M. T. (2008). An illustration of the consequences of meta-analysis model choice. Organizational Research Methods, 11, 35-53.
77. Kling, K., Hyde, J., Showers, C., & Buswell, B. (1999). Gender differences in self-esteem: A meta-analysis. Psychological Bulletin, 125, 470-500.
78. Kluger, A., & DeNisi, A. (1996). Effects of feedback intervention on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119,254-284.
79. Knight, G., Fabes, R., & Higgins, D. (1996). Concerns about drawing causal inferences from meta- analyses: An example in the study of gender differences in aggression. Psychological Bulletin, 119,410-421.
80. Konrad, A., Ritchie, J., Lieb, P., & Corrigall, E. (2000). Sex differences and similarities in job attribute preferences: A meta-analysis. Psychological Bulletin, 126, 593-641.
81. Kromrey, J. D., & Hogarty, K. Y. (2000). Retrospective statistical power analysis: An empirical investigation of point and interval estimation techniques. Multiple Linear Regression Viewpoints, 26,7-14.
82. Kumkale, G., & Albarracín, D. (2004). The sleeper effect in persuasion: A meta-analytic Review. Psychological Bulletin, 130, 143-172.
83. Kuncel, N., Hezlett, S., & Ones, D. (2001). A comprehensivemeta-analysis of the predictive validity of the graduate record examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127, 162-181.
84. LaFrance, M., Hecht, M., & Paluck, E. (2003). The contingent smile: A meta-analysis of sex differences in smiling. Psychological Bulletin, 129, 305-334.
85. Lalumière, M., Blanchard, R., & Zucker, K. (2000). Sexual orientation and handedness in men and women: A meta-analysis. Psychological Bulletin, 126, 575-592.
86. Langlois, J., Kalakanis, L., Rubenstein, A., Larson, A., Hallam, M., & Smoot, M. (2000). Maxims or myths of beauty? A meta-analytic and theoretical review. Psychological Bulletin, 126, 390-423.
87. Light, R. J., Singer, J. D., & Willett, J. B. (1994). The visual presentation and interpretation of meta-analyses. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 439-453). New York, NY: Russell Sage Foundation.
88. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist, 48, 1181-1209.
89. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
90. Logan, T., Cole, J., & Leukefeld, C. (2002). Women, sex, and HIV: Social and contextual factors, meta-analysis of published interventions, and implications for practice and research. Psychological Bulletin, 128, 851-885.
91. Lorber, M. (2004). Psychophysiology of aggression, psychopathy, and conduct problems: A meta- analysis. Psychological Bulletin, 130, 531-552.
92. Low, K., Yoon, M., Roberts, B., & Rounds, J. (2005). The stability of vocational interests from early adolescence to middle adulthood: A quantitative review of longitudinal studies. Psychological Bulletin, 131, 713-737.
93. Lyubomirsky, S., King, L., & Diener, E. (2005). The benefits of frequent positive affect: Does happiness lead to success? Psychological Bulletin, 131, 803-855.
94. Maxwell, S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147-163.
95. McClure, E. (2000). A meta-analytic review of sex differences in facial expression processing and their development in infants, children, and adolescents. Psychological Bulletin, 126, 424-453.
96. Meyer, I. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129, 674-697.
97. Mezulis, A., Abramson, L., Hyde, J., & Hankin, B. (2004). Is there a universal positivity bias in attributions? A meta-analytic review of individual, developmental, and cultural differences in the self-serving attributional bias. Psychological Bulletin, 130, 711-747.
98. Miller, T., Smith, T., Turner, C., Guijarro, M., & Hallet, A. (1996). Meta-analytic review of research on hostility and physical health. Psychological Bulletin, 119, 322-348.
99. Milton, J., & Wiseman, R. (1999). Does psi exist? Lack of replication of an anomalous process of information transfer. Psychological Bulletin, 125, 387-391.
100. Mitte, K. (2005). Meta-analysis of cognitive-behavioral treatments for generalized anxiety disorder: A comparison with pharmacotherapy. Psychological Bulletin, 131, 785-795.
101. Mor, N., & Winquist, J. (2002). Self-focused attention and negative affect: A meta-analysis. Psychological Bulletin, 128, 638-662.
102. Moyer, C., Rounds, J., & Hannum, J. (2004). A meta-analysis of massage therapy research. Psychological Bulletin, 130, 3-18.
103. Mulaik, S. A., Raju, N. S., & Harshman, R. A. (1997). There is a time and place for significance testing. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 65-115). Mahwah, NJ: Erlbaum.
104. National Research Council. (1992). Combining information: Statistical issues and opportunities for research. Washington, DC: National Academy of Science Press.
105. Newcomb, A., & Bagwell, C. (1995). Children's friendship relations: A meta-analytic review. Psychological Bulletin, 117, 306-347.
106. Normand, S. L. T. (1995). Meta-analysis software: A comparative review. American Statistician, 49, 298-309.
107. Ouellette, J., & Wood, W. (1998). Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior. Psychological Bulletin, 124, 54-74.
108. Oyserman, D., Coon, H., & Kemmelmeier, M. (2002). Rethinking individualism and collectivism: Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin, 128, 3-72.
109. Ozer, E., Best, S., Lipsey, T., & Weiss, D. (2003). Predictors of posttraumatic stress disorder and symptoms in adults: A meta-analysis. Psychological Bulletin, 129, 52-73.
110. Postmes, T., & Spears, R. (1998). Deindividuation and antinormative behavior: A meta-analysis. Psychological Bulletin, 123, 238-259.
111. Raju, N. S., Burke, M. J., Normand, J., & Langlois, G. M. (1991). A new meta-analytic approach. Journal of Applied Psychology, 76, 432-446.
112. Raudenbush, S. W. (1994). Random effects models. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 301-322). New York, NY: Russell Sage Foundation.
113. Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
114. Rhee, S., & Waldman, I. (2002). Genetic and environmental influences on antisocial behavior: A meta-analysis of twin and adoption studies. Psychological Bulletin, 128, 490-529.
115. Rind, B., Tromovitch, P., & Bauserman, R. (1998). A meta-analytic examination of assumed properties of child sexual abuse using college samples. Psychological Bulletin, 124, 22-53.
116. Rind, B., Tromovitch, P., & Bauserman, R. (2001). The validity and appropriateness of methods, analyses, and conclusions in Rind et al. (1998): A rebuttal of victimological critique from Ondersma et al. (2001) and Dallam et al. (2001). Psychological Bulletin, 127, 734-758.
117. Robbins, S., Lauver, K., Le, H., Davis, D., Langley, R., & Carlstrom, A. (2004). Do psychosocial and study skill factors predict college outcomes? A meta-analysis. Psychological Bulletin, 130, 261-288.
118. Roberts, B., & DelVecchio, W. (2000). The rank-order consistency of personality traits from childhood to old age: A quantitative review of longitudinal studies. Psychological Bulletin, 126, 3-25.
119. Rosenthal, R. (1978). Combining results of independent studies. Psychological Bulletin, 85, 185-193.
120. Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 231-244). New York, NY: Russell Sage Foundation.
121. Rossi, J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646-656.
122. Rudolph, U., & Forsterling, F. (1997). The psychological causality implicit in verbs: A review. Psychological Bulletin, 121, 192-218.
123. Sankoh, A. J., Huque, M. F., & Dubey, S. D. (1997). Some comments on frequently used multiple endpoint adjustment methods in clinical trials. Statistics in Medicine, 16, 2529-2542.
124. Schmidt, F. L., & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
125. Schmidt, F. L., & Hunter, J. E. (1997). Eight common but false objections to the discontinuation of significance testing in the analysis of research data. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 37-64). Mahwah, NJ: Erlbaum.
126. Schmidt, F. L., Oh, I., & Hayes, T. L. (2009). Fixed- versus random-effects models in metaanalysis: Model properties and an empirical comparison of differences in results. British Journal of Mathematical and Statistical Psychology, 62, 97-128.
127. Sedlmeier, P., & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
128. See, J., Howe, S., Warm, J., & Dember, W. (1995). Meta-analysis of the sensitivity decrement in vigilance. Psychological Bulletin, 117, 230-249.
129. Segerstrom, S., & Miller, G. (2004). Psychological stress and the human immune system: A meta- analytic study of 30 years of inquiry. Psychological Bulletin, 130, 601-630.
130. Shadish, W., Navarro, A., Matt, G., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin, 126, 512-529.
131. Sheeran, P., Abraham, C., & Orbell, S. (1999). Psychosocial correlates of heterosexual condom use: A meta-analysis. Psychological Bulletin, 125, 90-132.
132. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428.
133. Smith, T., McCullough, M., & Poll, J. (2003). Religiousness and depression: Evidence for a main effect and the moderating influence of stressful life events. Psychological Bulletin, 129, 614-636.
134. Sporer, S., Penrod, S., Read, D., & Cutler, B. (1995). Choosing, confidence, and accuracy: A meta- analysis of the confidence accuracy relation in eyewitness identification studies. Psychological Bulletin, 118, 315-327.
135. Stajkovic, A., & Luthans, F. (1998). Self-efficacy and work-related performance: A meta-analysis. Psychological Bulletin, 124, 240-261.
136. Stanne, M., Johnson, D., & Johnson, R. (1999). Does competition enhance or inhibit motor performance: A meta-analysis. Psychological Bulletin, 125, 133-154.
137. Stanton, M., & Shadish, W. (1997). Outcome, attrition, and family-couples treatment for drug abuse: A meta-analysis and review of the controlled, comparative studies. Psychological Bulletin, 122,170-191.
138. Steidl, R. J., Hayes, J. P., & Schauber, E. (1997). Statistical power analysis in wildlife research. Journal of Wildlife Management, 61, 270-279.
139. Stice, E. (2002). Risk and maintenance factors for eating pathology: A meta-analytic review. Psychological Bulletin, 128, 825-848.
140. Stice, E., & Shaw, H. (2004). Eating disorder prevention programs: A meta-analytic review. Psychological Bulletin, 130, 206-227.
141. Storm, L., & Ertel, S. (2001). Does psi exist? Comments on Milton and Wiseman's (1999) meta- analysis of Ganzfield research. Psychological Bulletin, 127, 424-433.
142. Symons, C., & Johnson, B. (1997). The self-reference effect in memory: A meta-analysis. Psycho- logical Bulletin, 121, 371-394.
143. Taylor, D. J., & Muller, K. E. (1996). Bias in linear model power and sample size calculation due to estimating noncentrality. Communication in Statistics: Theory & Methods, 25, 1595-1610.
144. Thompson, L., & Hrebec, D. (1996). Lose-lose agreements in interdependent decision making. Psychological Bulletin, 120, 396-409.
145. Thoresen, C., Kaplan, S., Barsky, A., Warren, C., & de Chermont, K. (2003). The affective under- pinnings of job perceptions and attitudes: A meta-analytic review and integration. Psychological Bulletin, 129, 914-945.
146. Turkheimer, E., & Waldron, M. (2000). Nonshared environment: A theoretical, methodological, and quantitative review. Psychological Bulletin, 126, 78-108.
147. Twenge, J., & Crocker, J. (2002). Race and self-esteem: Meta-analyses comparing Whites, Blacks, Hispanics, Asians, and American Indians and comment on Gray-Little and Hafdahl (2000). Psychological Bulletin, 128, 371-408.
148. Uchino, B., Cacioppo, J., & Kiecolt-Glaser, J. (1996). The relationship between social support and physiological processes: A review with emphasis on underlying mechanisms and implications for health. Psychological Bulletin, 119, 488-531.
149. Van den Noortgate, W., & Onghena, P. (2003). Multilevel meta-analysis: A comparison with traditional meta-analytical procedures. Educational and Psychological Measurement, 63, 765-790.
150. van IJzendoorn, M. (1995). Adult attachment representations, parental responsiveness, and infant attachment: A meta-analysis on the predictive validity of the adult attachment interview. Psychological Bulletin, 117, 387-403.
151. van IJzendoorn, M., Juffer, F., & Poelhuis, C. (2005). Adoption and cognitive development: A meta-analytic comparison of adopted and nonadopted children's IQ and school performance. Psychological Bulletin, 131, 301-316.
152. Verhaeghen, P., & Salthouse, T. (1997). Meta-analyses of age-cognition relations in adulthood: Estimates of linear and nonlinear age effects and structural models. Psychological Bulletin, 122, 231-249.
153. Vitaliano, P., Zhang, J., & Scanlan, J. (2003). Is caregiving hazardous to one's physical health? A meta-analysis. Psychological Bulletin, 129, 946-972.
154. Voyer, D., Voyer, S., & Bryden, M. (1995). Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 250-270.
155. Wampold, B., Mondin, G., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, 'all must have prizes.' Psychological Bulletin, 122, 203-215.
156. Waschbusch, D. (2002). A meta-analytic examination of comorbid hyperactive-impulsive-attention problems and conduct problems. Psychological Bulletin, 128, 118-150.
157. Weeden, J., & Sabini, J. (2005). Physical attractiveness and health in western societies: A review. Psychological Bulletin, 131, 635-653.
158. Weisz, J., Weiss, B., Han, S., & Granger, D. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117, 450-468.
159. Whitley, B., & Kite, M. (1995). Sex differences in attitudes toward homosexuality: A comment on Oliver and Hyde (1993). Psychological Bulletin, 117, 146-154.
160. Wildschut, T., Pinter, B., Vevea, J., Insko, C., & Schopler, J. (2003). Beyond the group mind: A quantitative review of the interindividual-intergroup discontinuity effect. Psychological Bulletin, 129,698-722.
161. Wood, W., & Quinn, J. (2003). Forewarned and forearmed? Two meta-analysis syntheses of forewarnings of influence appeals. Psychological Bulletin, 129, 119-138.
162. Yirmiya, N., Erel, O., Shaked, M., & Solomonica-Levi, D. (1998). Meta-analyses comparing theory of mind abilities of individuals with autism, individuals with mental retardation, and normally developing individuals. Psychological Bulletin, 124, 283-307.