Meta-analysis of meta-analyses in communication: Comparing fixed effects and random effects analysis models

Communication Quarterly

Volumn 58, Issue 3, 2010, Pages 257-278

  Anker, Ashley E ^a   Reinhart, Amber Marie ^a   Feeley, Thomas Hugh ^a  

^a The State University of New York   (United States)

Author keywords

Fixed effects model; Meta analysis; Random effects model; Research methods

Indexed keywords

EID: 79957896094     PISSN: 01463373     EISSN: 17464102     Source Type: Journal    
DOI: 10.1080/01463373.2010.503154     Document Type: Article

References (89)

1. Allen, M., Berkowitz, S., Hunt, S., & Louden, A. (1999). A meta-analysis of the impact of forensics and communication education on critical thinking. Communication Education, 48, 18-30.
2. Allen, M., Bourhis, J., Emmers-Sommer, T., & Sahlstein, E. (1998). Reducing dating anxiety: A meta-analysis. Communication Reports, 11, 49-55.
3. Allen, M., D'Alessio, D., & Emmers-Sommer, T. M. (1999). Reactions of criminal sexual offenders to pornography: A meta-analytic summary. Communication Yearbook, 22, 139-169.
4. Allen, M., Emmers-Sommer, T. M., D'Alessio, D., Timmerman, L., Hanzal, A., & Korus, J. (2007). The connection between the physiological and psychological reactions to sexually explicitmaterials: A literature summary using meta-analysis. Communication Monographs, 74, 541-560.
5. Allen, M., Mabry, E., Mattrey, M., Bourhis, J., Titsworth, S., & Burrell, N. (2004). Evaluating the effectiveness of distance learning: A comparison using meta-analysis. Journal of Communication, 54, 402-420.
6. Allen, M., Witt, P. L., & Wheeless, L. R. (2006). The role of teacher immediacy as a motivational factor in student learning: Using meta-analysis to test a causal model. Communication Education, 55, 21-31.
7. BarNir, A. (1998). Can group- and issue-related factors predict choice shift? A meta-analysis of group decisions on life dilemmas. Small Group Research, 29, 308-338.
8. Beatty, M. J., Heisel, A. D., Hall, A. E., Levine, T. R., & La France, B. H. (2002). What can we learn from the study of twins about genetic and environmental influences on interpersonal affiliation, aggressiveness, and social anxiety? A meta-analytic study. Communication Monographs, 69, 1-18.
9. Becker, B. J. (1996). The generalizability of empirical research results. In C. P. Benbow & D. Lubinski (Eds.), Intellectual talent: Psychological and social issues (pp. 363-383). altimore, MD: Johns Hopkins University Press.
10. Benoit, W. L., Hansen, G. J., & Verser, R. M. (2003). A meta-analysis of the effects of viewing U.S. presidential debates. Communication Monographs, 70, 335-350.
11. Borenstein, M., Hedges, L., & Rothstein, H. (2007). Meta-analysis: Fixed effects vs. random effects [Online White Paper]. Retrieved May 22, 2008, from www.meta-analysis.com and http://www.sciencedownload.net/demodownload/Fixed%20effect%20vs.%20random%20effects.pdf
12. Boster, F. J. (2002). On making progess in communication science. Human Communication Research, 28, 473-490.
13. Bourhis, J., & Allen, M. (1998). The role of videotaped feedback in the instruction of public speaking: A quantitative synthesis of published empirical research. Communication Research Reports, 15, 256-261.
14. Bowers, C. A., Pharmer, J. A., & Salas, E. (2000). When member homogeneity is needed in work teams: A meta-analysis. Small Group Research, 31, 305-327.
15. Buck, R., & VanLear, A. (2002). Verbal and nonverbal communication: Distinguishing symbolic, spontaneous, and pseudo-spontaneous nonverbal behavior. Journal of Communication, 52, 522-541.
16. Casey, M. K., Allen, M., Emmers-Sommer, T., Sahlstein, E., Degooyer, D., Winter, A. M., et al. (2003). When a celebrity contracts a disease: The example of Earvin "Magic" Johnson's announcement that was HIV positive. Journal of Health Communication, 8, 249-265.
17. Chiaburu, D. S., & Harrison, D. A. (2008). Do peers make the place? Conceptual synthesis and meta-analysis of coworker effects of perceptions, attitudes, OCBs, and performance. Journal of Applied Psychology, 93, 1082-1103.
18. Cooper, E., & Allen, M. (1998). A meta-analytic examination of the impact of student race on classroom interaction. Communication Research Reports, 15, 151-161.
19. Cooper, H. (1989). Integrating research: A guide for literature reviews (2nd ed.). Newbury Park, CA: Sage.
20. Cooper, H. (1997). Some finer points in meta-analysis. In M. Hunt (Ed.), How science takes stock: The story of meta-analysis (pp. 169-181). New York: Russell Sage Foundation.
21. D'Alessio, D., & Allen, M. (2000). Media bias in presidential elections: A meta-analysis. Journal of Communication, 50, 133-156.
22. Devine, D. J., & Philips, J. L. (2001). Do smarter teams do better? A meta-analysis of cognitive ability and team performance. Small Group Research, 32, 507-532.
23. Dillard, J. P., Weber, K. M., & Vail, R. G. (2007). The relationship between the perceived and actual effectiveness of persuasive messages: A meta-analysis with implications for formative campaign research. Journal of Communication, 57, 613-631.
24. Emmers-Sommer, T. M., & Allen, M. (1999a). Surveying the effects of media effects: A meta-analytic summary of the media effects research in Human Communication Research. Human Communication Research, 25, 478-497.
25. Emmers-Sommer, T. M., & Allen, M. (1999b). Variables related to sexual coercion: A path model. Journal of Social and Personal Relationships, 16, 659-678.
26. Emmers-Sommer, T. M., Allen, M., Bourhis, J., Sahlstein, E., Laskowski, K., Falato, W. L., et al. (2004). A meta-analysis of the relationship between social skills and sexual offenders. Communication Reports, 17, 1-7.
27. Feeley, T. H. (2008). A bibliometric analysis of communication journals from 2002 to 2005. Human Communication Research, 34, 505-520.
28. Field, A. P. (2001). Meta-analysis of correlation coefficients: A Monte Carlo comparison of fixedand random-effects methods. Psychological Methods, 6, 161-180.
29. Field, A. P. (2003). The problems in using fixed-effects models of meta-analysis on real-world data. Understanding Statistics, 2, 105-124.
30. Frank, M. G., & Feeley, T. H. (2003). To catch a liar: Challenges for research in lie detection training. Journal of Applied Communication Research, 31(3), 58-75.
31. Hall, S. M., & Brannick, M. T. (2002). Comparison of two random-effects methods of meta-analysis. Journal of Applied Psychology, 87, 377-389.
32. Hansen, G. J., & Benoit, W. L. (2007). Communication forms as predictors of issue knowledge in presidential campaigns: A meta-analytic assessment. Mass Communication & Society, 10, 189-210.
33. Hedges, L. V. (1992). Meta-analysis. Journal of Educational Statistics, 17, 279-296.
34. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic.
35. Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
36. Hetsroni, A. (2007a). Four decades of violent content on prime-time network programming: A longitudinal meta-analytic review. Journal of Communication, 57, 759-784.
37. Hetsroni, A. (2007b). Three decades of sexual content on prime-time network programming: A longitudinal meta-analytic review. Journal of Communication, 57, 318-348.
38. Hoffner, C. A., & Levine, K. J. (2005). Enjoyment of mediated fright and violence: A meta-analysis. Media Psychology, 7, 207-237.
39. Hogben, M. (1998). Factors moderating the effect of televised aggression on viewer behavior. Communication Research, 25, 220-247.
40. Holmstrom, A. J. (2004). The effects of the media on body image: A meta-analysis. Journal of Broadcasting & Electronic Media, 48, 196-217.
41. Hullett, C. R. (2005). The impact of mood on persuasion: A meta-analysis. Communication Research, 32, 423-442.
42. Hunter, J. E., & Schmidt, F. E. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
43. Hunter, J. E., & Schmidt, F. E. (1994). Correcting for sources of artificial variation across studies. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 323-338). New York: Russell Sage Foundation.
44. Hunter, J. E., & Schmidt, F. E. (1996). Cumulative research knowledge and social policy formulation: The critical role of meta-analysis. Psychology, Public Policy, and Law, 2, 324-347.
45. Hunter, J. E., & Schmidt, F. L. (2000). Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment, 8, 275-292.
46. Hunter, J. E., & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings. Thousand Oaks, CA: Sage.
47. Hunter, J. E., Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage.
48. Johnson, B. T., Mullen, B., & Salas, E. (1995). Comparison of three major meta-analytic approaches. Journal of Applied Psychology, 80, 94-106.
49. La France, B. H., Heisel, A. D., & Beatty, M. J. (2004). Is there empirical evidence for a nonverbal profile of extraversion?: A meta-analysis and critique of the literature. Communication Monographs, 71, 28-48.
50. Latham, G. P., Erez, M., & Locke, E. A. (1988). Resolving scientific disputes by the joint design of crucial experiments by the antagonists: Application to the Erez-Latham dispute regarding participation in goal setting. Journal of Applied Psychology, 73, 753-772.
51. Levine, T. R., Anders, L. N., Banas, J., Baum, K. L., Endo, K., Hu, A. D. S., et al. (2000). Norms, expectations, and deception: A norm violation model of veracity judgments. Communication Monographs, 67, 123-137.
52. Levine, T. R., Bresnahan, M., Park, H. S., Lapinski, M. K., Wittenbaum, G. M., Shearman, S. M., et al. (2003). Self-construal scales lack validity. Human Communication Research, 29, 210-252.
53. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Newbury Park, CA: Sage.
54. Machill, M., Beiler, M., & Fischer, C. (2006). Europe-topics in Europe's media: The debate about the European public sphere: A meta-analysis of media content analyses. European Journal of Communication, 21, 57-88.
55. Mares, M., & Woodard, E. (2005). Positive effects of television on children's social interactions: A meta-analysis. Media Psychology, 7, 301-322.
56. Mast, M. S. (2002). Dominance expressed and inferred through speaking time: A meta-analysis. Human Communication Research, 28, 420-450.
57. Mattson, M., Allen, M., Ryan, D. J., & Miller, V. (2000). Considering organizations as a unique interpersonal context for deception detection: A meta-analytic review. Communication Research Reports, 17, 148-160.
58. Noar, S. M., Carlyle, K., & Cole, C. (2006). Why communication is crucial: Meta-analysis of the relationship between safer sexual communication and condom use. Journal of Health Communication, 11, 365-390.
59. Novak, J. M., Markey, V., & Allen, M. (2007). Evaluating cognitive outcomes of service learning in higher education: A meta-analysis. Communication Research Reports, 24, 149-157.
60. O'Keefe, D. J. (1999). How to handle opposing arguments in persuasive messages: A meta-analytic review of the effects of one-sided and two-sidedmessages. Communication Yearbook, 22, 209-249.
61. O'Keefe, D. J. (2000). Guilt and social influence. Communication Yearbook, 23, 67-101.
62. O'Keefe, D. J., & Hale, S. L. (1998). The door-in-the-face influence strategy: A random-effects meta-analytic review. Communication Yearbook, 21, 1-33.
63. O'Keefe, D. J., & Hale, S. L. (2001). An odds-ratio based meta-analysis of research on the door-inthe-face influence strategy. Communication Reports, 14, 31-38.
64. O'Keefe, D. J., & Jensen, J. D. (2006). The advantages of compliance or the disadvantages of noncompliance? A meta-analytic review of the relative persuasive effectiveness of gain-framed and loss-framed messages. Communication Yearbook, 30, 1-43.
65. O'Keefe, D. J., & Jensen, J. D. (2007). The relative persuasiveness of gain-framed loss-framed messages for encouraging disease prevention behaviors: A meta-analytic review. Journal of Health Communication, 12, 623-644.
66. Orlitzsky, M., & Hirokawa, R. Y. (2001). To err is human, to correct for it divine: A meta-analysis of research testing the functional theory of group decision-making effectiveness. Small Group Research, 32, 313-341.
67. Overton, R. C. (1998). A comparison of fixed effects and mixed (random effects) models for meta-analysis tests of moderator variable effects. Psychological Methods, 3, 354-379.
68. Paul, B., Salwen, M. B., & Dupagne, M. (2000). The third-person effect: A meta-analysis of the perceptual hypothesis. Mass Communication & Society, 3, 57-85.
69. Rains, S. A. (2005). Leveling the organizational playing field-virtually: A meta-analysis of experimental research assessing the impact of group support system use on member influence behaviors. Communication Research, 32, 193-234.
70. Riggio, H. R., & Riggio, R. E. (2002). Emotional expressiveness, extraversion, and neuroticism: A meta-analysis. Journal of Nonverbal Behavior, 26, 195-218.
71. Rosenthal, R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
72. Rosenthal, R. (1995). Writing meta-analytic reviews. Psychological Bulletin, 118, 183-192.
73. Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (2000). Contrasts and effect sizes in behavioral research. Cambridge, England: Cambridge University Press.
74. Rosenthal, R., & Rubin, D. (1978). Interpersonal expectancy effects: The first 345 studies. Behavior and Brain Sciences, 3, 377-415.
75. Sagie, A., & Koslowsky, M. (1993). Detecting moderators with meta-analysis: An evaluation and comparison of techniques. Personnel Psychology, 46, 629-640.
76. Salas, E., Nichols, D. R., & Driskell, J. E. (2007). Testing three team training strategies in intact teams: A meta-analysis. Small Group Research, 38, 471-488.
77. Schmidt, F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173-1181.
78. Schmidt, F. L., Oh, I. S., & Hayes, T. L. (2009). Fixed- versus random-effects models in meta-analysis: Model properties and an empirical comparison of differences in results. British Journal of Mathematical and Statistical Psychology, 62, 97-128.
79. Sheehan, K. B. (2001). E-mail survey response rates: A review. Journal of Computer-Mediated Communication, 6. Available at http://www.jcmc.indiana.edu/vol6/issue2/sheehan.html
80. Sherry, J. L. (2001). The effects of violent video games on aggression. Human Communication Research, 27, 409-431.
81. Snyder, L. B., Hamilton, M. A., Mitchell, E. W., Kiwanuka-Tondo, J., Fleming-Milici, F., & Proctor, D. (2004). A meta-analysis of the effect of mediated health communication campaigns on behavior change in the United States. Journal of Health Communication, 9, 71-96.
82. Sopory, P., & Dillard, J. P. (2002). The persuasive effects of metaphor: A meta-analysis. Human Communication Research, 28, 382-419.
83. Stephen, T., & Geel, R. (2007). Normative publication productivity of communication scholars at selected career milestones. Human Communication Research, 33, 103-118.
84. Strom, R. E., & Boster, F. J. (2007). Dropping out of high school: A meta-analysis assessing the effect of messages in the home and in school. Communication Education, 56, 433-452.
85. Sun, Y., Pan, Z., & Shen, L. (2008). Understanding the third-person perception: Evidence from a meta-analysis. Journal of Communication, 58, 280-300.
86. Timmerman, C. E., & Kruepke, K. A. (2006). Computer-assisted instruction, media richness, and college student performance. Communication Education, 55, 73-104.
87. Van den Hooff, B., Groot, J., & de Jonge, S. (2005). Situational influences on the use of communication technologies: A meta-analysis and exploratory study. Journal of Business Communication, 41(2), 4-27.
88. Whitener, E. M. (1990). Confusion of confidence intervals and credibility intervals in meta-analysis. Journal of Applied Psychology, 75, 315-321.
89. Witt, P. L., Wheeless, L. R., & Allen, M. (2004). A meta-analytical review of the relationship between teacher immediacy and student learning. Communication Monographs, 71, 184-207.