Concerns about drawing causal inferences from meta-analyses: An example in the study of gender differences in aggression

Psychological Bulletin

Volumn 119, Issue 3, 1996, Pages 410-421

  Knight, George P ^a   Fabes, Richard A ^a   Higgins, Dane A ^a  

^a ARIZONA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGGRESSION; ARTICLE; HUMAN; META ANALYSIS; PSYCHOLOGICAL ASPECT; SEXUAL DEVELOPMENT;

AGGRESSION; HUMANS; META-ANALYSIS; SEX CHARACTERISTICS;

EID: 0030138841     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/0033-2909.119.3.410     Document Type: Article

References (142)

1. Abramovitch, R., Corter, C, & Lando, B. (1979). Sibling interaction in the home. Child Development, 50. 997-1003.
2. Arms, R. L., Russell, G. W., & Sandilands, M. L. (1979). Effects on the hostility of spectators of viewing aggressive sports. Social Psychology Quarterly, 42, 275-279.
3. Bakker, C. B., Bakker-Rabdau, M. K., & Breit, S. (1978). The measurement of assertiveness and aggressiveness. Journal of Personality Assessment, 42, 277-284.
4. Bandura, A., Grusec, J. E., & Menlove, F. L. (1966). Observational learning as a function of symbolization and incentive set. Child Development. 37, 499-506.
5. Bankart, C. P., & Anderson, C. C. (1979). Short-term effects of prosocial television viewing on play on pre-school boys and girls. Psychological Reports, 44, 935-941.
6. Barclay, A. M. (1970). The effect of female aggressiveness on aggressive and sexual fantasies. Journal of Protective Techniques and Personality Assessment, 34, 19-26.
7. Barrett, D. E. (1979). A naturalistic study of sex differences in children's aggression. Merrill-Palmer Quarterly, 25, 193-203.
8. Basow, S. A. (1992). Gender stereotypes and roles. Pacific Grove, CA: Brooks/Cole.
9. Baumrind, D. (1971). Current pattern of parental authority. Developmental Psychology Monographs, 4(2, No. 1).
10. Baumrind, D., & Black, A. E. (1967). Socialization practices associated with dimensions of competence in preschool boys and girls. Child Development, 38, 291-327.
11. Becker, B. J., & Hedges, L. V. (1984). Meta-analysis of cognitive gender differences: A comment on an analysis by Rosenthal and Rubin. Journal of Educational Psychology, 76. 583-587.
12. Becker, B. J., & Schram, C. M. (1994). Examining explanatory models through research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 357-382). New \brk: Russell Sage Foundation.
13. Brissett, M., & Nowicki, S., Jr. (1973). Internal versus external control of reinforcement and reaction to frustration. Journal of Personality and Social Psychology, 25, 35-44.
14. Brody, L. R. (1985). Gender differences in emotional development: A review of theories and research. Journal of Personality, 53, 102-149.
15. Bullock, D., & Merrill, L. (1980). The impact of personal preference on consistency through time: The case of childhood aggression. Child Development, 51,808-814.
16. Buss, A. H. (1966). Instrumentality of aggression, feedback, and frustration as determinants of physical aggression. Journal of Personality and Social Psychology, 3, 153-162.
17. Cohn, L. D. (1991). Sex differences in the course of personality development: A meta-analysis. Psychological Bulletin, 109, 252-266.
18. Cook, T. D. (1991). Meta-analysis: Its potential for causal description and causal explanation within program evaluation. In G. Albrecht & H.-U. Otto (Eds.), Social prevention and the social sciences: Theoretical controversies, research problems, and evaluation strategies (pp. 245-286). New York: Walter de Gruyter.
19. Cook, T. D., Cooper, H., Cordray, D. S., Hartmann, H., Hedges, L. V., Light, R. J., Louis, T. A., & Mosteller, F. (1992). Mela-analysis for explanation: A casebook. New York: Russell Sage Foundation.
20. Cooper, H. & Hedges, L. V. (1994). Potentials and limitations of research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 521-530). New York: Russell Sage Foundation.
21. Grain, W. C., & Smoke, L. (1981). Rorschach aggressive content in normal and problematic children. Journal of Personality Assessment. 45, 2-4.
22. Crowther, J. H., Bond, L. A., & Rolf, J. E. (1981). The incidence, prevalence, and severity of behavior disorders among preschool-aged children in day care. Journal of Abnormal Child Psychology, 9, 23-42.
23. Deaux, K. K. (1971). Honking at the intersection: A replication and extension. Journal of Social Psychology, 84, 159-160.
24. Deluty, R. H. (1979). Children's Action Tendency Scale: A self-report measure of aggressiveness, assertiveness, and submissiveness in children. Journal of Consulting and Clinical Psychology, 47, 1061-1071.
25. Department of Justice, Federal Bureau of Investigation. (1964-1991). Uniform Crime Reports for the United States. Washington, DC: Author.
26. DiPietro, J. A. (1981). Rough and tumble play: A function of gender. Developmental Psychology, 17, 50-58.
27. Ditrichs, R., Simons, S., & Greene, B. (1967). Effect of vicarious scheduling on the verbal conditioning of hostility in children. Journal of Personality and Social Psychology, 6, 71-78.
28. Doob, A. N., & Gross, A. E. (1968). Status of frustrator as an inhibitor of horn-honking responses. Journal of Social Psychology, 76, 213-218.
29. Doolittle, J. C. (1980). Immunizing children against possible anti social effects of viewing television violence: A curricular intervention. Perceptual and Motor Skills, 51, 498.
30. Eagly, A. H., &Carli, L. L. (1981). Sex of researchers and sex-typed communications as determinants of sex differences in influenceability: A meta-analysis of social influence studies. Psychological Bulletin, 90, 1-20.
31. Eagly, A. H., & Crowley, M. (1986). Gender and helping behavior: A meta-analytic review of the social psychological literature. Psychological Bulletin, 100, 283-308.
32. Eagly, A. H., & Johnson, B. T. (1990). Gender and leadership style: A meta-analysis. Psychological Bulletin, 108, 233-256.
33. Eagly, A. H., & Karau, S. J. (1991). Gender and the emergence of leaders: A meta-analysis. Journal of Personality and Social Psychology, 60,685-710.
34. Eagly, A. H., & Steffen, V. J. (1986). Gender and aggressive behavior A meta-analytic review of the social psychological literature. Psychological Bulletin, 100, 309-330.
35. Eagly, A. H., & Wood, W. (1991). Explaining sex differences in social behavior: A meta-analytic perspective. Personality and Social Psychology Bulletin, 17, 306-315.
36. Eaton, W. O., & Enns, L. R. (1986). Sex differences in human motor activity level. Psychological Bulletin, 100, 19-28.
37. Eisenberg, G. J. (1980). Children and aggression after observed film aggression with sanctioning adults. Annals of the New York Academy of Sciences, 347. 304-318.
38. Eisenberg, N., & Lennon, R. (1983). Sex differences in empathy and related capacities. Psychological Bulletin, 94, 100-131.
39. Ellis, L. (1990). Universal behavioral and demographic correlates of criminal behavior: Toward common ground in the assessment of criminological theories. In L. Ellis & H. Hoffman (Eds.), Crime in biological, social, and moral contexts (pp. 36-49). New \brlc: Praeger Press.
40. Ellis, L., & Coontz, P. D. (1990). Androgens, brain functioning, and criminality: The neurohormonal foundations of antisociality. In L. Ellis & H. Hoffman (Eds.), Crime in biological, social, and moral contexts (pp. 162-193). New York: Praeger Press.
41. Epstein, R. (1965). Authoritarianism, displaced aggression, and social status of the target. Journal of Personality and Social Psychology, 2, 585-589.
42. Eysenck, H. J. (1952). The effects of psychotherapy: An evaluation. Journal of Consulting Psychology, 16, 319-324.
43. Fagot, B. I., & Patterson, G. R. (1969). An in vivo analysis of reinforcing contingencies for sex-role behaviors in the preschool child. Developmental Psychology, 1, 563-568.
44. Feingold, A. (1988). Cognitive gender differences are disappearing. American Psychologist, 43, 95-103.
45. Feingold, A. (1994). Gender differences in personality: A meta-analysis. Psychological Bulletin, 116,429-456.
46. Ferguson, L. R., & Maccoby, E. E. (1966). Interpersonal correlates of differential abilities. Child Development, 37, 549-571.
47. Feshbach, N. D. (1969). Sex differences in children's modes of aggressive responses toward outsiders. Merrill-Palmer Quarterly, 15, 249-258.
48. Finchum, K. G., & Freitag, C. B. (1979). Achievement, aggression, and perceived adult age stages. Journal of Psychology, 102, 179-184.
49. Forman, S. G. (1980). Self-statements of aggressive and nonaggressive children. Child Behavior Therapy, 2, 49-57.
50. Franzini, L. R., Litrownik, A. J., & Blanchard, F. H. (1978). Modeling of sex-typed behaviors: Effects on boys and girls. Developmental Psychology, 14, 313-314.
51. French, L. A., & Wailes, S. N. (1980). Regional comparisons of suicidal aggression. Corrective & Social Psychiatry Journal of Behavior Technology, Methods, & Therapy, 26, 180-192.
52. Frodi, A., Macaulay, J., & Thome, P. R. (1977). Are women always less aggressive than men? A review of the experimental literature. Psychological Bulletin, 84, 634-660.
53. Geary, D. C. (1989). A model for representing gender differences in the pattern of cognitive abilities. American Psychologist, 44,1155-1156.
54. Golombok, S., & Fivush, R. (1994). Gender development. Cambridge, England: Cambridge University Press.
55. Green, E. H. (1933). Friendships and quarrels among preschool children. Child Development, 4, 236-252.
56. Greenhouse, J. B., & Lyengar, S. (1994). Sensitivity analysis and diagnostics. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 383-398). New York: Russell Sage Foundation.
57. Grusec, J. E. (1972). Demand characteristics of the modeling experiment: Altruism as a function of age and aggression. Journal of Personality and Social Psychology, 22, 139-148.
58. Grusec, J. E. (1973). Effects of co-observer evaluations on imitation: A developmental study. Developmental Psychology, 8,141.
59. Hall, J. A. (1978). Gender effects in decoding nonverbal cues. Psychological Bulletin, 85, 845-857.
60. Halpern, D. F. (1989). The disappearance of cognitive gender differences: What you see depends on where you look. American Psychologist, 44. 1156-1158.
61. Hapkiewicz, W. G., & Roden, A. H. (1971). The effect of aggressive cartoons on children's interpersonal play. Child Development, 42, 1583-1585.
62. Harden, R. R., & Jacob, S. H. (1978). Relationship between aggression of preschoolers and teachers' sex. Psychological Reports, 43, 1172-1174.
63. Harmatz, M. G. (1967). Verbal conditioning and change on personality measures. Journal of Personality and Social Psychology, 5, 175-185.
64. Hedges, L. V., &Olkin, I. (1985). Statistical methodsfor meta-analysis. New \brk: Academic Press.
65. Hicks, D. J. (1968). Effects of co-observer's sanctions and adult presence on imitative aggression. Child Development, 39, 303-309.
66. Hoppe, C. M. (1979). Interpersonal aggression as a function of subject's sex role identification, opponent's sex, and degree of provocation. Journal of Personality, 47, 317-329.
67. Huesmann, L. R., Lefkowitz, M. M., & Eron, L. D. (1978). Sum of MMPI Scales F, 4, and 9 as a measure of aggression. Journal of Consulting and Clinical Psychology, 46, 1071-1078.
68. Hyde, J. S. (1984). How large are gender differences in aggression? A developmental meta-analysis. Developmental Psychology, 20, 722-736.
69. Hyde, J. S. (1986). Gender differences in aggression. In J. S. Hyde & M. C. Linn (Eds.), The psychology of gender: Advances through metaanalysis (pp. 51-66). Baltimore, MD: Johns Hopkins University Press.
70. Hyde, J. S. (1990). Meta-analysis and the psychology of gender differences. Signs, 16, 55-73.
71. Hyde, J. S., Fennema, E., & Lamon, S. J. (1990). Gender differences in mathematics performance: A meta-analysis. Psychological Bulletin, 107, 139-155.
72. Hyde, J. S., & Linn, M. C. (1986). The psychology of gender: Advances through meta-analysis. Baltimore, MD: Johns Hopkins University Press.
73. Hyde, J. S., & Linn, M. C. (1988). Gender differences in verbal ability: A meta-analysis. Psychological Bulletin, 104. 53-69.
74. Hyde, J. S., & Schuck, J. R. (1977, August). The development of sex differences in aggression: A revised model. Paper presented at the 85th Annual Convention of the American Psychological Association, San Francisco, CA.
75. Hynan, M., Harper, S., Wood, C., & Kallas, C. (1980). Parametric effects of blocking and winning in a competition paradigm of human aggression. Bulletin of the Psychonomic Society, 16, 295-298.
76. Jacklin, C. N., & Maccoby, E. E. (1979, March). Peer interaction in boys and girls. Pupa presented at the biennial meeting of the Society for Research in Child Development, San Francisco, CA.
77. Jersild, A. T, & Markey, F. V. (1935). Conflicts between preschool children. Child Development Monographs (No. 21).
78. Johnson, B. T. (1993). DSTAT1.10: Software for the meta-analytic review of research literatures [Software and manual]. Hillsdale, NJ: Erlbaum.
79. Johnson, S. D. (1980). Reverse discrimination and aggressive behavior. Journal of Psychology, 104, 11-19.
80. Klesges, R. C., McGinley, H., Jurkovic, G. J., & Morgan, T. J. (1979). The predictive validity of typical and maximal personality measures in self-reports and peer reports. Bulletin of the Psychonomic Society, 13, 401-404.
81. Langlois, J. H., & Downs, A. C. (1979). Peer relations as a function of physical attractiveness: The eye of the beholder or behavioral reality? Child Development, 50, 409-418.
82. Larsen, K. S., Cdeman, D., Forbes, J., & Johnson, R. (1972). Is the subject's personality or the experimental situation a better prediction of a subject's willingness to administer shock to a victim? Journal of Personality and Social Psychology, 22,287-295.
83. Laventure, R. O. (1978). The relationship between attitudes towards women and perceptions of aggression and resultant aggressive behavior. Dissertation Abstracts International, 38 (10), 6015A.
84. Lefkowitz, M. M., Huesmann, L. R., & Eron, L. D. (1978). Parental punishment: A longitudinal analysis of effects. Archives of General Psychiatry, 35, 186-191.
85. Leventhal, D. B., Shemberg, K. M., & Van Schoelandt, S. K. (1968). Effects of sex-role adjustment upon the expression of aggression. Journal of Personality and Social Psychology, 8. 393-396.
86. Liebert, R. M., & Baron, R. A. (1972). Some immediate effects of televised violence on children's behavior. Developmental Psychology, 6, 469-475.
87. Lightdale, J. R., & Prentice, D. A. (1994). Rethinking sex differences in aggression: Aggressive behavior in the absence of social roles. Personality and Social Psychology Bulletin, 20, 34-44.
88. Linn, M. C., & Petersen, A. C. (1985). Emergence and characterization of sex differences in spatial ability: A meta-analysis. Child Development, 56, 1479-1498.
89. Lipsey, M. W., & Wilson, D. B. (1993). The efficacy of psychological, educational, and behavioral treatments: Confirmation with metaanalysis. American Psychologist, 48, 1181-1209.
90. Luborsky, L., Singer, B., & Luborsky, L. (1975). Comparative studies of psychotheravies. Archives of General Psychiatry, 32, 995-1008.
91. Lytton, H. (1990). Child and parent effects in boys' conduct disorder A reinterpretation. Developmental Psychology, 26, 683-697.
92. Maccoby, E. E., & Jacklin. C. N. (1974). The psychology of sex differences. Stanford, CA: Stanford University Press.
93. Maccoby, E. E., & Jacklin, C. N. (1980). Sex differences in aggression: A rejoinder and reprise. Child Development, 51, 964-980.
94. Madsen, C. (1968). Nurturance and modeling in preschoolers. Child Development, 39, 221-236.
95. »Mallick, S. K., & McCandless, B. R. (1966). A study of catharsis of aggression. Journal of Personality and Social Psychology, 4, 591-596.
96. Mann, C. C. (1994). Can meta-analysis make policy? Science, 266, 960-962.
97. Manosevitz, M., Prentice, N. M., & Wilson, F. (1973). Individual and family correlates of imaginary companions in preschool children. Developmental Psychology. 8, 72-79.
98. 'Martin, M. F., Gelfand, D. M., & Hartmann, D. P. (1971). Effect of adult and peer observers on boys' and girls' responses to an aggressive model. Child Development, 42, 1271-1275.
99. Matt, G. E., & Cook, T. D. (1994). Threats to the validity of research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 503-520). New %rk: Russell Sage Foundation.
100. Matthews, K. A., & Angulo, J. (1980). Measurement of the Type A behavior pattern in children: Assessment of children's competitiveness, impatience-anger, and aggression. Child Development, 51,466-475.
101. McGuire, J. M. (1973). Aggression and sociometric status with preschool children. Sociometry, 36, 542-549.
102. McKee, J. P., & Leader, F. B. (1955). The relationship of socioeconomic status and aggression to the competitive behavior of preschool children. Child Development, 26,135-142.
103. Miller, N., Lee, J.-Y., & Carlson, M. (1991). The validity of inferential judgments when used in theory-testing meta-analysis. Personality and Social Psychology Bulletin, 17, 335-343.
104. Miller, N., & Pollock, V. E. (1994). Meta-analytic synthesis for theory development. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 457-484). New \fark: Russell Sage Foundation.
105. Moore, M. (1966). Aggression themes in a binocular rivalry situation. Journalof Personality and Social Psychology, 3, 685-688.
106. Mullen, B., Salsa, E., & Miller, N. (1991). Using meta-analysis to test theoretical hypotheses in social psychology. Personality and Social Psychology Bulletin. 17. 258-264.
107. Nelson, J. D., Gelfand, D. M., & Hartmann, D. P. (1969). Children's aggression following competition and exposure to an aggression model. Child Development. 40, 1085-1097.
108. Oliver, M. B., & Hyde, J. S. (1993). Gender differences in sexuality: A meta-analysis. Psychological Bulletin, 114,29-51.
109. Paolino, A. F. (1964). Sex differences in aggressive content. Journal of Protective Techniques and Personality Assessment, 28, 219-226.
110. Parton, D. A., &Geshuri, Y. (1971). Learning of aggression as a function of presence of a human model, response intensity, and target of the response. Journal of Experimental Child Psychology, 11, 491-504.
111. Pearce, J. W. (1978). Relationship of socioeconomic status and aggression in preschool children. Psychological Reports, 43, 379-382.
112. Pederson, F. A., & Bell, R. Q. (1970). Sex differences in preschool children without histories of complications in pregnancy and delivery. Developmental Psychology, 3, 10-15.
113. Penk, W. (1971). Developmental changes in idiodynamic set responses of children's word associations. Developmental Psychology, 5, 55-63.
114. Prerost, F. J. (1976). Reduction of aggression asa function of related content in humor. Psychological Reports, 38, 771-777.
115. Puleo, J. S. (1978). Acquisition of imitative aggression in children as a function of the amount of reinforcement given the model. Social Behavior & Personality, 6, 67-71.
116. Rau, M., Stover, L., & Guerney, B. G., Jr. (1970). Relationship of socioeconomic status, sex, and age to aggression of emotionally disturbed children in mothers' presence. Journal of Genetic Psychology, 776,95-100.
117. Rogers, R. W. (1980). Expressions of aggression: Aggression-inhibiting effects of anonymity to authority and threatened retaliation. Personality and Social Psychology Bulletin, 6, 315-320.
118. Rosenthal, R., & Rubin, D. B. (1982). Further meta-analytic procedures for assessing cognitive gender differences. Journal of Educational Psychology, 74,708-712.
119. Rossi, P. H., & Wright, J. D. (1984). Evaluation research: An assessment. Annual Review of Sociology, 10, 331-352.
120. Santrock, J. W. (1970). Paternal absence, sex-typing, and identification. Developmental Psychology, 2, 264-272.
121. Schuck, S. Z., Schuck, A., Hallam, E., Mancini, E, & Wells, R. (1971). Sex differences in aggressive behavior subsequent to listening to a radio broadcast of violence. Psychological Reports, 28, 931-936.
122. Sears, R. R., Rau, L., & Alpert, R. (1965). Identification and child rearing. Stanford, CA: Stanford University Press.
123. Semler, I. J., & Eron, L. D. (1967). Replication report: Relationship of aggression in third grade children to certain pupil characteristics. Psychology in the Schools, 4, 356-358.
124. Semler, I. J., Eron, L. D., Meyerson, L. J., &. Williams, J. F. (1967). Relationship of aggression in third grade children to certain pupil characteristics. Psychology in the Schools, 4, 85-88.
125. Shortell, J. R., & Biller, H. B. (1970). Aggression in children as a function of sex of subject and sex of opponent Developmental Psychology, 3, 143-144.
126. Singer, J. L., Singer, D. G., & Sherrod, L. R. (1980). A factor analytic study of preschoolers' play behavior. Academic Psychology Bulletin, 2, 143-156.
127. Slaby, R. G. (1974). Verbal regulation of aggression and altruism. In J. deWit & W. W. Hartup (Eds.), Determinants and origins of aggressive behavior. The Hague, The Netherlands: Mouton.
128. Strayer, J., & Strayer, F. F. (1978). Social aggression and power relations among preschool children. Aggressive Behavior, 4, 173-182.
129. Taylor, S. P., & Epstein, S. (1967). Aggression as a function of the interaction of the sex of the aggressor and the sex of the victim. Journal of Personality, 35,474-496.
130. Thomas, J. R., & French, K. E. (1985). Gender differences across age in motor performance: A meta-analysis. Psychological Bulletin, 98, 260-282.
131. Tieger, T. (1980). On the biological basis of sex differences in aggression. Child Development. 51. 943-963.
132. Titley, R. W., & Viney, W. (1969). Expression of aggression toward physically handicapped. Perceptual and Motor Skills, 29, 51-56.
133. Unger, R., & Crawford, M. (1992). Women and gender. Philadelphia: Temple University Press.
134. Vernon, D. T, Foley, J. M., & Schulman, J. L. (1967). Effect of mother-child separation and birth order on young children's responses to two potentially stressful experiences. Journal of Personality and Social Psychology, 5, 162-174.
135. Voyer, D., Voyer, S., & Bryden, M. P. (1995). Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 250-270.
136. Wagman, M. (1967). Sex differences in types of daydreams. Journal of Personality and Social Psychology, 7. 329-332.
137. Walker, R. N. (1967). Some temperament traits in children as viewed by their peers, their teachers, and themselves. Monographs of the Society for Research in Child Development, 32(6, Serial No. 114).
138. Wilson, J. Q., & Hernstein, R. J. (1985). Crime and human nature. New York: Simon & Schuster.
139. Wohlford, P., Santrock, J. W., Berger, S. E., & Liberman, D. (1971). Older brothers' influence on sex-typed, aggressive, and dependent behavior in father-absent children. Developmental Psychology, 4, 124-134.
140. Wolf, F. M. (1986). Meta-analysis: Quantitative methods for research synthesis. Newbury Park, CA: Sage.
141. Wood, W. (1987). Meta-analytic review of sex differences in group performance. Psychological Bulletin, 102, 53-71.
142. Youssef, Z. L. (1968). The role of race, sex, hostility, and verbal stimulus in inflicting punishment. Psychonomic Science, 12, 285-286.