Meta-analysis and the development of knowledge

Perspectives on Psychological Science

Volumn 7, Issue 1, 2012, Pages 79-92

  Chan, MeowLan Evelyn ^a   Arvey, Richard D ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

epistemology; knowledge development; meta analysis; progress of science

Indexed keywords

EID: 84855394123     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691611429355     Document Type: Article

References (121)

1. Arthur, W., Jr., Bennett, W., Jr., Edens, P. S., & Bell, S. T. (2003). Effectiveness of training in organizations: A meta-analysis of design and evaluation features. Journal of Applied Psychology, 88, 234-245. doi:10.1037/0021-9010.88.2.234
2. Baas M.,De Dreu C. K. W.,Nijstad B. A.A meta-analysis of 25 years of mood-creativity research: Hedonic tone, activation, or regulatory focus?.Psychological Bulletin. 2008;134:779-806.
3. Bauer T. N.,Green S. G.The development of leader-member exchange: A longitudinal test.Academy of Management Journal. 1996;39:1538-1567.
4. Becker, B. J. (2001). Discourse synthesis in meta-analysis. In R. G. McInnis (Ed.), Discourse synthesis, Studies in historical and contemporary social epistemology (pp. 301-321). Westport, CT: Praeger Publishers.
5. Benjamin L. T.A history of psychology: Original sources and contemporary research. Malden, MA: Blackwell Publishing; 2009:.
6. Bird A.Thomas Kuhn. Princeton, NJ: Princeton University Press; 2000:.
7. Borman, W. C., & Motowidlo, S. J. (1993). Expanding the criterion domain to include elements of contextual performance. In N. Schmitt & W. C. Borman (Eds.), Personnel selection in organizations (pp.71-98). San Francisco, CA: Jossey-Bass.
8. Brief A. P.,Motowidlo S. J.Prosocial organizational behaviors.Academy of Management Review. 1986;11:710-725.
9. Bullock R. J.,Svyantek D. J.Analyzing meta-analysis: Potential problems, an unsuccessful replication, and evaluation criteria.Journal of Applied Psychology. 1985;70:108-115.
10. Butler A. C.,Chapman J. E.,Forman E. M.,Beck A. T.The empirical status of cognitive-behavioral therapy: A review of meta-analyses.Clinical Psychology Review. 2006;26:17-31.
11. Callender J. C.,Osburn H. G.Development and test of a new model for validity generalization.Journal of Applied Psychology. 1980;65:543-558.
12. Carlson M.,Charlin V.,Miller N.Positive mood and helping behavior: A test of six hypotheses.Journal of Personality and Social Psychology. 1988;55:211-229.
13. Carlson M.,Miller N.Explanation of the relation between negative mood and helping.Psychological Bulletin. 1987;102:91-108.
14. Chow S. L.Meta-analysis of pragmatic and theoretical research: A critique.Journal of Psychology. 1987;121:259-271.
15. Cialdini R. B.,Darby B. L.,Vincent J. E.Transgression and altruism: A case for hedonism.Journal of Experimental Social Psychology. 1973;9:502-516.
16. Cialdini R. B.,Fultz J.Interpreting the negative-mood helping literature via "mega"-analysis: A contrary view.Psychological Bulletin. 1990;107:210-214.
17. Cohen J.The earth is round (p<.05).American Psychologist. 1994;49:997-1003.
18. Curran P. J.The seemingly quixotic pursuit of a cumulative psychological science: Introduction to the special issue.Psychological Methods. 2009;14:77-80.
19. Czienskowski, U. (2003). Meta-analysis: Not just research synthesis In R. Schulze, H. Holling, & D. Bohning (Eds.), Meta-analysis: New developments and applications in medical and social sciences (pp. 141-152). Cambridge, MA: Hogrefe & Huber Publishers.
20. Dalal R.A meta-analysis of the relationship between organizational citizenship behavior and counterproductive work behavior.Journal of Applied Psychology. 2005;90:1241-1255.
21. Dalton D. R.,Dalton C. M.Meta-analyses: Some very good steps toward a bit longer journey.Organizational Research Methods. 2008;11:127-147.
22. DeGeest D. S.,Schmidt F. L.The impact of research synthesis methods on industrial-organizational psychology: The road from pessimism to optimism about cumulative knowledge.Research Synthesis Methods. 2010;1:185-197.
23. DePaulo B. M.,Lindsay J. J.,Malone B. E.,Muhlenbruck L.,Charlton K.,Cooper H.Cues to deception.Psychological Bulletin. 2003;129:74-118.
24. Donovan J. J.,Radosevicb D. J.The moderating role of goal commitment on the goal difficulty-performance relationship: A meta-analytic review and critical reanalysis.Journal of Applied Psychology. 1998;83:308-315.
25. Driver-Linn E.Where is psychology going? Structural fault lines revealed by psychologists' use of Kuhn.American Psychologist. 2003;58:269-278.
26. Eden D.Replication, meta-analysis, scientific progress, and AMJ's publication policy.Academy of Management Journal. 2002;45:841-846.
27. Egger M.,Smith G. D.,Phillips A. N.Meta-analysis: Principles and procedures.British Medical Journal. 1997;315:1533-1537.
28. Egger M.,Smith G. D.,Schneider M.,Minder C.Bias in meta-analysis detected by a simple, graphical test.British Medical Journal. 1997;315:629-634.
29. Fehr R.,Gelfand M. J.,Nag M.The road to forgiveness: A meta-analytic synthesis of its situational and dispositional correlates.Psychological Bulletin. 2010;136:894-914.
30. Franke G. R.Applications of meta-analysis for marketing and public policy: A review.Journal of Public Policy & Marketing. 2001;20:186-200.
31. Fried Y.,Ferris G. R.The validity of the job characteristics model: A review and meta-analysis.Personnel Psychology. 1987;40:287-322.
32. Fuchs, A. H., & Milar, K. S. (2003). Psychology as a science. In D. K. Freedheim & I. B. Weiner (Eds.), Handbook of psychology: History of psychology (Vol. 1, pp. 1-26). Hoboken, NJ: John Wiley.
33. Garb H. N.,Florio C. M.,Grove W. M.The validity of the Rorschach and the Minnesota Multiphasic Personality Inventory: Results from meta-analyses.Psychological Science. 1998;9:402-404.
34. Gaugler B. B.,Rosenthal D. B.,Thornton G. C.,Bentson C.Meta-analysis of assessment center validity.Journal of Applied Psychology. 1987;72:493-511.
35. George J. M.,Brief A. P.Feeling good-doing good: A conceptual analysis of the mood at work-organizational spontaneity relationship.Psychological Bulletin. 1992;112:310-329.
36. Gerber J.,Wheeler L.On being rejected: A meta-analysis of experimental research on rejection.Perspectives on Psychological Science. 2009;4:468-488.
37. Gerstner C. R.,Day D. V.Meta-analytic review of leader-member exchange theory: Correlates and construct issues.Journal of Applied Psychology. 1997;82:827-844.
38. Glass G. V.Primary, secondary, and meta-analysis of research.Educational Researcher. 1976;5:3-8.
39. Glass G. V.,McGaw B.,Smith M. L.Meta-analysis in social research. Beverly Hills, CA: SAGE; 1981:.
40. Guzzo R. A.,Jackson S. E.,Katzell R. A.Meta-analysis analysis.Research in Organizational Behavior. 1987;9:407-442.
41. Hale J. L.,Dillard J. P.The uses of meta-analysis: Making knowledge claims and setting research agendas.Communication Monographs. 1991;58:463-471.
42. Hedges L. V.,Olkin I.Statistical methods for meta-analysis. Orlando, FL: Academic Press; 1985:.
43. Hock, R. R. (2005). Forty studies that changed psychology: Explorations into the history of psychological research (5th ed.). Upper Saddle River, NJ: Pearson Prentice Hall.
44. Hoyle R. H.On the relation between data and theory.American Psychologist. 1993;48:1094-1095.
45. Hoyningen-Huene P.Reconstructing scientific revolutions: Thomas S. Kuhn's philosophy of science. Chicago, IL: University of Chicago Press; 1993:.
46. Hulleman C. S.,Schrager S. M.,Bodmann S. M.,Harackiewicz J. M.A meta-analytic review of achievement goal measures: Different labels for the same constructs or different constructs with same labels?.Psychological Bulletin. 2010;136:422-449.
47. Hunt M.How science takes stock: The story of meta-analysis. New York, NY: Russell Sage Foundation; 1997:.
48. Hunter J. E.,Schmidt F. L.Cumulative research knowledge and social policy formulation: The critical role of meta-analysis.Psychology, Public Policy, and Law. 1996;2:324-347.
49. Hunter J. E.,Schmidt F. L.Methods of meta-analysis: Correcting error and bias in research findings. Thousand Oaks, CA: SAGE; 2004:.
50. Ilies R.,Nahrgang J. D.,Morgeson F. P.Leader-member exchange and citizenship behaviors: A meta-analysis.Journal of Applied Psychology. 2007;92:269-277.
51. Johnson D. W.,Maruyama G.,Johnson R.,Nelson D.,Skon L.Effects of cooperative, competitive, and individualistic goal structures on achievement: A meta-analysis.Psychological Bulletin. 1981;89:47-62.
52. Jones E. E.,Nisbett R. E.The actor and the observer: Divergent perceptions of the causes of behavior. Morristown, NJ: General Learning Press; 1971:.
53. Kendall P. C.,Maruyama G.Meta-analysis: On the road to synthesis of knowledge?.Clinical Psychology Review. 1985;5:79-89.
54. King D. B.,Viney W.,Woody W. D.A history of psychology: Ideas and context. Boston, MA: Pearson Education; 2009:.
55. Kinicki A. J.,McKee-Ryan F. M.,Schriesheim C. A.,Carson K. P.Assessing the construct validity of the Job Descriptive Index: A review and meta-analysis.Journal of Applied Psychology. 2002;87:14-32.
56. Kirsch I.Psychology's first paradigm.Journal of the History of the Behavioral Sciences. 1977;13:317-325.
57. Kuhn T. S.The structure of scientific revolutions. Chicago, IL: University of Chicago Press; 1962:.
58. Kuhn, T. S. (1970a). Reflections on my critics. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 231-278). London, England: Cambridge University Press.
59. Kuhn, T. S. (1962). The structure of scientific revolutions. Chicago, IL: University of Chicago Press.
60. Lae A.,Crano W. D.Monitoring matters: Meta-analytic review reveals the reliable linkage of parental monitoring with adolescent marijuana use.Perspectives on Psychological Science. 2009;4:578-586.
61. Popper, K. R. (1970). Normal science and its dangers. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 51-58). London, England: Cambridge University Press.
62. Rothstein, H. R. (2003). Progress is our most important product: Contributions of validity generalization and meta-analysis to the development and communication of knowledge in I/O Psychology. In K. R. Murphy (Ed.), Validity generalization: A critical review (pp. 115-154). Mahwah, NJ: Lawrence Erlbaum.
63. Laudan L.Progress and its problems: Toward a theory of scientific growth. Berkeley: University of California Press; 1977:.
64. Laudan L.Science and values: The aims of science and their role in scientific debate. Berkeley: University of California Press; 1984:.
65. Leahey, T. H. (2003). Cognition and learning. In D. K. Freedheim & I. B. Weiner (Eds.), Handbook of psychology: History of psychology (Vol. 1, pp. 109-133.). Hoboken, NJ: John Wiley.
66. Leahey T. H.A history of psychology: Main currents in psychological thought. Upper Saddle River, NJ: Pearson Education; 2004:.
67. LePine J. A.,Erez A.,Johnson D. E.The nature and dimensionality of organizational citizenship behavior: A critical review and meta-analysis.Journal of Applied Psychology. 2002;87:52-65.
68. Lepper M. R.Theory by numbers? Some concerns about meta-analysis as a theoretical tool.Applied Cognitive Psychology. 1995;9:411-422.
69. Lewin K.Principles of topological psychology. New York, NY: McGraw-Hill Book Company; 1936:.
70. Lipsey M. W.,Wilson D. B.The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.American Psychologist. 1993;48:1181-1209.
71. Malle B. F.The actor-observer asymmetry in attribution: A (surprising) meta-analysis.Psychological Bulletin. 2006;132:895-919.
72. Mandler G.Origins of the cognitive (r)evolution.Journal of the History of the Behavioral Sciences. 2002;38:339-353.
73. Maruyama G.Meta-analyses relating goal structures to achievement: Findings, controversies, and impacts.Personality and Social Psychology Bulletin. 1991;17:300-305.
74. Matt, G. E., & Cook, T. D. (2009). Threats to the validity of generalized inferences. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 537-560). New York, NY: Russell Sage Foundation.
75. Matt G. E.,Navarro A. M.What meta-analyses have and have not taught us about psychotherapy effects: A review and future directions.Clinical Psychology Review. 1997;17:1-32.
76. Miller N.,Carlson M.Valid theory-testing meta-analyses further question the negative state relief model of helping.Psychological Bulletin. 1990;107:215-225.
77. Miller N.,Pollock V. E.Use of meta-analysis for testing theory.Evaluation & The Health Professions. 1995;18:370-392.
78. Mullen B.,Muellerleile P.,Bryant B.Cumulative meta-analysis: A consideration of indicators of sufficiency and stability.Personality and Social Psychology Bulletin. 2001;27:1450-1462.
79. Murphy, K. R., & Newman, D. A. (2003). The past, present, and future of validity generalization. In K. R. Murphy (Ed.), Validity generalization: A critical review (pp. 403-424). Mahwah, NJ: Lawrence Erlbaum.
80. Organ D. W.Organizational citizenship behavior: The good soldier syndrome. Lexington, MA: Lexington Books; 1988:.
81. Pearlman K.,Schmidt F. L.,Hunter J. E.Validity generalization results for tests used to predict job proficiency and training success in clerical occupations.Journal of Applied Psychology. 1980;65:373-406.
82. Pfeffer J.Barriers to the advance of organizational science: Paradigm development as a dependent variable.Academy of Management Review. 1993;18:599-620.
83. Podsakoff N. P.,Whiting S. W.,Podsakoff P. M.,Blume B. D.Individual- and organizational-level consequences of organizational citizenship behaviors: A meta-analysis.Journal of Applied Psychology. 2009;94:122-141.
84. Podsakoff P. M.,MacKenzie S. B.,Paine J. B.,Bachrach D. G.Organizational citizenship behaviors: A critical review of the theoretical and empirical literature and suggestions for future research.Journal of Management. 2000;26:513-563.
85. Popper K. R.The logic of scientific discovery. London, England: Hutchinson & Co; 1959:.
86. Popper, K. R. (1970). Normal science and its dangers. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 51-58). London, England: Cambridge University Press
87. Raju N. S.,Burke M. J.,Normand J.,Langlois G. M.A new meta-analytic approach.Journal of Applied Psychology. 1991;76:432-446.
88. Richard F. D.,Bond C. F.,Stokes-Zoota J. J.One hundred years of social psychology quantitatively described.Review of General Psychology. 2003;7:331-363.
89. Robins R. W.,Gosling S. D.,Craik K. H.An empirical analysis of trends in psychology.American Psychologist. 1999;54:117-128.
90. Rosenthal R.Meta-analytic procedures for social research. Beverly Hills, CA: SAGE; 1984:.
91. Rosenthal R.,DiMatteo M. R.Meta-analysis: Recent developments in quantitative methods for literature reviews.Annual Review of Psychology. 2001;52:59-82.
92. Rosenthal, R., & Rosnow, R. L. (2008). Essentials of behavioral research: Methods and data analysis (3rd ed.). New York, NY: McGraw-Hill.
93. Murphy, K. R.,Newman, D. A. (2003). The past, present, and future of validity generalization. In K. R. Murphy (Ed.), Validity generalization: A critical review (pp. 403-424). Mahwah, NJ: Lawrence Erlbaum.
94. Rudolph U.,Roesch S. C.,Greitemeyer T.,Weiner B.A meta-analytic review of help giving and aggression from an attributional perspective: Contributions to a general theory of motivation.Cognition & Emotion. 2004;18:815-848.
95. Rothstein, H. R. (2003). Progress is our most important product: Contributions of validity generalization and meta-analysis to the development and communication of knowledge in I/O Psychology. In K. R. Murphy (Ed.), Validity generalization: A critical review (pp. 115-154). Mahwah, NJ: Lawrence Erlbaum.
96. Sackett P. R.,Harris M. M.,Orr J. M.On seeking moderator variables in the meta-analysis of correlational data: A Monte Carlo investigation of statistical power and resistance to Type I error.Journal of Applied Psychology. 1986;71:302-310.
97. Schmidt F. L.What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.American Psychologist. 1992;47:1173-1181.
98. Schmidt F. L.Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers.Psychological Methods. 1996;1:115-129.
99. Schmidt F. L.Detecting and correcting the lies that data tell.Perspectives on Psychological Science. 2010;5:233-242.
100. Schmidt, F. L., & Hunter, J. E. (2003). History, development, evolution, and the impact of validity generalization and meta-analysis methods, 1975-2001. In K. R. Murphy (Ed.), Validity generalization: A critical review (pp. 31-65). Mahwah, NJ: Lawrence Erlbaum.
101. Schmidt F. L.,Hunter J. E.,Pearlman K.,Hirsh H. R.,Sackett P. R.,Schmitt N.,Zedeck S.Forty questions about validity generalization and meta-analysis.Personnel Psychology. 1985;38:697-798.
102. Schmidt F. L.,Law K.,Hunter J. E.,Rothstein H. R.,Pearlman K.,McDaniel M.Refinements in validity generalization methods: Implications for the situational specificity hypothesis.Journal of Applied Psychology. 1993;78:3-12.
103. Schulze R.Meta-analysis: A comparison of approaches. Ashland, OH: Hogrefe & Huber Publishers; 2004:.
104. Secord P. F.Social psychology in search of a paradigm.Personality and Social Psychology Bulletin. 1977;3:41-50.
105. Segal E. M.,Lachman R.Complex behavior or higher mental process: Is there a paradigm shift?.American Psychologist. 1972;27:46-55.
106. Sharpe D.Of apples and oranges, file drawers and garbage: Why validity issues in meta-analysis will not go away.Clinical Psychology Review. 1997;17:881-901.
107. Slavin R. E.Meta-analysis in education: How has it been used?.Educational Researcher. 1984;13:6-15.
108. Smith M. L.,Glass G. V.Meta-analysis of psychotherapy outcome studies.American Psychologist. 1977;32:752-760.
109. Sohn D.Meta-analysis as a means of discovery.American Psychologist. 1995;50:108-110.
110. Sohn D.Meta-analysis and science.Theory & Psychology. 1996;6:229-246.
111. Stajkovic A. D.,Luthans F.Behavioral management and task performance in organizations: Conceptual background, meta-analysis, and test of alternative models.Personnel Psychology. 2003;56:155-194.
112. Steblay N. K.,Dysart J. E.,Wells G. L.Seventy-two tests of the sequential lineup superiority effect: A meta-analysis and policy discussion.Psychology, Public Policy, and Law. 2011;17:99-139.
113. Van den Bussche E.,Van den Noortgate W.,Reynvoet B.Mechanisms of masked priming: A meta-analysis.Psychological Bulletin. 2009;135:452-477.
114. Van Dyne, L., Cummings, L. L.,McLean Parks, J. (1995). Extrarole behaviors: In pursuit of construct and definitional clarity. In L. L. Cummings B. M. Staw (Eds.), Research in organizational behavior (Vol. 17, pp. 215-285). Greenwich, CT: JAI Press.
115. Wallace D. S.,Paulson R. M.,Lord C. G.,Bond C. F.Review of General Psychology. 2005:214-227.
116. Wanous J. P.,Sullivan S. E.,Malinak J.The role of judgment calls in meta-analysis.Journal of Applied Psychology. 1989;74:259-264.
117. Warren N.On Segal and Lachman.American Psychologist. 1972;27:1196-1197.
118. Watson J. B.Psychology as the behaviorist views it.Psychological Review. 1913;29:158-177.
119. Weiner B.Judgments of responsibility: A foundation for a theory of social conduct. New York: Guilford Press; 1995:.
120. Westerman R.,Spies K.,Stahl G.,Hesse F. W.Relative effectiveness and validity of mood induction procedures: A meta-analysis.European Journal of Social Psychology. 1996;26:557-580.
121. Zimmerman R. D.Understanding the impact of personality traits on individuals' turnover decisions: A meta-analytic path model.Personnel Psychology. 2008;61:309-348.