Publication Bias in the Organizational Sciences

Organizational Research Methods

Volumn 15, Issue 4, 2012, Pages 624-662

  Kepes, Sven ^a   Banks, George C ^a   McDaniel, Michael ^a   Whetzel, Deborah L ^b  

^a VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

^b HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

Author keywords

meta analysis; missing data; publication bias; quantitative research

Indexed keywords

EID: 84873868342     PISSN: 10944281     EISSN: 15527425     Source Type: Journal    
DOI: 10.1177/1094428112452760     Document Type: Review

References (126)

1. Aguinis H.,Pierce C. A.,Bosco F. A.,Dalton D. R.,Dalton C. M.Debunking myths and urban legends about meta-analysis.Organizational Research Methods. 2011;14:306-331.
2. Aguinis H.,Vandenberg R. J.Organizational research methods: Yearly update.Organizational Research Methods. 2008;11:3-5.
3. Aguinis H.,Werner S.,Abbott J. L.,Angert C.,Park J. H.,Kohlhausen D.Customer-centric science: Reporting significant research results with rigor, relevance, and practical impact in mind.Organizational Research Methods. 2010;13:515-539.
4. Publication manual of the American Psychological Association. 2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.Washington, DC: Author; 2010:.
5. Aytug Z. G.,Rothstein H. R.,Zhou W.,Kern M. C.Revealed or concealed? Transparency of procedures, decisions, and judgment calls in meta-analyses.Organizational Research Methods. 2012;15:103-133.
6. Banks G. C.,Kepes S.,Banks K. P.Publication bias: The antagonist of meta-analytic reviews and effective policy making.Educational Evaluation and Policy Analysis. 2012;:.
7. Banks G. C.,Kepes S.,McDaniel M. A.Publication bias: A call for improved meta-analytic practice in the organizational sciences.International Journal of Selection and Assessment. 2012;20:182-196.
8. Banks G. C.,McDaniel M. A.The kryptonite of evidence-based I-O psychology.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2011;4:40-44.
9. Becker B. J.The handbook of research synthesis. Cooper H.Hedges L. V., ed. New York, NY: Russell Sage Foundation; 1994:215-230.
10. Becker B. J.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:111-126.
11. Begg C. B.,Mazumdar M.Operating characteristics of a rank correlation test for publication bias.Biometrics. 1994;50:1088-1101.
12. Berk R. A.An introduction to sample selection bias in sociological data.American Sociological Review. 1983;48:386-398.
13. Berlin J. A.,Ghersi D.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:35-48.
14. Berman N.,Parker R.Meta-analysis: Neither quick nor easy.BMC Medical Research Methodology. 2002;2:10.
15. Blackwell S. C.,Thompson L.,Refuerzo J.Full publication of clinical trials presented at a national maternal-fetal medicine meeting: Is there a publication bias?.American Journal of Perinatology. 2009;26:679-682.
16. Borenstein M.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:193-220.
17. Borenstein M.,Hedges L. V.,Higgins J. P.,Rothstein H. R.Comprehensive meta-analysis. 2005). Comprehensive meta-analysis (Version 2). Englewood, NJ: Biostat.Englewood, NJ: Biostat; 2005:.
18. Borenstein M.,Hedges L. V.,Higgins J. P.,Rothstein H. R.Introduction to meta-analysis. West Sussex, UK: Wiley; 2009:.
19. Briner R. B.,Rousseau D. M.Evidence-based I-O psychology: Not there yet.Industrial and Organizational Psychology: Perspectives on Science and Practice. 2011;4:3-22.
20. Chalmers I.In the dark: Drug companies should be forced to publish all the results of clinical trials.New Scientist. 2004;181:19.
21. Chan A.-W.,Altman D. G.Identifying outcome reporting bias in randomised trials on PubMed: Review of publications and survey of authors.British Medical Journal. 2005;330 (753):.
22. Chan A.-W.,Hróbjartsson A.,Haahr M. T.,Gøtzsche P. C.,Altman D. G.Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles.Journal of the American Medical Association. 2004;291:2457-2465.
23. Chen G.,Åstebro T.How to deal with missing categorical data: Test of a simple Bayesian method.Organizational Research Methods. 2003;6:309-327.
24. Chou R.,Fu R.,Huffman L. H.,Korthuis P. T.Initial highly-active antiretroviral therapy with a protease inhibitor versus a non-nucleoside reverse transcriptase inhibitor: Discrepancies between direct and indirect meta-analyses.Lancet. 2006;368:1503-1515.
25. Cipriani A.,Furukawa T. A.,Salanti G.,Geddes J. R.,Higgins J. P.,Churchill R.,Barbui C.Comparative efficacy and acceptability of 12 new-generation antidepressants: A multiple-treatments meta-analysis.Lancet. 2009;373:746-758.
26. Cooper H.Synthesizing research: A guide for literature reviews. 1998). Synthesizing research: A guide for literature reviews (3rd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 1998:.
27. Cooper H.Editorial.Psychological Bulletin. 2003;129:3-9.
28. Cooper H.,Hedges L. V.The handbook of research synthesis and meta-analysis. 2009). Research synthesis as a scientific process. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 3-16). New York, NY: Russell Sage Foundation.Cooper H.Hedges L. V.Valentine J. C., ed. New York, NY: Russell Sage Foundation; 2009:3-16.
29. Curfman G. D.,Morrissey S.,Drazen J. M.Expression of concern reaffirmed.New England Journal of Medicine. 2006;354:1193.
30. De Angelis C.,Drazen J. M.,Frizelle F. A.,Haug C.,Hoey J.,Horton R.,Van der Weyden M. B.Clinical trial registration: A statement from the International Committee of Medical Journal Editors.New England Journal of Medicine. 2004;351:1250-1251.
31. Dickersin K.The existence of publication bias and risk factors for its occurrence.Journal of the American Medical Association. 1990;263:1385-1389.
32. Dickersin K.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:11-34.
33. Doucouliagos H.,Stanley T. D.Publication selection bias in minimum-wage research? A meta-regression analysis.British Journal of Industrial Relations. 2009;47:406-428.
34. Duval S. J.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:127-144.
35. Duval S. J.,Tweedie R. L.A nonparametric "trim and fill" method of accounting for publication bias in meta-analysis.Journal of the American Statistical Association. 2000a;95:89-98.
36. Duval S. J.,Tweedie R. L.Trim and fill: A simple funnel plot-based method of testing and adjusting for publication bias in meta-analysis.Biometrics. 2000b;56:455-463.
37. Dwan K.,Altman D. G.,Arnaiz J. A.,Bloom J.,Chan A. W.,Cronin E.,Williamson P. R.Systematic review of the empirical evidence of study publication bias and outcome reporting bias.PloS One. 2008;3:e3081.
38. Egger M.,Smith G. D.,Altman D.Systematic reviews in health care: Meta-analysis in context. London, UK: BMJ Books; 2001:.
39. Egger M.,Smith G. D.,Schneider M.,Minder C.Bias in meta-analysis detected by a simple, graphical test.British Medical Journal. 1997;315:629-634.
40. Evangelou E.,Trikalinos T. A.,Ioannidis J. P.Unavailability of online supplementary scientific information from articles published in major journals.The FASEB Journal. 2005;19:1943-1944.
41. Evans S.Statistician's comment (to misleading meta-analysis: "fail safe N" is a useful mathematical measure of the stability of results by R. Persaud).British Medical Journal. 1996;312:125.
42. Field A. P.Can meta-analysis be trusted?.The Psychologist. 2003;16:642-645.
43. Field A. P.,Gillett R.How to do a meta-analysis.British Journal of Mathematical and Statistical Psychology. 2010;63:665-694.
44. Greenwald A. G.Consequences of prejudice against the null hypothesis.Psychological Bulletin. 1975;82:1-20.
45. Harbord R. M.,Egger M.,Sterne J. A. C.A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints.Statistics in Medicine. 2006;25:3443-3457.
46. Hasenboehler E. A.,Choudhry I. K.,Newman J. T.,Smith W. R.,Ziran B. H.,Stahel P. F.Bias towards publishing positive results in orthopedic and general surgery: A patient safety issue?.Patient Safety in Surgery. 2007;1:4.
47. Heckman J.The common structure of statistical models of truncation, sample selection and limited dependent variables, and a simple estimator for such models.Annals of Economic and Social Measurement. 1976;5:475-492.
48. Hedges L. V.Modeling publication selection effects in meta-analysis.Statistical Science. 1992;7:246-255.
49. Hedges L. V.,Olkin I.Statistical methods for meta-analysis. New York, NY: Academic Press; 1985:.
50. Hedges L. V.,Vevea J. L.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A.Borenstein M., ed. West Sussex: Wiley; 2005:145-174.
51. Higgins J. P.,Green S.Cochrane handbook for systematic reviews of interventions. 2009:.
52. Higgins J. P.,Thompson S. G.,Deeks J. J.,Altman D. G.Measuring inconsistency in meta-analyses.British Medical Journal. 2003;327:557-560.
53. Hopewell S.,Clarke M.,Mallett S.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:48-72.
54. Hopewell S.,McDonald S.,Clarke M. J.,Egger M.Grey literature in meta-analyses of randomized trials of health care interventions.Cochrane Database of Systematic Reviews. 2007;18 (2):.
55. Hough L. M.Beyond multiple choice: Evaluating alternatives to traditional testing for selection. Hakel M. D., ed. Mahwah, NJ: Lawrence Erlbaum; 1998:131-166.
56. Huffcutt A. I.,Roth P. L.,Conway J. M.,Klehe U.-C.The impact of job complexity and study design on situational and behavior description interview validity.International Journal of Selection and Assessment. 2004;12:262-273.
57. Hunter J. E.,Schmidt F. L.Methods of meta-analysis: Correcting error and bias in research findings. Thousand Oaks, CA: Sage; 2004:.
58. Ioannidis J. P.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:287-302.
59. Ioannidis J. P.,Trikalinos T. A.Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials.Journal of Clinical Epidemiology. 2005;58:543-549.
60. Jick T. D.Mixing qualitative and quantitative methods: Triangulation in action.Administrative Science Quarterly. 1979;24:602-611.
61. Jonsson A.,Svingby G.The use of scoring rubrics: Reliability, validity and educational consequences.Educational Research Review. 2007;2:130-144.
62. Journal Citation Reports. 2010:.
63. Kromrey J. D.,Rendina-Gobioff G.On knowing what we do not know: An empirical comparison of methods to detect publication bias in meta-analysis.Educational and Psychological Measurement. 2006;66:357-373.
64. Laine C.,De Angelis C.,Delamothe T.,Drazen J. M.,Frizelle F. A.,Haug C.,Verheugt F.Clinical trial registration: Looking back and moving ahead.New England Journal of Medicine. 2007;356:2734-2736.
65. Lau J.,Antman E. M.Cumulative meta-analysis of therapeutic trials for myocardial infarction.New England Journal of Medicine. 1992;327:248-254.
66. Lau J.,Schmid C. H.,Chalmers T. C.Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care.Journal of Clinical Epidemiology. 1995;48:45-57.
67. Le H.,Oh I.-S.,Shaffer J.,Schmidt F. L.Implications of methodological advances for the practice of personnel selection: How practitioners benefit from meta-analysis.Academy of Management Perspectives. 2007;21:6-15.
68. Lipsey M. W.,Wilson D. B.Practical meta-analysis. Thousand Oaks, CA: Sage; 2001:.
69. Macaskill P.,Walter S. D.,Irwig L.A comparison of methods to detect publication bias in meta-analysis.Statistics in Medicine. 2001;20:641-654.
70. McDaniel M. A.Cumulative meta-analysis as a publication bias method. New Orleans, LA: Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology; 2009, April:.
71. McDaniel M. A.,Rothstein H. R.,Whetzel D. L.Publication bias: A case study of four test vendors.Personnel Psychology. 2006;59:927-953.
72. McDaniel M. A.,Whetzel D. L.,Schmidt F. L.,Maurer S. D.The validity of employment interviews: A comprehensive review and meta-analysis.Journal of Applied Psychology. 1994;79:599-616.
73. Moreno S. G.,Sutton A. J.,Ades A. E.,Stanley T. D.,Abrams K. R.,Peters J. L.,Cooper N. J.Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study.BMC Medical Research Methodology. 2009;9:2.
74. Moreno S. G.,Sutton A. J.,Turner E. H.,Abrams K. R.,Cooper N. J.,Palmer T. M.,Ades A. E.Novel methods to deal with publication biases: Secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications.British Medical Journal. 2009;339:b2981.
75. Newman D. A.Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences. Lance C. E.Vandenberg R. J., ed. New York, NY: Routledge/Taylor & Francis Group; 2009:7-36.
76. Newman D. A.,Lyon J. S.Recruitment efforts to reduce adverse impact: Targeted recruiting for personality, cognitive ability, and diversity.Journal of Applied Psychology. 2009;94:298-317.
77. Ones D. S.,Viswesvaran C.,Schmidt F. L.Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance.Journal of Applied Psychology. 1993;78:679-703.
78. Orlitzky M.How can significance tests be deinstitutionalized?.Organizational Research Methods, 15. 2012;:199-228.
79. Orwin R. G.A fail-safe N for effect size in meta-analysis.Journal of Educational Statistics. 1983;8:157-159.
80. Palmer T. M.,Peters J. L.,Sutton A. J.,Moreno S. G.Contour-enhanced funnel plots for meta-analysis.Stata Journal. 2008;8:242-254.
81. Peters J. L.,Sutton A. J.,Jones D. R.,Abrams K. R.,Rushton L.Comparison of two methods to detect publication bias in meta-analysis.Journal of the American Medical Association. 2006;295:676.
82. Peters J. L.,Sutton A. J.,Jones D. R.,Abrams K. R.,Rushton L.Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry.Journal of Clinical Epidemiology. 2008;61:991-996.
83. Peters J.,Sutton A.,Jones D. R.,Abrams K. R.,Rushton L.,Moreno S. G.Assessing publication bias in meta-analyses in the presence of between-study heterogeneity.Journal of the Royal Statistical Society (Series A). 2010;173:575-591.
84. Pigott T. D.The handbook of research synthesis and meta-analysis. 2009). Handling missing data. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 399-416). New York, NY: Russell Sage Foundation.Cooper H.Hedges L. V.Valentine J. C., ed. New York, NY: Russell Sage Foundation; 2009:399-416.
85. Ployhart R. E.,Schneider B.,Schmitt N.Staffing organizations: Contemporary practice and theory. Mahwah, NJ: Lawrence Erlbaum; 2006:.
86. Rennie D.Thyroid storm.Journal of the American Medical Association. 1997;277:1238-1243.
87. Rosenthal R.The file drawer problem and tolerance for null results.Psychological Bulletin. 1979;86:638-641.
88. Rothstein H.APA handbook of research methods in psychology: Vol. 1. Foundations, planning, measures, and psychometrics. Cooper H. M., ed. Washington, DC: American Psychological Association; 2012:.
89. Rothstein H. R.,Sutton A. J.,Borenstein M.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005a:1-7.
90. Rothstein H. R.,Sutton A. J.,Borenstein M.Publication bias in meta-analysis: Prevention, assessment, and adjustments. West Sussex, UK: Wiley; 2005b:.
91. Sackett P. R.,Larson J. R.Handbook of industrial and organizational psychology. Dunnette M. D.Hough L. M., ed. Palo Alto, CA: Consulting Psychologists Press; 1990:419-489.
92. Saul S.Experts conclude Pfizer manipulated studies.New York Times. 2008, October 8;:4.
93. Scandura T. A.,Williams E. A.Research methodology in management: Current practices, trends, and implications for future research.The Academy of Management Journal. 2000;43:1248-1264.
94. Schafer J. L.,Graham J. W.Missing data: Our view of the state of the art.Psychological Methods. 2002;7:147-177.
95. Schmidt F. L.,Hunter J. E.Validity generalization: A critical review. Murphy K. R., ed. Mahwah, NJ: Lawrence Erlbaum; 2003:31-65.
96. Schmidt F. L.,Le H.Hunter & Schmidt's meta-analysis programs. 2005). Hunter & Schmidt's meta-analysis programs(Version 1.1). Ames, IA: The University of Iowa.Ames, IA: The University of Iowa; 2005:.
97. Schmitt N.,Gooding R. Z.,Noe R. A.,Kirsch M.Meta analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics.Personnel Psychology. 1984;37:407-422.
98. Schopfel J.Observations on the future of grey literature.Grey Journal. 2006;2:67-76.
99. Schopfel J.,Prost H.Document supply of grey literature and open access: An update.Interlending and Document Supply. 2009;37:181-191.
100. Shields P. G.Publication bias is a scientific problem with adverse ethical outcomes: The case for a section for null results.Cancer Epidemiology Biomarkers and Prevention. 2000;9:771-772.
101. Simes R. J.Publication bias: The case for an international registry of clinical trials.Journal of Clinical Oncology. 1986;4:1529-1541.
102. Slavin R. E.Best-evidence synthesis: An alternative to meta-analytic and traditional reviews.Educational Researcher. 1986;15:5-11.
103. Smith G. D.,Egger M.Who benefits from medical interventions? Treating low risk patients can be a high risk strategy.British Medical Journal. 1994;308:72-74.
104. Song F.,Parekh S.,Hooper L.,Loke Y. K.,Ryder J.,Sutton A. J.,Harvey I.Dissemination and publication of research findings: An updated review of related biases.Health Technology Assessment. 2010;14:1-220.
105. Stanley T. D.Meta-regression methods for detecting and estimating empirical effect in the presence of publication selection.Oxford Bulletin of Economics and Statistics. 2008;70:103-127.
106. Steel P. D.,Kammeyer-Mueller J. D.Comparing meta-analytic moderator estimation techniques under realistic conditions.Journal of Applied Psychology. 2002;87:96-111.
107. Stern J. M.,Simes R. J.Publication bias: Evidence of delayed publication in a cohort study of clinical research projects.British Medical Journal. 1997;315:640-645.
108. Sterne J. A.,Egger M.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:99-110.
109. Sterne J. A.,Gavaghan D.,Egger M.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:75-98.
110. Sterne J. A. C.,Sutton A. J.,Ioannidis J. P.,Terrin N.,Jones D. R.,Lau J.,Higgins J. P.Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials.British Medical Journal. 2011;343:.
111. Stewart L.,Tierney J.,Burdett S.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:261-286.
112. Sutton A. J.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:175-192.
113. Sutton A. J.The handbook of research synthesis and meta-analysis. 2009). Publication bias. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 435-452). New York, NY: Russell Sage Foundation.Cooper H.Hedges L. V.Valentine J. C., ed. New York, NY: Russell Sage Foundation; 2009:435-452.
114. Sutton A. J.,Abrams K. R.,Jones D. R.,Sheldon T. A.,Song F.Methods for meta-analysis in medical research. West Sussex, UK: Wiley; 2000:.
115. Sutton A. J.,Pigott T. D.Publication bias in meta analysis: Prevention, assessment, and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:223-240.
116. Terrin N.,Schmid C. H.,Lau J.,Olkin I.Adjusting for publication bias in the presence of heterogeneity.Statistics in Medicine. 2003;22:2113-2126.
117. Thompson S. G.,Pocock S. J.Can meta-analyses by trusted?.Lancet. 1991;338:1127.
118. Trikalinos T. A.,Ioannidis J. P. A.Publication bias in meta analysis: Prevention, assessment and adjustments. Rothstein H. R.Sutton A. J.Borenstein M., ed. West Sussex, UK: Wiley; 2005:241-259.
119. Turner E. H.,Matthews A. M.,Linardatos E.,Tell R. A.,Rosenthal R.Selective publication of antidepressant trials and its influence on apparent efficacy.New England Journal of Medicine. 2008;358:252-260.
120. Vedula S. S.,Bero L.,Scherer R. W.,Dickersin K.Outcome reporting in industry-sponsored trials of gabapentin for off-label use.New England Journal of Medicine. 2009;361:1963-1971.
121. Vevea J. L.,Clements N. C.,Hedges L. V.Assessing the effects of selection bias on validity data for the General Aptitude Test Battery.Journal of Applied Psychology. 1993;78:981-987.
122. Vevea J. L.,Hedges L. V.A general linear model for estimating effect size in the presence of publication bias.Psychometrika. 1995;60:419-435.
123. Vevea J. L.,Woods C. M.Publication bias in research synthesis: Sensitivity analysis using a priori weight functions.Psychological Methods. 2005;10:428-443.
124. White H. D.Research synthesis and meta-analysis. 2009). Scientific communication and literature retrieval. In CooperH.HedgesL. V.ValentineJ. C. (Eds.), Research synthesis and meta-analysis (2nd ed., pp. 51-71). New York, NY: Russell Sage.Cooper H.Hedges L. V.Valentine J. C., ed. New York, NY: Russell Sage; 2009:51-71.
125. Wicherts J. M.,Borsboom D.,Kats J.,Molenaar D.The poor availability of psychological research data for reanalysis.American Psychologist. 2006;61:726-728.
126. Yang M.,Wong S. C. P.,Coid J.The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools.Psychological Bulletin. 2010;136:740-767.