No effects in independent prevention trials: Can we reject the cynical view?

Journal of Experimental Criminology

Volumn 5, Issue 2, 2009, Pages 163-183

  Eisner, Manuel ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Conflict of interests; Independent evaluation; Methodological bias; Research synthesis

Indexed keywords

EID: 67349173939     PISSN: 15733750     EISSN: 15728315     Source Type: Journal    
DOI: 10.1007/s11292-009-9071-y     Document Type: Article

References (77)

1. S. Al-Marzouki S. Evans T. Marshall I. Roberts 2005 Are these data real? Statistical methods for the detection of data fabrication in clinical trials BMJ 331 267 270 (Pubitemid 41097910)
2. S. Al-Marzouki I. Roberts T. Marshall S. Evans 2005 The effect of scientific misconduct on the results of clinical trials: a Delphi survey Contemporary Clinical Trials 26 3 331 337 (Pubitemid 40731535)
3. D. G. Altman 1996 Better reporting of randomised controlled trials: the consort statement BMJ 313 7057 570 571 (Pubitemid 26293636)
4. L. Babcock G. Loewenstein S. Issacharoff C. Camerer 1995 Biased judgments of fairness in bargaining The American Economic Review 85 5 1337 1343
5. N. S. Bauer P. Lozano F. P. Rivara 2007 The Effectiveness of the Olweus bullying prevention program in public middle schools: a controlled trial The Journal of Adolescent Health: Official Publication of the Society for Adolescent Medicine 40 3 266 274 (Pubitemid 46281645)
6. A. Beelmann F. Lösel 2006 Child social skills training in developmental crime prevention: effects on antisocial behavior and social competence Psycothema 18 3 603 610
7. G. J. Botvin E. Baker L. Dusenbury E. M. Botvin T. Diaz 1995 Long-term follow-up results of a randomized drug abuse prevention trial in a white middle-class population JAMA 273 14 1106 1112
8. M. K. Campbell D. R. Elbourne D. G. Altman 2004 Consort statement: extension to cluster randomised trials BMJ 328 7441 702 708 (Pubitemid 38393415)
9. H. Cho D. D. Hallfors V. Sánchez 2005 Evaluation of a high school peer group intervention for at-risk youth Journal of Abnormal Child Psychology 33 3 363 374 (Pubitemid 40674967)
10. Cornish, D. B., & Clarke, R. V. G. (Eds.). (1986). The reasoning criminal: Rational choice perspectives on offending. New York: Springer.
11. J. Dana G. Loewenstein 2003 A social science perspective on gifts to physicians from industry JAMA 290 2 252 255 (Pubitemid 37430065)
12. I. de Graaf P. Speetjens F. Smit M. de Wolff L. Tavecchio 2008 Effectiveness of the Triple P positive parenting program on behavioral problems in children: a meta-analysis Behav Modif 32 5 714 735
13. A. Diekmann 2007 Not the first digit! Using Benford's Law to detect fraudulent scientific data Journal of Applied Statistics 34 3 321 329
14. D. L. DuBois B. E. Holloway J. C. Valentine H. Cooper 2002 Effectiveness of mentoring programs for youth: a meta-analytic review American Journal of Community Psychology 30 157 197
15. D. L. DuBois B. E. Holloway J. C. Valentine H. Cooper 2002 Effectiveness of mentoring programs for youth: a meta-analytic review American Journal of Community Psychology 30 2 157 197
16. L. L. Eggert C. D. Seyi L. J. Nicholas 1990 Effects of a school-based prevention program for potential high school dropouts and drug abusers Substance Use & Misuse 25 7 773 801
17. L. L. Eggert E. A. Thompson J. R. Herting L. J. Nicholas B. G. Dickers 1994 Preventing adolescent drug abuse and high school dropout through an intensive social network development program American Journal of Health Promotion 8 2 202 215 (Pubitemid 24031168)
18. Eisner, M., & Ribeaud, D. (2008). Markt, Macht und Wissenschaft; Kritische Überlegungen zur Deutschen Präventionsforschung. In E. Marks & W. Steffen (Eds.), Starke Jugend - Starke Zukunft (Ausgewählte Beiträge des 12. Deutschen Präventionstages, 18. und 19. Juni 2007) (pp. 173-191). Mönchengladbach: Forum Verlag Godesberg.
19. Eisner, M., Ribeaud, D., Jünger, R., & Meidert, U. (2007). Frühprävention von Gewalt und Aggression; Ergebnisse des Zürcher Interventions- und Präventionsprojektes an Schulen. Zürich: Rüegger.
20. Ellickson, P. L. (1998). Preventing adolescent substance abuse: lessons from the project alert program. In J. Crane (Ed.), Social programs that work (pp. 201-257). New York: Russell Sage.
21. P. L. Ellickson R. M. Bell 1990 Drug prevention in junior high: a multi-site longitudinal test Science 247 1299 1305 (Pubitemid 20112631)
22. P. L. Ellickson D. F. McCaffrey B. Ghosh-Dastidar D. L. Longshore 2003 New inroads in preventing adolescent drug use: results from a large-scale trial of project ALERT in middle schools American Journal of Public Health 93 11 1830 1836 (Pubitemid 38480147)
23. D. S. Elliott S. F. Mihalic 2004 Issues in disseminating and replicating effective prevention programs Prevention Science 5 1 47 53 (Pubitemid 39023964)
24. H. Etzkowitz 2003 Research groups as 'Quasi-Firms': the invention of the entrepreneurial university Research Policy 32 1 109 121
25. D. P. Farrington 2003 Methodological quality standards for evaluation research Annals of the American Academy of Political and Social Sciences 587 49 68 (Pubitemid 36532925)
26. D. P. Farrington B. Welsh 2003 Family-based prevention of offending: a meta-analysis Australian and New Zealand Journal of Criminology 36 2 127 151 (Pubitemid 37052961)
27. Felson, M. (1994). Crime and everyday life; insight and implications for society. Thousand Oaks: Pine Forge Press.
28. L. S. Friedman E. D. Richter 2004 Relationship between conflicts of interest and research results Journal of General Internal Medicine 19 1 51 56 (Pubitemid 38221951)
29. A. G. Gandhi E. Murphy-Graham A. Petrosino S. S. Chrismer C. H. Weiss 2007 The devil is in the details: examining the evidence for "proven" school-based drug abuse prevention programs Evaluation Review 31 1 43 74
30. N. Gilbert 1997 Advocacy research and social policy Crime and Justice: A Review of Research 22 101 148 (Pubitemid 127095064)
31. D. M. Gorman 2003 Alcohol & drug abuse: the best of practices, the worst of practices: the making of science-based primary prevention programs Psychiatric Services 54 8 1087 1089
32. D. M. Gorman 2005 Does measurement dependence explain the effects of the life skills training program on smoking outcomes? Preventive Medicine 40 4 479 487 (Pubitemid 39458068)
33. D. M. Gorman 2005 Drug and violence prevention: rediscovering the critical rational dimension of evaluation research Journal of Experimental Criminology 1 1 39 62 (Pubitemid 41310188)
34. Gorman, D. M. (2006). Conflicts of interest in the evaluation and dissemination of drug use prevention programs. In J. Kleinig, & S. Einstein (Eds.), Intervening in drug use: Ethical challenges (pp. 171-187). Huntsville: Office of International Criminal Justice.
35. D. M. Gorman E. Conde 2007 Conflict of interest in the evaluation and dissemination of "Model" school-based drug and violence prevention programs Evaluation and Program Planning 30 4 422 429 (Pubitemid 47559962)
36. Heinrichs, N., Hahlweg, K., Bertram, H., Kuschel, A., Naumann, S., & Harstick, S. (2006). Die langfristige Wirksamkeit eines Elterntrainings zur universellen Prävention kindlicher Verhaltensstörungen: Ergebnisse aus Sicht der Mütter und Väter. Zeitschrift für klinische Psychologie und Psychotherapie, 35(2).
37. S. W. Henggeler P. B. Cinningham S. G. Pickrel S. K. Schoenwald M. J. Brondino 1996 Multisystemic therapy: an effective violence prevention approach for serious juvenile offenders Journal of Adolescence 19 1 47 61 (Pubitemid 26120078)
38. C. E. Hewitt N. Mitchell D. J. Torgerson 2008 Listen to the data when results are not significant BMJ 336 7634 23 25
39. K. J. Holyoak D. Simon 1999 Bidirectional reasoning in decision making by constraint satisfaction Journal of Experimental Psychology; General 128 1 3 31
40. T. J. Kaptchuk 2003 Effect of interpretive bias on research evidence BMJ 326 7404 1453 1455 (Pubitemid 36776160)
41. Lipsey, M. W. (1995). What do we learn from 400 research studies on the effectiveness of treatment with juvenile delinquents? In J. McGuire (Ed.), What works? Reducing reoffending (pp. 63-78). New York: Wiley.
42. Lipsey, M. W., & Cullen, F. T. (2007). The effectiveness of correctional rehabilitation: a review of systematic reviews. Annual Review of Law and Social Science, 3, 297-320.
43. M. W. Lipsey C. Petrie D. Weisburd D. Gottfredson 2006 Improving evaluation of anti-crime programs: summary of a national research council report Journal of Experimental Criminology 2 3 271 307
44. J. Littell 2005 Lessons from a systematic review of effects of multisystemic therapy Children and Youth Services Review 27 4 445 463 (Pubitemid 40289705)
45. Littell, J., Popa, M., & Forsythe, B. (2005). Multisystemic Therapy for Social, Emotional, and Behavioral Problems in Youth Aged 10-17 (Report for the Campbell Collaboration) (Electronic Version). Accessed 14 January 2008 from http://www.sfi.dk/graphics/Campbell/Dokumenter/MST-Review/ MULTISYSTEMIC%20TERAPHY%20-%20REVIEW.pdf .
46. Lock, S., Wells, F., & Farthing, M. (Eds.). (2001). Fraud and misconduct in medical research. London: BMJ Publishing Group.
47. F. Lösel A. Beelmann 2003 Effects of child skills training in preventing antisocial behavior: a systematic review of randomized evaluations The ANNALS of the American Academy of Political and Social Science 587 1 84 109 (Pubitemid 41408848)
48. Lösel, F., & Koferl, P. (1989). Evaluation research on correctional treatment in West Germany: A meta-analysis. In H. Wegener, F. Lösel, & J. Haisch (Eds.), Criminal behavior and the justice system: Psychological perspectives. New York: Springer.
49. F. Lösel A. Beelmann 2003 Effects of child skills training in preventing antisocial behavior: a systematic review of randomized evaluations The ANNALS of the American Academy of Political and Social Science 587 1 84 109 (Pubitemid 36532927)
50. L. Luborsky L. Diguer D. A. Seligman R. Rosenthal E. D. Krause S. Johnson 1999 The researcher's own therapy allegiances: a "Wild Card" in comparisons of treatment efficacy Clinical Psychology: Science and Practice 6 1 95 106
51. B. Lundahl H. J. Risser M. C. Lovejoy 2006 A meta-analysis of parent training: moderators and follow-up effects Clinical Psychology Review 26 1 86 104 (Pubitemid 41805071)
52. R. J. MacCoun 1998 Biases in the interpretation and use of research statistics Annual Review of Psychology 49 259 287 (Pubitemid 128046689)
53. MacCoun, R. J. (2005). Conflicts of interest in public policy research. In D. Moore, D. M. Cain, G. Loewenstein, & M. H. Bazerman (Eds.), Conflicts of interest; challenges and solutions in business, law, medicine, and public policy (pp. 233-262). Cambridge: Cambridge University Press.
54. B. C. Martinson M. S. Anderson R. de Vries 2005 Scientists behaving badly Nature 435 9 June 2005 737 738 (Pubitemid 40839708)
55. D. M. Messick K. P. Sentis 1979 Fairness and preference Journal of Experimental Social Psychology 15 4 418 434
56. Moore, D., Tetlock, P. E., Tanlu, L., & Bazerman, M. H. (2006). Conflicts of interest and the case of auditor independence: moral seduction and strategic issue cycling. Academy of Management Review, 31(1), 10-29.
57. C. Nowak N. Heinrichs 2008 A comprehensive meta-analysis of Triple P-positive parenting program using hierarchical linear modeling: effectiveness and moderating variables Clinical Child and Family Psychology Review 11 3 114 144
58. T. Ogden C. A. Halliday-Boykins 2004 Multisystemic treatment of antisocial adolescents in Norway: replication of clinical outcomes outside of the us Child and Adolescent Mental Health 9 77 83
59. T. Ogden K. A. Hagen 2006 Multisystemic treatment of serious behaviour problems in youth: sustainability of effectiveness two years after intake Child and Adolescent Mental Health 11 3 142 149 (Pubitemid 44263441)
60. K. Okike M. S. Kocher C. T. Mehlman M. Bhandari 2007 Conflict of interest in orthopaedic research. an association between findings and funding in scientific presentations J Bone Joint Surg Am 89 3 608 613 (Pubitemid 46365361)
61. D. Olweus 1994 Bullying at school: basic facts and effects of a school based intervention program Journal of Child Psychology and Psychiatry 35 7 1171 1190 (Pubitemid 24284699)
62. R. H. Perlis C. S. Perlis Y. Wu C. Hwang M. Joseph A. A. Nierenberg 2005 Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry American Journal of Psychiatry 162 10 1957 1960 (Pubitemid 41428627)
63. A. Petrosino H. Soydan 2005 The impact of program developers as evaluators on criminal recidivism: results from meta-analyses of experimental and quasi-experimental research Journal of Experimental Criminology 1 4 435 450
64. J. Ranstam M. Buyse S. L. George S. Evans N. L. Geller B. Scherrer 2000 Fraud in medical research: an international survey of biostatisticians Controlled Clinical Trials 21 5 415 427
65. D. B. Resnik 2000 Financial interests and research bias Perspectives on Science 8 3 255 285
66. Russo, J. E., Carlson, K. A., Meloy, M., & Yong, K. (2007). The goal of consistency as a cause of information distortion. Johnson School Research Paper Series No. 04-07.
67. V. Sanchez A. Steckler P. Nitirat D. Hallfors H. Cho P. Brodish 2007 Fidelity of implementation in a treatment effectiveness trial of reconnecting youth Health Education Research 22 1 95 107 (Pubitemid 46134979)
68. Sanders, M. R. (1992). Every parent: A positive guide to children's behavior. Sydney: Addison-Wesley.
69. M. R. Sanders 1999 Triple P-positive parenting program: towards an empirically validated multilevel parenting and family support strategy for the prevention of behaviour and emotional problems in children Clinical Child and Family Psychology Review 2 2 71 89
70. Shadish, W. R., Cook, T. D., & Campbell, D. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
71. L. W. Sherman 2006 "to develop and test:" the inventive difference between evaluation and experimentation Journal of Experimental Criminology 2 3 393 406
72. Sherman, L. W., Farrington, D. P., Welsh, B. C., & MacKenzie, D. L. (Eds.). (2002). Evidence-based crime prevention. London: Routledge.
73. T. L. St Pierre D. W. Osgood C. C. Mincemoyer D. L. Kaltreider T. J. Kauh 2006 Results of an independent evaluation of project alert delivered in schools by cooperative extension Prevention Science 6 4 305 317
74. K. Sundell K. Hansson C. A. Löfholm T. Olsson L. H. Gustle C. Kadasjo 2008 The transportability of multisystemic therapy to Sweden: short-term results from a randomized trial of conduct disordered youth Journal of Family Psychology 22 4 550 560
75. S. J. Wilson M. W. Lipsey 2007 School-based interventions for aggressive and disruptive behavior: update of a meta-analysis American Journal of Preventive Medicine 33 2, Supplement 1 S130 S143
76. S. J. Wilson M. W. Lipsey J. H. Derzon 2003 The effects of school-based intervention programs on aggressive behavior: a meta-analysis Journal of Consulting and Clinical Psychology 71 1 136 149 (Pubitemid 36150959)
77. S. J. Wilson M. W. Lipsey H. Soydan 2003 Are mainstream programs for juvenile delinquency less effective with minority youth than majority youth? a meta-analysis of outcomes research Research on Social Work Practice 13 1 2 26 (Pubitemid 36092902)