Verdicts or Inventions? Interpreting Results from Randomized Controlled Experiments in Criminology

American Behavioral Scientist

Volumn 47, Issue 5, 2004, Pages 575-607

  Sherman, Lawrence W ^a   Strang, Heather ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Campbell Collaboration; Criminology; Experiments; Forest graphs; Randomized controlled trials; Systematic reviews

Indexed keywords

EID: 0346343065     PISSN: 00027642     EISSN: None     Source Type: Journal    
DOI: 10.1177/0002764203259294     Document Type: Conference Paper

References (72)

1. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444-455.
2. Assendelft, W. J. J., Morton, S. C., Yu, E. I., Suttorp, M. J., & Shekelle, P. G. (2003). Spinal manipulative therapy for low back pain: A meta-analysis of effectiveness relative to other therapies. Annals of Internal Medicine, 138, 871-881.
3. Attorney General's Task Force on Violent Crime. (1981). Report. Washington, DC: U. S. Department of Justice.
4. Berk, R. A., Campbell, A., Klap, R., & Western, B. (1992). The deterrent effect of arrest in incidents of domestic violence: A Bayesian analysis of four field experiments. American Sociological Review, 57, 698-708.
5. Blumstein, A., Cohen, J., Roth, J. A., & Visher, C. A. (1986). Criminal careers and "career criminals." Washington, DC: National Academies Press.
6. Butterfield, F. (1997, April 16). Most efforts to stop crime fall far short, study finds. New York Times, p. 1.
7. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand-McNally.
8. Chalmers, I. (2003). Trying to do more good than harm in policy and practice: The role of rigorous, transparent, up-to-date evaluations. Annals of the American Academy of Political and Social Science, 589, 22-40.
9. Cottingham, P. (2003). Summing up the evidence from experiments. Westport, NY: Smith Richardson Foundation.
10. Cox, D. R. (1958). Planning of experiments. London: Wiley.
11. Dunford, F (1990). System-initiated warrants for suspects of misdemeanor domestic assault: A pilot study. Justice Quarterly, 7, 631-653.
12. Eastman, J. (2003, June 16). Sweeping changes: James Dyson, inventor of the cyclonic vacuum, wants to revolutionize invention itself. Los Angeles Times, p. 1.
13. Federal Judicial Center. (1981). Experimentation in the law. Washington, DC: Federal Judicial Center.
14. Fisher, R. A. (1935). The design of experiments. Edinburgh, Scotland: Oliver & Boyd.
15. Fonagy, P., Target, M., Cottrell, D., Phillips, J., & Kurtz, Z. (Eds.). (2002). What works for whom? A critical review of treatments for children and adolescents. New York: Guilford.
16. Garner, J. H., & Visher, C. A. (2003). The production of criminological experiments. Evaluation Review, 27, 316-335.
17. Gerber, A. S., & Green, D. P. (2000). The effects of canvassing, direct mail, and telephone contact on voter turnout: A field experiment. American Political Science Review, 94, 653-663.
18. Glazerman, S., Levy, D. M., & Myers, D. (2003). Nonexperimental vs. experimental estimates of earnings impacts. Annals of the American Academy of Political and Social Science, 589, 63-93.
19. Gorman, D. M. (2002). The "science" of drug and alcohol prevention: The case of the randomized trial of the Life Skills Training program. International Journal of Drug Policy, 13, 21-26.
20. Gottfredson, D. C., & Exum, L. M. (2002). The Baltimore city drug treatment court: One-year results from a randomized study. Journal of Research in Crime and Delinquency, 39, 337-356.
21. Gottfredson, D. C., Wilson, D. B., & Najaka, S. S. (2002). School-based crime prevention. In L. W. Sherman, D. Farrington, B. C. Welsh, & D. L. MacKenzie (Eds.), Evidence-based crime prevention. London: Routledge.
22. Grady, D. (2003, August 21). Medicare to pay for major lung operation. New York Times, p. A22.
23. Harre, R. (1983). Great scientific experiments. Oxford, UK: Oxford University Press.
24. Hilts, P. J. (1986, September 20). Results of preliminary tests prompt AIDS drug's release. The Washington Post, p. A1.
25. Howell, W., & Peterson, P. (2002). The education gap: Vouchers and urban schools. Washington, DC: Brookings Institution.
26. Howell, W., & Peterson, P. (2004, this issue). Uses of theory in randomized field trials: Lessons from school voucher research on disaggregation, missing data, and the generalization of findings. American Behavioral Scientist.
27. Juni, P., Altman, D. G., & Egger, M. (2001). Systematic reviews in health care: Assessing the quality of controlled clinical trials. British Medical Journal, 323, 42-46.
28. Krueger, A., & Zhu, P. (2004, this issue). Inefficiency, subsample selection bias, and nonrobustness: A Response to Paul E. Peterson and G. William Howell. American Behavioral Scientist.
29. Latimer, J., Dowden, C., & Muise, D. (2001). The effectiveness of restorative justice practices: A meta-analysis. Ottawa, Canada: Department of Justice, Research and Statistics Division Methodological Series.
30. Long, R., & Chase, J. (2003, August 19). Schools to target "bad" kids for prison: But law to scare youths has critics. Chicago Tribune, C1.
31. Mallett, S., & Clarke, M. (2002). The typical Cochrane review. How many trials? How many participants? International Journal of Technology Assessment in Health Care, 18, 820-823.
32. Martinson, R. (1974). What works ? Questions and answers about prison reform. The Public Interest, 10, 22-54.
33. McCold, P., & Wachtel, B. (1998). Restorative policing experiment: The Bethlehem, Pennsylvania, Police Family Group Conferencing Project. Pipersville, PA: Community Service Foundation.
34. McCold, P., & Wachtel, T. (2000, October 1-4). Restorative justice theory validation. Paper presented to the 4th International Conference on Restorative Justice for Juveniles, University of Tübingen, Germany, http://www.iirp.org/Pages/eforum001.html.
35. McGarrell, E. F., Olivaies, K., Crawford, K., & Kroovand, N. (2000). Returning justice to the community: The Indianapolis Juvenile Restorative Justice Experiment. Indianapolis, IN: Hudson Institute, Crime Control Policy Center.
36. Millenson, M. L. (1997). Demanding medical excellence: Doctors and accountability in the information age. Chicago: University of Chicago Press.
37. Moffitt, R. (2002, August 20), The role of randomized field trials in social science research: A perspective from evaluations of reforms of social welfare programs. Paper presented to the Conference on Randomized Experiments in the Social Sciences, Yale University Institution for Social and Policy Studies.
38. Moffitt, R. (2003, September 4). Statement presented to the Workshop on Improving Evaluation of Criminal Justice Programs, Committee on Law and Justice, National Research Council, Washington, DC, National Academy of Sciences.
39. Oldham, R. K. (1987). Patient-funded cancer research. New England Journal of Medicine, 316, 46-47.
40. Olds, D. L., Henderson, C. R., Cole, R., Eckenrode, J., Kitzman, H., Luckey, D., et al. (1998). Long-term effects of nurse home visitation on children's criminal and anti-social behavior: 15-year follow-up of a randomized controlled trial. Journal of the American Medical Association, 280, 1238-1244.
41. Pate, A. M., & Hamilton, E. H. (1992). Formal and informal deterrents to domestic violence: The Dade County spouse assault experiment. American Sociological Review, 57, 691-697.
42. Peto, R., Pike, M., Armitage, P., Breslow, N. E., Cox, D. R., Howard, S. V., et al. (1976). Design and analysis of randomized clinical trials requiring prolonged observation of each patient: Part 1. Introduction and design. British Journal of Cancer, 34, 585-612.
43. Petrosino, A., Turpin-Petrosino, C., & Buehler, J. (2003). Scared Straight and other juvenile awareness programs for preventing juvenile delinquency: A systematic review of randomized experimental evidence. Annals of the American Academy of Political and Social Science, 559, 41-62.
44. Petrosino, A., Turpin-Petrosino, C., & Finckenauer, J. O. (2000). Well-meaning programs can have harmful effects ! Lessons from Scared Straight and other like programs. Crime and Delinquency, 46, 354-379.
45. Piantadosi, S. (1997). Clinical trials: A mehodologic perspective. London: Wiley.
46. President's Commission on Law Enforcement and Administration of Justice. (1967). The challenge of crime in a free society. Washington, DC: Government Printing Office.
47. Sherman, L. W. (1984). Experiments in police discretion: Scientific boon or dangerous knowledge? Law and Contemporary Problems, 47, 61-81.
48. Sherman, L. W. (1992). Policing domestic violence. New York: Free Press.
49. Sherman, L. W. (1993). Defiance, deterrence and irrelevance: A theory of the criminal sanction. Journal of Research in Crime and Delinquency, 30, 445-473.
50. Sherman, L. W. (2003). Reason for emotion: Reinventing justice with theories, innovations and research. Criminology, 41, 1-37.
51. Sherman, L. W., & Berk, R. A. (1984). The specific deterrent effects of arrest for domestic assault: A field experiment. American Sociological Review, 49, 261-272.
52. Sherman, L. W., & Cohn, E. G. (1989). The impact of research on legal policy: The Minneapolis Domestic Violence Experiment. Law and Society Review, 23, 117-144.
53. Sherman, L. W., Farrington, D. P., Welsh, D. C., & MacKenzie, D. L. (2002). Evidence-based crime prevention. New York: Routledge.
54. Sherman, L. W., Gottfredson, D. C., MacKenzie, D. L., Eck, J., Reuter, P., & Bushway, S. (1997). Preventing crime: What works, what doesn't, what's promising. Washington, DC: U.S. Department of Justice.
55. Sherman, L. W., & Smith, D. A. (1992). Crime, punishment and stake in conformity: Legal and informal control of domestic violence. American Sociological Review, 57, 680-690.
56. Sherman, L. W., & Strang, H. (2003, August). "Smart" justice and hard science: Testing restorative justice. Paper presented to the 13th World Congress of Criminology, Rio de Janiero.
57. Sherman, L. W., Strang, H., & Woods, D. (2000). Recidivism patterns in the Canberra Reintegrative Shaming Experiments. Canberra: Australian National University, Research School of Social Sciences, Centre for Restorative Justice, www.aic.gov.au/rjustice/rise/index.html.
58. Skogan, W., & Frydl, K. (Eds.). (2003). Committee to review research on police policy and practices: Fairness and effectiveness in policing. The evidence. Washington, DC: The National Academies Press.
59. Smith, J. (1990). Patenting the sun: Polio and the Salk vaccine. New York: William Morrow.
60. Sontag, D. (2002, November 17). Fierce entanglements. New York Times Magazine, p. 52.
61. Strang, H., & Sherman, L. W. (2003). Effects of face-to-face restorative justice on repeat offending and victim satisfaction: A systematic review for the Campbell Crime And Justice Group. Philadelphia: Jerry Lee Center of Criminology, University of Pennsylvania, www.crim.upenn.edu/campbell.html
62. Streptomycin Tuberculosis Trials Committee. (1948). Streptomycin treatment of pulmonary tuberculosis: A Medical Research Council investigation. British Medical Journal, 20, 769-782.
63. Sunday Times. (1979). Suffer the children: The story of thalidomide. New York: Viking.
64. Uglow, J. (2002). The lunar men: Five friends whose curiosity changed the world. New York: Farrar, Straus and Giroux.
65. van Tulder, M. W., Assendelft, W. J., Koes, B. W., & Bouter, L. M. (1997). Method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group for Spinal Disorders. Spine, 22, 2323-2330.
66. Weinstein, G. S., & Levin, B. (1989). Effect of crossover on the statistical power of randomized studies. Annals of Thoracic Surgery, 48, 490-495.
67. Weisburd, D., Lum, C. M., & Petrosino, A. (2001). Does research design affect study outcomes in criminal justice? Annals of the American Academy of Social and Political Science, 578, 50-70.
68. Weisburd, D., Lum, C. M., & Yang, S. -M. (2003). When can we conclude that treatments or programs don't work? Annals of the American Academy of Political and Social Science, 587, 31-48.
69. White, S. O., & Krislov, S. (1977). Understanding crime: An evaluation of the national institute of law enforcement and criminal justice. Washington, DC: National Academy of Sciences.
70. Wilson, D. B., & Lipsey, M. W. (2000). Practical meta-analysis. Thousand Oaks, CA: Sage.
71. Yoshikawa, H. (1994). Prevention as cumulative protection: Effects of early family support and education on chronic delinquency and its risks. Psychological Bulletin, 115, 28-54.
72. Zigler, J. (2003, September 4). Statement presented to the Workshop on Improving Evaluation of Criminal Justice Programs, Committee on Law and Justice, National Research Council, Washington, DC, National Academy of Sciences.