Trying to Do More Good than Harm in Policy and Practice: The Role of Rigorous, Transparent, Up-to-Date Evaluations

Annals of the American Academy of Political and Social Science

Volumn 589, Issue , 2003, Pages 22-40

  Chalmers, Iain ^a  

^a NONE

Author keywords

Ethics; Evaluation; Research methodology; Research synthesis

Indexed keywords

EID: 0041917350     PISSN: 00027162     EISSN: None     Source Type: Journal    
DOI: 10.1177/0002716203254762     Document Type: Article

References (60)

1. Achara, S., B. Adeyemi, E. Dosekun, S. Kelleher, M. Lansley, I. Male, N. Muhialdin, L. Reynolds, I. Roberts, M. Smailbegovic, and N. van der Spek. 2001. Evidence based road safety: The Driving Standards Agency's schools programme. Lancet 358:230-32.
2. Antiplatelet Trialists' Collaboration. 1988. Secondary prevention of vascular disease by prolonged antiplatelet treatment. BMJ 296:320-31.
3. Antman, E. M., J. Lau, B. Kupelnick, F. Mosteller, and T. C. Chalmers. 1992. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Journal of the American Medical Association 268:240-48.
4. Auerbach, A. W. 1978. The role of the therapeutic community "Street Prison" in the rehabilitation of youthful offenders, University Microfilms no. 78-01086. Doctoral diss., George Washington University, Washington, DC.
5. Boruch, R. 1997. Randomized experiments for planning and evaluation: A practical guide. Thousand Oaks, CA: Sage.
6. Boruch, R., and F. Mosteller. 2002. Overview and new directions. In Evidence matters: Randomised trials in education research, edited by F. Mosteller and R. Boruch, 1-14. Washington, DC: Brookings Institution.
7. Britton, A., M. McKee, N. Black, K. McPherson, C. Sanderson, and C. Bain. 1998. Choosing between randomised and non-randomised studies: A systematic review. Health Technology Assessment 2 (13): 1-124.
8. Burns, T., M. Knapp, J. Catty, A. Healey, J. Henderson, H. Watt, and C. Wright. 2001. Home treatment for mental health problems: A systematic review. Health Technology Assessment 5 (15): 1-139.
9. Campbell, D. T. 1969. Reforms as experiments. American Psychologist 24:409-29.
10. Chalmers, I. 1993. The Cochrane Collaboration: Preparing, maintaining and disseminating systematic reviews of the effects of health care. In "Doing more good than harm: The evaluation of health care interventions," edited by K. S. Warren and F. Mosteller. Annals of the New York Academy of Sciences 703 (special iss.): 156-63.
11. _. 1995. What do I want from health research and researchers when I am apatient? BMJ 310:1315-18.
12. _. 2000. A patient's attitude to the use of research evidence to guide individual choices and decisions in health care. Clinical Risk 6:227-30.
13. _. 2001. Invalid health information is potentially lethal. BMJ 322:998.
14. _. 2002. Why we need to know whether prophylactic antibiotics can reduce measles-related morbidity. Pediatrics 109:312-15.
15. Chalmers, I., L. V. Hedges, and H. Cooper. 2002, A brief history of research synthesis. Evaluation and the Health Professions 25:12-37.
16. Chalmers, I., and R. Lindley. 2000. Double standards on informed consent to treatment. In Informed consent in medical research, edited by L. Doyal and J. S. Tobias, 266-75. London: BMJ Publications.
17. Clarke, M., P. Alderson, and I. Chalmers. 2002. Discussion sections in reports of controlled trials published in general medical journals. journal of the American Medical Association 287:2799-801.
18. Clarke, R. V. 1997. Situational crime prevention: successful case studies. 2d ed. New York: Harrow and Heston.
19. Clarke, R. V. G., and D. B. Cornish. 1972. The controlled trial in institutional research - Paradigm, or pitfall for penal evaluators? Home Office Research Study no. 15. London: Her Majesty's Stationery Office.
20. Cooper, H. M. 1982. Scientific principles for conducting integrative research reviews. Review of Educational Research 52:291-302.
21. Cornish, D. B., and R. V. G. Clarke. 1975. Residential treatment and its effects on deliquency. Home Office Research Study no. 32. London: Her Majesty's Stationery Office.
22. Dobash, R. E., and R. P. Dobash. 2000. Evaluating criminal justice interventions for domestic violence. Crime & Delinquency 46:252-70.
23. Freed, C. R., P. E. Greene, R. E. Breeze, W. Y. Tsai, W. DuMouchel, R. Kao, S. Dillon, H. Winfield, S. Culver, J. Q. Trojanowski, D. Eidelberg, and S. Fahn, 2001. Transplantation of embryonic dopamine neurons for severe Parkinson's disease. New England Journal of Medicine 344:710-19.
24. Gilbert, R. 1994. The changing epidemiology of SIDS. Archives of Disease in Childhood 70:445-49.
25. Glass, G. V. 1967. Primary, secondary and meta-analysis of research. Educational Researcher 10:3-8.
26. Goldthorpe, J. H. 2001. Causation, statistics, and sociology. European Sociological Review 17:1-20.
27. Graebsch, C. 2000. Legal issues of randomized experiments on sanctioning. Crime & Delinquency 46:271-82.
28. Gueron, J. 2002. The politics of random assignment: Implementing studies and affecting policy. In Evidence matters: Randomised trials in education research, edited by F. Mosteller and R. Boruch, 15-49. Washington, DC: Brookings Institution.
29. Hammersley, M. 2001. On "systematic" reviews of research literatures: A "narrative" response to Evans & Benefield. British Educational Research Journal 27:543-54.
30. _. 2002, Systematic or unsystematic, is that the question? Some reflections on the science, art, and politics of reviewing research evidence. Text of a talk given to the Public Health Evidence Steering Group of the Health Development Agency, October, in London.
31. Juni, P., D. G. Altman, and M. Egger. 2001. Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ 323:42-46,
32. Kippax, S. 2003. Sexual health interventions are unsuitable for experimental evaluation, In Effective sexual health interventions: Issues in experimental evaluation, edited by J. Stephenson, J. Imrie, and C. Bonell, 17-34. Oxford: Oxford University Press.
33. Kleijnen, J., P. Gøtzsche, R. H. Kunz, A. D. Oxman, and I. Chalmers, 1997. So what's so special about randomisation? In Non-random reflections on health services research: On the 25 anniversary of Archie Cochrane's Effectiveness and efficiency, edited by A. Maynard and I. Chalmers, 93-106. London: BMJ Books.
34. Konnerup, M. 2002. The three main pillars of the Campbell Collaboration, Presented at Nordic Campbell Center Inauguration Seminar, 12 November, in Copenhagen, Denmark, Retrieved 18 January 2003 from from http://www.nordic-campbell.dk/MereteKonnerupsforedrag4/index.htm.
35. Kunz, R., and A. D. Oxman. 1998. The unpredictability paradox: Review of empirical comparisons of randomised and non-randomised clinical trials. BMJ 317:1185-90.
36. Kunz, R., G. Vist, and A. D. Oxman. 2003. Randomisation to protect against selection bias in healthcare trials (Cochrane methodology review). In The Cochrane Library, iss. 1. Oxford: Update Software.
37. Learmonth, A. M., and N. J. Watson. 1999. Construing evidence-based health promotion: perspectives from the field. Critical Public Health 9:317-33.
38. Macintyre, S., and M. Petticrew. 2000. Good intentions and received wisdom are not enough. Journal of Epidemiology and Community Health 54:802-3.
39. MacLehose. R. R., B. C. Reeves, I. M. Harvey, T. A. Sheldon, I. T. Russell, and A. M. Black. 2000. A systematic review of comparisons of effect sizes derived from randomised and non-randomised studies. Health Technology Assessment 4 (34): 1-154.
40. McDonagh, M. S., P. F. Whiting, P. M. Wilson, A. J. Sutton. I. Chestnutt, J. Cooper, K. Misso, M. Bradley, E. Treasure, and J. Kleijnen. 2000. Systematic review of water fluoridation. BMJ 321:855-59.
41. Medical ethics - Should medicine turn the other cheek? 1990. Lancet 336:846-47.
42. National Institute of Child Health and Human Development. 2000. Report of the National Reading Panel. Teaching children to read.: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. NIH Publication no. 00-4769. Washington, DC: Government Printing Office.
43. NHS Centre for Reviews and Dissemination, York and School of Sociology & Social Policy, Nottingham. 1999. Therapeutic community effectiveness. CRD Report 17. Retrieved 18 January 2003 from www.york.ac.uk/inst/crd/.
44. Oakley, A. 1999. Paradigm wars. International Journal of Social Research Methodology 2:247-54.
45. _. 2000. Experiments in knowing. Oxford: Polity Press.
46. Organization of Economic Cooperation and Development. 2002. Educational research and development in England, Examiners' report, CERI/CD10, September, p. 21.
47. Oxman, A. D., I. Chalmers, and D. L. Sackett. 2001. A practical guide to informed consent to treatment. BMJ 323:1464-66.
48. Petrosino, A., R. F. Boruch, C. Rounding, S. McDonald, and I. Chalmers. 2000. The Campbell Collaboration Social, Psychological, Educational & Criminological Trials Register (C2-SPECTR), Evaluation and Research in Education 14:206-19.
49. Petrosino, A., C. Turpin-Petrosino, and J. Buehler. 2003. "Scared Straight" and other juvenile awareness programs for preventing juvenile delinquency (Cochrane Review). In The Cochrane Library, iss. 1. Oxford: Update Software.
50. Petrosino, A., C. Turpin-Petrosino, and J. O. Finchenauer. 2000. Well-meaning programs can have harmful effects! Lessons from experiments such as Scared Straight. Crime & Delinquency 46:354-79.
51. Prideaux, D. 2002. Researching the outcomes of educational interventions; A matter of design BMJ 324:126-27.
52. Shann, F., R. M. D'Souza, and R. D'Souza. 2002. Antibiotics for preventing pneumonia in children with measles (Cochrane Review). In The Cochrane Library, iss. 2. Oxford: Update Software.
53. Smith, A. 1996. Mad cows and ecstasy. Journal of the Royal Statistical Society 159:367-83.
54. Smithells, R. W. 1975. latrogenic hazards and their effects. Postgraduate Medical Journal 15:39-52.
55. Spock, B. 1966. Baby and child care. 165th printing. New York: Pocket Books.
56. Sterne, J. A. C., M. Egger, and G. Davey Smith. 2001, Investigating and dealing with publication and other biases. In Systematic reviews in health care: Meta-analysis in context, 2d ed. of Systematic Reviews, edited by M. Egger, G. Davey Smith, and D. Altmen, 189-208. London: BMJ Books.
57. Susser, M. 1984. Causal thinking in practice: Strengths and weaknesses of the clinical vantage point. Pediatrics 74:842-49.
58. Webb, S. A. 2001. Some considerations of the validity of evidence-based practice in social work. British Journal of Social Work 31:57-79.
59. Weisburd, D., C. M. Lum, and A. Petrosino. 2001. Does research design affect study outcomes in criminal justice? Annals of the American Academy of Political and Social Science 578:50-70.
60. Wennergren, G., B. Alm, N. Oyen, K. Helweg-Larsen, J. Milerad, R. Skjaerven, S. G. Norvenius, H. Lagercrantz, M. Wennborg, A. K. Daltveit, T. Markestad, and L. M. Irgens. 1997. The decline in the incidence of SIDS in Scandinavia and its relation to risk-intervention campaigns. Nordic Epidemiological SIDS Study. Acta Paediatr 86:963-68.