The double-blind, randomized, placebo-controlled trial: Gold standard or golden calf?

Journal of Clinical Epidemiology

Volumn 54, Issue 6, 2001, Pages 541-549

  Kaptchuk, Ted J ^a  

^a HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Artifacts; Bias; Double blind randomized controlled trial; Gold standard; Placebo

Indexed keywords

PLACEBO;

ALERTNESS; APPARATUS; ARTIFACT; CLINICAL TRIAL; COFFEE; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; DOUBLE BLIND PROCEDURE; HUMAN; HUMAN EXPERIMENT; INFORMED CONSENT; MOTOR PERFORMANCE; NORMAL HUMAN; OUTCOMES RESEARCH; PRIORITY JOURNAL; PULSE RATE; RANDOMIZED CONTROLLED TRIAL; REVIEW; SCIENCE; SYSTOLIC BLOOD PRESSURE; TENSION; VALIDATION PROCESS;

EID: 0035021115     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0895-4356(00)00347-4     Document Type: Note

References (99)

1. Rorty R. Philosophy and the mirror of nature. 1977;Princeton University Press, Princeton.
2. Friedman L.M., Furberg C.D., DeMets D.L. Fundamentals of clinical trials. 1985;Mosby, St. Louis.
3. Weinstein M.C. Allocation of subjects in medical experiments. N Engl J Med. 291:1974;1278-1285.
4. Fisher S., Cole J.O., Rickels K., Uhlenhutt E.H. Drug-set interaction. the effect of expectation on drug response in outpatients Bradley P.B., Flügel F., Hoch P.H. Neuropsychopharmacology vol. 3. 1964;Elsevier, New York.
5. Kaptchuk T.J. Intentional ignorance. a history of blind assessment and placebo controls Bull Hist Med. 72:1998;389-433.
6. Gehan E.A., Freireich E.J. Non-randomized controls in cancer clinical trials. N Engl J Med. 290:1974;198-203.
7. Kleijnen J., de Craen A.J.M., van Everdingen J., Krol L. Placebo effect in double-blind clinical trials. a review of interactions with medications Lancet. 344:1994;1347-1349.
8. Sibbald B., Roland M. Why are randomized controlled trials important? Br Med J. 316:1998;201-202.
9. Schulz K.F., Chalmers I., Hayes R.J., Altman D.G. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. J Am Med Assoc. 273:1995;408-412.
10. Sackett D.L. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest. 89(Suppl.):1986;2S-3S.
11. Pocock S.J. Allocation of patients to treatment in clinical trials. Biometrics. 35:1979;183-197.
12. Greiner T., Gold H., Cattell M., Travell J., Bakst H., Rinzler S.H., Benjamin Z.H., Warshaw L.J., Bobb A.L., Kwit N.T., Modell W., Rothendler H.H., Messeloff C.R., Kramer M.L. A method for the evaluation of the effects of drugs on cardiac pain in patients with angina on effort. A study of Khellin (Visammin). Am J Med. 9:1950;143-155.
13. Conference on Therapy. How to Evaluate a New Drug. Am J Med 1954;17:722-7.
14. Foulds G.A. Clinical research in psychiatry. J Ment Sci. 104:1958;259-265.
15. Glick B.S., Margolis R. A study of the influence of experimental design on clinical outcome in drug research. Am J Psychol. 118:1962;1087-1096.
16. Astin A., Ross S. Glutamic acid and human intelligence. Psychol Bull. 57:1960;429-434.
17. Wechsler H., Grosser G.H., Greenblatt M. Research evaluating antidepressant medications on hospitalized mental patients. a survey of published reports during a five-year period J Nerve Ment Dis. 141:1965;231-239.
18. Grace N.D., Muench H., Chalmer T.C. The present status of shunts for portal hypertension in cirrhosis. Gastroenterology. 50:1996;684-691.
19. O'Brien W.M. Indomethacin. a survey of clinical trials Clin Pharm Ther. 9:1967;94-107.
20. Kaptchuk T.J. Powerful placebo. the dark side of the randomized controlled trial Lancet. 351:1998;1722-1725.
21. Kunz R., Oxman A.D. The unpredictability paradox. review of empirical comparisons of randomized and non-randomized clinical trials Br Med J. 317:1998;1185-1190.
22. Chalmers T.C., Matta R.J., Smith H., Kunzler A.M. Evidence favoring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med. 297:1977;1091-1096.
23. Sacks H., Chalmers T.C., Smith H. Randomized versus historical controls for clinical trials. Am J Med. 72:1982;233-240.
24. Diehl L.F., Perry D.J. A comparison of randomized concurrent control groups with matched historical control groups. are historical controls valid? J Clin Oncol. 4:1986;1114-1120.
25. Pyorala S., Huttunen N.P., Uhari M. A review and meta analysis of hormonal treatment of cryptorchidism. J Clin Endocrinol Metab. 80:1995;2795-2799.
26. Carroll D., Tramer M., McQuay H., Nye B., Moore A. Randomization is important in studies with pain outcomes. systematic review of transcutaneous electrical nerve stimulation in acute postoperative pain Br J Med. 77:1996;798-803.
27. Reimold S.C., Chalmers T.C., Berlin J.A., Antman E.M. Assessment of the efficacy and safety of antiarrhythmic therapy for chronic atrial fibrillation. observations on the role of trial design and implications of drug related mortality Am Heart J. 124:1992;924-932.
28. Worldwide collaborative observational study and meta-analysis on allogenic leukocyte immunotherapy for recurrent spontaneous abortion. Am J Reprod Immunol. 32:1994;55-72.
29. Watson A., Vanderkerckhove P., Lilford R., Vail A., Brosens I., Hughes E. A meta-analysis of the therapeutic role of oil soluble contrast media at hysterosalpingography. a surprising result? Fertil Steril. 61:1994;470-477.
30. Colditz G.A., Miller J.N., Mosteller F. How study design affects outcomes in comparisons of therapy. I. medical Stat Med. 8:1989;441-454.
31. Miller J.N., Colditz G.A., Mosteller F. How study design affects outcomes in comparisons of therapy. II. surgical Stat Med. 8:1989;455-466.
32. Ottenbacher K. Impact of random assignment on study outcome. an empirical examination Control Clin Trials. 13:1992;50-61.
33. McKee M., Gritton A., Black N., McPherson K., Sanderson C., Bain C. Interpreting the evidence. choosing between randomized and non-randomized studies Br Med J. 319:1999;312-315.
34. Reeves B.C., MacLehose R.R., Harvey I.M., Sheldon T.A., Russell I.T., Black A.M.A. Comparison of effect size estimates derived from randomised and non-randomised studies. Black N., Brazier J., Fitzpatrick R., Reeves B. Health services research methods. a guide to best practice:1998;BMJ Publishing, London.
35. Britton A, McKee M, Black N, McPherson K, Sanderson C, Bain C. Three systematic reviews - not so different answers? [Letter] eBMJ. http://www.bmj.org/cgi/eletters/319/7205/312 .
36. Concato J., Shah N., Horwitz R.I. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med. 342:2000;1887-1892.
37. Benson K., Hartz A.J. A comparison of observational studies and randomized, controlled trials. N Engl J Med. 342:2000;1878-1888.
38. Pocock S.J., Elbourne D.R. Randomized trials or observational tribulations. N Engl J Med. 342:2000;1907-1909.
39. Kunz R, Oxman A. Two systematic reviews-two different answers? [Letter] eBMJ. http://www.bmj.org/cgi/eletters/319/7205/312 .
40. Moher D., Ba'Pham Jones A., Cook D.J., Jadad A.R., Moher M., Tugwell P., Klassen T.P. Does the quality of randomized trials affect estimates of intervention efficacy reported in meta-analysis? Lancet. 352:1998;609-613.
41. Chalmers T.C., Celano P., Sacks H.S., Smith H. Bias in treatment assignment in controlled clinical trials. N Engl J Med. 309:1983;1358-1361.
42. Hacking I. Statistical language, statistical truth and statistical reason. the self-authentication of a style of scientific reasoning McMullin E. The social dimensions of science. 1992;University of Notre Dame Press, Notre Dame.
43. Sacks H.S., Chalmers T.C., Smith H. Sensitivity and specificity of clinical trials. Randomized v historical controls. Arch Intern Med. 143:1983;753-755.
44. Black N. Why we need observational studies to evaluate the effectiveness of health care. Br Med J. 312:1996;1215-1218.
45. McPherson K. The best and the enemy of the good. randomised controlled trials, uncertainty, and assessing the role of patient choice in medical decision making J Epidemiol Comm Health. 48:1994;6-15.
46. Schulz K.F. Subverting randomization on controlled trials. J Am Med Assoc. 274:1995;1456-1458.
47. Torgerson D.J., Sibbald B. What is a patient preference trial? Br Med J. 316:1998;360.
48. Silverman W.A., Altman D.G. Patients' preferences and randomized trials. Lancet. 347:1996;171-174.
49. Urbach P. Randomization and the design of experiments. Philos Science. 52:1985;256-273.
50. Kempthorne O. Why randomize? J Stat Plan Inf. 1:1977;1-25.
51. Dahan R., Caulin C., Figea L., Kanis J.A., Cauline R., Segrestaa J.M. Does informed consent influence therapeutic outcome? A clinical trial of the hypnotic activity of placebo in patients admitted to hospital. Br Med J. 293:1986;363-364.
52. Bergmann J.F., Chassany O., Gandiol J., Deblois P., Kanis J.A., Segrestaa J.M., Caulin C., Dahan R. A randomized clinical trial of the effect of informed consent on the analgesic activity of placebo and naproxen in cancer pain. Clin Trials Meta-Anal. 29:1994;41-47.
53. Roethlisberger F.J., Dickson W.J., Wright H.A. Management and the worker. 1946;Harvard University Press, Cambridge.
54. Bouchet C, Guillemin F, Briançon S. Nonspecific effects in longitudinal studies: impact on quality of life measures. J Clin Epidemiol 1996;1996:49:15-20.
55. Kirsch I., Weixel L.J. Double-blind versus deceptive administration of a placebo. Behav Neurosci. 2:1988;319-323.
56. Hughes J.R., Gulliver S.B., Amori G., Mireault G.C., Fenwsick J.F. Effect of instructions and nicotine on smoking cessation, withdrawal symptoms and self-administration of nicotine gum. Psychopharmacology. 99:1989;486-491.
57. Kirsch I., Rosadino M.J. Do double-blind studies with informed consent yield externally valid results? Psychopharmacology. 110:1993;437-442.
58. Dinnerstein A.J., Lowenthal M., Blitz B. The interaction of drugs with placebos in the control of pain and anxiety. Perspect Biol Med. 10:1966;103-114.
59. Penick S.B., Hinkle L.E. The effect of expectation on response to phenmetrazine. Psychosom Med. 26:1964;369-373.
60. Penick S.G., Fisher S. Drug-set interaction. psychological and physiological effects of epinephrine under differential expectations Psychosom Med. 27:1965;177-182.
61. Lyerly S.B., Ross S., Krugman A.D., Cylde D.J. Drugs and placebos. the effects of instruction upon performance and mood under amphetamine sulphate and chloral hydrate J Abnorm Soc Psychol. 68:1964;321-327.
62. Luparello T.J., Leist N., Lourie C.H., Sweet P. The interaction of psychologic stimuli and pharmacologic agents on airway reactivity in asthmatic subjects. Psychosom Med. 32:1970;509-513.
63. Sodergren S.C., Hyland M.E. Expectancy and asthma. Kirsch I. How expectations shape experience. 1999;American Psychological Association, Washington, DC.
64. Kirsch I. Response expectancy as a determinant of experience and behavior. Am Psychol. 40:1985;1189-1202.
65. Hull J.C., Bond C.F. Social and behavioral consequences of alcohol consumption and expectancy. a meta-analysis Psychol Bull. 99:1986;347-360.
66. Wolf S. Effects of suggestion and conditioning on the action of chemical agents in human subjects - the pharmacology of placebos. J Clin Invest. 29:1950;100-109.
67. Britton A., McKee M., Black N., McPherson K., Sanderson C., Bain C. Choosing between randomised and non-randomised studies. a systematic review Health Technol Assess. 2:1998;1-124.
68. Wolf S. Part IV. Placebos. problems and pitfalls Clin Pharmacol Ther. 3:1962;254-257.
69. Sarles H., Camatte R., Sahel J. A study of the variations in the response regarding duodenal ulcer when treated with placebo by different investigators. Digestion. 16:1977;289-292.
70. Joyce C.R.B. Differences between physicians as revealed by clinical trials. Proc Soc Med. 28:1961;12-14.
71. Thomas K.B. General practice consultations. is there any point in being positive? Br Med J. 294:1987;1200-1202.
72. LeBaron S., Reyher J., Stack J.M. Paternalistic vs. egalitarian physician styles. the treatment of patients in crisis J Fam Med. 21:1985;56-62.
73. Uhlenhuth E.H., Canter A., Neustadt J.O., Payson H.E. The symptomatic relief of anxiety with meprobamate, phenobarbital and placebo. Am J Psychiatry. 115:1959;905-910.
74. Uhlenhuth E.H., Rickels K., Fisher S., Park L.C., Lipman R.S., Mock J. Drug, doctor's verbal attitude and clinic setting in the symptomatic response to pharmacotherapy. Psychopharmacologia (Berl). 9:1966;392-418.
75. Martindale C. The therapist-as-fixed-effect fallacy in psychotherapy research. J Controlled Clin Psychol. 46:1978;1526-1530.
76. Shapiro A.K., Shapiro E. The powerful placebo. from ancient priest to modern physician:1997;The Johns Hopkins University Press, Baltimore.
77. Siegrist J., Peter R., Junge A., Cremer P., Seidel D. Low status control, high effect at work and ischaemic heart disease. prospective evidence from blue-collar men Soc Sci Med. 31:1990;1127-1234.
78. Horwitz R.I., Viscolli C.M., Berkman L., Donaldson R.M., Horwitz S.M., Murray C.J., Ransohoff D.F., Sindelar J. Treatment adherence and risk of death after a myocardial infarction. Lancet. 336:1991;543-545.
79. Horwitz R.I., Horwitz S.M. Adherence to treatment and health outcomes. Arch Intern Med. 153:1993;1863-1868.
80. Brewin C.R., Bradley C. Patient preferences and randomised clinical trials. Br Med J. 299:1989;313-315.
81. Feinstein A.R. Statistics versus science in the design of experiments. Clin Pharm Ther. 11:1970;282-292.
82. Patient population. Am J Cardiol. 56:1985;10G-14G.
83. Smith P., Arnesen H. Mortality in non-consenters in a post-myocardial infarction trial. J Int Med. 228:1990;253-256.
84. Fairhurst K., Dowrick C. Problems with recruitment in a randomized controlled trial of counselling in general practice. causes and implications J Health Serv Res Policy. 1:1996;77-80.
85. Llewellyn-Thomas H.A., McGreal M.J., Thiel E.C., Fine S., Erlichman C. Patients' willingness to enter clinical trials. measuring the association with perceived benefit and preference for decision participation Soc Sci Med. 32:1991;35-42.
86. Charlson M.E., Horwitz R.I. Applying results of randomised trials to clinical practice. impact of losses before randomisation Br Med J. 289:1984;1281-1284.
87. Schooler N.R. How generalizable are the results of clinical trials? Psychopharmacol Bull. 16:1980;29-31.
88. Marcus S.M. Assessing non-consent bias with parallel randomized and nonrandomized clinical trials. J Clin Epidemiol. 50:1997;823-828.
89. Pringle M., Churchill R. Randomised controlled trials in general practice. Gold standard or fool's gold? Br Med J. 311:1995;1382-1383.
90. Schooler N.R., Levine J., Severe J.B., Brauzer B. Prevention of relapse in schizophrenia. Arch Gen Psychol. 37:1980;16-24.
91. Edlund J.M., Craig T.J., Richardson M.A. Informed consent as a form of volunteer bias. Am J Psychol. 142-624-7:1985.
92. Levine R.J. The apparent incompatibility between informed consent and placebo-controlled clinical trials. Clin Pharmacol Ther. 42:1987;247-249.
93. Myers M.G., Cairns J.A., Singer J. The consent form as a possible cause of side effects. Clin Pharmacol Ther. 42:1987;250-253.
94. Simes R.J., Tattershall M.H.N., Coastes A.S., Raghavan D., Solomon H.J. Randomised comparison of procedures for obtaining informed consent in clinical trials of treatment for cancer. Br Med J. 293:1986;1065-1068.
95. Porter T.M. Objectivity as standardization. the rhetoric of impersonality in measurement, statistics, and cost-benefit analysis Ann Scholar. 9:1992;19-60.
96. Mathews J.R. Quantification and the quest for medical certainty. 1995;Princeton University Press, Princeton.
97. Megill A. Introduction. Four senses of objectivity Megill A. Rethinking objectivity. 1994;Duke University Pres, Durham.
98. Putnam H. Reason, truth, and history. 1981;Cambridge University Press, Cambridge.
99. Feinstein A.R. Meta-analysis. statistical alchemy for the 21st century J Clin Epidemiol. 48:1995;71-79.