In randomization we trust? There are overlooked problems in experimenting with people in behavioral intervention trials

Journal of Clinical Epidemiology

Volumn 67, Issue 3, 2014, Pages 247-253

  McCambridge, Jim ^a   Kypri, Kypros ^b   Elbourne, Diana ^a  

^a LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^b UNIVERSITY OF NEWCASTLE   (Australia)

Author keywords

Behavior; Bias; Hawthorne effect; Intervention; Research participation; Trials

Indexed keywords

ARTICLE; BEHAVIOR CHANGE; BEHAVIORAL INTERVENTION TRIALS; DRINKING BEHAVIOR; HUMAN; INTERVENTION STUDY; MEDICAL RESEARCH; OVERNUTRITION; PATIENT PREFERENCE; PRIORITY JOURNAL; RANDOMIZATION; SEDENTARY LIFESTYLE; SMOKING CESSATION; STUDY DESIGN;

BEHAVIOR; BIAS; HAWTHORNE EFFECT; INTERVENTION; RESEARCH PARTICIPATION; TRIALS;

BEHAVIOR THERAPY; BIAS (EPIDEMIOLOGY); HEALTH BEHAVIOR; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; THERAPEUTIC HUMAN EXPERIMENTATION;

EID: 84894930266     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2013.09.004     Document Type: Note

References (57)

1. A.H. Mokdad, J.S. Marks, D.F. Stroup, and J.L. Gerberding Actual causes of death in the United States, 2000 JAMA 291 2004 1238 1245 PubMed PMID: 15010446
2. A.L. Kinmonth, N.J. Wareham, W. Hardeman, S. Sutton, A.T. Prevost, and T. Fanshawe et al. Efficacy of a theory-based behavioural intervention to increase physical activity in an at-risk group in primary care (ProActive UK): a randomised trial Lancet 371 2008 41 48 PubMed PMID: 18177774. Epub January 08, 2008. eng
3. R.L. Solomon An extension of control group design Psychol Bull 46 2 1949 137 150 PubMed PMID: 18116724. Epub March 1, 1949. eng
4. G. Godin, P. Sheeran, M. Conner, and M. Germain Asking questions changes behavior: mere measurement effects on frequency of blood donation Health Psychol 27 2 2008 179 184 PubMed PMID: 18377136. Epub April 2, 2008. eng
5. M. Conner, G. Godin, P. Norman, and P. Sheeran Using the question-behavior effect to promote disease prevention behaviors: two randomized controlled trials Health Psychol 30 3 2011 300 309 PubMed PMID: 21553974. Epub May 11, 2011. eng
6. J. McCambridge Research assessments: instruments of bias and brief interventions of the future? Addiction 104 8 2009 1311 1312 PubMed PMID: 19624324. Epub July 25, 2009. eng
7. J. McCambridge, and K. Kypri Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials PLoS One 6 10 2011 e23748 PubMed PMID: 21998626. Pubmed Central PMCID: 3187747. Epub October 15, 2011. eng
8. T. Sandberg, and M. Conner Using self-generated validity to promote exercise behaviour Br J Soc Psychol 50 4 2011 769 783 PMID: 21361982. Epub March 3, 2011. eng
9. J.R.P. French Experiments in field settings L. Festinger, D. Katz, Research methods in the behavioral sciences 1953 Holt, Rinehart & Winston New York, NY
10. H.M. Parsons What happened at Hawthorne? Science 181 1974 922 932
11. J.G. Adair The Hawthorne effect: a reconsideration of the methodological artefact J Appl Psychol 69 1984 334 345
12. S.R.G. Jones Was there a Hawthorne effect? Am J Sociol 98 1992 451 468
13. D.T. Campbell Factors relevant to the validity of experiments in social settings Psychol Bull 54 4 1957 297 312 PubMed PMID: 13465924. Epub July 1, 1957. eng
14. M.T. Orne The nature of hypnosis: artifact and essence J Abnorm Psychol 58 1959 277 299
15. M.T. Orne On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications Am Psychol 17 1962 776 783
16. R.L. Rosnow, and R. Rosenthal People studying people: artifacts and ethics in behavioral research 1997 Freeman New York, NY
17. J. McCambridge, J. Witton, and D. Elbourne Systematic review of the Hawthorne effect J Clin Epidemiol 67 2014 267 277 [in this issue]
18. J. McCambridge, K. Butor-Bhavsar, J. Witton, and D. Elbourne Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from Solomon 4-group studies PLoS One 6 10 2011 e25223 Epub doi: 10.1371/journal.pone.0025223
19. J. McCambridge, M. de Bruin, and J. Witton The effects of demand characteristics on research participant behaviours in non-laboratory settings: a systematic review PLoS One 7 6 2012 e39116
20. I. Kirsch Are drug and placebo effects in depression additive? Biol Psychiatry 47 8 2000 733 735 PubMed PMID: 10773181. Epub April 22, 2000. eng
21. P.C. Amrhein, W.R. Miller, C.E. Yahne, M. Palmer, and L. Fulcher Client commitment language during motivational interviewing predicts drug use outcomes J Consult Clin Psych 71 5 2003 862 878 PubMed PMID: AMRHEIN2003
22. P.R. Clifford, and S.A. Maisto Subject reactivity effects and alcohol treatment outcome research J Stud Alcohol 61 6 2000 787 793 PubMed PMID: 11188483. Epub February 24, 2001. eng
23. W.R. Miller Motivation for treatment: a review with special emphasis on alcoholism Psychol Bull 98 1 1985 84 107 PubMed PMID: MILLER1985
24. I.L. Kvalem, J.M. Sundet, K.I. Rivo, D.A. Eilertsen, and L.S. Bakketeig The effect of sex education on adolescents' use of condoms: applying the Solomon four-group design Health Educ Q 23 1 1996 34 47 PubMed PMID: 8822400. Epub February 1, 1996. eng
25. T.D. Cook, and D.T. Campbell Quasi-experimentation: design and analysis. Issues for field settings 1979 Rand McNally Chicago, IL
26. W.A. Silverman, and D.G. Altman Patients' preferences and randomised trials Lancet 347 1996 171 174
27. Preference Collaborative Review Group Patients' preferences within randomised trials: systematic review and patient level meta-analysis BMJ 337 2008 a1864
28. C.R. Brewin, and C. Bradley Patient preferences and randomized clinical trials Br Med J 299 1989 313 315
29. M. Zelen A new design for randomized clinical trials N Engl J Med 300 1979 1242 1245
30. M. Zelen Randomized consent designs for clinical trials: an update Stat Med 9 1990 654 656
31. R. Schellings, A.G. Kessels, G. ter Riet, F. Sturmans, G.A. Widdershoven, and J.A. Knottnerus Indications and requirements for the use of prerandomization J Clin Epidemiol 62 2009 393 399 PubMed PMID: 19056237
32. M. King, I. Nazareth, F. Lampe, P. Bower, M. Chandler, and M. Morou et al. Impact of participant and physician intervention preferences on randomized trials: a systematic review JAMA 293 2005 1089 1099
33. J. Adamson, S. Cockayne, S. Puffer, and D.J. Torgerson Review of randomised trials using the post-randomised consent (Zelen's) design Contemp Clin Trials 27 2006 305 319
34. A.J. de Craen, T.J. Kaptchuk, J.G. Tijssen, and J. Kleijnen Placebos and placebo effects in medicine: historical overview J R Soc Med 92 10 1999 511 515 PubMed PMID: 10692902. Epub February 29, 2000. eng
35. T.J. Kaptchuk, J.M. Kelley, L.A. Conboy, R.B. Davis, C.E. Kerr, and E.E. Jacobson et al. Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome BMJ 336 2008 999 1003 PubMed PMID: 18390493. Epub April 9, 2008. eng
36. B.T. Walsh, S.N. Seidman, R. Sysko, and M. Gould Placebo response in studies of major depression: variable, substantial, and growing JAMA 287 2002 1840 1847 PubMed PMID: 11939870. Epub April 10, 2002. eng
37. B. Colagiuri Participant expectancies in double-blind randomized placebo-controlled trials: potential limitations to trial validity Clin Trials 7 2010 246 255 PubMed PMID: 20421243
38. N. Mills, J.L. Donovan, J. Wade, F.C. Hamdy, D.E. Neal, and J.A. Lane Exploring treatment preferences facilitated recruitment to randomized controlled trials J Clin Epidemiol 64 2011 1127 1136 PubMed PMID: 21477994. Pubmed Central PMCID: 3167372. Epub April 12, 2011. eng
39. Higgins JPT, Altman DG, Sterne JAC, on behalf of the Cochrane Statistical Methods Group and the Cochrane Bias Methods Group. Chapter 8: assessing risk of bias in included studies. In: Higgins JPT, Green, S, Eds. Cochrane handbook for systematic reviews of interventions version 510 (updated March 2011): the Cochrane Collaboration. 2011. Available at www.cochrane-handbook.org.
40. J.P. Higgins, D.G. Altman, P.C. Gotzsche, P. Juni, D. Moher, and A.D. Oxman et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials BMJ 343 2011 d5928 PubMed PMID: 22008217. Pubmed Central PMCID: 3196245
41. G. Dunn, M. Maracy, C. Dowrick, J.L. Ayuso-Mateos, O.S. Dalgard, and H. Page et al. Estimating psychological treatment effects from a randomised controlled trial with both non-compliance and loss to follow-up Br J Psychiatry 183 2003 323 331 PubMed PMID: 14519610
42. G. Dunn, and E. Goetghebeur Analysing compliance in clinical trials Stat Methods Med Res 14 4 2005 325 326 PubMed PMID: 16178135
43. K. Kypri, J. McCambridge, A. Wilson, J. Attia, P. Sheeran, and S. Bowe et al. Effects of Study Design and Allocation on participant behaviour - ESDA: study protocol for a randomized controlled trial Trials 12 1 2011 42 PubMed PMID: 21320316. Pubmed Central PMCID: 3045904. Epub February 16, 2011. eng
44. K.E. Freedland, D.C. Mohr, K.W. Davidson, and J.E. Schwartz Usual and unusual care: existing practice control groups in randomized controlled trials of behavioral interventions Psychosom Med 73 4 2011 323 335 PubMed PMID: 21536837. Pubmed Central PMCID: 3091006. Epub May 4, 2011. eng
45. J. McCambridge, KK, P. Bendtsen, and J. Porter The use of deception in public health behavioural intervention trials: a case study of three online alcohol trials Am J Bioeth 13 11 2013 39 47
46. J. Thompson, R. Barber, P.R. Ward, J.D. Boote, C.L. Cooper, and C.J. Armitage et al. Health researchers' attitudes towards public involvement in health research Health Expect 12 2 2009 209 220 PubMed PMID: 19392833
47. J. Savovic, H. Jones, D. Altman, R. Harris, P. Juni, and J. Pildal et al. Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies Health Technol Assess 16 2012 1 82 PubMed PMID: 22989478
48. I. Boutron, and P. Ravaud Classification systems to improve assessment of risk of bias J Clin Epidemiol 65 2012 236 238 PubMed PMID: 22264767
49. I. Boutron, F. Tubach, B. Giraudeau, and P. Ravaud Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials J Clin Epidemiol 57 2004 543 550 PubMed PMID: 15246122. Epub July 13, 2004. eng
50. P. Bower, M. King, I. Nazareth, F. Lampe, and B. Sibbald Patient preferences in randomised controlled trials: conceptual framework and implications for research Soc Sci Med 61 3 2005 685 695 PubMed PMID: 15899326
51. J. McCambridge, K. Kypri, and A. Wilson How should debriefing be undertaken in web-based studies? Findings from a randomised controlled trial J Med Internet Res 14 6 2012 e157
52. J. McCambridge, P. Bendtsen, M. Bendtsen, and P. Nilsen Alcohol email assessment and feedback study dismantling effectiveness for university students (AMADEUS-1): study protocol for a randomized controlled trial Trials 13 1 2012 49 PubMed PMID: 22540638. Epub May 1, 2012. eng
53. J. McCambridge, M. Bendtsen, N. Karlsson, I.R. White, P. Nilsen, and P. Bendtsen Alcohol assessment and feedback by e-mail for university students: main findings from the AMADEUS-1 randomised controlled trial Br J Psychiatry 2013 DOI: 10.1192/bjp.bp.113.128660 PubMed PMID: 24072758
54. S.K. McCann, M.K. Campbell, and V.A. Entwistle Reasons for participating in randomised controlled trials: conditional altruism and considerations for self Trials 11 2010 31 PubMed PMID: 20307273. Pubmed Central PMCID: 2848220. Epub March 24, 2010. eng
55. T.M. Marteau, R.E. Ashcroft, and A. Oliver Using financial incentives to achieve healthy behaviour BMJ 338 2009 b1415 PubMed PMID: 19359291. Epub April 11, 2009. eng
56. S.D. Hollon Randomized controlled trials are relevant to clinical practice Can J Psychiatry 54 9 2009 637 639 PubMed PMID: 19751553
57. M.C. Fiore, R.C. Jaen, T.B. Baker, W.C. Bailey, N.L. Benowitz, and S.J. Curry et al. Treating tobacco use and dependence: 2008 update 2008 U.S. Department of Health and Human Services. Public Health Service Rockville, MD Available at www.surgeongeneral.gov/tobacco/treating-tobacco-use08.pdf May 2008. Report No