Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions

Trials

Volumn 13, Issue , 2012, Pages

  Wells, Mary ^a   Williams, Brian ^b   Treweek, Shaun ^a   Coyle, Joanne ^c   Taylor, Julie ^a,d  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

^b UNIVERSITY OF STIRLING   (United Kingdom)

^c UNIVERSITY OF ST ANDREWS   (United Kingdom)

^d National Society for the Prevention of Cruelty to Children   (United Kingdom)

Author keywords

Case study; Complex interventions; Context; RCT

Indexed keywords

ARTICLE; DOCUMENTATION; HUMAN; INFORMATION PROCESSING; INTERVIEW; RANDOMIZED CONTROLLED TRIAL (TOPIC);

ADAPTATION, PSYCHOLOGICAL; ATTITUDE OF HEALTH PERSONNEL; COOPERATIVE BEHAVIOR; EVIDENCE-BASED MEDICINE; GUIDELINE ADHERENCE; HEALTH KNOWLEDGE, ATTITUDES, PRACTICE; HUMANS; INTERDISCIPLINARY COMMUNICATION; ORGANIZATIONAL OBJECTIVES; PATIENT CARE TEAM; PRACTICE GUIDELINES AS TOPIC; PROFESSIONAL-PATIENT RELATIONS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN; RESEARCH PERSONNEL; RESEARCH SUBJECTS; TREATMENT OUTCOME;

EID: 84862755598     PISSN: None     EISSN: 17456215     Source Type: Journal    
DOI: 10.1186/1745-6215-13-95     Document Type: Article

References (75)

1. Medical Research Council A framework for development and evaluation of RCTs for complex interventions to improve health 2000, London: Medical Research Council, Medical Research Council.
2. Hoddinott P, Britten J, Pill R. Why do interventions work in some places and not others: a breastfeeding support group trial. Soc Sci Med 2010, 70:769-778. 10.1016/j.socscimed.2009.10.067, 20005617.
3. Voigt-Radloff S, Graff M, Leonhart R, Hull M, Rikkert M, Vernooij-Dassen M. Why did an effective Dutch complex psycho-social intervention for people with dementia not work in the German healthcare context? Lessons learnt from a process evaluation alongside a multicentre RCT. BMJ Open 2011, 1:e000094. 10.1136/bmjopen-2011-000094, 3191434, 22021759.
4. Wilson DK, Griffin S, Saunders RP, Kitzman-Ulrich H, Meyers DC, Mansard L. Using process evaluation for program improvement in dose, fidelity and reach: the ACT trial experience. International Journal of Behavioural Nutrition and Physical Activity 2009, 6:79.
5. Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ 2001, 323:625-628. 10.1136/bmj.323.7313.625, 1121189, 11557716.
6. Blackwood B. Methodological issues in evaluating complex healthcare interventions. J Adv Nurs 2006, 54:612-622. 10.1111/j.1365-2648.2006.03869.x, 16722959.
7. Craig P, Dieppe P, MacIntyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008, 337:a1655. 10.1136/bmj.a1655, 2769032, 18824488.
8. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be?. BMJ 2004, 328:1561-1563. 10.1136/bmj.328.7455.1561, 437159, 15217878.
9. Perera R, Henghan C, Yudkin P. Graphical method for depicting randomised trials of complex interventions. BMJ 2007, 334:127-129. 10.1136/bmj.39045.396817.68, 1779898, 17235093.
10. Butler H, Bowes G, Drew S, Glover S, Godfrey C, Patton G, Trafford L, Bond L. Harnessing complexity: taking advantage of context and relationships in dissemination of school-based interventions. Health Promot Pract 2010, 11:259-267. 10.1177/1524839907313723, 18353909.
11. Iliffe S. Hospital at home: from red to amber?. BMJ 1998, 316:1761-1762. 10.1136/bmj.316.7147.1761, 1113311, 9624058.
12. Dowswell G, Lawler J, Young J. Unpacking the 'black box' of a nurse-led stroke support service. Clin Rehabil 2000, 14:160-171. 10.1191/026921500672130349, 10763793.
13. Dowswell G, Lawler J, Dowswell T, Young J, Forster A, Hearn J. Investigating recovery from stroke: a qualitative study. J Clin Nurs 2000, 9:507-515. 10.1046/j.1365-2702.2000.00411.x, 11261130.
14. van Meijel B, Gamel C, van Swieten-Duijfjes B, Grypdonck MH. The development of evidence-based nursing interventions: methodological considerations. J Adv Nurs 2004, 48:84-92. 10.1111/j.1365-2648.2004.03171.x, 15347414.
15. Glaziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews?. BMJ 2008, 336:1472-1474. 10.1136/bmj.39590.732037.47, 2440840, 18583680.
16. Karanicolas P, Montori V, Devereaux P, Schünemann H, Guyatt G. A new 'mechanistic-practical' framework for designing and interpreting randomized trials. J Clin Epidemiol 2009, 62:479-484. 10.1016/j.jclinepi.2008.02.009, 18468856.
17. Kent D, Kitsios G. Against pragmatism: on efficacy, effectiveness and the real world. Trials 2009, 10:48. 10.1186/1745-6215-10-48, 2715401, 19580642.
18. Oxman A, Lombard C, Treweek S, Gagnier J, Maclure M, Zwarenstein M. Why we will remain pragmatists: four problems with the impractical mechanistic framework and a better solution. J Clin Epidemiol 2009, 62:485-488. 10.1016/j.jclinepi.2008.08.015, 19348973.
19. ICEBeRG Designing theoretically-informed implementation interventions. (The improved clinical effectiveness through behavioural research group). Implementation Science 2006, 1:4. 10.1186/1748-5908-1-4, 1436012, 16722571, ICEBeRG.
20. Connelly J. Realism in evidence based medicine: interpreting the randomised controlled trial. Journal of Health Organisation and Management 2004, 18:70-81.
21. McCormack J, Greenhalgh T. Seeing what you want to see in a randomised controlled trial: versions and perversions of UKPDS data. BMJ 2000, 320:1720-1723. 10.1136/bmj.320.7251.1720, 1127485, 10864554.
22. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review - a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy 2005, 10:21-34. 10.1258/1355819054308530, 16053581.
23. Boutron I, Moher D, Altman D, Schulz K, Ravaud P. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008, 148:295-309.
24. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D, . for the CONSORT and Pragmatic Trials in Healthcare (Practihc) groups Improving the reporting of pragmatic trials: an extension of the CONSORT Statement. BMJ 2008, 337. for the CONSORT and Pragmatic Trials in Healthcare (Practihc) groups.
25. Schulz R, Czaja SJ, McKay JR, Ory MG, Bell SH. Intervention Taxonomy (ITAX): describing essential features of interventions. American J of Health Behav 2010, 34:811-821.
26. Hart A. What is a research question? A case study in the early stages of design of a randomised controlled trial for a complementary therapy. Complement Ther Med 2003, 11:42-45. 10.1016/S0965-2299(02)00114-0, 12667975.
27. Wight D, Obasi A. Unpacking the 'black box': the importance of process data to explain outcomes. Effective Sexual Interventions: issues in experimental evaluation 2003, 151-169. Oxford: Oxford University Press, Stephenson J, Imrie J, Bonell C.
28. Toroyan T, Oakley A, Laing G, Roberts I, Mugford M, Turner J. The impact of day care on socially disadvantaged families: an example of the use of process evaluation within a randomized controlled trial. Care, Health & Development 2004, 30:691-698.
29. Wells EM. Behind the scenes of randomised trials of complex interventions: insiders reveal the importance of context. PhD Thesis 2007, Dundee: College of Medicine, Dentistry and Nursing, University of Dundee.
30. Yin R. Case study research: Design and Methods 1994, Thousand Oaks: Sage, 2.
31. Stoecker R. Evaluating and rethinking the case study. Sociol Rev 1991, 39:88-112.
32. Crowe C, Cresswell K, Robertson R, Huby G, Avery A, Sheikh A. The case study approach. BMC Research Methodology 2011, 11:100.
33. Wells M, Harrow A, Donnan P, Davey P, Devereux S, Little G, McKenna E, Wood R, Chen R, Thompson A. Patient, carer and health service outcomes of nurse-led early discharge after breast cancer surgery: a randomised controlled trial. Br J Cancer 2004, 91:651-658. 2364768, 15238983.
34. National Research Register (NRR) Archive. http://www.nihr.ac.uk/Pages/NRRArchive.aspx.
35. Ritchie J, Spencer L. Qualitative data analysis for applied policy research. Analysing Qualitative Data 1993, 173-194. London: Routledge, Bryman A, Burgess R.
36. NVIVO 2. http://www.qsrinternational.com/products_previous-products_nvivo2.aspx.
37. Mays N. Qualitative Research: rigour and qualitative research. BMJ 1995, 311:109-112. 10.1136/bmj.311.6997.109, 2550154, 7613363.
38. Mays N, Pope C. Assessing quality in qualitative research. BMJ 2000, 320:50-52. 10.1136/bmj.320.7226.50, 1117321, 10617534.
39. Kovach C, Cashin J, Sauer L. Deconstruction of a complex tailored intervention to assess and treat discomfort of people with advanced dementia. J Adv Nurs 2006, 55:678-688. 10.1111/j.1365-2648.2006.03968.x, 16925616.
40. Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health psychology: Official journal of the Division of Health Psychology, American Psychological Association 2008, 27:379-387.
41. Voigt-Radloff S, Graff M, Leonhart R, Hull M, Rikkert MO, Vernooij-Dassen M. Why did an effective Dutch complex psycho-social intervention for people with dementia not work in the German healthcare context? Lessons learnt from a process evaluation alongside a multicentre RCT. BMJ Open 2011,
42. Mcdonald A, Treweek S, Shakur H, Free C, Knight R, Speed C, Campbell M. Using a business model approach and marketing techniques for recruitment to clinical trials. Trials 2011, 12:74. 10.1186/1745-6215-12-74, 3063210, 21396088.
43. Czaja SJ, Schulz R, Lee CC, Belle SH, . REACH Investigators A methodology for describing and decomposing complex psychosocial and behavioural interventions. Psychol Aging 2003, 18:385-395. REACH Investigators.
44. Connell J, Kubisch A. Applying a theory of change approach to the evaluation of comprehensive community initiatives: progress, prospects, and problems. http://www.aspeninstitute.org/site/c.huLWJeMRKpH/b.613709/k.B547/Applying_a_Theory_of_Change_Approach_to_the_Evaluation_of_Comprehensive_Community_Initiatives_Progress_Prospects_and_Problems.htm.
45. Glasgow RE. Evaluation of theory-based interventions: The RE-AIM model. Health Behavior and Health Education 2002, 531-544. San Francisco: Jossey-Bass, Glanz K, Lewis FM, Rimer BK, 3.
46. Lloyd JJ, Logan S, Greaves CJ, Wyatt KM. Evidence, theory and context - using intervention mapping to develop a school-based intervention to prevent obesity in children. Int J Behav Nutr Phys Act 2011, 8:73. 10.1186/1479-5868-8-73, 3152876, 21752261.
47. Hardeman W, Sutton S, Griffin S, Johnston M, White A, Wareham NJ, Kinmonth AL. A causal modelling approach to the development of theory-based behaviour change programmes for trial evaluation. Health Educ Res 2005, 20:676-687. 10.1093/her/cyh022, 15781446.
48. Fayter D, McDaid C, Ritchie G, Stirk L, Eastwood A. Systematic review of barriers, modifiers and benefits involved in participation in cancer clinical trials. Centre for Reviews and Dissemination 2006, York: University of York, http://www.york.ac.uk/inst/crd/CRD_Reports/crdreport31.pdf.
49. Ziebland S, Featherstone K, Snowdon C, Barker K, Frost H, Fairbank J. Does it matter if clinicians recruiting for a trial don't understand what the trial is really about? Qualitative study of surgeons experiences of participation in a pragmatic multi-centre RCT. Trials 2007, 8:4. 10.1186/1745-6215-8-4, 1794540, 17257440.
50. Snowdon C, Garcia J, Elbourne D. Making sense of randomisation; responses of parents of critically ill babies to random allocation of treatment in a clinical trial. Soc Sci Med 1997, 45:1337-1355. 10.1016/S0277-9536(97)00063-4, 9351153.
51. Dolan G, Broomfield J, Lewith G, Watkins A. Operational and resource management of an RCT: some of the pitfalls and lessons learned. J Clin Nurs 1999, 8:389-395. 10.1046/j.1365-2702.1999.00256.x, 10624255.
52. Treweek S, Mitchell E, Pitkethly M, Cook J, Kjeldstrøm M, Johansen M, Taskila T, Sullivan F, Wilson S, Jackson C, Jones R, Lockhart P. Strategies to improve recruitment to randomised controlled trials. Cochrane Database Syst Rev 2010, 4:MR000013.
53. McKinstry B, Hammersley V, Daly F, Sullivan F. Recruitment and retention in a multicentre randomised controlled trial in Bells palsy: A case study. BMC Med Res Methodol 2007, 7:15. 10.1186/1471-2288-7-15, 1847527, 17391510.
54. Prescott R, Counsell C, Gillespie W, Grant A, Russell I, Kiauka S, Colthart I, Ross S, Shepherd S, Russell D. Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess 1999, 3:1-143.
55. Campbell M, Snowdon C, Francis D, Elbourne D, McDonald A, Knight R, Entwistle V, Garcia J, Roberts I, Grant A, Grant A, . STEPS group Recruitment to randomised trials: strategies for trial enrolment and participation study. The STEPS study. Health Technol Assess 2007, 11. http://www.hta.ac.uk/fullmono/mon1148.pdf, STEPS group.
56. Plant H, Bredin M, Krishnasamy M, Corner J. Working with resistance, tension and objectivity: conducting a randomised controlled trial of a nursing intervention for breathlessness. NT Research 2000, 5:426-434.
57. Bredin M, Corner J, Krishnasamy M, A'Hern R, Bailey C. Multicentre randomised controlled trial of nursing intervention for breathlessness in patients with lung cancer. BMJ 1999, 318:901-904. 10.1136/bmj.318.7188.901, 27809, 10102851.
58. Schulz KF. Unbiased research and the human spirit: the challenges of randomized controlled trials. Can Med Assoc J 1995, 153:783-786.
59. Watson J, Torgerson D. Increasing recruitment to randomised trials: a review of randomised controlled trials. BMC Med Res Methodol 2006, 6:34. 10.1186/1471-2288-6-34, 1559709, 16854229.
60. Lawton J, Jenkins N, Darbyshire J, Holman R, Farmer A, Hallowell N. Challenges of maintaining research protocol fidelity in a clinical care setting: A qualitative study of the experiences and views of patients and staff participating in a randomized controlled trial. Trials 2011, 12:108. 10.1186/1745-6215-12-108, 3104488, 21542916.
61. Schulz KF, Altman DG, Moher D, . CONSORT Group CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials 2010, 11:32. 10.1186/1745-6215-11-32, 2857832, 20334632, CONSORT Group.
62. Mackenzie M, O'Donnell C, Halliday E, Sridharan S, Platt S. Evaluating complex interventions: one size does not fit all. BMJ 2010, 340:401-403.
63. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol 2008, 8:45. 10.1186/1471-2288-8-45, 2478656, 18616818.
64. Power R, Williams B. Checklists for improving rigour in qualitative research. Including personal reflections might help. BMJ 2001, 323:514.3.
65. Kingdon C. Reflexivity: Not just a qualitative methodological research tool. British Journal of Midwifery 2005, 13:622-627.
66. MacPherson H, Thorpe L, Thomas K. Beyond needling - therapeutic processes in acupuncture care: a qualitative study nested within a low-back pain trial. J Altern Complement Med 2006, 12:873-880. 10.1089/acm.2006.12.873, 17109578.
67. Reflexivity: a practical guide for researchers in health and social science 2003, Oxford: Blackwell, Finlay L, Gough B.
68. Audrey S, Holliday J, Parry-Langdon N, Campbell R. Meeting the challenges of implementing process evaluation within randomized controlled trials: the example of ASSIST (A Stop Smoking in Schools Trial). Health Educ Res 2006, 21:366-377. 10.1093/her/cyl029, 16740670.
69. Hotopf M, Churchill R, Lewis G. Pragmatic randomised controlled trials in psychiatry. Br J Psychiatry 1999, 175:217-223. 10.1192/bjp.175.3.217, 10645321.
70. Oakley A, Strange V, Bonell C, Allen E, Stephenson J, . Ripple Study Team Process evaluation in randomised controlled trials of complex interventions. BMJ 2006, 332:413-416. 10.1136/bmj.332.7538.413, 1370978, 16484270, Ripple Study Team.
71. Schwartz D, Lelouch J. Explanatory and pragmatic attitudes in therapeutic trials. Journal of Chronic Disease 1967, 20:637-648.
72. Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Sequin R. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol 2003, 3:28. 10.1186/1471-2288-3-28, 317298, 14690550.
73. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell K, Ong BN, Rapley T, Rogers A, May C. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med 2010, 8:63. 10.1186/1741-7015-8-63, 2978112, 20961442.
74. Riley T, Hawe P, Shiell A. Contested ground: how should qualitative evidence inform the conduct of a community intervention trial?. J Health Serv Res Policy 2005, 10:103-110. 10.1258/1355819053559029, 15831193.
75. McCormack B, Kitson A, Harvery G, Rycroft-Malone J, Titchen A, Seers K. Getting evidence into practice: the meaning of 'context'. J Adv Nurs 2002, 38:94-104. 10.1046/j.1365-2648.2002.02150.x, 11895535.