Reducing the risk of bias in health behaviour change trials: Improving trial design, reporting or bias assessment criteria? A review and case study

Psychology and Health

Volumn 30, Issue 1, 2015, Pages 8-34

  de Bruin, Marijn ^a,b   McCambridge, Jim ^c   Prins, Jan M ^d  

^a UNIVERSITY OF ABERDEEN   (United Kingdom)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

^c LONDON SCHOOL OF HYGIENE AND TROPICAL MEDICINE   (United Kingdom)

^d ACADEMIC MEDICAL CENTER   (Netherlands)

Author keywords

behaviour change; Cochrane; intervention; methodology; randomised controlled trial; risk of bias

Indexed keywords

HEALTH BEHAVIOR; HIV INFECTIONS; HUMAN; METHODOLOGY; PROCEDURES; PSYCHOLOGY; RANDOMIZED CONTROLLED TRIAL (TOPIC); RISK; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); HEALTH BEHAVIOR; HIV INFECTIONS; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN; RISK;

EID: 84918534901     PISSN: 08870446     EISSN: 14768321     Source Type: Journal    
DOI: 10.1080/08870446.2014.953531     Document Type: Article

References (62)

1. Amico, K. R. (2009). Percent total attrition: A poor metric for study rigor in hosted intervention designs. American Journal of Public Health, 99, 1567–1575. doi:10.2105/AJPH10.2105/AJPH.2008.134767
2. Asendorpf, J. B., Conner, M., De Fruyt, F., De Houwer, J., Denissen, J. J. A., Fiedler, K., … Wicherts, J. M. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119. doi:10.1002/per.191910.1002/per.1919
3. Ayling, K., Brierley, S., Johnson, B., Heller, S., & Eiser, C. (2015). How standard is standard care? Exploring control group outcomes in behaviour change interventions for young people with type 1 diabetes. Psychology & Health, 30, 85–103.
4. Bartholomew, L. K., Parcel, G. S., Kok, G., Gottlieb, N. H., & Fernández, M. E. (2011). Planning health promotion programs: An intervention mapping approach (3rd ed.). San Francisco, CA: Jossey-Bass.
5. Bertholet, N., Favrat, B., Stubi, C. L. F., Brunner, H. R., & Burnier, M. (2000). Why objective monitoring of compliance is important in the management of hypertension. Journal of Clinical Hypertension, 2, 258–262.
6. Bishop, F. L., Fenge-Davies, A. L., Kirby, S., & Geraghty, A. W. A. (2015). Context effects and behaviour change techniques in randomized trials: A systematic review using the example of trials to increase adherence to physical activity in musculoskeletal pain. Psychology & Health, 30, 104–121.
7. Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., & Ravaud, P. (2007). Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Medicine, 4, e61. doi:10.1371/journal.pmed.004006110.1371/journal.pmed.0040061
8. Boutron, I., Moher, D., Altman, D. G., Schulz, K. F., Ravaud, P., & CONSORT Group. (2008). Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: Explanation and elaboration. Annals of Internal Medicine, 148, 295–309. doi:10.7326/0003-4819-148-4-200802190-0000810.7326/0003-4819-148-4-200802190-00008
9. Bruhn, M., & McKenzie, D. (2009). In pursuit of balance: Randomization in practice in development field experiments. American Economic Journal: Applied Economics, 1, 200–232. doi:10.1257/app.1.4.200
10. de Bruin, M. (2013). Does MAPS work and in what setting? Considerations regarding the internal and external validity of a trial evaluating an intervention to promote adherence to HIV treatment. Journal of the American Medical Association Internal Medicine, 173, 1474. doi:10.1001/jamainternmed.2013.778810.1001/jamainternmed.2013.7788
11. de Bruin, M., Hospers, H. J., van Breukelen, G. J. P., Kok, G., Koevoets, W. M., & Prins, J. M. (2010). Electronic monitoring-based counseling to enhance adherence among HIV-infected patients: A randomized controlled trial. Health Psychology, 29, 421–428. doi:10.1037/a002033510.1037/a0020335
12. de Bruin, M., Hospers, H. J., van den Borne, H. W., Kok, G., & Prins, J. M. (2005). Theory- and evidence-based intervention to improve adherence to antiretroviral therapy among HIV-infected patients in the Netherlands: A pilot study. Aids Patient Care and STDs, 19, 394–394. doi:10.1089/apc.2005.19.384
13. de Bruin, M., Viechtbauer, W., Hospers, H. J., Schaalma, H. P., & Kok, G. (2009). Standard care quality determines treatment outcomes in control groups of HAART-adherence intervention studies: Implications for the interpretation and comparison of intervention effects. Health Psychology, 28, 668–674. doi:10.1037/a001598910.1037/a0015989
14. de Bruin, M., Viechtbauer, W., Schaalma, H. P., Kok, G., Abraham, C., & Hospers, H. J. (2010). Standard care impact on effects of highly active antiretroviral therapy adherence interventions – A meta-analysis of randomized controlled trials. Archives of Internal Medicine, 170, 240–250. doi:10.1001/archinternmed.2009.53610.1001/archinternmed.2009.536
15. Chaudoir, S. R., Dugan, A. G., & Barr, C. H. I. (2013). Measuring factors affecting implementation of health innovations: A systematic review of structural, organizational, provider, patient, and innovation level measures. Implementation Science, 8(22), 1–20.
16. Crocetti, M. T., Amin, D. D., & Scherer, R. (2010). Assessment of risk of bias among pediatric randomized controlled trials. Pediatrics, 126, 298–305. doi:10.1542/peds.2009-312110.1542/peds.2009-3121
17. Crutzen, R., Peters, G.-J. Y., & Abraham, C. (2012). What about trialists sharing other study materials? British Medical Journal, 345, e8352. doi:10.1136/bmj.e835210.1136/bmj.e8352
18. Crutzen, R., Viechtbauer, W., Spigt, M., & Kotz, D. (2015). Differential attrition in health behaviour change trials: A systematic review and meta-analysis. Psychology & Health, 30, 122–134.
19. Demonceau, J., Ruppar, T., Kristanto, P., Hughes, D. A., Fargher, E., Kardas, P., … Vrijens, B. (2013). Identification and assessment of adherence-enhancing interventions in studies assessing medication adherence through electronically compiled drug dosing histories: A systematic literature review and meta-analysis. Drugs, 73, 545–562. doi:10.1007/s40265-013-0041-310.1007/s40265-013-0041-3
20. Evers, S. M. A. A., Hiligsmann, M., & Adarkwah, C. C. (2015). Risk of bias in trial-based economic evaluations: Identification of sources and bias-reducing strategies. Psychology & Health, 30, 52–71.
21. Fanelli, D. (2009). How many scientists fabricate and falsify research? A systematic review and meta-analysis of survey data. PLoS ONE, 4, e5738. doi:10.1371/journal.pone.000573810.1371/journal.pone.0005738
22. Fanelli, D. (2010). Do pressures to publish increase scientists’ bias? An empirical support from US states data. PLoS ONE, 5, e10271. doi:10.1371/journal.pone.001027110.1371/journal.pone.0010271
23. Farrin, A., Russell, I., Torgerson, D., Underwood, M., & UK BEAM Trial Team. (2005). Differential recruitment in a cluster randomized trial in primary care: The experience of the UK Back pain, Exercise, Active management and Manipulation (UK BEAM) feasibility study. Clinical Trials, 2, 119–124. doi:10.1191/1740774505cn073oa10.1191/1740774505cn073oa
24. Foster, C., Hillsdon, M., Thorogood, M., Kaur, A., & Wedatilake, T. (2005). Interventions for promoting physical activity. Cochrane Database of Systematic Reviews, (1), Art. No.: CD003180. doi:10.1002/14651858.CD003180.pub2
25. Gupta, S. K. (2011). Intention-to-treat concept: A review. Perspectives in Clinical Research, 2, 109–112. doi:10.4103/2229-3485.8322110.4103/2229-3485.83221
26. Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., … Schünemann, H. J. (2011). GRADE guidelines: 4. Rating the quality of evidence-study limitations (risk of bias). Journal of Clinical Epidemiology, 64, 407–415. doi:10.1016/j.jclinepi.2010.07.01710.1016/j.jclinepi.2010.07.017
27. Haynes, R. B., Ackloo, E., Sahota, N., McDonald, H. P., & Yao, X. (2008). Interventions for enhancing medication adherence. Cochrane Database of Systematic Reviews, (2), Art. No.: CD000011. doi:10.1002/14651858.CD000011.pub3
28. Higgins, J. P. T., Altman, D. G., & Sterne, J. A. C. (2011). Chapter 8: Assessing risk of bias in included studies. In J. P. T. Higgins & S. Green (Eds.), Cochrane handbook for systematic reviews of interventions (Version 5.1.0). Retrieved from www.cochrane-handbook.org
29. Hollis, S., & Campbell, F. (1999). What is meant by intention to treat analysis? Survey of published randomised controlled trials. British Medical Journal, 319, 670–674. doi:10.1136/bmj.319.7211.67010.1136/bmj.319.7211.670
30. Hróbjartsson, A., Forfang, E., Haahr, M. T., Als-Nielsen, B., & Brorson, S. (2007). Blinded trials taken to the test: An analysis of randomized clinical trials that report tests for the success of blinding. International Journal of Epidemiology, 36, 654–663. doi:10.1093/ije/dym02010.1093/ije/dym020
31. Johnson, B. T., Low, R. E., & MacDonald, H. V. (2015). Panning for the gold in health research: Incorporating studies’ methodological quality in meta-analysis. Psychology & Health, 30, 135–152.
32. Keogh-Brown, M. R., Bachmann, M. O., Shepstone, L., Hewitt, C., Howe, A., Ramsay, C. R., … Campbell, M. J. (2007). Contamination in trials of educational interventions. Health Technology Assessment, 11, 1–128. Retrieved from http://aura.abdn.ac.uk/handle/2164/184
33. Kernan, W. N., Viscoli, C. M., Makuch, R. W., Brass, L. M., & Horwitz, R. I. (1999). Stratified randomization for clinical trials. Journal of Clinical Epidemiology, 52, 19–26. doi:10.1016/S0895-4356(98)00138-310.1016/S0895-4356(98)00138-3
34. Lexchin, J., Bero, L. A., Djulbegovic, B., & Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: Systematic review. British Medical Journal, 326, 1167–1170. doi:10.1136/bmj.326.7400.116710.1136/bmj.326.7400.1167
35. Liu, H., Miller, L. G., Golin, C. E., Hays, R. D., Wu, T., Wenger, N. S., & Kaplan, A. H. (2007). Repeated measures analyses of dose timing of antiretroviral medication and its relationship to HIV virologic outcomes. Statistics in Medicine, 26, 991–1007. doi:10.1002/sim.259210.1002/(ISSN)1097-0258
36. Mathieu, S., Chan, A., & Ravaud, P. (2013). Use of trial register information during the peer review process. PLoS ONE, 8, e59910. doi:10.1371/journal.pone.005991010.1371/journal.pone.0059910
37. McCambridge, J. (2015). From question-behaviour effects in trials to the social psychology of research participation. Psychology & Health, 30(1), 72–84.
38. McCambridge, J., Butor-Bhavsar, K., Witton, J., & Elbourne, D. (2011). Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from Solomon 4-group studies. PLoS ONE, 6, e25223. doi:10.1371/journal.pone.002522310.1371/journal.pone.0025223
39. McCambridge, J., & Kypri, K. (2011). Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS ONE, 6, e23748. doi:10.1371/journal.pone.002374810.1371/journal.pone.0023748
40. McCambridge, J., Kypri, K., & Elbourne, D. R. (2013). In randomisation we trust? Overlooked problems in experimenting with people in behavioural intervention trials. Journal of Clinical Epidemiology, 67, 247–253. doi:10.1016/j.jclinepi.2013.09.004
41. Montori, V. M., Devereaux, P. J., Adhikari, N. K. J., Burns, K. E. A., Eggert, C. H., Briel, M., & Lacchetti, C. (2005). Randomized trials stopped early for benefit. The Journal of the American Medical Association, 294, 2203–2209. doi:10.1001/jama.294.17.220310.1001/jama.294.17.2203
42. Nellen, J. F. J. B., Nieuwkerk, P. T., Burger, D. M., Wibaut, M., Gras, L. A., & Prins, J. M. (2009). Which method of adherence measurement is most suitable for daily use to predict virological failure among immigrant and non-immigrant HIV-1 infected patients? AIDS Care, 21, 842–850. doi:10.1080/0954012080261281610.1080/09540120802612816
43. Nellen, J. F. J. B., Wit, F. W., Wolf, F. D., Jurriaans, S., Lange, J. M., & Prins, J. M. (2004). Virological and immunological response to HAART in indigenous and non-indigenous HIV-1 infected patients in the Netherlands: A cohort study. Journal of Acquired Immune Deficiency Syndrome, 36, 943–950.10.1097/00126334-200408010-00008
44. Oberjé, E., de Bruin, M., Evers, S., Viechtbauer, W., Nobel, H.-E., Schaalma, H. P., … Prins, J. M. (2013). Cost-effectiveness of a nurse-based intervention (AIMS) to improve adherence among HIV-infected patients: Design of a multi-centre randomised controlled trial. BMC Health Services Research, 13(274), 1–11. doi:10.1186/1472-6963-13-274
45. Oberjé, E. J., de Kinderen, R. J., Evers, S. M., van Woerkum, C. M., & de Bruin, M. (2013). Cost effectiveness of medication adherence-enhancing interventions: A systematic review of trial-based economic evaluations. PharmacoEconomics, 31, 1155–1168. doi:10.1007/s40273-013-0108-810.1007/s40273-013-0108-8
46. Poobalan, A. S., Aucott, L. S., Precious, E., Crombie, I. K., & Smith, W. C. (2009). Weight loss interventions in young people (18 to 25 year olds): A systematic review. Obesity Reviews, 11, 580–592. doi:10.1111/j.1467-789X.2009.0067310.1111/obr.2010.11.issue-8
47. Puffer, S., Torgerson, D. J., & Watson, J. (2003). Evidence for risk of bias in cluster randomised trials: Review of recent trials published in three general medical journals. British Medical Journal, 327, 785–789. doi:10.1136/bmj.327.7418.78510.1136/bmj.327.7418.785
48. Puffer, S., Torgerson, D. J., & Watson, J. (2005). Cluster randomized controlled trials. Journal of Evaluation in Clinical Practice, 11, 479–483. doi:10.1111/j.1365-2753.2005.00568.x10.1111/jep.2005.11.issue-5
49. Rice, V. H., Hartmann-Boyce, J., & Stead, L. F. (2013). Nursing interventions for smoking cessation. Cochrane Database of Systematic Reviews, (8). Art. No.: CD001188. doi:10.1002/14651858.CD001188.pub4
50. Roberts, C., & Torgerson, D. J. (1999). Understanding controlled trials: Baseline imbalance in randomised controlled trials. British Medical Journal, 319, 185. doi:10.1136/bmj.319.7203.18510.1136/bmj.319.7203.185
51. Sackett, D. L. (2007). Commentary: Measuring the success of blinding in RCTs: Don’t, must, can’t or needn’t? International Journal of Epidemiology, 36, 664–665. doi:10.1093/ije/dym08810.1093/ije/dym088
52. Savovic, J., Jones, H., Altman, D., Harris, R., Juni, P., Pildal, J., … Sterne, J. (2012). Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: Combined analysis of meta-epidemiological studies. Health Technology Assessment, 16, 1–82.
53. Schulz, K. F. (2000). Assessing allocation concealment and blinding in randomised controlled trials: Why bother? Evidence Based Medicine, 5, 36–38. doi:10.1136/ebm.5.2.3610.1136/ebm.5.2.36
54. Schulz, K. F., & Grimes, D. A. (2002). Generation of allocation sequences in randomised trials: Chance, not choice. The Lancet, 359, 515–519. doi:10.1016/S0140-6736(02)07683-310.1016/S0140-6736(02)07683-3
55. Senn, S. J. (1989). Covariate imbalance and random allocation in clinical trials. Statistics in Medicine, 8, 467–475. doi:10.1002/sim.478008041010.1002/(ISSN)1097-0258
56. Senn, S. J. (2012). Seven myths of randomisation in clinical trials. Statistics in Medicine, 32, 1439–1450. doi:10.1002/sim.5713
57. Tarquinio, C., Kivits, J., Minary, L., Coste, J., & Alla, F. (2015). Evaluating complex interventions: Perspectives and issues for health behaviour change interventions. Psychology & Health, 30, 35–51.
58. Torgerson, D. J. (2001). Contamination in trials: Is cluster randomisation the answer? British Medical Journal, 322, 355–357. doi:10.1136/bmj.322.7282.35510.1136/bmj.322.7282.355
59. Vartanian, L. R., Schwartz, M. B., & Brownell, K. D. (2007). Effects of soft drink consumption on nutrition and health: A systematic review and meta-analysis. American Journal of Public Health, 97, 667–675. doi:10.2105/AJPH.2005.08378210.2105/AJPH.2005.083782
60. van Sighem, A., Smit, C., Holman, R., Gras, L., Stolte, I., Bezemer, D., & de Wolf, F. (2012). Monitoring report 2012: Human Immunodeficiency Virus (HIV) infection in the Netherlands. Retrieved from www.hiv-monitoring.nl
61. Ware Jr., J. E., Kosinski, M., & Keller, S. D. (1996). A 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 34, 220–233.10.1097/00005650-199603000-00003
62. Wood, L., Egger, M., Gluud, L. L., Schulz, K., Jüni, P., Altman, D. G., … Sterne, J. A. C. (2008). Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: Meta-epidemiological study. British Medical Journal, 336, 601–605. doi:10.1136/bmj.39465.451748.AD10.1136/bmj.39465.451748.AD