Developing a reporting guideline for social and psychological intervention trials

American Journal of Public Health

Volumn 103, Issue 10, 2013, Pages 1741-1746

  Montgomery, Paul ^a   Mayo Wilson, Evan ^b   Hopewell, Sally ^c   MacDonald, Geraldine ^d   Moher, David ^e   Grant, Sean ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^e OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; HUMAN; INTERNET; MENTAL DISEASE; PRACTICE GUIDELINE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; RESEARCH; SOCIAL ADAPTATION; STANDARD;

GUIDELINES AS TOPIC; HUMANS; INTERNET; MENTAL DISORDERS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; RESEARCH REPORT; SOCIAL ADJUSTMENT;

EID: 84883556044     PISSN: 00900036     EISSN: 15410048     Source Type: Journal    
DOI: 10.2105/AJPH.2013.301447     Document Type: Review

References (67)

1. A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London, England: Medical Research Council; 2008.
2. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist Synthesis: An Introduction. Manchester, UK: Economic and Social Research Council Methods Programme; 2004.
3. Bonell C. The utility of randomized controlled trials of social interventions: an examination of two trials of HIV prevention. Crit Public Health. 2002; 12(4): 321-334.
4. Hawe P, Shiell A, Riley T. Complex interventions: how "out of control" can a randomised controlled trial be? BMJ. 2004;328(7455): 1561-1563.
5. Bonell C, Fletcher A, Morton M, Lorenc T, Moore L. Realist randomised controlled trials: a new approach to evaluating complex public health interventions. Soc Sci Med. 2012;75(12): 2299-2306.
6. Henggeler SW, Schoenwald SK, Rowland MD, Cunningham PB. Serious Emotional Disturbances in Children and Adolescents: Multisystemic Therapy. New York, NY: Guildford Press; 2002.
7. Littell JH, Popa M, Forsythe B. Multisystemic therapy for social, emotional, and behavioral problems in youth aged 10-17. Cochrane Database Syst Rev. 2005;(4):CD004797.
8. Cochrane Collaboration. Available at: http://www.cochrane.org. Accessed April 25, 2013.
9. Campbell Collaboration. Available at: http://campbellcollaboration.org. Accessed April 25, 2013.
10. Perry AE, Weisburd D, Hewitt C. Are criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials. J Exp Criminol. 2010;6: 245-262.
11. Naleppa MJ, Cagle JG. Treatment fidelity in social work intervention research: a review of published studies. Res Soc Work Pract. 2010;20: 674-681.
12. Torgerson CJ, Torgerson DJ, Birks YF, Porthouse J. A comparison of RCTs in health and education. Br Educ Res J. 2005;31(6): 761-785.
13. Stinson JN, McGrath PJ, Yamada JT. Clinical trials in the Journal of Pediatric Psychology: applying the CONSORT Statement. J Pediatr Psychol. 2003;28 (3): 159-167.
14. Michie S, Abraham C, Eccles MP, Francis JJ, Hardeman W, Johnston M. Strengthening evaluation and implementation by specifying components of behaviour change interventions: a study protocol. Implement Sci. 2011;6: 10.
15. Semaan S, Kay L, Strouse D, et al. A profile of US-based trials of behavioral and social interventions for HIV risk reduction. J Acquir Immune Defic Syndr. 2002;30(suppl 1):S30-S50.
16. Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c332.
17. Davidson KW, Goldstein M, Kaplan RM, et al. Evidence-based behavioural medicine: what is it and how do we achieve it? Ann Behav Med. 2003;26 (3): 161-171.
18. Bonell C, Oakley A, Hargreaves J, Strange V, Rees R. Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006;333(7563): 346-349.
19. Moher D, Schulz KF, Simera I, Altman DG. Guidance for developers of health research reporting guidelines. PLoS Med. 2010;7(2):e1000217.
20. Bonell CP, Hargreaves J, Cousens S, et al. Alternatives to randomisation in the evaluation of public health interventions: design challenges and solutions. J Epidemiol Community Health. 2011;65(7): 582-587.
21. Chalmers I. Trying to do more good than harm in policy and practice: the role of rigorous, transparent, up-to-date evaluations. Ann Am Acad Pol Soc Sci. 2003;589(22): 22-40.
22. Turner L, Shamseer L, Altman DG, et al. Consolidated Standards of Reporting Trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;11:MR000030.
23. Moher D, Altman DG, Schulz KF, Elbourne DR. Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. CMAJ. 2004;171(4): 349-350.
24. Mayo-Wilson E. Reporting implementation in randomized trials: proposed additions to the Consolidated Standards of Reporting Trials Statement. Am J Public Health. 2007;97(4): 630.
25. Gill CE. Missing links: how descriptive validity impacts the policy relevance of randomized controlled trials in criminology. J Exp Criminol. 2011;7(3): 201-224.
26. Campbell MK, Elbourne DR, Altman DG. CONSORT statement: extension to cluster randomised trials. BMJ. 2004;328 (7441): 702-708.
27. Boutron I, Moher D, Altman DG, Schulz K, Ravaud P, for the CONSORT group. Methods and processes of the CONSORT group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008;148 (4):W60-W67.
28. Zwarenstein M, Treweek S, Gagnier JJ, et al. for the CONSORT and Pragmatic Trials in Healthcare (Practihc) group. Improving the reporting of pragmatic trials: an extension of the CONSORT Statement. BMJ. 2008;337:a2390.
29. Calvert M, Blazeby J, Revicki D, Moher D, Brundage M. Reporting quality of life in clinical trials: a CONSORT extension. Lancet. 2011;378(9804): 1684-1685.
30. Abraham C. WIDER recommendations to improve reporting of the content of behaviour change interventions. 2009. Available at: http://interventiondesign. co.uk/wp-content/uploads/2009/02/wider-recommendations.pdf. Accessed November 13, 2012.
31. American Educational Research Association. Standards for reporting on empirical social science research in AERA publications. Educ Res. 2006;35(6): 33-40.
32. Newman M, Elbourne D. Improving the usability of educational research: guidelines for the REPOrting of primary empirical research Studies in Education (The REPOSE Guidelines). Eval Res Educ. 2004;18(4): 201-212.
33. American Psychological Association Journal Article Reporting Standards Group. Reporting standards for research in psychology: why do we need them? What might they be? Am Psychol. 2008; 63(9): 839-851.
34. Grant S, Montgomery P, Mayo- Wilson E. Development of a CONSORT extension for interventions in public health and related disciplines. Lancet. 2012;380(suppl 3):S14.
35. Perry AE, Johnson M. Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: a research note. J Exp Criminol. 2008; 4: 165-185.
36. Armstrong R, Waters E, Moore L, et al. Improving the reporting of public health intervention research: advancing TREND and CONSORT. J Public Health. 2008;30(1): 103-109.
37. Pildal J, Hróbjartsson A, Jørgensen KJ, Hilden J, Altman DG, Gøtzsche PC. Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol. 2007; 36(4): 847-857.
38. Prescott RJ, Counsell CE, Gillespie WJ, et al. Factors that limit the quality, number and progress of randomised controlled trials. Health Technol Assess. 1999;3(20): 1-143.
39. Schulz KF, Grimes DA. Allocation concealment in randomised trials: defending against deciphering. Lancet. 2002;359(9306): 614-617.
40. Moher D, Pham B, Jones A, et al. Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352(9128): 609-613.
41. Ladd BO, McCrady BS, Manuel JK, Campbell W. Improving the quality of reporting alcohol outcome studies: effects of the CONSORT statement. Addict Behav. 2010;35(7): 660-666.
42. Using Natural Experiments to Evaluate Population Health Interventions: Guidance for Producers and Users of Evidence. London, UK: Medical Research Council; 2011.
43. Marshall M, Lockwood A, Bradley C, Adams C, Joy C, Fenton M. Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia. Br J Psychiatry. 2000; 176: 249-252.
44. Fraser MW, Galinsky MJ, Richman JM, Day SH. Intervention Research: Developing Social Programs. Oxford, UK: Oxford University Press; 2009.
45. Cartwright N, Munro E. The limitations of randomized controlled trials in predicting effectiveness. J Eval Clin Pract. 2010;16(2): 260-266.
46. Moore L, Moore GF. Public health evaluation: which designs work, for whom and under what circumstances? J Epidemiol Community Health. 2011; 65(7): 596-597.
47. Shepperd S, Lewin S, Straus S, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6(8):e1000086.
48. Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? BMJ. 2008;336(7659): 1472-1474.
49. Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
50. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;6: CD000259.
51. Hardeman W, Michie S, Fanshawe T, Prevost AT, McLoughlin K, Kinmonth AL. Fidelity of delivery of a physical activity intervention: predictors and consequences. Psychol Health. 2008;23: 11-24.
52. McGrath PJ, Stinson J, Davidson K. Commentary: The Journal of Pediatric Psychology should adopt the CONSORT Statement as a way of improving the evidence base in pediatric psychology. J Pediatr Psychol. 2003;28(3): 169-171.
53. Evans T, Brown H. Road traffic crashes: operationalizing equity in the context of health sector reform. Inj Control Saf Promot. 2003;10(1-2): 11-12.
54. Moore L. Research design for the rigorous evaluation of complex educational interventions: lessons from health services research. Building Res Capacity. 2002;1: 4-5.
55. Tugwell P, Petticrew M, Kristjansson E, et al. Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health. BMJ. 2010;341:c4739.
56. Welch V, Petticrew M, Tugwell P, et al. PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012;9(10):e1001333.
57. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida; 2005.
58. Wang S, Moss JR, Hiller JE. Applicability and transferability of interventions in evidence-based public health. Health Promot Int. 2006;21(1): 76-83.
59. Boutron I, Moher D, Altman DG, Schulz K, Ravaud P, for the CONSORT group. Extending the CONSORT Statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148 (4): 295-309.
60. Hopewell S, Clarke M, Moher D, et al. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008;371(9609): 281-283.
61. Murphy MK, Black NA, Lamping DL, et al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess. 1998;2 (3):i-iv, 1-88.
62. Moher D, Hopewell S, Schultz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.
63. Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4: 40.
64. Goldbeck L, Vitiello B. Reporting clinical trials of psychosocial interventions in child and adolescent psychiatry and mental health. Child Adolesc Psychiatry Ment Health. 2011;5: 4.
65. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Ann Intern Med. 2007;147(8): 573-577.
66. Des Jarlais DC, Lyles C, Crepaz N, and the TREND Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Public Health. 2004;94 (3): 361-366.
67. Tong A, Sainsbury P, Craig J. Consolidated Criteria for Reporting Qualitative Research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6): 349-357.