Developing a reporting guideline for social and psychological intervention trials

British Journal of Social Work

Volumn 43, Issue 5, 2013, Pages 1024-1038

  Montgomery, Paul ^b   Grant, Sean ^a   Hopewell, Sally ^b   Macdonald, Geraldine ^b   Moher, David ^b   Mayo Wilson, Evan ^b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b NONE

Author keywords

CONSORT SPI; Randomised controlled trial; RCT; Reporting guideline; Reporting standards

Indexed keywords

EID: 84881358411     PISSN: 00453102     EISSN: 1468263X     Source Type: Journal    
DOI: 10.1093/bjsw/bct129     Document Type: Article

References (65)

1. Abraham, C., for the Workgroup for Intervention Development and Evaluation Research (2009) 'Wider recommendations to improve reporting of the content of behaviour change interventions', available online at http://interventiondesign.co.uk/wp-content/uploads/2009/02/wider- recommendations.pdf.
2. American Educational Research Association (AERA) (2006) 'Standards for reporting on empirical social science research in AERA publications', Educational Researcher, 35(6), pp. 33-40.
3. American Psychological Association Journal Article Reporting Standards Group (APA JARS Group) (2008) 'Reporting standards for research in psychology: Why do we need them? What might they be?', American Psychologist, 63, pp. 839-51.
4. Armstrong, R., Waters, E., Moore, L., Riggs, E., Cuervo, L. G., Lumbiganon, P. and Hawe, P. (2008) 'Improving the reporting of public health intervention research: advancing TREND and CONSORT', Journal of Public Health, 30(1), pp. 103-109.
5. Bonell, C. (2002) 'The utility of randomized controlled trials of social interventions: An examination of twotrials ofHIVprevention', Critical Public Health, 12(4), pp. 321-334. (Pubitemid 35446519)
6. Bonell, C., Fletcher, A., Morton, M., Lorenc, T. and Moore, L. (2012) 'Realist randomised controlled trials: a new approach to evaluating complex public health interventions,' Social Science & Medicine, 75(12), pp. 2299-2306.
7. Bonell, C., Oakley, A., Hargreaves, J., Strange, V. and Rees, R. (2006) 'Assessment of generalisability in trials of health interventions: Suggested framework and systematic review', BMJ, 333, pp. 346-9. (Pubitemid 44350402)
8. Bonell, C. P., Hargreaves, J., Cousens, S., Ross, D., Hayes, R., Petticrew, M.and Kirkwood, B. R. (2011) 'Alternatives to randomisation in the evaluation of public health interventions: Design challenges and solutions', Journal of Epidemiological Community Health, 65, pp. 582-7.
9. Boutron, I., Moher, D.,Altman,D. G., Schulz, K.andRavaud, P., for theCONSORTgroup (2008) 'Extending the CONSORT Statement to randomized trials of nonpharmacologic treatment: Explanation and elaboration,' Annals of Internal Medicine, 148, pp. 295-309. (Pubitemid 351665487)
10. Calvert, M., Blazeby, J., Revicki, D., Moher, D. and Brundage, M. (2011) 'Reporting quality of life in clinical trials: A CONSORT extension', The Lancet, 378, pp. 1684-5.
11. Campbell Collaboration. (2013) Avaialble at: http:// campbellcollaboration.org/.
12. Campbell, M. K., Elbourne, D. R. and Altman, D. G. (2004) 'CONSORT statement: Extension to cluster randomised trials', BMJ, 328, pp. 702-8. (Pubitemid 38393415)
13. Cartwright, N. and Munro, E. (2010) 'The limitations of randomized controlled trials in predicting effectiveness,' Journal of Evaluation in Clinical Practice, 16, pp. 260-266.
14. Chalmers, I. (2003) 'Trying to do more good than harm in policy and practice: The role of rigorous, transparent, up-to-date evaluations', The ANNALS of the American Academy of Political and Social Science, 589(22), pp. 22-40. (Pubitemid 37089332)
15. Cochrane Collaboration. (2013) Available at: http://www.cochrane.org/.
16. Craig, P., Dieppe, P., Macintyre, S., Mitchie, S., Nazareth, I. and Petticrew, M. (2008) 'Developing and evaluating complex interventions: The new Medical Research Council guidance', BMJ, 337, pp. 979-83.
17. Davidson, K. W., Goldstein, M., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B., Trudeau, K. J. and Whitlock, E. P. (2003) 'Evidence-based behavioural medicine: What is it and how do we achieve it?', Annals of Behavioral Medicine, 26, pp. 161-71. (Pubitemid 37553472)
18. Des Jarlais, D. C., Lyles, C. and Crepaz, N., the TREND Group (2004) 'Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND statement', American Journal of Public Health, 94, pp. 361-6. (Pubitemid 38269486)
19. Evans, T. and Brown,H. (2003) 'Road traffic crashes:Operationalizing equity in the context of health sector reform', Injury Control and Safety Promotion, 10(1-2), pp. 11-12.
20. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. and Wallace, F. (2005) Implementation Research: A Synthesis of the Literature, Tampa, FL, University of South Florida.
21. Fraser, M. W., Galinsky, M. J., Richman, J. M. and Day, S. H. (2009) Intervention Research: Developing Social Programs, Oxford, Oxford University Press.
22. Gill, C. E. (2011) 'Missing links: How descriptive validity impacts the policy relevance of randomized controlled trials in criminology', Journal of Experimental Criminology, 7(3), pp. 201-24.
23. Glasziou, P., Meats, E., Heneghan, C. and Shepperd, S. (2008) 'What is missing from descriptions of treatment in trials and reviews?', BMJ, 336, pp. 1472-4.
24. Goldbeck, L. and Vitiello, B. (2011) 'Reporting clinical trials of psychosocial interventions in child and adolescent psychiatry and mental health', Child and Adolescent Psychiatry and Mental Health, 5(1): pp. 4.
25. Grant, S.,Montgomery,P. andMayo-Wilson, E. (2012) 'Development of aCONSORTextension for interventions in public health and related disciplines,' The Lancet, 380(Supp. 3), p. S14. Available at http://www.thelancet.com/ abstracts/public-health-science-in-the-uk.
26. Hardeman, W., Michie, S., Fanshawe, T., Prevost, A. T., McLoughlin, K. and Kinmonth, A. L. (2008) 'Fidelity of delivery of a physical activity intervention: Predictors and consequences', Psychology & Health, 23, pp. 11-24.
27. Hawe, P., Shiell, A. and Riley, T. (2004) 'Complex interventions: how"out of control" can a randomised controlled trial be?', BMJ, 328(7455), pp. 1561-1563. (Pubitemid 38850320)
28. Henggeler, S. W., Schoenwald, S. K., Rowland, M. D. and Cunningham, P. B. (2002) Serious Emotional Disturbances in Children and Adolescents: Multisystemic Therapy, New York: Guilford Press.
29. Hopewell, S., Clarke, M., Moher, D., Wager, E., Middleton, P., Altman, D. G. and Schulz, K. F., and theCONSORTGroup. (2008)'CONSORTfor reporting randomised trials in journal and conference abstracts,' Lancet, 371, pp. 281-283.
30. Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J. and Oxman, A. D. (2012) 'Audit and feedback: Effects on professional practice and healthcare outcomes', Cochrane Database of Systematic Reviews, 6, p. CD000259.
31. Ladd, B. O., McCrady, B. S., Manuel, J. K. and Campbell,W. (2010) 'Improving the quality of reporting alcohol outcome studies: Effects of the CONSORT statement', Addictive Behaviors, 35, pp. 660-6.
32. Littell, J. H., Campbell, M., Green, S. and Toews, B. (2009) 'Multisystemic Therapy for social, emotional, and behavioral problems in youth aged 10-17', Cochrane Library of Systematic Reviews, 4, CD004797.
33. Marshall, M., Lockwood, A., Bradley, C., Adams, C., Joy, C. and Fenton, M. (2000). 'Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia', British Journal of Psychiatry, 176, 249-252. (Pubitemid 30179844)
34. Mayo-Wilson, E. (2007) 'Reporting implementation in randomized trials: Proposed additions to the Consolidated Standards of Reporting Trials statement', American Journal of Public Health, 97, pp. 630-3. (Pubitemid 47280158)
35. McGrath, P. J., Stinson, J. and Davidson, K. (2003) 'Commentary: The Journal of Pediatric Psychology should adopt theCONSORTstatement as a way of improving the evidence base in pediatric psychology', Journal of Pediatric Psychology, 28, pp. 169-71. (Pubitemid 36403044)
36. Medical Research Council. (2008)AFramework for Development and Evaluation ofRCTs for Complex Interventions to Improve Health. London, Medical Research Council.
37. Medical Research Council (2011) Using Natural Experiments to Evaluate Population Health Interventions: Guidance for Producers and Users of Evidence, London, Medical Research Council.
38. Michie, S., Abraham, C., Eccles, M. P., Francis, J. J., Hardeman, W. and Johnston, M. (2011) 'Strengthening evaluation and implementation by specifying components of behaviour change interventions: A study protocol', Implementation Science, 6, p. 10.
39. Michie, S., Fixsen, D., Grimshaw, J. M. and Eccles, M. P. (2009) 'Specifying and reporting complex behaviour change interventions: The need for a scientific method', Implementation Science, 4, p. 40.
40. Moher, D., Altman, D. G., Schulz, K. F. and Elbourne, D. R. (2004) 'Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond', Canadian Medical Association Journal, 171(4), pp. 349-50. (Pubitemid 39127989)
41. Moher, D., Hopewell, S., Schultz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M. and Altman, D. G. (2010a) 'CONSORT 2010 Explanation and Elaboration: Updated guidelines for reporting parallel group randomised trials', BMJ, 340, p. c869.
42. Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P. and Klassen, T. P. (1999) 'Does quality of reports of randomized trials affect estimates of intervention efficacy reported in meta-analyses?', Lancet, 352, pp. 609-13. (Pubitemid 28380142)
43. Moher, D., Schulz, K. F., Simera, I. and Altman, D. G. (2010b) 'Guidance for developers of health research reporting guidelines', PLoS Med, 7(2), p. e1000217.
44. Moore, L. (2002) 'Research design for the rigorous evaluation of complex educational interventions: Lessons from health services research', Building Research Capacity, 1, pp. 4-5.
45. Moore, L. and Moore, G. F. (2011) 'Public health evaluation: Which designs work, for whom and under what circumstances?', Journal of Epidemiology & Community Health, 65, pp. 596-7.
46. Murphy, M. K., Black, N. A., Lamping, D. L., McKee, C. M., Sanders, C. F. B., Askham, J. and Marteau, T. (1998) 'Consensus development methods, and their use in clinical guideline development', Health Technology Assessment, 2(3), pp. 1-88.
47. Naleppa, M. J. and Cagle, J. G. (2010) 'Treatment fidelity in social work intervention research: A review of published studies', Research on Social Work Practice, 20, pp. 674-81.
48. Newman, M. and Elbourne, D. (2004) 'Improving the usability of educational research: Guidelines for the REPOrting of primary empirical research Studies in Education (The REPOSE Guidelines)', Evaluation & Research in Education, 18(4), pp. 201-12. (Pubitemid 43256208)
49. Pawson, R., Greenhalgh, T., Harvey, G. and Walshe, K. (2004) Realist Synthesis: An Introduction. University of Manchester: ESRC Research Methods Programme.
50. Perry, A. E. and Johnson, M. (2008) 'Applying the Consolidated Standards of Reporting Trials (CONSORT) to studies of mental health provision for juvenile offenders: A research note', Journal of Experimental Criminology, 4, pp. 165-85.
51. Perry, A. E., Weisburd, D. and Hewitt, C. (2010) 'Are criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials', Journal of Experimental Criminology, 6, pp. 245-62.
52. Pildal, J., Hróbjartsson, A., Jørgensen, K. J., Hilden, J., Altman, D. G. and Gøtzsche, P. C. (2007) 'Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials', International Journal of Epidemiology, 36(4), pp. 847-57. (Pubitemid 47394153)
53. Prescott, R. J., Counsell, C. E., Gillespie, W. J., Grant, A. M., Russell, I. T., Kiauka, S., Colthart, I. R., Ross, S., Shepherd, S. M. and Russel, D. (1999) 'Factors that limit the quality, number and progress of randomised controlled trials', Health Technology Assessment, 3(20), pp. 1-143.
54. Schulz, K. F., Altman, D. G. and Moher, D., for theCONSORTGroup (2010)'CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials', BMJ, 340, pp. 698-702.
55. Schulz, K. F., Chalmers, I., Hayes, R. J. and Altman, D. G. (1995) 'Allocation concealment in randomised trials: Defending against deciphering', Lancet, 359, pp. 614-17.
56. Semaan, S., Kay, L., Strouse, D., Sogolow, E., Mullen, P. D., Neumann, M. S., Flores, S. A., Peersman, G., Johnson, W. D., Lipman, P. D., Eke, A. and Des Jarlais, D. C. (2002) 'A profile of U.S.-based trials of behavioral and social interventions forHIVrisk reduction', Journal of Acquired Immune Deficiency Syndromes, 30, pp. S30-50. (Pubitemid 34774063)
57. Shepperd, S., Lewin, S., Straus, S., Clarke, M., Eccles, M. P., Fitzpatrick, R., Wong, G. and Sheikh, A. (2009) 'Can we systematically review studies that evaluate complex interventions?', PLoS Medicine, 6(8), p. 31000086.
58. Stinson, J. N., McGrath, P. J. and Yamada, J. T. (2003) 'Clinical trials in the Journal of Pediatric Psychology: Applying the CONSORT statement', Journal of Pediatric Psychology, 28, pp. 159-67. (Pubitemid 36403043)
59. Tong, A., Sainsbury, P. and Craig, J. (2007) 'Consolidated criteria for reporting qualitative research (COREQ):A32-item checklist for interviews and focus groups', International Journal for Quality in Health Care, 19(6), pp. 349-57. (Pubitemid 350186969)
60. Torgerson, C. J., Torgerson, D. J., Birks, Y. F. and Porthouse, J. (2005) 'A comparison of RCTs in health and education', British Educational Research Journal, 31(6), pp. 761-85.
61. Tugwell, P., Petticrew, M., Kristjansson, E., Welch, V. and Ueffing, E. et al. (2010) 'Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health', BMJ, 341, c4739.
62. Turner, L., Shamseer, L., Altman,D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C. and Moher, D. (2012) 'Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals', Cochrane Database of Systematic Reviews, 11, p. MR000030.
63. vonElm,E., Altman,D.G., Egger, M., Pocock, S. J., Gotzsche, P. C.andVandenbroucke, J. P. (2007) 'The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for reporting observational studies', Annals of Internal Medicine, 147(8), pp. 573-7. (Pubitemid 351664504)
64. Welch, V., Petticrew, M., Tugwell, P., Moher, D., O'Neill, J., Waters, E. and White, H., and the PRISMA-Equity Bellagio group. (2012) 'PRISMA-Equity 2012 extension: reporting guidelines for systematic reviews with a focus on health equity', PLoS Med, 9(10), e1001333.
65. Zwarenstein, M., Treweek, S., Gagnier, J. J., Altman, D. G., Tunis, S., Haynes, B., Oxman, A. D. and Moher, D., for theCONSORTand Pragmatic Trials in Healthcare (Practihc) group (2008) 'Improving the reporting of pragmatic trials: an extension of the CONSORT statement', BMJ, 337, p. a2390.