Do Evidence-Based Interventions Work When Tested in the "Real World?" A Systematic Review and Meta-analysis of Parent Management Training for the Treatment of Child Disruptive Behavior

Clinical Child and Family Psychology Review

Volumn 16, Issue 1, 2013, Pages 18-34

  Michelson, Daniel ^a   Davenport, Clare ^b   Dretzke, Janine ^b   Barlow, Jane ^c   Day, Crispin ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^c UNIVERSITY OF WARWICK   (United Kingdom)

Author keywords

Child disruptive behavior; Meta analysis; Parent management training; Systematic review

Indexed keywords

EID: 84874794338     PISSN: 10964037     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10567-013-0128-0     Document Type: Review

References (93)

1. Achenbach, T. (1991). Manual for the child behavior checklist/4-18 & 1991 profile. Burlington: University of Vermont.
2. Addis, M. E., Wade, W., & Hughes, C. (1999). Barriers to dissemination of evidence-based practices: addressing practitioners' concerns about manual-based psychotherapies. Clinical Psychology: Science and Practice, 6, 430-441.
3. American Academy of Child and Adolescent Psychiatry. (2007a). Practice parameter for the assessment and treatment of children and adolescents with oppositional defiant disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 126-141.
4. American Academy of Child and Adolescent Psychiatry. (2007b). Practice parameter for the assessment and treatment of children and adolescents with anxiety disorders. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 267-283.
5. Axberg, U., & Broberg, A. G. (2012). Evaluation of "The Incredible Years" in Sweden: The transferability of an American parent-training program to Sweden. Scandinavian Journal of Psychology, 53, 224-232.
6. Barkham, M., Stiles, W. B., Connell, J., Twigg, E., Leach, C., Lucock, M., et al. (2008). Effects of psychological therapies in randomized trials and practice-based studies. British Journal Clinical Psychology, 47, 397-415.
7. Barkley, R. (1997). Defiant children. A clinician's manual for assessment and PMT (2nd ed.). New York: The Guilford Press.
8. Behan, J., Fitzpatrick, C., Sharry, J., Carr, A., & Waldron, B. (2004). Evaluation of the parenting plus program. The Irish Journal of Psychology, 22, 238-256.
9. Bloomquist, M. L., & Schnell, S. V. (2002). Helping children with aggression and conduct problems. New York: The Guilford Press.
10. Bonell, C., Oakley, A., Hargreaves, J., Strange, V., & Rees, R. (2006). Assessment of generalisability in trials of health interventions: Suggested framework and systematic review. BMJ, 333, 346-349.
11. Braet, C., Meerschaert, T., Merlevede, E., Bosmans, G., van Leeuwen, K., & De Mey, W. (2009). Prevention of antisocial behaviour: Evaluation of an early intervention programme. European Journal of Developmental Psychology, 6, 223-240.
12. Cahill, J., Barkham, M., & Stiles, W. B. (2010). Systematic review of practice-based research on psychological therapies in routine clinic settings. British Journal of Clinical Psychology, 49, 421-453.
13. Chorpita, B. F. (2003). The frontier of evidence-based practice. In A. E. Kazdin & J. R. Weisz (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 42-59). New York: Guilford Press.
14. Connell, S., Sanders, M. R., & Markie-Dadds, C. (1997). Self-directed behavioral family intervention for parents of oppositional children in rural and remote areas. Behavior Modification, 21, 379-408.
15. Connor-Smith, J. K., & Weisz, J. R. (2003). Applying treatment outcome research in clinical practice: Techniques for adapting interventions to the real world. Child and Adolescent Mental Health, 8, 3-10.
16. Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, P. (2008). Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ, 337, 1655.
17. Davis, H., Day, C., Cox, A., & Cutler, L. (2000). Child and adolescent mental health needs assessment and service implications in an inner city area. Clinical Child Psychology and Psychiatry, 5, 169-188.
18. Dawe, S., Harnett, P. H., Rendalls, V., & Staiger, P. (2003). Improving family functioning and child outcome in methadone maintained families: The parents under pressure program. Drug and Alcohol Review, 22, 299-307.
19. Day, C., Kowalenko, S., Ellis, M., Dawe, S., Harnett, P., & Scott, S. (2010). The helping families programme: A new parenting intervention for children with severe and persistent conduct problems. Child and Adolescent Mental Health, 16, 167-171.
20. Day, C., Michelson, D., Thomson, S., Penney, C., & Draper, L. (2012). Evaluation of a peer led parenting intervention for disruptive behaviour problems in children: Community based randomised controlled trial. BMJ, 344, e1107.
21. Deeks, J. J., Altman, D. G., & Bradburn, M. J. (2001). Statistical methods for examining heterogeneity and combining results from several studies in meta-analysis. In M. Egger, G. Davey Smith, & D. G. Altman (Eds.), Systematic reviews in health care: Meta-analysis in context (2nd ed., pp. 285-312). London: BMJ Books.
22. Deeks, J. J., Higgins, J. P. T., & Altman, D. G. (2011). Analysing data and undertaking meta-analysis. In J. P. T. Higgins & S. Green (Eds.), The Cochrane handbook of systematic reviews of interventions, version 5. 1. 0. The Cochrane Collaboration.
23. DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177-188.
24. Downs, S. H., & Black, N. (1998). The feasibility of creating a checklist for the assessment of the methodological quality both of randomized and non-randomized studies of health care interventions. Journal of Epidemiology Community Health, 52, 377-384.
25. Dretzke, J., Davenport, C., Frew, E., Barlow, J., Stewart-Brown, S., Bayliss, S., Taylor, R., Sandercock, J., & Hyde, C. (2009). The clinical effectiveness of different parenting programs for children with conduct problems: A systematic review of randomized controlled trials. Child and Adolescent Psychiatry and Mental Health, 3(7).
26. Dretzke, J., Frew, E., Davenport, C., Barlow, J., Stewart-Brown, S., Sandercock, J., Bayliss, S., Raftery, J., Hyde, C., & Taylor R. (2005). The effectiveness and cost-effectiveness of PMT/education programs for the treatment of conduct disorder, including oppositional defiant disorder, in children. Health Technology Assessment, 9(50).
27. Dulcan, M. K. (2005). Practitioner perspectives on evidence-based practice. Child and Adolescent Psychiatric Clinics of North America, 14, 225-240.
28. Eddy, J. M., Reid, J. B., & Fetrow, R. A. (2000). An elementary school-based prevention program targeting modifiable antecedent of youth delinquency and violence: Linking the interests of families and teachers (LIFT). Journal of Emotional and Behavioral Disorders, 8, 165-176.
29. Enebrink, P., Högström, J., Forster, M., & Ghaderi, A. (2012). Internet-based parent management training: A randomized controlled study. Behaviour Research and Therapy, 50, 240-249.
30. Eyberg, S. M. (1980). Eyberg child behavior inventory. Journal of Clinical Child Psychology, 9, 22-29.
31. Feinfield, K. A., & Baker, B. L. (2004). Empirical support for a treatment program for families of young children with externalizing problems. Journal of Clinical Child and Adolescent Psychology, 33, 182-195.
32. Forehand, R. L., Merchant, M. J., Parent, J., Long, N., Linnea, K., & Baer, J. (2011). An examination of a group curriculum for parents of young children with disruptive behavior. Behavior Modification, 35, 235-251.
33. Gallart, S., & Matthey, S. (2005). The effectiveness of Group Triple P, and the impact of the four telephone contacts. Behaviour Change, 22, 71-80.
34. Gardner, F., Burton, J., & Klimes, I. (2006). Randomized controlled trial of a parenting intervention in the voluntary sector for reducing child conduct problems: Outcomes and mechanisms of change. Journal of Child Psychology and Psychiatry, 47, 1123-1132.
35. Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C. (2010). Methodological challenges of characterizing usual care psychotherapeutic practice. Administration and Policy in Mental Health and Mental Health Services, 37, 208-210.
36. Gartlehner, G., Hansen, R. A., Nissman, D., Lohr, K. N., & Carey, T. S. (2006). A simple and valid tool distinguished efficacy from effectiveness studies. Journal of Clinical Epidemiology, 59, 1040-1048.
37. Goodman, R. (1997a). Child and adolescent mental health services: Reasoned advice to commissioners and providers. In Maudsley Discussion Paper No. 4. London: South London and Maudsley NHS Foundation Trust.
38. Goodman, R. (1997b). The strengths and difficulties questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581-586.
39. Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. Millbank Quarterly, 82, 581-629.
40. Grol, R., & Grimshaw, J. (2003). From best evidence to best practice: Effective implementation of change in patients' care. Lancet, 11, 1225-1230.
41. Gross, D., Fogg, L., & Tucker, S. (1995). The efficacy of PMT for promoting positive parent-toddler relationships. Research in Nursing & Health, 18, 489-499.
42. Hautmann, C., Eichelberger, I., Hanisch, C., Plück, J., Walter, D., & Döpfner, M. (2010). The severely impaired do profit most: Short-term and long-term predictors of therapeutic change for a parent management training under routine care conditions for children with externalizing problem behavior. European Child and Adolescent Psychiatry, 19, 419-430.
43. Henggeler, S. W. (2004). Decreasing effect sizes for effectiveness studies-Implications for the transport of evidence-based treatments: Comment on Curtis, Ronan, and Borduin. Journal of Family Psychology, 18, 420-423.
44. Hoagwood, K., Burns, B., Kiser, L., Ringeisen, H., & Schoenwald, S. (2001). Evidence-based practice in child and adolescent mental health services. Psychiatric Services, 52, 1179-1189.
45. Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38, 21-33.
46. Hutchings, J., Gardner, F., Bywater, T., Daley, D., Whitaker, C., Jones, K., et al. (2007). Parenting intervention in sure start services for children at risk of developing conduct disorder: Pragmatic randomized controlled trial. BMJ, 334, 678-682.
47. Joachim, S., Sanders, M. R., & Turner, K. M. T. (2010). Reducing preschoolers' disruptive behavior in public with a brief parent discussion group. Child Psychiatry and Human Development, 41, 47-60.
48. Kazdin, A. E. (2000). Developing a research agenda for child and adolescent psychotherapy. Archives of General Psychiatry, 57, 829-835.
49. Kazdin, A. E. (2006). Treatment outcomes, common factors, and continued neglect of mechanisms of change. Clinical Psychology: Science and Practice, 12, 184-188.
50. Kazdin, A. E., & Whitley, M. K. (2006a). Comorbidity, case complexity, and effects of evidence-based treatment for children referred for disruptive behavior. Journal of Consulting and Clinical Psychology, 74, 455-467.
51. Kazdin, A. E., & Whitley, M. K. (2006b). Pretreatment social relations, therapeutic alliance, and improvements in parenting practices in parent management training. Journal of Consulting and Clinical Psychology, 74, 346-355.
52. Kazdin, A. E., Whitley, M. K., & Marciano, P. L. (2006). Child-therapist and parent-therapist alliance and therapeutic change in the treatment of children referred for oppositional, aggressive, and antisocial behavior. Journal of Child Psychology and Psychiatry, 47, 436-445.
53. Kennedy, E. (2009). Evaluating interventions in child mental health: The importance of care provider and contextual influences. Clinical Child Psychology and Psychiatry, 14, 163-165.
54. Kling, A., Forster, M., Sundell, K., & Melin, L. (2010). A randomized controlled effectiveness trial of parent management training with varying degrees of therapist support. Behavior Therapy, 41, 530-542.
55. Larsson, B., Fossum, S., Clifford, G., Drugli, M. B., Handegård, B. H., & Mørch, W. T. (2009). Treatment of oppositional defiant and conduct problems in young Norwegian children: Results of a randomized controlled trial. European Child and Adolescent Psychiatry, 18, 42-52.
56. Lau, A. S., Fung, J., Ho, L., Liu, L., & Gudino, O. (2011). PMT with high-risk immigrant Chinese families: A pilot group randomized trial yielding practice-based evidence. Behavior Therapy, 42, 413-426.
57. Leung, C., Sanders, M. R., Leung, S., Mak, R., & Lau, J. (2003). An outcome evaluation of the implementation of the Triple P-Positive Parenting Program in Hong Kong. Family Process, 42, 531-544.
58. Loeber, R., & Farrington, D. P. (2000). Young children who commit crime: Epidemiology, developmental origins, risk factors, early interventions, and policy implications. Development and Psychopathology, 12, 737-762.
59. Markie-Dadds, C., & Sanders, M. R. (2006). A controlled evaluation of an enhanced self-directed behavioral family intervention for parents of children with conduct problems in rural and remote areas. Behavior Change, 23, 55-72.
60. McLeod, B. D. (2011). The relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31, 603-616.
61. McLeod, B. D., & Weisz, J. R. (2004). Using dissertations to examine potential bias in child and adolescent clinical trials. Journal of Consulting and Clinical Psychology, 72, 235-251.
62. Morawska, A., Haslam, D., Milne, D., & Sanders, M. R. (2011). Evaluation of a brief parenting discussion group for parents of young children. Journal of Developmental and Behavioral Pediatrics, 32, 136-145.
63. NICE. (2005). Depression in children and young people: Identification and management in primary, community and secondary care. London: National Institute for Clinical Excellence.
64. NICE. (2006). Parent-training/education programs in the management of children with conduct disorders. London: National Institute for Clinical Excellence.
65. Nixon, R. D., Sweeney, L., Erickson, D. B., & Touyz, S. W. (2003). Parent-child interaction therapy: A comparison of standard and abbreviated treatments for oppositional defiant preschoolers. Journal of Consulting and Clinical Psychology, 71, 251-260.
66. Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317-329.
67. Palinkas, L. A., Aarons, G. A., Chorpita, B. F., Hoagwood, K., Landsverk, J., & Weisz, J. R. (2009). Cultural exchange and the implementation of evidence-based practices: Two case studies. Research on Social Work Practice, 19, 602-612.
68. Patterson, J., Barlow, J., Mockford, C., Klimes, I., Pyper, C., & Stewart-Brown, S. (2002). Improving mental health through parenting programs: Block randomized controlled trial. Archives of Disease in Childhood, 87, 472-477.
69. Public Health Resource Unit. (2006). Critical appraisal skills program (casp): making sense of evidence. Oxford: Public Health Resource Unit.
70. Reyno, S. M., & McGrath, P. J. (2006). Predictors of PMT efficacy for child externalizing behavior problems: A meta-analytic review. Journal of Child Psychology and Psychiatry, 47, 99-111.
71. Ross, G., & Brannigan, C. (2008). Are depressed adolescents routinely offered CBT? A brief review of current practice. Behavioral and Cognitive Psychotherapy, 36, 113-117.
72. Sanders, M. R., Markie-Dadds, C., Tully, L., & Bor, W. (2000). The Triple P-Positive Parenting Program: A comparison of enhanced, standard, and self directed behavioural family intervention for parents of children with early conduct problems. Journal of Consulting and Clinical Psychology, 69, 624-640.
73. Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52, 1179-1189.
74. Schuhmann, E. M., Foote, R. C., Eyberg, S. M., Boggs, S. R., & Algina, J. (1998). Efficacy of parent-child interaction therapy: Interim report of a randomized trial with short-term maintenance. Journal of Clinical Child Psychology, 27, 34-45.
75. Schulz, K. F., Altman, D. G., Moher, D., & CONSORT Group. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, 332.
76. Serketich, W. J., & Dumas, J. E. (1996). The effectiveness of behavioral PMT to modify antisocial behavior in children: A meta-analysis. Behavior Therapy, 27, 171-186.
77. Smelt, A. F., van der Weele, G. M., Blom, J. W., Gussekloo, J., & Assendelft, W. J. (2010). How usual is usual care in pragmatic intervention studies in primary care? An overview of recent trials. British Journal of General Practice, 60, 305-318.
78. Spielmans, G. I., Gatlin, E. T., & McFall, J. P. (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychother Research, 20, 234-246.
79. Sterne, J. A. C., Sutton, A., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., et al. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 342, d4002.
80. Straus, S. E., Richardson, W. S., Glasziou, P., & Haynes, R. B. (2010). Evidence-based medicine: How to practice and teach EBM (4th ed.). Edinburgh: Churchill Livingstone.
81. Taylor, T. K., Schmidt, F., Pepler, D., & Hodgins, C. (1998). A comparison of eclectic treatment with Webster-Stratton's parents and children series in a children's mental health center: A randomized controlled trial. Behavior Therapy, 29, 221-240.
82. Turner, K. M., & Sanders, M. R. (2006). Help when it's needed first: A controlled evaluation of brief, preventive behavioral family intervention in a primary care setting. Behavior Therapy, 37, 131-142.
83. Webster-Stratton, C. (1990). Enhancing the effectiveness of self-administered videotape PMT for families with conduct-problem children. Journal of Abnormal Child Psychology, 18, 479-492.
84. Webster-Stratton, C., & Hammond, M. (1997). Treating children with early-onset conduct problems: A comparison of child and PMT interventions. Journal of Consulting and Clinical Psychology, 65, 93-109.
85. Weersing, V. R., & Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70, 299-310.
86. Weersing, V. R., Weisz, J. R., & Donenberg, G. R. (2002). Development of the therapy procedures checklist: A measure for assessing the technique use of child and adolescent therapists. Journal of Clinical Child Psychology, 31, 168-180.
87. Weisz, J. R., Donenberg, G. R., Han, S. S., & Weiss, B. (1995). Bridging the gap between laboratory and clinic in child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63, 688-701.
88. Weisz, J. R., Doss, A. J., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671-689.
89. Weisz, J. R., Hawley, K. M., & Jensen-Doss, A. (2004). Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child and Adolescent Psychiatric Clinics of North America, 13, 729-815.
90. Weisz, J. R., Huey, S. J., & Weersing, V. R. (1998). Psychotherapy with children and adolescents: The state of the art. Advances in Clinical Child Psychology, 20, 49-91.
91. Weisz, J. R., & Jensen, P. S. (1999). Efficacy and effectiveness of child and adolescent psychotherapy and pharmacotherapy. Mental Health Services Research, 1, 125-157.
92. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337-363.
93. Wiggins, T. L., Sofronoff, K., & Sanders, M. R. (2009). Pathways Triple P-Positive Parenting Program: Effects on parent-child relationships and child behavior problems. Family Process, 48, 517-530.