Evidence-based programs in children's services: A critical appraisal

Children and Youth Services Review

Volumn 35, Issue 2, 2013, Pages 268-277

  Axford, Nick ^a   Morpeth, Louise ^a  

^a Dartington Service Design Lab   (United Kingdom)

Author keywords

Children's services; Early intervention; Evaluation; Evidence based practice; Evidence based program; Prevention

Indexed keywords

EID: 84871451557     PISSN: 01907409     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.childyouth.2012.10.017     Document Type: Article

References (119)

1. Adams K.B., Matto H.C., Lecroy C.W. Limitations of evidence-based practice for social work education: Unpacking the complexity. Journal of Social Work Education 2009, 45(2):165-186.
2. Aos S., Lee S., Drake E., Pennucci A., Klima T., Miller M., et al. Return on investment: Evidence-based options to improve statewide outcomes 2011, Document No. 11-07-1201, Washington State Institute for Public Policy, Olympia.
3. Atria M., Spiel C. The Viennese Social Competence (ViSC) training for students: Program and evaluation. Bullying, victimization and peer harassment: A handbook of prevention and intervention 2007, 179-198. Haworth Press, New York, NY. J.E. Zins, M.J. Elias, C.A. Maher (Eds.).
4. Axford N. Exploring concepts of child wellbeing: Implications for children's services 2008, Policy Press, Bristol.
5. Axford N., Elliott D.S., Little M. Blueprints for Europe: promoting evidence-based programmes in children's services. Psychosocial Intervention 2012, 21(2):205-214.
6. Axford N., Lehtonen M., Tobin K., Kaoukji D., Berry V. Engaging parents in parenting programs: lessons from research and practice. Children and Youth Services Review 2012, 34(10):2061-2071.
7. Ayre P., Calder M.C. The de-professionalisation of child protection: regaining our bearings. Children's services at the crossroads: A critical evaluation of contemporary policy for practice 2010, Russell House Publishing, Lyme Regis, UK. P. Ayre, M. Preston-Shoot (Eds.).
8. Barnes J., Ball M., Meadows P., McLeish J., Belsky J., the FNP Implementation Research Team Nurse-family partnership programme: First year pilot sites. Implementation in England Pregnancy and the Post-partum Period 2008, DCSF & DoH, (Research Report DCSF-RW051).
9. Barth R.P., Lee B.R., Lindsey M.A., Collins K.S., Strieder F., Chorpita B.F., et al. Evidence-based practice at a crossroads: The emergence of common elements and factors. Research on Social Work Practice 2012, 22(1):108-119.
10. Bessant J., Tidd J. Innovation and entrepreneurship 2011, Wiley, Chichester, (second edition).
11. Bickman L., Douglas Kelley S., Breda C., Regina de Andrade A., Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services 2011, 62(12):1423-1429.
12. Botvin G.J., Griffin K.W. Prevention science, drug abuse prevention, and Life Skills Training: Comments on the state of the science. Journal of Experimental Criminology 2005, 1:63-78.
13. Bullock R., Little M., Millham S. The relationships between quantitative and qualitative approaches to social policy research. Mixing methods: Qualitative and quantitative research 1992, Avebury, Aldershot. J. Brannen (Ed.).
14. Bumbarger B.K., Perkins D.F. After randomised trials: Issues related to the dissemination of evidence-based interventions. Journal of Children's Services 2008, 3(2):55-64.
15. Butler S., Baruch G., Hickey N., Fonagy P. A randomized controlled trial of multisystemic therapy and a statutory therapeutic intervention for young offenders. Journal of the American Academy of Child and Adolescent Psychiatry 2011, 50(12):1220-1235.
16. Case S. Young people 'at risk' of what? Risk-focused early intervention as crime prevention. Youth Justice 2006, 6:171-178.
17. Case S. Questioning the 'evidence' of risk that underpins evidence-led youth justice interventions. Youth Justice 2007, 7:91-105.
18. Cash S.J., Ingram S.D., Biben D.S., McKeever S.J., Thompson R.W., Ferrell J.Z. Moving forward without looking back: Performance management systems as real-time evidence-based practice tools. Children and Youth Services Review 2012, 34:655-659.
19. Catalano R.F., Hawkins J.D. The social development model: A theory of antisocial behavior. Delinquency and Crime: Current Theories 1996, 149-197. Cambridge University Press, New York, NY. J.D. Hawkins (Ed.).
20. Chard A., Ayre P. Managerialism: At the tipping point?. Children's Services at the Crossroads: A Critical Evaluation of Contemporary Policy for Practice 2010, Russell House Publishing, Lyme Regis, UK. P. Ayre, M. Preston-Shoot (Eds.).
21. Chauveron L., Perkins D. Prevention in context: classroom heterogeneity as a moderator of PATHS' effectiveness. Journal of Children's Services 2009, 4(1):44-59.
22. Chen X., Eisenberg N. Understanding cultural issues in child development: Introduction. Child Development Perspectives 2012, 6(1):1-4.
23. Collishaw S. Time Trends in young People's Emotional and Behavioural Problems. Changing Adolescence: Social Trends and Mental Health 2012, Policy Press, Bristol. A. Hagell (Ed.).
24. Craighead W.E., Sheets E.S., Bjornsson A.S. Specificity and nonspecificity in psychotherapy. Clinical Psychology: Science and Practice 2005, 12(2):189-193.
25. Cross W., West J. Examining implementer fidelity: Conceptualising and measuring adherence and competence. Journal of Children's Services 2011, 6(1):18-33.
26. Durlak J.A., Weissberg R.P., Dymnicki A.B., Taylor R.D., Schellinger K.B. The impact of enhancing student's social and emotional learning: a meta-analysis of school-based universal interventions. Child Development 2011, 82(1):405-432.
27. Eames C., Daley D., Hutchings J., Whitaker C.J., Hughes C., Jones K., et al. The impact of group leaders behavior on parents acquisition of key parenting skills during parent training. Behavior Research and Therapy 2010, 48(12):1221-1226. 10.1016/j.brat.2010.07.011.
28. Ecclestone K., Hayes D. The dangerous rise of therapeutic education 2009, Routledge, Abingdon, UK.
29. Eisner M. No effects in independent prevention trials: Can we reject the cynics' hypothesis?. Journal of Experimental Criminology 2009, 5:163-183.
30. Eisner M. Reply to the comments by David Olds and Lawrence Sherman. Journal of Experimental Criminology 2009, 5:215-218.
31. Eisner M., Nagin D., Ribeaud D., Malti T. Effects of a universal parenting program for highly adherent parents: A propensity score matching approach. Prevention Science 2012, 13(3):252-266.
32. Eisner M., Nivette A. How to reduce the global homicide rate to 2 per 100,000 by 2060. The Future of Criminology 2012, Oxford University Press, Oxford. R. Loeber, B.C. Welsh (Eds.).
33. Elliott D. Lessons from Columbine: Effective school-based violence prevention strategies and programmes. Journal of Children's Services 2010, 4(4):53-62.
34. Embry D.D., Biglan A. Evidence-based kernels: Fundamental units of behavioral influence. Clinical Child and Family Psychology Review 2008, 11(3):75-113.
35. Faggiano F., Galanti M.R., Bohrn K., Burkhart G., Vigna-Taglianti F., Cuomo L., et al. The effectiveness of a school-based substance abuse prevention programme: EU-Dap cluster randomised controlled trial. Preventive Medicine 2008, 47(5):537-543.
36. Farrington D.P. A short history of randomized experiments in criminology: A meager feast. Evaluation Review 2003, 27(3):218-227.
37. Ferrer-Wreder L., Stattin H., Lorente C.C., Tubman J.G., Adamson L. Successful prevention and youth development programs. Across borders 2004, Kluwer Academic/ Plenum Publishers, New York.
38. Fixsen D., Naoom S.F., Blasé K.A., Friedman R.M., Wallace F. Implementation Research: A Synthesis of the Literature 2005, USF, Tampa.
39. Ford T., Hutchings J., Bywater T., Goodman A., Goodman R. Strengths and Difficulties Questionnaire Added Value Scores: Evaluating effectiveness in child mental health interventions. The British Journal of Psychiatry 2009, 194:552-558.
40. Forrester D. Playing with fire or rediscovering fire? The perils and potential for evidence based practice in child and family social work. Children's Services at the Crossroads: A Critical Evaluation of Contemporary Policy for Practice 2010, Russell House Publishing, Lyme Regis, UK. P. Ayre, M. Preston-Shoot (Eds.).
41. Fraser M.W., Richman J.M., Galinsky M.J., Day S.H. Intervention Research: Developing Social Programs 2009, Oxford University Press, New York.
42. Fraser M.W., Galinsky M.J. Steps in intervention research: Designing and developing social programs. Research on Social Work Practice 2010, 20(5):459-466.
43. Furlong M., McGilloway S., Bywater T., Hutchings J., Smith S.M., Donnelly M. Behavioral and Cognitive-behavioral Group-based Parenting Programmes for Early-onset Conduct Problems in Children Aged 3 to 12Years (Review) 2012, Cochrane Collaboration, Wiley.
44. Gallart S.C., Matthey S. The effectiveness of Group Triple P and the impact of the four telephone contacts. Behaviour Change 2005, 22(2):71-80.
45. Garrett P.M. Transforming children's services? Social work, neoliberalism and the 'modern' world 2009, Open University Press/ McGraw-Hill, Maidenhead.
46. Gill C.E. Missing links: How descriptive validity impacts the policy relevance of randomized controlled trials in criminology. Journal of Experimental Criminology 2011, 7:201-224.
47. Gorman D.M. The "science" of drug and alcohol prevention: the case of the randomized trial of the Life Skills Training Program. The International Journal on Drug Policy 2002, 13:21-26.
48. Gorman D.M. Defining and operationalizing 'research-based' prevention: a critique (with case studies) of the US Department of Education's safe, disciplined and drug-free schools exemplary programs. Evaluation and Program Planning 2002, 25:295-302.
49. Gorman D.M. The best of practices, the worst of practices: The making of science-based primary prevention programs. Psychiatric Services 2003, 54(8):1087-1089.
50. Gorman D.M. Drug and violence prevention: Rediscovering the critical rational dimension of evaluation research. Journal of Experimental Criminology 2005, 1:39-62.
51. Gorman D.M. The centrality of critical rational reasoning in science: A response and further comments on the Life Skills Training program, the Seattle Social Development Project, and prevention studies. Journal of Experimental Criminology 2005, 1:263-275.
52. Graham J.R., Shier M.L. The social work profession and subjective well-being: The impact of a profession on overall subjective well-being. British Journal of Social Work 2010, 40(5):1553-1572.
53. Gray M., Plath D., Webb S.A. Evidence-based social work: A critical stance 2009, Routledge, Abingdon.
54. Graybeal C.T. Evidence for the art of social work. Families in Society 2007, 88(4):513-523.
55. Grietens H. Discerning European perspectives on evidence-based interventions for vulnerable children and their families. International Journal of Child and Family Welfare 2010, 13(1-2):6-17.
56. Haggerty K.P., Kosterman R., Catalano R.F., Hawkins J.D. Preparing for the Drug Free Years. Office of Juvenile Justice and Delinquency Prevention Juvenile Justice Bulletin [NCJ 173408] Retrieved from. https://www.ncjrs.gov/pdffiles1/173408.pdf.
57. Hahlweg K., Heinrichs N., Kuschel A., Bertram H., Nauman S. Long-term outcome of a randomized controlled universal prevention trial through a positive parenting program: Is it worth it?. Child and Adolescent Psychiatry and Mental Health 2010, 4:1-14.
58. Hawkins J.D., Catalano R.F. Doing prevention science: A response to Dennis M. Gorman and a brief history of the quasi-experimental study nested within the Seattle Social Development Project. Journal of Experimental Criminology 2005, 1:79-86.
59. Henggeler S.W., Schoenwald S.K. Evidence-based interventions for juvenile offenders and juvenile justice policies that support them. SRCD Social Policy Report 2011, 25(1):3-20.
60. Hobbs T. Realising ambition: Applying standards of evidence to preventive interventions for anti-social and offending behavior. Paper presentation at Society for Prevention Research Annual Meeting, Washington, US, 31st May 2012.
61. Holder H. Prevention programs in the 21st century: What we do not discuss in public. Addiction 2009, 105:578-581.
62. Hutchings J., Bywater T., Daley D., Gardner F., Jones K., Eames C., et al. A pragmatic randomised control trial of a parenting intervention in sure start services for children at risk of developing conduct disorder. British Medical Journal 2007, 334:678-682.
63. Ipsos MORI Children's well-being in UK, Sweden and Spain: The role of inequality and materialism 2011, Ipsos MORI, London.
64. Johnson S. Where good ideas come from: The natural history of innovation 2010, Penguin, New York.
65. Jordan B. Social value in policies for children: Contract or culture?. Journal of Children's Services 2008, 3(3):65-75.
66. Kratochwill T.R., McDonald L., Levin J.R., Young Bear-Tibbets H., Demaray M.K. Families and schools together: An experimental analysis of a parent-mediated multi family group program for American Indian Children. Journal of School Psychology 2004, 42:359-383.
67. Kumpfer K.L., Magalhães C., Xie J. Cultural adaptations of evidence-based family interventions to strengthen families and improve children's developmental outcomes. The European Journal of Developmental Psychology 2012, 9(1):104-116.
68. Larsson B., Fossum B., Clifford G., Drugli M., Handegard B., Morch W. Treatment of oppositional defiant and conduct problems in young Norwegian children: Results of a randomized controlled trial'. European Child & Adolescent Psychiatry 2009, 18(1):42-52.
69. Lee S., Drake E., Pennucci A., Bjornstad G., Edovald T. Economic evaluation of early childhood education in a policy context. Journal of Children's Services 2012, 7(1):53-63.
70. Lipsey M., Howell J.C., Kelly M.R., Chapman G., Carver D. Improving the effectiveness of juvenile justice programs: A new perspective on evidence-based practice 2010, Center for Juvenile Justice Reform: Georgetown Public Policy Institute, Georgetown University.
71. Little M. Proof Positive 2010, Demos, London.
72. Little M. How to achieve lasting impact at scale: Behavior change and the spread of family health innovations in low-income countries. Synthesis and summary of a convening hosted by the Bill & Melinda Gates Foundation in Seattle, November 1-2 2011, Social Research Unit, Dartington.
73. Little M. From innovation to proven model 2012, Social Research Unit, Dartington.
74. Little M., Axford N. Taking over the world or scratching at its surface?. Journal of Children's Services 2012, 6(4):207-209.
75. Little M., Axford N., Morpeth L. Risk and protection in the context of services for children in need. Child and Family Social Work 2004, 9(1):105-118.
76. Little M., Axford N., Morpeth L., Weyts A. Evaluating children's services: Recent conceptual and methodological developments. British Journal of Social Work 2005, 35(1):73-88.
77. Little M., Berry V., Morpeth L., Blower S., Axford N., Taylor R., Bywater T., Lehtonen M., Tobin K. The impact of three evidence-based programmes delivered in public systems in Birmingham, UK. International Journal of Conflict and Violence 2012, 6(2).
78. Effective interventions for children in need 2010, Ashgate, Aldershot. M. Little, B. Maughan (Eds.).
79. Malti T., Ribeaud D., Eisner M. The effectiveness of two universal preventive interventions in reducing children's externalizing behavior: A cluster randomized controlled trial. Journal of Clinical Child and Adolescent Psychology 2011, 40(5):677-692.
80. Masson H., Frost N., Parton N. Reflections from the 'front-line': Social workers' experiences of post qualifying child care training and their current work practices in the new children's services. Journal of Children's Services 2008, 3(3):54-64.
81. Maughan B., Collishaw S., Meltzer H., Goodman R. Recent trends in UK child and adolescent mental health. Social Psychiatry and Psychiatric Epidemiology 2008, 43:305-310.
82. Child Development 2010, Ashgate, Aldershot. B. Maughan, M. Little (Eds.).
83. McGilloway S., Mhaille G., Bywater T., Furlong M., Leckey Y., Kelly P., et al. A parenting intervention for childhood behavioural problems: A randomized controlled trial in disadvantaged community-based settings. Journal of Consulting and Clinical Psychology 2012, 80(1):116-127.
84. Milova H.J.-L., Sohere S. Key concepts of parenting support in France and Germany. International Journal of Child and Family Welfare 2011, 14(3-4):105-118.
85. Misurell J.R., Springer C. Developing culturally responsive evidence-based practice: A game-based group therapy program for child sexual abuse (CSA). Journal of Child and Family Studies 2011, 10.1007/s10826-011-9560-2.
86. Mitchell P.F. Evidence-based practice in real-world services for young people with complex needs: New opportunities suggested by recent implementation science. Children and Youth Services Review 2011, 33:207-216.
87. NICE (National Institute for Health and Clinical Excellence) Parent Training/Education Programmes in the Management of Children with Conduct Disorders 2006, NICE, London.
88. Ogden T., Hagen K.A. Treatment effectiveness of Parent Management Training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology 2008, 76(4):607-621.
89. Olds D. In support of disciplined passion. Journal of Experimental Criminology 2009, 5:201-214.
90. Olsson T. MST with conduct disordered youth in Sweden: Costs and benefits after 2 years. Research on Social Work Practice 2010, 20(6):561-571.
91. Pawson R., Tilley N. Realistic evaluation 1997, Sage, London.
92. Perry A.E., Weisburd D., Hewitt C. Are criminologists describing randomized controlled trials in ways that allow us to assess them? Findings from a sample of crime and justice trials. Journal of Experimental Criminology 2010, 6:245-262.
93. Petrie P., Boddy J., Cameron C., Wigfall V., Simon A. Working with children in care - European perspectives 2006, Open University Press, Maidenhead.
94. Petrosino A., Turpin-Petrosino C., Buehler J. Scared Straight and other juvenile awareness programs for preventing juvenile delinquency: A systematic review of the randomized experimental evidence. The Annals of the American Academy of Political and Social Science 2003, 589(1):41-62.
95. Ritter G.W. Using the proper tool for the task: RCTs are the gold standard for estimating programme effects - A response to Stewart-Brown et al. Journal of Children's Services 2012, 7(2):148-152.
96. Rossi P., Freeman H., Lipsey M. Evaluation: A systematic approach 1999, Sage, Thousand Oaks, CA. 6th edition.
97. Rowlands J. Services are not enough: Child well-being in a very unequal society. Journal of Children's Services 2010, 5(3):80-88.
98. Rubin A. Teaching EBP in social work: Retrospective and prospective. Journal of Social Work 2011, 11(1):64-79.
99. Salmivalli C., Kärnä A., Poskiparta E. Counteracting bullying in Finland: The KiVa program and its effects on different forms of being bullied. International Journal of Behavioral Development 2011, 35(5):405-411.
100. Scott, S., Carby, A. & Rendu, A. (2008). Impact of Therapists' Skill on Effectiveness of Paretning Groups for Child Antisocial Behavior. Unpublished paper.
101. Scott S., O'Connor T.G., Futh A., Matias C., Price J., Doolan M. Impact of a parenting program in a high-risk, multi-ethnic community: The PALS trial. Journal of Child Psychology and Psychiatry, and Allied Disciplines 2010, 51(12):1331-1341.
102. Shadish W.R. Randomized controlled studies and alternative designs in outcome studies: Challenges and opportunities. Research on Social Work Practice 2011, 21(6):636-643.
103. Sheldon B., Macdonald G. A Textbook of Social Work 2009, Routledge, London.
104. Sherman L.W., Strang H. Testing for analysts' bias in crime prevention experiments: Can we accept Eisner's one-tailed test?. Journal of Experimental Criminology 2009, 5:185-200.
105. Soydan H., Mullen E.J., Alexandra L., Rehnman J., Li Y.-P. Evidence-based clearinghouses in social work. Research on Social Work Practice 2010, 20(6):690-700.
106. SRU (Social Research Unit) Investing in Children: Youth Justice 1.1 2012, SRU, Dartington.
107. Stalker C.A., Mandell D., Frensch K., Harvey C., Wright M. Child welfare workers who are exhausted yet satisfied with their jobs: How to do they do it?. Child and Family Social Work 2007, 12(2):182-191.
108. Stemmler M., Kötter C., Bühler A., Jaursch S., Beelmann A., Lösel F. Prevention of familial transmission of depression through a family-oriented programme targeting parenting as well as the child's social competence. Journal of Children's Services 2013, 8(1).
109. Stewart-Brown S., Anthony R., Wilson L., Winstanley S., Stallard N., Snooks H., et al. Should randomised controlled trials be the "gold standard" for research on preventive interventions for children?. Journal of Children's Services 2011, 6(4):228-235.
110. Sundell K., Hansson K., Lofholm C.A., Olsson T., Gustle L.H., Kadesjo C. The transportability of multisystemic therapy to Sweden: Short-term results from a randomized trial of conduct-disordered youths. Journal of Family Psychology 2008, 22(3):550-560.
111. Thoburn J. Towards knowledge-based practice in complex child protection cases: A research-based expert briefing. Journal of Children's Services 2010, 5(1):9-24.
112. Thompson N. Focusing on outcomes: Developing systematic practice. Practice 2008, 20(1):5-16.
113. Tolan P., Gorman-Smith D., Henry D. Supporting families in a high-risk setting: Proximal effects of the SAFEChildren preventive intervention. Journal of Consulting and Clinical Psychology 2004, 72:855-869.
114. Torgerson D., Torgerson C. Randomised controlled trials in children's services. Journal of Children's Services 2008, 3(1):2-8.
115. UNICEF Child poverty in perspective: An overview of child wellbeing in rich countries 2007, UNICEF Innocenti Research Centre, Florence.
116. Webb S.A. Considerations on the validity of evidence-based practice in social Work. British Journal of Social Work 2001, 31(1):57-79.
117. Webster-Stratton C., Kolpacoff M., Hollinsworth T. Self-administered videotape therapy for families with conduct-problem children: Comparison with two cost-effective treatments and a control group. Journal of Consulting and Clinical Psychology 1988, 56:558-566.
118. Webster-Stratton C., Reid M.J. Adapting the incredible years, an evidence-based parenting programme, for families involved in the child welfare system. Journal of Children's Services 2010, 5(1):25-42.
119. Wilkinson R., Pickett K. The spirit level: Why more equal societies almost always do better 2009, Allan Lane, London.