Conceptualising causal pathways in systematic reviews of international development interventions through adopting a causal chain analysis approach

Journal of Development Effectiveness

Volumn 10, Issue 4, 2018, Pages 422-437

  Kneale, Dylan ^a   Thomas, James ^a   Bangpan, Mukdarut ^a   Waddington, Hugh ^b   Gough, David ^a  

^a UNIVERSITY OF LONDON   (United Kingdom)

^b London School of Hygiene and Tropical Medicine   (United Kingdom)

Author keywords

causal chain analysis; causality; Evidence synthesis; logic models; systematic reviews

Indexed keywords

CONCEPTUAL FRAMEWORK; DEVELOPMENT LEVEL; LITERATURE REVIEW; MODELING;

EID: 85055481638     PISSN: 19439342     EISSN: 19439407     Source Type: Journal    
DOI: 10.1080/19439342.2018.1530278     Document Type: Article

References (72)

1. Anderson, L. M., M., Petticrew, E., Rehfuess, R., Armstrong, E., Ueffing, P., Baker, D., Francis, and P., Tugwell. 2011. “Using Logic Models to Capture Complexity in Systematic Reviews.” Research synthesis methods 2 (1): 33–42. doi:10.1002/jrsm.32
2. Becker, B. J., 2001. “Examining Theoretical Models through Research Synthesis: The Benefits of Model-Driven Meta-Analysis.” Evaluation & the Health Professions 24 (2): 190–217. doi:10.1177/01632780122034876
3. Becker, B. J., 2009. “Model-Based Meta-Analysis.” In The Handbook of Research Synthesis and Meta-Analysis, edited by H., Cooper, L. V., Hedges, and J. C., Valentine, 377–395. New York: Russell Sage Foundation
4. Booth, A., and C., Carroll. 2015. “How to Build up the Actionable Knowledge Base: The Role of ‘Best Fit’framework Synthesis for Studies of Improvement in Healthcare.” BMJ quality & safety 24 (11): 700–708. doi:10.1136/bmjqs-2014-003642
5. Brunton, G., J., Caird, D., Kneale, J., Thomas, and M., Richardson. 2015. Community Engagement for Health via Coalitions, Collaborations and Partnerships: A Systematic Review and Meta-Analysis. London: EPPI-Centre, UCL Institute of Education
6. Brunton, G., S., Oliver, and J., Thomas. 2015. “Applying Framework Synthesis to Understand Complexity in Systematic Reviews: A Systematic Review of Methods.” In, 23rd Cochrane Colloquium, edited by Cochrane Collaboration, 84. Vienna, Austria: Cochrane Collaboration
7. Campbell Collaboration. 2017. “Protocol Template.” Accessed on October 5. https://campbellcollaboration.org/library/campbell-systematic-review-templates.html
8. Cartwright, N., 2010. “What are Randomised Controlled Trials Good For?”. Philosophical studies 147 (1) 59. doi:10.1007/s11098-009-9450-2
9. Cartwright, N., 2018. “What Evidence Should Guidelines Take Note of?.” Journal of evaluation in clinical practice
10. Cartwright, N., 2007a. “Are RCTs the Gold Standard?” BioSocieties 2 (1): 11–20. doi:10.1017/S1745855207005029
11. Cartwright, N., 2007b. Hunting Causes and Using Them: Approaches in Philosophy and Economics. Cambridge: Cambridge University Press
12. Chandler, J., J., Thomas, K., Sutcliffe, L., Kahwati, and D., Kneale. 2017. “Applying Current Philosophical Insights on Causality Using Qualitative Comparative Analysis as an Additional Synthesis in Systematic Reviews to Address Complex Interventions.” In Gobal Evidence Summit. Cochrane Database of Systematic Reviews 2017; (9 Suppl 1).South Africa: Cape Town
13. Clark, A. M., 2013. “What are the Components of Complex Interventions in Healthcare? Theorizing Approaches to Parts, Powers and the Whole Intervention” Social science & medicine 93: 185–193. doi:10.1016/j.socscimed.2012.03.035
14. Eddy-Spicer, D., M., Ehren, M., Bangpan, M., Khatwa, and F., Perrone. 2016. “Under What Conditions Do Inspection, Monitoring and Assessment Improve System Efficiency, Service Delivery and Learning Outcomes for the Poorest and Most Marginalised? A Realist Synthesis of School Accountability in Low-And Middle-Income Countries.” London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London
15. Funnell, S. C., and P. J., Rogers. 2011. Purposeful Program Theory: Effective Use of Theories of Change and Logic Models. Vol. 31. San Francisco, CA: John Wiley & Sons
16. Glouberman, S., and B., Zimmerman. 2002. “Complicated and Complex Systems: What Would Successful Reform of Medicare Look Like?” Ottawa, Canada:Commission on the Future of Healthcare in Canada. doi:10.1044/1059-0889(2002/er01)
17. Gough, D., S., Oliver, and J., Thomas. 2017. An Introduction to Systematic Reviews. London: Sage
18. Guyatt, G. H., A. D., Oxman, G. E., Vist, R., Kunz, Y., Falck-Ytter, P., Alonso-Coello, and H. J., Schünemann. 2008. “Rating Quality of Evidence and Strength of Recommendations: GRADE: An Emerging Consensus on Rating Quality of Evidence and Strength of Recommendations.” BMJ: British Medical Journal 336 (7650): 924. doi:10.1136/bmj.39489.470347.AD
19. Harris, K. M., D., Kneale, T. J., Lasserson, V. M., McDonald, J., Grigg, and J., Thomas. 2015. “School‐Based Self Management Interventions for Asthma in Children and Adolescents: A Mixed Methods Systematic Review.” The Cochrane Library doi:10.1002/14651858.CD011651
20. Hausmann, R., D., Rodrik, and A., Velasco. 2008. “Growth Diagnostics.” In The Washington Consensus Reconsidered: Towards a New Global Governance, edited by N., Serra and J. E., Stiglitz. 324-355. Oxford, UK: Oxford University Press
21. Higgins, J. P. T., J. A., López-López, B. J., Becker, S. R., Davies, S., Dawson, J. M., Grimshaw, L. A., McGuiness, et al. in press. “Synthesising Quantitative Evidence in Systematic Reviews of Complex Health Interventions”
22. Hill, A. B., 1965. “The Environment and Disease: Association or Causation?” Journal of the Royal Society of Medicine 58:295–300
23. Howick, J., P., Glasziou, and J. K., Aronson. 2009. “The Evolution of Evidence Hierarchies: What Can Bradford Hill’s ‘Guidelines for Causation’contribute?” Journal of the Royal Society of Medicine 102 (5): 186–194. doi:10.1258/jrsm.2009.090020
24. Illari, P., and F., Russo. 2014. Causality: Philosophical Theory Meets Scientific Practice. London: OUP Oxford
25. Kane, S. S., B., Gerretsen, R., Scherpbier, M. D., Poz, and M., Dieleman. 2010. “A Realist Synthesis of Randomised Control Trials Involving Use of Community Health Workers for Delivering Child Health Interventions in Low and Middle Income Countries.” BMC health services research 10 (1): 286. doi:10.1186/1472-6963-10-302
26. Kneale, D., J., Thomas, M., Bangpan, I. Waddington, and D., Gough. 2018a. “Causal Chain Analysis in Systematic Reviews of International Development Interventions.” CEDIL Inaugral Papers. London: Centre of Excellence for Development Impact and Learning
27. Kneale, D., J., Thomas, and K., Harris. 2015. “Developing and Optimising the Use of Logic Models in Systematic Reviews: Exploring Practice and Good Practice in the Use of Programme Theory in Reviews.” PloS one doi:10.1371/journal.pone.0142187
28. Kneale, D., J., Thomas, A., O’Mara-Eves, and R. D., Wiggins. 2018b. “How Can Additional Secondary Data Analysis of Observational Data Enhance the Generalisability of Meta-Analytic Evidence for Local Public Health Decision-Making?” Research synthesis methods doi:10.1002/jrsm.1320
29. Krauer, F., M., Riesen, L., Reveiz, O. T., Oladapo, R., Martínez-Vega, T. V., Porgo, A., Haefliger, et al. 2017. “Zika Virus Infection as a Cause of Congenital Brain Abnormalities and Guillain–Barré Syndrome: Systematic Review.” PLoS medicine 14 (1): e1002203. doi:10.1371/journal.pmed.1002230
30. Krieger, N., and G. D., Smith. 2016. “The Tale Wagged by the DAG: Broadening the Scope of Causal Inference and Explanation for Epidemiology.” International journal of epidemiology 45 (6): 1787–1808. doi:10.1093/ije/dyw114
31. Kristjansson, E., D., Francis, S., Liberato, T., Greenhalgh, V., Welch, M. B., Jandu, M., Batal, et al. 2016. “Supplementary Feeding for Improving the Health of Disadvantaged Infants and Children.” London: International Initiative for Impact Evaluation (3ie)
32. Langer, L., J., Tripney, Y., Erasmus, N., Tannous, C., Chisoro, M., Opondo, L., Zigana, E., Obuku, C., van Rooyen, and R., Stewart. 2018. “Women in Wage Labour: A Systematic Review of the Effectiveness and Design Features of Interventions Supporting Women’s Participation in Wage Labour in Higher Growth And/Or Male-Dominated Sectors in LMICs.”London: Evidence for Policy and Practice Information and Coordinating Centre, Social Science Research Unit, UCL Institute of Education; University College London
33. Lewin, S., A., Booth, C., Glenton, H., Munthe-Kaas, A., Rashidian, M., Wainwright, M. A., Bohren, Ö., Tunçalp, C. J., Colvin, and R., Garside. 2018. “Applying GRADE-CERQual to Qualitative Evidence Synthesis Findings: Introduction to the Series” BioMed Central. doi:10.1186/s13012-017-0688-3
34. Lewin, S., M., Hendry, J., Chandler, A. D., Oxman, S., Michie, S., Shepperd, B. C., Reeves, P., Tugwell, K., Hannes, and E. A., Rehfuess. 2017. “Assessing the Complexity of Interventions within Systematic Reviews: Development, Content and Use of a New Tool (Icat_Sr).” BMC Medical Research Methodology 17 (1): 76. doi:10.1186/s12874-017-0349-x
35. Mackie, J. L., 1965. “Causes and Conditions.” American philosophical quarterly 2 (4): 245–264
36. Mallett, R., J., Hagen-Zanker, R., Slater, and M., Duvendack. 2012. “The Benefits and Challenges of Using Systematic Reviews in International Development Research.” Journal of development effectiveness 4 (3): 445–455. doi:10.1080/19439342.2012.711342
37. Maxwell, J. A., 2004. “Causal Explanation, Qualitative Research, and Scientific Inquiry in Education.” Educational Researcher 33 (2): 3–11. doi:10.3102/0013189X033002003
38. Norris, S. L., and L., Bero. 2016. “GRADE Methods for Guideline Development: Time to Evolve?” Annals of internal medicine 165 (11): 810–811. doi:10.7326/M16-1254
39. Pawson, R., 2002. “Evidence-Based Policy: The Promise of ‘Realist Synthesis’.” Evaluation 8 (3): 340–358. doi:10.1177/135638902401462448
40. Pawson, R., and N., Tilley. 1997. Realistic Evaluation. London: Sage
41. Purgato, M., A. L., Gross, T., Betancourt, P., Bolton, C., Bonetto, C., Gastaldon, J., Gordon, P., O’Callaghan, D., Papola, and K., Peltonen. 2018. “Focused Psychosocial Interventions for Children in Low-Resource Humanitarian Settings: A Systematic Review and Individual Participant Data Meta-Analysis.” The Lancet Global Health 6 (4): e390–e400. doi:10.1016/S2214-109X(18)30046-9
42. Ragin, C. C., 2008. Redesigning Social Inquiry: Fuzzy Sets and Beyond. Vol. 240. Chicago: University of Chicago
43. Reiss, J., 2012. “Causation in the Sciences: An Inferentialist Account”. Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences 43 (4) 769–777. doi:10.1016/j.shpsc.2012.05.005
44. Reiss, J., 2009. “Causation in the Social Sciences: Evidence, Inference, and Purpose.” Philosophy of the Social Sciences 39 (1): 20–40. doi:10.1177/0048393108328150
45. Riley, R. D., P. C., Lambert, and G., Abo-Zaid. 2010. “Meta-Analysis of Individual Participant Data: Rationale, Conduct, and Reporting.” BMJ (Clinical Research ed.) 340. C221
46. Ritchie, J., and L., Spencer. 2002. “Qualitative Data Analysis for Applied Policy Research.” The qualitative researcher’s companion 573 (2002): 305–329
47. Rogers, P., 2014. “Overview: Strategies for Causal Attribution: Impact Evaluation No. 6.” In Methodological Briefs. Florence, Italy: UNICEF
48. Rogers, P. J., 2000. “Causal Models in Program Theory Evaluation.” New directions for evaluation 2000 (87): 47–55. doi:10.1002/ev.1181
49. Rogers, P. J., 2008. “Using Programme Theory to Evaluate Complicated and Complex Aspects of Interventions.” Evaluation 14 (1): 29–48. doi:10.1177/1356389007084674
50. Rohwer, A., L., Pfadenhauer, J., Burns, L., Brereton, A., Gerhardus, A., Booth, W., Oortwijn, and E., Rehfuess. 2017. “Series: Clinical Epidemiology in South Africa. Paper 3: Logic Models Help Make Sense of Complexity in Systematic Reviews and Health Technology Assessments.” Journal of clinical epidemiology 83: 37–47. doi:10.1016/j.jclinepi.2016.06.012
51. Rutter, H., N., Savona, K., Glonti, J., Bibby, S., Cummins, D. T., Finegood, F., Greaves, L., Harper, P., Hawe, and L., Moore. 2017. “The Need for a Complex Systems Model of Evidence for Public Health.” The Lancet 390 (10112): 2602–2604. doi:10.1016/S0140-6736(17)31267-9
52. Sankoh, O., A. J., Herbst, S., Juvekar, S., Tollman, P., Byass, and M., Tanner. 2013. “INDEPTH Launches a Data Repository and INDEPTHStats.” The lancet global health 1 (2): e69. doi:10.1016/S2214-109X(13)70034-2
53. Shiell, A., P., Hawe, and L., Gold. 2008. “Complex Interventions or Complex Systems? Implications for Health Economic Evaluation.” BMJ: British Medical Journal 336 (7656): 1281. doi:10.1136/bmj.39569.510521.AD
54. Snilstveit, B., 2012. “Systematic Reviews: From ‘Bare Bones’ Reviews to Policy Relevance.” Journal of development effectiveness 4 (3): 388–408. doi:10.1080/19439342.2012.709875
55. Snilstveit, B., S., Oliver, and M., Vojtkova. 2012. “Narrative Approaches to Systematic Review and Synthesis of Evidence for International Development Policy and Practice.” Journal of development effectiveness 4 (3): 409–429. doi:10.1080/19439342.2012.710641
56. Thomas, J., and A., Harden. 2008. “Methods for the Thematic Synthesis of Qualitative Research in Systematic Reviews.” BMC Medical Research Methodology 8 (1): 45. doi:10.1186/1471-2288-8-45
57. Thomas, J., A., O’Mara-Eves, and G., Brunton. 2014. “Using Qualitative Comparative Analysis (QCA) in Systematic Reviews of Complex Interventions: A Worked Example.” Systematic reviews 3 (1): 1–14. doi:10.1186/2046-4053-3-1
58. Thompson, S. G., and J. P. T., Higgins. 2005. “Can Meta-Analysis Help Target Interventions at Individuals Most Likely to Benefit?” The Lancet 365 (9456): 341–346. doi:10.1016/S0140-6736(05)70200-2
59. Ton, G., S., Desiere, W., Vellema, S., Wytse, and M., D’Haese. 2017. “The Effectiveness of Contract Farming for Raising Income of Smallholder Farmers in Low-And Middle-Income Countries: A Systematic Review.” Campbell Systematic Reviews 13. doi:10.4073/csr.2017.13
60. van Eijk, A., J. H., Maria, D. A., Larsen, J., Webster, R. W., Steketee, T. P., Eisele, and F. O., Ter Kuile. 2013. “Coverage of Intermittent Preventive Treatment and Insecticide-Treated Nets for the Control of Malaria during Pregnancy in sub-Saharan Africa: A Synthesis and Meta-Analysis of National Survey Data, 2009–11.” The Lancet infectious diseases 13 (12): 1029–1042. doi:10.1016/S1473-3099(13)70199-3
61. Vandenbroucke, J. P., A., Broadbent, and N., Pearce. 2016. “Causality and Causal Inference in Epidemiology: The Need for a Pluralistic Approach.” International journal of epidemiology 45 (6): 1776–1786. doi:10.1093/ije/dyv341
62. Waddington, H., E., Masset, and E., Jimenez. 2018. “What Have We Learned after Ten Years of Systematic Reviews in International Development?” Journal of development effectiveness 10 (1): 1–16. doi:10.1080/19439342.2018.1441166
63. Waddington, H., B., Snilstveit, J. G., Hombrados, M., Vojtkova, J., Anderson, D., Phillips, P., Davies, and H., White. 2014. “Farmer Field Schools for Improving Farming Practices and Farmer Outcomes in Low-And Middle-Income Countries: A Systematic Review.” Campbell Systematic Reviews 10 (6): doi:10.4073/csr.2014.6
64. Waddington, H., H., White, B., Snilstveit, J. G., Hombrados, M., Vojtkova, P., Davies, A., Bhavsar, J., Eyers, T. P., Koehlmoos, and M., Petticrew. 2012. “How to Do a Good Systematic Review of Effects in International Development: A Tool Kit.” Journal of development effectiveness 4 (3): 359–387. doi:10.1080/19439342.2012.711765
65. Welch, V. A., E., Ghogomu, A., Hossain, S., Awasthi, Z. A., Bhutta, C., Cumberbatch, R., Fletcher, J., McGowan, S., Krishnaratne, and E., Kristjansson. 2017. “Mass Deworming to Improve Developmental Health and Wellbeing of Children in Low-Income and Middle-Income Countries: A Systematic Review and Network Meta-Analysis.” The Lancet Global Health 5 (1): e40–e50. doi:10.1016/S2214-109X(16)30242-X
66. Westhorp, G., B., Walker, P., Rogers, N., Overbeeke, D., Ball, and G., Brice. 2014. “Enhancing Community Accountability, Empowerment and Education Outcomes in Low and Middle-Income Countries: A Realist Review.” University of London, Institute of Education, EPPI-Centre, London
67. White, H., 2014. “Current Challenges in Impact Evaluation.” The European Journal of Development Research 26 (1): 18–30. doi:10.1057/ejdr.2013.45
68. White, H., 2018. “Theory-Based Systematic Reviews.” Journal of development effectiveness 10 (1): 17–38. doi:10.1080/19439342.2018.1439078
69. White, H., 2009. “Theory-Based Impact Evaluation: Principles and Practice.” Journal of development effectiveness 1 (3): 271–284. doi:10.1080/19439340903114628
70. Whiteside, M. F., and B. J., Becker. 2000. “Parental Factors and the Young Child’s Postdivorce Adjustment: A Meta-Analysis with Implications for Parenting Arrangements” American Psychological Association. doi:10.1037/0893-3200.14.1.5
71. Wilson, D. B., E., Tanner-Smith, and D., Mavridis. 2016. “Campbell Methods Policy Note on Network Meta-Analysis (Version 1.0, Updated September 2015).” Oslo: Campbell Collaboration
72. Wirtz, P. W., 2007. “Advances in Causal Chain Development and Testing in Alcohol Research: Mediation, Suppression, Moderation, Mediated Moderation, and Moderated Mediation.” Alcoholism: Clinical and experimental research 31: s3. doi:10.1111/j.1530-0277.2007.00495.x