Series: Clinical Epidemiology in South Africa. Paper 3: Logic models help make sense of complexity in systematic reviews and health technology assessments

Journal of Clinical Epidemiology

Volumn 83, Issue , 2017, Pages 37-47

  Rohwer, Anke ^a,b   Pfadenhauer, Lisa ^a   Burns, Jacob ^a   Brereton, Louise ^c   Gerhardus, Ansgar ^d   Booth, Andrew ^c   Oortwijn, Wija ^e   Rehfuess, Eva ^a  

^a UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF STELLENBOSCH   (South Africa)

^c UNIVERSITY OF SHEFFIELD   (United Kingdom)

^d UNIVERSITY OF BREMEN   (Germany)

^e ECORYS Netherlands   (Netherlands)

Author keywords

Africa; Analytical framework; Complexity; Conceptual framework; Evidence synthesis; Systems based thinking

Indexed keywords

AFRICA SOUTH OF THE SAHARA; ARTICLE; BIOMEDICAL TECHNOLOGY ASSESSMENT; COCHRANE LIBRARY; CONCEPTUAL FRAMEWORK; EVIDENCE BASED PRACTICE; HEALTH CARE DELIVERY; HEALTH CARE QUALITY; HUMAN; LOGIC MODEL; LOWEST INCOME GROUP; MEDLINE; MIDDLE INCOME COUNTRY; PRIORITY JOURNAL; SYSTEMATIC REVIEW (TOPIC); EVIDENCE BASED MEDICINE; LITERATURE; PROCEDURES; SOUTH AFRICA; STANDARDS; THEORETICAL MODEL;

EVIDENCE-BASED MEDICINE; HUMANS; MODELS, THEORETICAL; REVIEW LITERATURE AS TOPIC; SOUTH AFRICA; TECHNOLOGY ASSESSMENT, BIOMEDICAL;

EID: 85006043610     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2016.06.012     Document Type: Article

References (65)

1. [1] Lozano, R., Naghavi, M., Foreman, K., Lim, S., Shibuya, K., Aboyans, V., et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet 380 (2012), 2095–2128.
2. [2] Chinnock, P., Siegfried, N., Clarke, M., Is evidence-based medicine relevant to the developing world?. PLoS Med, 2, 2005, e107.
3. [3] Birbeck, G.L., Wiysonge, C.S., Mills, E.J., Frenk, J.J., Zhou, X.N., Jha, P., Global health: the importance of evidence-based medicine. BMC Med, 11, 2013, 223.
4. [4] Chalmers, I., Bracken, M.B., Djulbegovic, B., Garattini, S., Grant, J., Gulmezoglu, A.M., et al. How to increase value and reduce waste when research priorities are set. Lancet 383 (2014), 156–165.
5. [5] Wiysonge, C.S., Volmink, J., Strengthening research capacity. Lancet, 359, 2002, 713.
6. [6] Wilson, M.G., Moat, K.A., Lavis, J.N., The global stock of research evidence relevant to health systems policymaking. Health Res Policy Syst, 11, 2013, 32.
7. [7] Oliver, S., Bangpan, M., Stansfield, C., Stewart, R., Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal. Health Res Policy Syst, 13, 2015, 23.
8. [8] Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., Petticrew, M., Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ, 337, 2008, a1655.
9. [9] Petticrew, M., Anderson, L., Elder, R., Grimshaw, J., Hopkins, D., Hahn, R., et al. Complex interventions and their implications for systematic reviews: a pragmatic approach. J Clin Epidemiol 66 (2013), 1209–1214.
10. [10] Squires, J.E., Valentine, J.C., Grimshaw, J.M., Systematic reviews of complex interventions: framing the review question. J Clin Epidemiol 66 (2013), 1215–1222.
11. [11] Petticrew, M., When are complex interventions ‘complex’? When are simple interventions ‘simple’?. Eur J Public Health 21 (2011), 397–398.
12. [12] Petticrew, M., Rehfuess, E., Noyes, J., Higgins, J.P., Mayhew, A., Pantoja, T., et al. Synthesizing evidence on complex interventions: how meta-analytical, qualitative, and mixed-method approaches can contribute. J Clin Epidemiol 66 (2013), 1230–1243.
13. [13] Pigott, T., Shepperd, S., Identifying, documenting, and examining heterogeneity in systematic reviews of complex interventions. J Clin Epidemiol 66 (2013), 1244–1250.
14. [14] Burford, B., Lewin, S., Welch, V., Rehfuess, E., Waters, E., Assessing the applicability of findings in systematic reviews of complex interventions can enhance the utility of reviews for decision making. J Clin Epidemiol 66 (2013), 1251–1261.
15. [15] Noyes, J., Gough, D., Lewin, S., Mayhew, A., Michie, S., Pantoja, T., et al. A research and development agenda for systematic reviews that ask complex questions about complex interventions. J Clin Epidemiol 66 (2013), 1262–1270.
16. [16] Wildschut, L.P., Theory-based evaluation, logic modelling and the experience of SA non-governmental organisations. 2014, Stellenbosch University, Stellenbosch.
17. [17] Anderson, L.M., Petticrew, M., Rehfuess, E., Armstrong, R., Ueffing, E., Baker, P., et al. Using logic models to capture complexity in systematic reviews. Res Synth Methods 2 (2011), 33–42.
18. [18] Kellog, W.K., Using logic models to bring together planning, evaluation, and action: logic model development guide. 2004, Kellog foundation, Michigan.
19. [19] Guise, J.M., Chang, C., Viswanathan, M., Glick, S., Treadwell, J., Umscheid, C., et al. Systematic reviews of complex multicomponent health care interventions. 2014, Agency for Healthcare Research and Quality (US), Rockville (MD).
20. [20] Anderson, L.M., Oliver, S.R., Michie, S., Rehfuess, E., Noyes, J., Shemilt, I., Investigating complexity in systematic reviews of interventions by using a spectrum of methods. J Clin Epidemiol 66 (2013), 1223–1229.
21. [21] Rohwer, A., Booth, A., Pfadenhauer, L., Brereton, L., Gerhardus, A., Mozygemba, K., et al. Guidance on the use of logic models in health technology assessments of complex interventions. 2016 Available at: http://www.integrate-hta.eu/downloads/.
22. [22] Baird, S., Fereirra, F.H.G., Özler, B., Woolcock, M., Relative effectiveness of conditional and unconditional cash transfers for schooling outcomes in developing countries: a systematic review. Campbell Syst Rev 8 (2013), 1–124.
23. [23] Baker, P.R.A., Francis, D.P., Soares, J., Weightman, A.L., Foster, C., Community wide interventions for increasing physical activity. Cochrane Database Syst Rev, 2011, CD008366.
24. [24] Chamberlain, C., O'Mara-Eves, A., Oliver, S., Caird, J.R., Perlen, S.M., Eades, S.J., et al. Psychosocial interventions for supporting women to stop smoking in pregnancy. Cochrane Database Syst Rev, 2013, CD001055.
25. [25] Coren, E., Hossain, R., Pardo Pardo, J., Veras, M.M.S., Chakraborty, K., Harris, H., et al. Interventions for promoting reintegration and reducing harmful behaviour and lifestyles in street-connected children and young people. Cochrane Database Syst Rev, 2016, CD009823.
26. [26] De-Regil, L.M., Suchdev, P.S., Vist, G.E., Walleser, S., Peña-Rosas, J.P., Home fortification of foods with multiple micronutrient powders for health and nutrition in children under two years of age. Cochrane Database Syst Rev, 2011, CD008959.
27. [27] Goerlich Zief, S., Lauver, S., Maynard, R.A., Impacts of After-school programs on student outcomes. Campbell Syst Rev, 3, 2006.
28. [28] Harris, R., Mosedale, S., Garner, J., Perkins, E., What factors influence the use of contracts in the context of NHS dental practice? A systematic review of theory and logic model. Soc Sci Med 108 (2014), 54–59.
29. [29] Mazerolle, L., Bennett, S., Davis, J., Sargeant, E., M, M., Legitimacy in policing: a systematic review. Campbell Syst Rev, 1, 2013.
30. [30] Sandoval, J.A., Lucero, J., Oetzel, J., Avila, M., Belone, L., Mau, M., et al. Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Educ Res 27 (2012), 680–690.
31. [31] Segal, L., Opie, R.S., Dalziel, K., Theory! The missing link in understanding the performance of neonate/infant home-visiting programs to prevent child maltreatment: a systematic review. Milbank Q 90 (2012), 47–106.
32. [32] Taylor-Robinson, D.C., Maayan, N., Soares-Weiser, K., Donegan, S., Garner, P., Deworming drugs for soil-transmitted intestinal worms in children: effects on nutritional indicators, haemoglobin and school performance. Cochrane Database Syst Rev, 2012, CD000371.
33. [33] Tripney, J., Hombrados, J., Newman, M., Hovish, K., Brown, C., Steinka-Fry, K., et al. Technical and vocational education and training (TVET) interventions to improve the employability and employment of young people in low-and middle-income countries: a systematic review. Campbell Syst Rev, 9, 2013.
34. [34] Turley, R., Saith, R., Bhan, N., Rehfuess, E., Carter, B., Slum upgrading strategies involving physical environment and infrastructure interventions and their effects on health and socio-economic outcomes. Cochrane Database Syst Rev, 2013, CD010067.
35. [35] Glenton, C., Colvin, C.J., Carlsen, B., Swartz, A., Lewin, S., Noyes, J., et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev, 2013, CD010414.
36. [36] Subirana, M., Long, A., Greenhalgh, J., Firth, J., A realist logic model of the links between nurse staffing and the outcomes of nursing. J Res Nurs 19 (2014), 8–23.
37. [37] Rachlis, B., Sodhi, S., Burciul, B., Orbinski, J., Cheng, A.H., Cole, D., A taxonomy for community-based care programs focused on HIV/AIDS prevention, treatment, and care in resource-poor settings. Glob Health Action 6 (2013), 1–21.
38. [38] Thomson, H., Thomas, S., Sellstrom, E., Petticrew, M., Housing improvements for health and associated socio-economic outcomes. Cochrane Database Syst Rev, 2013, CD008657.
39. [39] Urstad, K.H., Wahl, A.K., Andersen, M.H., Oyen, O., Hagen, K.B., Limited evidence for the effectiveness of educational interventions for renal transplant recipients. Results from a systematic review of controlled clinical trials. Patient Educ Couns 90 (2013), 147–154.
40. [40] Harris, R.P., Helfand, M., Woolf, S.H., Lohr, K.N., Mulrow, C.D., Teutsch, S.M., et al. Current methods of the U.S. Preventive Services Task Force: a review of the process. Am J Prev Med 20 (2001), 21–35.
41. [41] Higgins, J.P.T., Green, S.E., Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration and Wiley-Blackwell, 2008.
42. [42] Stone, P.W., Popping the (PICO) question in research and evidence-based practice. Appl Nurs Res 15 (2002), 197–198.
43. [43] Shiell, A., Hawe, P., Gold, L., Complex interventions or complex systems? Implications for health economic evaluation. BMJ 336 (2008), 1281–1283.
44. [44] Pfadenhauer, L.M., Mozygemba, K., Gerhardus, A., Hofmann, B., Booth, A., Lysdahl, K.B., et al. Context and implementation: a concept analysis towards conceptual maturity. Z Evid Fortbild Qual Gesundhwes 109 (2015), 103–114.
45. [45] Burns, J., Boogaard, J., Turley, R., Pfadenhauer, L.M., van Erp, A.M., Rohwer, A.C., et al. Interventions to reduce ambient particulate matter air pollution and their effect on health. Cochrane Database Syst Rev, 2014, CD010919.
46. [46] Rohwer, A., Rehfuess, E., Young, T., E-learning of evidence-based health care to increase EBHC competencies in healthcare professionals. 2014 Available at: http://www.campbellcollaboration.org/lib/project/224/.
47. [47] Pfadenhauer, L., Burns, J., Rohwer, A., Rehfuess, E.A., A protocol for a systematic review of the effectiveness of interventions to reduce exposure to lead through consumer products and drinking water. Syst Rev, 3, 2014, 36.
48. [48] Brereton, L., Wahlster, P., Lysdahl, K.B., Mozygemba, K., Burns, J., Chilcott, J.B., et al. Integrated assessment of home based palliative care with and without reinforced caregiver support: ‘A demonstration of INTEGRATE-HTA methodological guidances’. 2016 Available at: http://www.integrate-hta.eu/downloads/.
49. [49] Durao, S., Schoonees, A., Ramokolo, V., Oliveira, J.M.D., Kristjansson, E., Community-level interventions for improving access to food in low- and middle-income countries. Cochrane Database Syst Rev, 2015, CD011504.
50. [50] May, C., Finch, T., Mair, F., Ballini, L., Dowrick, C., Eccles, M., et al. Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Serv Res, 7, 2007, 148.
51. [51] Wells, M., Williams, B., Treweek, S., Coyle, J., Taylor, J., Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials, 13, 2012, 95.
52. [52] Damschroder, L.J., Aron, D.C., Keith, R.E., Kirsh, S.R., Alexander, J.A., Lowery, J.C., Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci, 4, 2009, 50.
53. [53] Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., Balain, S., A conceptual framework for implementation fidelity. Implement Sci, 2, 2007, 40.
54. [54] Linnan, L., Steckler, A., Process evaluation for public health interventions and research. 2002, Jossey-Bass, San Fransisco.
55. [55] Audrey, S., Holliday, J., Parry-Langdon, N., Campbell, R., Meeting the challenges of implementing process evaluation within randomized controlled trials: the example of ASSIST (A Stop Smoking in Schools Trial). Health Educ Res 21 (2006), 366–377.
56. [56] Furgerson, J.L., Hannah, W.N. Jr., Thompson, J.C., Challenge of surrogate endpoints. South Med J 105 (2012), 156–160.
57. [57] Burzykowski, T., Molenberghs, G., Buyse, M., The evaluation of surrogate endpoints. 2005, Springer, New York.
58. [58] Pfadenhauer, L., Rohwer, A., Burns, J., Booth, A., Lysdahl, K.B., Hofmann, B., et al. Guidance for the Assessment of Context and Implementation in Health Technology Assessments (HTA) and Systematic Reviews of Complex Interventions: The Context and Implementation of Complex Interventions (CICI) Framework. 2016 Available at: http://www.integrate-hta.eu/downloads/.
59. [59] Morville, P., User Experience Design. 2004 Available at: http://semanticstudios.com/user_experience_design/.
60. [60] Hummelbrunner, R., Beyond logframe: critique, variations and alternatives. Fujita, N., (eds.) Beyond logframe: using systems concepts in evaluation, 2010, Foundation for Advanced Studies on International Development, Tokyo.
61. [61] Rogers, P., Representing simple, complicated, and complex aspects in logic models for evaluation quality. 24th Annual Conference of the American Evaluation Association, 2010 San Antonio, Texas.
62. [62] Meremikwu, M., Udoh, E., Nwagbara, B., Effa, E., Oringanje, C., Edet, B., et al. Priority setting for systematic review of health care interventions in Nigeria. Health Policy 99 (2011), 244–249.
63. [63] Forland, F., Rohwer, A., Klatser, P., Boer, K., Mayanja-Kizza, H., Strengthening evidence-based healthcare in Africa. Evid Based Med 18 (2013), 204–206.
64. [64] English, M., Opiyo, N., Getting to grips with GRADE-perspective from a low-income setting. J Clin Epidemiol 64 (2011), 708–710.
65. [65] Nachega, J.B., Uthman, O.A., Ho, Y.S., Lo, M., Anude, C., Kayembe, P., et al. Current status and future prospects of epidemiology and public health training and research in the WHO African region. Int J Epidemiol 41 (2012), 1829–1846.