Beyond synthesis: augmenting systematic review procedures with practical principles to optimise impact and uptake in educational policy and practice

International Journal of Research and Method in Education

Volumn 39, Issue 3, 2016, Pages 329-344

  Green, Chris ^a   Taylor, Celia ^b   Buckley, Sharon ^c   Hean, Sarah ^d,e  

^a UNIVERSITY OF ESSEX   (United Kingdom)

^b UNIVERSITY OF WARWICK   (United Kingdom)

^c UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^d BOURNEMOUTH UNIVERSITY   (United Kingdom)

^e UNIVERSITY OF STAVANGER   (Norway)

Author keywords

evidence based practice; impact; knowledge synthesis; Systematic review

Indexed keywords

EID: 84958038574     PISSN: 1743727X     EISSN: 17437288     Source Type: Journal    
DOI: 10.1080/1743727X.2016.1146668     Document Type: Article

References (53)

1. H.Arksey,, and L.O'Malley. 2005. “Scoping Studies: Towards a Methodological Framework.” International Journal of Social Research Methodology 8 (1): 19–32. doi:10.1080/1364557032000119616.
2. S.Armijo-Olivo,, C.R.Stiles, N.A.Hagen, P.D.Biondo, and G.G.Cummings. 2012. “Assessment of Study Quality for Systematic Reviews: A Comparison of the Cochrane Collaboration Risk of Bias Tool and the Effective Public Health Practice Project Quality Assessment Tool: Methodological Research.” Journal of Evaluation in Clinical Practice 18 (1): 12–18. doi:10.1111/j.1365-2753.2010.01516.x.
3. S.A.Azer, 2015. “The Top-cited Articles in Medical Education: A Bibliometric Analysis.” Academic Medicine 90 (8). Advance online publication. doi:0.1097/ACM.0000000000000780.
4. J.M.Bartunek,, and S.L.Rynes. 2014. “Academics and Practitioners Are Alike and Unalike: The Paradoxes of Academic-Practitioner Relationships.” Journal of Management 40 (5): 1181–1201. doi: 10.1177/0149206314529160
5. S.Bastow, Simon, P.DunleavyPatrick, and J.TinklerJane. 2014. The Impact of the Social Sciences: How Academics and Their Research Make a Difference. London: Sage.
6. G.J.J.Biesta, 2010. “Why ‘What Works’ Still Won't Work: From Evidence-Based Education to Value-Based Education.” Studies in Philosophy and Education 29: 491–503. doi:10.1007/s11217-010-9191-x.
7. Cabinet Office. 2014. What Works? Evidence for Decision Makers. London: Cabinet Office. Accessed June 3. https://www.gov.uk/government/publications/what-works-evidence-for-decision-makers.
8. Cochrane Collaboration. 2015. Our Vision, Mission and Principles. Accessed June 23. http://www.cochrane.org/about-us/our-vision-mission-and-principles.
9. D.A.Cook, 2012. “If you Teach Them, They Will Learn: Why Medical Education Needs Comparative Effectiveness Research.” Advances in Health Sciences Education 17: 305–310. doi:10.1007/s10459-012-9381-0.
10. D.A.Cook,, A.J.Levinson, S.Garside, D.M.Dupras, P.J.Erwin, and V.M.Montori. 2008. “Internet-based Learning in the Health Professions: A Meta-analysis.” Journal of the American Medical Association 300: 1181–1196. doi:10.1001/jama.300.10.1181.
11. E.Cottrell,, E.Whitlock, E.Kato, S.Uhl, S.Belinson, C.Chang, and T.Hoomans 2014. Defining the Benefits of Stakeholder Engagement in Systematic Reviews. AHRQ Publication No. 14-EHC006-EF.: Agency for Healthcare Research and Quality. Accessed June 23. www.effectivehealthcare.ahrq.gov/reports/final.cfm.
12. M.E.David, 2008. “Research Quality Assessment and the Metrication of the Social Sciences.” European Political Science 7: 52–63. doi:10.1057/palgrave.eps.2210176.
13. H.Davies,, S.Nutley, and I.Walter. 2005. Assessing the Impact of Social Science Research:Conceptual, Methodological and Practical Issues. ESRC Symposium on Assessing Non-Academic Impact of Research. London: ESRC.
14. Y.Engeström,, and A.Sannino. 2010. “Studies of Expansive Learning: Foundations, Findings and Future Challenges.” Educational Research Review 5 (1): 1–24. doi:10.1016/j.edurev.2009.12.002.
15. J.Gabbay,, and A.Le May. 2011. Practice-based Evidence for Healthcare: Clinical Mindlines. Abingdon: Routledge.
16. T.L.Giluk,, and S.L.Rynes. 2012. “Research Findings Practitioners Resist: Lessons for Management Academics from Evidence-based Medicine.” In The Oxford Handbook of Evidence-Based Management, edited by D.RousseauDenise, 130–164. Oxford: Oxford University Press.
17. M.Gordon,, and T.Gibbs. 2014. “Stories Statement: Publication Standards for Healthcare Education Evidence Synthesis.” BMC Medicine 12 (143). doi:10.1186/s12916-014-0143-0.
18. J.M.Grimshaw,, M.P.Eccles, J.N.Lavis, S.J.Hill, and J.E.Squires. 2012. “Knowledge Translation of Research Findings.” Implementation Science 7: 50. doi:10.1186/1748-5908-7-50.
19. Hammersley, M. 2005. “The myth of research-based practice: The critical case of educational inquiry.” International Journal of Social Research Methodology 8 (4): 317–330. doi:10.1080/1364557042000232844.
20. M.Hammersley, 2013. The Myth of Research-based Policy and Practice. London: Sage.
21. R.M.Harden,, J.Grant, G.Buckley, and I.R.Hart. 1999. “BEME Guide No 1: Best Evidence Medical Education.” Medical Teacher 21 (6): 597–598. doi: 10.1080/01421599979059
22. J.Hattie, 2015. What Doesn't Work in Education: The Politics of Distraction. London: Pearson.
23. S.B.Issenberg,, W.C.Mcgaghie, E.R.Petrusa, D.L.Gordon, and R.J.Scalese. 2005. “Features and Uses of High-fidelity Medical Simulations that Lead to Effective Learning: A BEME Systematic Review.” Medical Teacher 27 (1): 10–28. doi:10.1080/01421590500046924.
24. M.Kastner,, A.C.Tricco, C.Soobiah, E.Lillie, L.Perrier, T.Horsley, V.Welch, E.Cogo, J.Antony, and S.E.Straus. 2012. “What is the Most Appropriate Knowledge Synthesis Method to Conduct a Review? Protocol for a Scoping Review.” BMC Medical Research Methodology 12 (114). doi:10.1186/1471-2288-12-114.
25. D.Kirkpatrick, 2007. The Four Levels of Evaluation: Measurement and Evaluation. Alexandria, VA: American Society for Training and Development.
26. D.Kolb, 1984. Experiential Learning: Experience as the Source of Learning and Development. Englewood Cliffs, NJ: Prentice Hall.
27. A.Liberati,, D.G.Altman, J.Tetzlaff, C.Mulrow, P.C.Gøtzsche, J.P.Ioannidis, M.Clarke, P.J.Devereaux, J.Kleijnen, and D.Moher. 2009. “The PRISMA Statement for Reporting Systematic Reviews and Meta-analyses of Studies that Evaluate Healthcare Interventions: Explanation and Elaboration.” British Medical Journal 339: b2700. doi:10.1136/bmj.b2700.
28. M.Maclure, 2005. “Clarity Bordering on Stupidity: Where's the Quality in Systematic Review?” Journal of Education Policy 20 (4): 393–416. doi:10.1080/02680930500131801.
29. B.R.Martin, 2011. “The Research Excellence Framework and the ‘Impact Agenda’: Are we Creating a Frankenstein Monster?” Research Evaluation 20 (3): 247–254. doi: 10.3152/095820211X13118583635693
30. B.McCormack, 2011. “Engaged Scholarship and Research Impact: Integrating the Doing and Using of Research in Practice.” Journal of Research in Nursing 16 (2): 111–127. doi:10.1177/1744987110393419.
31. W.C.McGaghie,, S.B.Issenberg, E.R.Cohen, J.H.Barsuk, and D.B.Wayne. 2011. “Does Simulation-based Medical Education with Deliberate Practice Yield Better Results than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence.” Academic Medicine 86 (6): 706–711. doi:10.1097/ACM.0b013e318217e119.
32. A.M.M.I.Micieli,, J.R.Frank, and A.Jalali. 2015. “A Medical Educator's Guide to #MedEd.” Academic Medicine 90 (8). doi:10.1097/ACM.0000000000000776.
33. A.J.Milat,, A.E.Bauman, and S.Redman. 2015. “A Narrative Review of Research Impact Assessment Models and Methods.” Health Research Policy and Systems 13: 646. doi:10.1186/s12961-015-0003-1.
34. V.Passi,, S.Johnson, E.Peile, S.Wright, F.Hafferty, and N.Johnson. 2013. “Doctor Role Modelling in Medical Education: BEME Guide No.27.” Medical Teacher 35 (9): e1422–e1436. doi:10.3109/0142159X.2013.806982.
35. R.Pawson, 2006. Evidence-based Policy: A Realist Perspective. London: Sage.
36. S.G.Pelletier, 2015. Use of Simulation Expands in Medical Education. Association of American Medical Colleges Reporter – February 2015. Accessed June 23. https://www.aamc.org/newsroom/reporter/february2015/426092/simulation.html.
37. M.Petticrew, 2003. “Why Certain Systematic Reviews Reach Uncertain Conclusion.” British Medical Journal 326: 756–758. doi:10.1136/bmj.326.7392.756.
38. Research Councils UK. 2014. Pathways to Impact. Accessed June 19. http://www.rcuk.ac.uk/innovation/impacts/.
39. Research Excellence Framework. 2011. Assessment Framework and Guidance on Submissions. Accessed July 12. http://www.ref.ac.uk/media/ref/content/pub/assessmentframeworkandguidanceonsubmissions/GOS%20including%20addendum.pdf.
40. Research Excellence Framework. 2012. Panel Criteria and Working Methods. Accessed July 12. http://www.ref.ac.uk/media/ref/content/pub/panelcriteriaandworkingmethods/01_12.pdf.
41. A.Rubin,, and J.Bellamy. 2012. Practitioner's Guide to Using Research for Evidence-based Practice. Hoboken, NJ: Wiley.
42. D.Sayer, 2015. Why the £246m Tab for the REF is Over Three Times as Much as the RAE (it's not Just Because of Impact). Maximising the Impact of Academic Research – the Impact Blog. LSE. Accessed October 9. http://blogs.lse.ac.uk/impactofsocialsciences/2015/08/03/why-did-the-2014-ref-cost-three-times-as-much-as-the-2008-rae-hint-its-not-just-because-of-impact/#author
43. D.Schön, 1983. The Reflective Practitioner: How Professionals Think in Action. London: Temple Smith.
44. T.A.Schwandt, 2014. “On the Mutually Informing Relationship Between Practice and Theory in Evaluation.” American Journal of Evaluation 35 (2): 231–236. doi:10.1177/1098214013503703.
45. M.Stevens,, K.Liabo, S.Witherspoon, and H.Roberts. 2009. “What do Practitioners Want from Research, What Do Funders Fund and What Needs to be Done to Know More About What Works in the New World of Children's Services?” Evidence and Policy 5 (3): 281–294. doi:10.1332/174426409X463820.
46. J.E.Thistlethwaite,, E.Bartle, A.A.L.Chong, M.-L.Dick, D.King, S.Mahoney, T.Papinczak, and G.Tucker. 2013. “A Review of Longitudinal Community and Hospital Placements in Medical Education: BEME Guide No.26.” Medical Teacher 35 (8): e1340–e1364. doi:10.3109/0142159X.2013.806981.
47. A.Tong,, K.Flemming, E.McInnes, S.Oliver, and J.Craig. 2012. “Enhancing Transparency in Reporting the Synthesis of Qualitative Research: ENTREQ.” BMC Medical Research Methodology 12 (181). doi:10.1186/1471-2288-12-181.
48. A.van de Ven, 2007. Engaged Scholarship: A Guide for Organizational and Social Research. Oxford: Oxford University Press.
49. P.Wells, 2007. “New Labour and Evidence-based Policy-making: 1997–2007.” People, Place and Policy Online 1 (1): 22–29. doi:10.3351/ppp.0001.0001.0004.
50. G.Wong,, T.Greenhalgh, and R.Pawson. 2010. “Internet-based Medical Education: A Realist Review of what Works, for Whom and in What Circumstances.” BMC Medical Education 10 (12). doi:10.1186/1472-6920-10-12.
51. G.Wong,, T.Greenhalgh, G.Westhorp, J.Buckingham, and R.Pawson. 2013a. “RAMESES Publication Standards: Realist Syntheses.” BMC Medicine 11 (21). doi:10.1186/1741-7015-11-21.
52. G.Wong,, T.Greenhalgh, G.Westhorp, J.Buckingham and R.Pawson. 2013b. “RAMASES Publication Standards: Meta-narrative Reviews.” BMC Medicine 11 (20). doi:10.1186/1741-7015-11-20.
53. K.Woolf,, H.W.W.Potts, and I.C.McManus. 2011. “Ethnicity and Academic Performance in UK Trained Doctors and Medical Students: Systematic Review and Meta-analysis.” British Medical Journal 342 (7803): d901. doi:http://dx.doi.org/10.1136/bmj.d901.