Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research

Global Environmental Change

Volumn 25, Issue 1, 2014, Pages 204-220

  Fazey, Ioan ^a   Bunse, Lukas ^a   Msika, Joshua ^a   Pinke, Maria ^a   Preedy, Katherine ^b   Evely, Anna C ^c   Lambert, Emily ^c   Hastings, Emily ^b   Morris, Sue ^b   Reed, Mark S ^d  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

^b SCOTTISH CROP RESEARCH INSTITUTE   (United Kingdom)

^c Project Maya   (United Kingdom)

^d BIRMINGHAM CITY UNIVERSITY   (United Kingdom)

Author keywords

Co design; Co management; Co production; Interdisciplinary research; Knowledge transfer; Participatory research

Indexed keywords

EID: 84898431333     PISSN: 09593780     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.gloenvcha.2013.12.012     Document Type: Article

References (92)

1. Allan C., Stankey G. Adaptive Environmental Management: A Practitioner's Guide 2009, Springer/CSIRO Publishing, Dordrecht.
2. Andersen A.A. The Community Builder's Approach to Theory of Change: A Practical Guide to Theory Development 2005, The Aspen Institute, Aspen, Colorado.
3. Bell S., Shaw B., Boaz A. Real-world approaches to assessing the impact of environmental research on policy. Research Evaluation 2011, 20:227-237.
4. Bellamy J.A., Walker D.H., McDonald G.T., Syme G.J. A systems approach to the evaluation of natural resource management initiatives. Journal of Environmental Management 2001, 63:407-423.
5. Blanton E., Ombeki S., Oluoch G.O., Mwaki A., Wannemuehler K., Quick R. Evaluation of the role of school children in the promotion of point-of-use water treatment and handwashing in schools and households - Nyanza Province, Western Kenya, 2007. American Journal of Tropical Medicine and Hygiene 2010, 82:664-671.
6. Boaz A., Fitzpatrick S., Shaw B. Assessing the impact of research on policy: a literature review. Science and Public Policy 2009, 36:255-270.
7. Bowen S., Martens P., Crockett S. Demystifying knowledge translation: learning from the community. Journal of Health Services Research and Policy 2005, 10:203-211.
8. Bowen S., Martens P.J. A model for collaborative evaluation of university-community partnerships. Journal of Epidemiology and Community Health 2006, 60:902-907.
9. Bracken L.J., Oughton E.A. Making sense of policy implementation: the construction and uses of expertise and evidence in managing freshwater environments. Environmental Science and Policy 2013, 30:10-18.
10. Cantú F.J., Bustani A., Molina A., Moreira H. A knowledge-based development model: the research chair strategy. Journal of Knowledge Management 2009, 13:154-170.
11. Cashman R., Bernstein L.J., Bilodeau D., Bovett G., Jackson B., Yousefi M., Prica A., Perry J. Evaluation of an educational program for the caregivers of persons diagnosed with a malignant glioma. Canadian Oncology Nursing Journal (Revue canadienne de nursing oncologique) 2007, 17:6-15.
12. Chapman D.D., Wiessner C.A., Storberg-Walker J., Hatcher T. New learning: a different way of approaching conference evaluation. Knowledge Management Research and Practice 2007, 5:261-270.
13. Clark G., Dawes F., Heywood A., McLaughlin T. Students as transferors of knowledge: the problem of measuring success. International Small Business Journal 2008, 26:735-758.
14. Connick S., Innes J.E. Outcomes of collaborative water policy making: applying complexity thinking to evaluation. Journal of Environmental Planning and Management 2003, 46:177-197.
15. Crawford B., Herrera M.D., Hernandez N., Leclair C.R., Jiddawi N., Masumbuko S., Haws M. Small scale fisheries management: lessons from cockle harvesters in Nicaragua and Tanzania. Coastal Management 2010, 38:195-215.
16. Cricelli L., Grimaldi M. Knowledge-based inter-organizational collaborations. Journal of Knowledge Management 2010, 14:348-358.
17. Davies H., Nutley S., Walter I. Approaches to Assessing the Nonacademic Impact of Social Science Research: A Report of the ESRC Symposium on Assessing the Non-academic Impact of Research 12th/13th May 2005 2005, University of St Andrews, St Andrews.
18. Davies H.T.O., Powell A.E. Communicating social research findings more effectively: what can we learn from other fields?. Evidence and Policy 2012, 8:213-233.
19. del Pilar Moreno-Sánchez R., Maldonado J.H. Evaluating the role of co-management in improving governance of marine protected areas: an experimental approach in the Colombian Caribbean. Ecological Economics 2010, 69:2557-2567.
20. DFID DFID Research Open and Enhanced Access Policy 2013, Department for International Development, London.
21. Dixon J., Sindall C. Applying logics of change to the evaluation of community development in health promotion. Health Promotion International 1994, 9:297-309.
22. ESRC Measuring the Impact of ESRC Funding. A Report Produced for the Economic and Social Research Council 2009, Frontier Economics Ltd., Swindon, UK.
23. ESRC Study of the Contribution of Social Scientists to Government Policy and Practice: Final Report 2012, Economic and Social Science Research Council, Swindon, UK.
24. European Communities Evaluation Methods for the European Union's External Assistance. Methodological Bases for Evaluation 2006, vol. 1. European Commission, Luxemburg.
25. Evans L., Cherrett N., Pemsl D. Assessing the impact of fisheries co-management interventions in developing countries: a meta-analysis. Journal of Environmental Management 2011, 92:1938-1949.
26. Fazey I. Resilience and higher order thinking. Ecology and Society 2010, 15:22.
27. Fazey I., Evely A.C., Reed M.R., Stringer L.C., Kruijsen J.H.J., White P.C.L., Newsham A., Jin L., Cortazzi M., Phillipson J., Blackstock K.L., Entwistle N., Sheate W.R., Armstrong F., Blackmore C., Fazey J.A., Ingram J., Gregson J., Lowe P., Morton S., Trevitt C. Knowledge exchange: a review and research agenda for environmental management. Environmental Conservation 2013, 40:19-36.
28. Fetterman D., Wandersman A. Empowerment Evaluation: Principles in Practice 2005, Guilford Press, New York, London.
29. Fischer J., Dyball R., Fazey I., Gross C., Dovers S., Ehrlich P.R., Brulle R.J., Christensen C., Borden R.J. Human behavior and sustainability. Frontiers in Ecology and the Environment 2012, 10:153-160.
30. Francis R.A., Goodman M.K. Post-normal science and the art of nature conservation. Journal for Nature Conservation 2011, 18:89-105.
31. Funtowicz S., Shepherd I., Wilkinson D., Ravetz J. Science and governance in the European Union: a contribution to the debate. Science and Public Policy 2000, 27:327-336.
32. Funtowicz S.O., Ravetz J.R. Science for the post-normal age. Futures 1993, 25:739-755.
33. Gabbay J., Le May A., Jefferson H., Webb D., Lovelock R., Powell J., Lathlean J. A case study of knowledge management in multi-agency consumer-informed 'communities of practice': implications for evidence-based policy development in health and social services. Health 2003, 7:283-310.
34. Granek E.E., Brown M.A. Co-management approach to marine conservation in Moh'eli, Comoros Islands. Conservation Biology 2005, 19:1724-1732.
35. Gross D.P., Lowe A. Evaluation of a knowledge translation initiative for physical therapists treating patients with work disability. Disability and Rehabilitation 2009, 31:871-879.
36. Guba, E.G., Lincoln, Y.S. (n.d.) Evaluation paradigms: worldviews or belief systems that guide evaluators. Cited in Chapman, D., Wiessner, C.A., Storberg-Walker, J., Hatcher, T., n.d. New Learning: a different way of approaching conference evaluation. Knowledge Management Research & Practice 5, 261-270.
37. Gutierrez N.L., Hilborn R., Defeo O. Leadership, social capital and incentives promote successful fisheries. Nature 2011, 470:386-389.
38. Heylings P., Bravo M. Evaluating governance: a process for understanding how co-management is functioning, and why, in the Galapagos Marine Reserve. Ocean and Coastal Management 2007, 50:174-208.
39. Hofer B.K. Dimensionality and disciplinary differences in personal epistemology. Contemporary Educational Psychology 2000, 25:378-405.
40. Innés J.E., Booher D.E. Consensus building and complex adaptive systems a framework for evaluating collaborative planning. Journal of the American Planning Association 1999, 65:412-423.
41. Juntti M., Russel D., Turnpenny J. Evidence, politics and power in public policy for the environment. Environmental Science and Policy 2009, 12:207-215.
42. Kates R.W., Clark W.C., Corell R., Hall J.M., Jaeger C.C., Lowe I., McCarthy J.J., Schellnhuber H.J., Bolin B., Dickson N.M., Faucheux S., Gallopin G.C., Grubler A., Huntley B., Jager J., Jodha N.S., Kasperson R.E., Mabogunje A., Matson P., Mooney H., Moore B., O'Riordan T., Svedin U. Environment and development - sustainability science. Science 2001, 292:641-642.
43. Kirshbaum M. Translation to practice: a randomised, controlled study of an evidence-based booklet for breast-care nurses in the United Kingdom. Worldviews on Evidence-Based Nursing 2008, 5:60-74.
44. Kothari A., Hovanec N., Hastie R., Sibbald S. Lessons from the business sector for successful knowledge management in health care: a systematic review. BMC Health Services Research 2011, 11.
45. Kothari A., Maclean L., Edwards N., Hobbs A. Indicators at the interface: managing policymaker-researcher collaboration. Knowledge Management Research and Practice 2011, 9:203-214.
46. Kuah C.T., Wong K.Y. Knowledge management performance measurement: a review. African Journal of Business Management 2011, 5:6021-6027.
47. Kuper M., Dionnet M., Hammani A., Bekkar Y., Garin P., Bluemling B. Supporting the shift from state water to community water: lessons from a social learning approach to designing joint irrigation projects in Morocco. Ecology and Society 2009, 14.
48. La Peyre M.K., Reams M.A., Mendelssohn I.A. Linking actions to outcomes in wetland management: an overview of US state wetland management. Wetlands 2001, 21:66-74.
49. Leys A.J., Vanclay J.K. Social learning: a knowledge and capacity building approach for adaptive co-management of contested landscapes. Land Use Policy 2011, 28:574-584.
50. LWEC LWEC Knowledge Exchange Guidelines 2012, Living With Environmental Change, http://www.lwec.org.uk/.
51. Marra M. Knowledge partnerships for development: what challenges for evaluation?. Evaluation and Program Planning 2004, 27:151-160.
52. Mauser W., Klepper G., Rice M., Schmalzbauer B.S., Hackmann H., Leemans R., Moore H. Transdisciplinary global change research: the co-creation of knowledge for sustainability. Current Opinion in Environmental Sustainability 2013, 5:420-431.
53. McWilliam, Stewart M., Judith Belle Brown J.B., John Feightner J., Mark Rosenberg M., Gloria Gutman G., Margaret Penning M., Miriam Stewart M., Robyn Tamblyn R., Grace Morfitt G. Promoting Evidence-based Health Policy. Programming and Practice for Seniors: Lessons from a National Knowledge Transfer Project 2005, National Knowledge Transfer Project.
54. McWilliam C.L., Stewart M., Brown J.B., Feightner J., Rosenberg M., Gutman G., Penning M., Tamblyn R., Morfitt G. Promoting evidence-based health policy, programming, and practice for seniors: lessons from a national knowledge transfer project. Canadian Journal on Aging 2003, 22:415-430.
55. Meagher L., Lyall C., Nutley S. Flows of knowledge, expertise and influence: a method for assessing policy and practice impacts from social science research. Research Evaluation 2008, 17:163-173.
56. Miller T.R., Baird T.D., Littlefield C.M., Kofinas G.P., Chapin F.S., Redman C.L. Epistemological pluralism: reorganizing interdisciplinary research. Ecology and Society 2008, 13. Art 46.
57. Molas-Gallart J., Tang P. Tracing 'productive interactions' to identify social impacts: an example from the social sciences. Research Evaluation 2011, 20:219-226.
58. Morton S. Exploring and Assessing Social Research Impact: A Case Study of A Research Partnership's Impacts on Policy and Practice 2012, University of Edinburgh, Edinburgh.
59. Muñoz-Erickson T.A., Aguilar-González B., Loeser M.R.R., Sisk T.D. A framework to evaluate ecological and social outcomes of collaborative management: lessons from implementation with a Northern Arizona collaborative group. Environmental Management 2010, 45:132-144.
60. Nonaka I., Toyama R., Konno N. SECI, ba and leadership: a unified model of dynamic knowledge creation. Long Range Planning 2000, 33:5-34.
61. Norgaard R.B. Learning and knowing collectively. Ecological Economics 2004, 49:231-241.
62. Nowotny H., SCott P., Gibbons M. Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty 2001, Polity Press, Cambridge.
63. O'Brien K., Reams J., Caspari A., Dugmore A., Faghihimani M., Fazey I., Hackmann H., Manuel-Navarrete D., Marks J., Miller R., Raivio K., Romero-Lankao P., Virji H., Vogel C., Winiwarter V. You say you want a revolution? Transforming education and capacity building in response to global change. Environmental Science and Policy 2013, 28:48-59.
64. Olson C.A., Tooman T.R., Alvarado C.J. Knowledge systems, health care teams, and clinical practice: a study of successful change. Advances in Health Science Education 2010, 15:491-516.
65. Pahl-Wostl C. A conceptual framework for analysing adaptive capacity and multi-level learning processes in resource governance regimes. Global Environmental Change-Human and Policy Dimensions 2009, 19:354-365.
66. Parfitt T. The ambiguity of participation: a qualified defence of participatory development. Third World Quarterly 2004, 25:537-556.
67. Pentland D., Forsyth K., Maciver D., Walsh M., Murray R., Irvine L., Sikora S. Key characteristics of knowledge transfer and exchange in healthcare: integrative literature review. Journal of Advanced Nursing 2011, 67:1408-1425.
68. Phillipson J., Lowe P., Proctor A., Ruto E. Stakeholder engagement and knowledge exchange in environmental research. Journal of Environmental Management 2012, 95:56-65.
69. Planet Under Pressure Planet Under Pressure 2012 State of the Planet Declaration: new knowledge towards new solutions. Planet Under Pressure Conference 2012.
70. Plummer R., Armitage D. A resilience-based framework for evaluating adaptive co-management: linking ecology, economics and society in a complex world. Ecological Economics 2007, 61:62-74.
71. Raman M., Dorasamy M., Muthaiyah S., Kaliannan M., Muthuveloo R. Knowledge management for social workers involved in disaster planning and response in Malaysia: an action research approach. Systemic Practice and Action Research 2011, 24:261-272.
72. Raymond C.M., Fazey I., Reed M.S., Stringer L.C., Robinson G.M., Evely A.C. Integrating local and scientific knowledge for environmental management. Journal of Environmental Management 2010, 91:1766-1777.
73. RCUK Excellence with Impact: Framework for the Future 2009, Research Councils UK, Swindon.
74. Reed M.S. Stakeholder participation for environmental management: a literature review. Biological Conservation 2008, 141:2417-2431.
75. Reed M.S., Fazey I., Stringer L.C., Raymond C.M., Akhtar-Schuster M., Begni G., Bigas H., Brehm S., Briggs J., Bryce R., Buckmaster S., Chanda R., Davies J., Diez E., Essahli W., Evely A., Geeson N., Hartmann I., Hubacek K., Ioris A.A.R., Kruger B., Laureano P., Phillipson J., Prell C., Quinn C.H., Reeves A.D., Seely M., Thomas R., Van der Werff Ten Bosch M.J., Vergunst P., Wagner L. Knowledge management for land degradation monitoring and assessment: an analysis of contemporary thinking. Land Degradation and Development 2014, 24:307-322.
76. Reeves T.C. Established and emerging evaluation paradigms for instructional design. Instructional Development Paradigms 1997, 163-178. Educational Technology Publications, Englewood Cliffs, NJ. C.R. Dills, A.J. Romiszowski (Eds.).
77. Rossi P.H. My views of evaluation and their origins. Evaluation Roots: Tracing Theorists' Views and Influences 2004, 122-131. Sage Publications Inc., Thousand Oaks, CA. M.C. Alkin (Ed.).
78. Roux D.J., Stirzaker R.J., Breen C.M., Lefroy E.C., Cresswell H.P. Framework for participative reflection on the accomplishment of transdisciplinary research programs. Environmental Science and Policy 2010, 13:733-741.
79. Rushmer R., Kelly D., Lough M., Wilkinson J.E., Davies H.T.O. Introducing the learning practice - I. The characteristics of learning organizations in primary care. Journal of Evaluation in Clinical Practice 2004, 10:375-386.
80. Rycroft-Malone J., Wilkinson J., Burton C., Andrews G., Ariss S., Baker R., Dopson S., Graham I., Harvey G., Martin G., McCormack B., Staniszewska S., Thompson C. Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC). Implementation Science 2011, 6:74.
81. Salafsky N., Cauley H., Balachander G., Cordes B., Parks J., Margoluis C., Bhatt S., Encarnacion C., Russell D., Margoluis R. A systematic test of an enterprise strategy for community-based biodiversity conservation. Conservation Biology 2001, 15:1585-1595.
82. Schmidt T. Strategic Project Management Made Simple: Practical Tools for Leaders and Teams 2009, John Wiley & Sons, Hoboken, New Jersey.
83. Scopus Sciverse Scopus 2012, Elsevier, Philadelphia, PA, U.S.A.
84. Scriven M. Reflections. Evaluation Roots: Tracing Theorists' Views and Influences 2004, 183-195. Sage Publications Inc., Thousand Oaks, CA. M.C. Alkin (Ed.).
85. Sheppard D.J., Moehrenschlager A., McPherson J.M., Mason J.J. Ten years of adaptive community-governed conservation: evaluating biodiversity protection and poverty alleviation in a West African hippopotamus reserve. Environmental Conservation 2010, 37:270-282.
86. Shufflebeam D.L., Shinkfield A.J. Evaluation Theory, Models and Applications 2007, Jossey Bass, San Francisco.
87. Stokols D., Hall K.L., Brandie K., Taylor B.K., Richard P., Moser R.P. The science of team science overview of the field and introduction to the supplement. American Journal of Preventive Medicine 2008, 35:2S.
88. Straus S.E., Tetroe J.M., Graham I.D. Knowledge translation is the use of knowledge in health care decision making. Journal of Clinical Epidemiology 2011, 64:6-10.
89. Stringer A.P., Bell C.E., Christley R.M., Gebreab F., Tefera G., Reed K., Trawford A., Pinchbeck G.L. A cluster-randomised controlled trial to compare the effectiveness of different knowledge-transfer interventions for rural working equid users in Ethiopia. Preventive Veterinary Medicine 2011, 100:90-99.
90. Warner G., Lyons R., Parker V., Phillips S. Advancing coordinated care in four provincial healthcare systems: evaluating a knowledge-exchange intervention. Healthcare Policy 2011, 7:80-94.
91. Waters E., Armstrong R., Swinburn B., Moore L., Dobbins M., Anderson L., Petticrew M., Clark R., Conning R., Moodie M., Carter R. An exploratory cluster randomised controlled trial of knowledge translation strategies to support evidence-informed decision-making in local governments (The KT4LG study). BMC Public Health 2011, 11.
92. Zukoski A., Luluquisen M. Participatory evaluation. What is it? why do it? what are the challenges?. Community-based Public Health Policy and Practice 2002, 5:1-6.