A Complexity-Informed Approach to Evaluating National Knowledge and Innovation Programmes

Systems Research and Behavioral Science

Volumn 32, Issue 1, 2015, Pages 50-63

  Bressers, Nanny ^a   Gerrits, Lasse ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Evaluation; Innovation programmes; National knowledge; Systemic complexity

Indexed keywords

EVALUATION; EVALUATION METHODS; MULTI ACTORS; NATIONAL KNOWLEDGE; NEW APPROACHES; SYSTEMIC COMPLEXITY;

BEHAVIORAL RESEARCH;

EID: 84923767656     PISSN: 10927026     EISSN: 10991743     Source Type: Journal    
DOI: 10.1002/sres.2205     Document Type: Article

References (55)

1. Arthur WB. 1994. Increasing returns and path dependence in the economy. The University of Michigan Press: Ann Arbor.
2. Barnes M, Matka E, Sullivan H. 2003. Evidence, understanding and complexity: evaluation in non-linear systems. Evaluation 9(3): 265-284.
3. Barton J, Emery M, Flood RL, Selsky JW, Wolstenholme E. 2004. A maturing of systems thinking? Evidence from three perspectives. Systemic Practice and Action Research 17(1): 3-36.
4. Benkö SS, Sarvimäki A. 2000. Evaluation of patient-focused health care from a systems perspective. Systems Research and Behavioral Science 17: 513-525.
5. Boons F, Van Buuren A, Gerrits L, Teisman G. 2009. Towards an approach of evolutionary public management. In Managing Complex Governance Systems. Dynamics, Self-Organization and Coevolution in Public Investments, Teisman G, Van Buuren A, Gerrits L (eds.). Routledge: New York/ London; 231-249.
6. Bressers N. 2011. Co-Creating Innovation. A systemic learning evaluation of knowledge and innovation programmes. PhD thesis, Erasmus University Rotterdam.
7. Buijs JM, Eshuis J, Byrne D. 2009. Approaches to researching complexity in public management. In Managing Complex Governance Systems. Dynamics, Self-Organization and Coevolution in Public Investments, Teisman G, Van Buuren A, Gerrits L (eds.). Routledge: New York/ London; 37-55.
8. Burton P, Goodlad R, Croft J. 2006. How would we know what works?: context and complexity in the evaluation of community involvement. Evaluation 12(3): 294-312.
9. Byrne DS. 1998. Complexity Theory and the Social Sciences. An Introduction. Routledge: London/ New York.
10. Byrne DS. 2005. Complexity, configurations and cases. Theory, Culture & Society 22(5): 95-111.
11. Checkland P. 1981. Systems Thinking, Systems Practice. John Wiley and Sons Ltd: Chichester.
12. Cilliers P. 2000. Knowledge, complexity and understanding. Emergence 2(4): 7-13.
13. Cousins JB, Whitmore E. 1998. Framing participatory evaluation. New Directions For Evaluation 80: 5-23.
14. Dewulf G, Noorderhaven N. 2011. Managing Public-Private Innovation Programs. Lessons from The Netherlands, the United Kingdom, Finland and Australia. Essay PSIBouw, accessible online via http://www.debouwvernieuwt.nl/details/kennis?kennis=275 [5 June 2012].
15. Edelenbos J, Van Buuren A. 2005. The learning evaluation: a theoretical and empirical exploration. Evaluation Review 29(6): 591-612.
16. Fetterman, DM. 1994. Empowerment evaluation. American Journal of Evaluation 15(1): 1-15.
17. Fischer F. 1995. Evaluating Public Policy. Nelson-Hall Publishers: Chicago.
18. Flood RL. 1999. Rethinking the Fifth Discipline. Learning Within the Unknowable. Routledge: London.
19. Gerrits L. 2008. The gentle Art of coevolution. A complexity theory perspective on decision making over estuaries in Germany, Belgium and The Netherlands. PhD Thesis, Erasmus University Rotterdam.
20. Gerrits L. 2011. A coevolutionary revison of decision making processes: an analysis of port extensions in Germany, Belgium and The Netherlands. Public Administration Quarterly 35(3): 309-329.
21. Gerrits L. 2012. Punching Clouds. An Introduction to the Complexity of Public Decision- Making. Emergent Publications: Litchfield Park, AZ.
22. Gilbert M, Cordey-Hayes M. 1996. Understanding the process of knowledge transfer to achieve successful technological innovation. Technovation 16(6): 301-312.
23. Guba EG, Lincoln YS. 1989. Fourth Generation Evaluation. SAGE Publications: Newbury Park.
24. Jeffrey P, Seaton RAF. 2004. A conceptual model of 'receptivity' applied to the design and deployment of water policy mechanisms. Journal of Integrative Environmental Sciences 1(3): 277-300.
25. Jenks CL. 1998. Evaluating educational system designs. Systems Research and Behavioral Science 15: 209-215.
26. Kanungo S, Duda S, Srinivas Y. 1999. A structured model for evaluating information systems effectiveness. Systems Research and Behavioral Science 16: 495-518.
27. Klijn EH, Snellen I. 2009. Complexity theory and public administration: a critical appraisal. In Managing Complex Governance Systems. Dynamics, Self-Organization and Coevolution in Public Investments, Teisman G, Van Buuren A, Gerrits L (eds.). Routledge: New York/ London; 17-36.
28. Majone G, Quade ES. 1980. Pitfalls of Analysis. John Wiley and Sons Ltd: Chichester.
29. van der Meer FB, Edelenbos J. 2006. Evaluation in multi-actor processes: accountability, learning and cooperation. Evaluation 12(2): 201-218.
30. Mitleton-Kelly E. 2003. Complex Systems and Evolutionary Perspectives on Organizations: The Application of Complexity Theory to Organizations. Elsevier: Oxford.
31. Norgaard RB. 1994. Development Betrayed; the end of progress and a coevolutionary revisioning of the future. Routledge: London, New York.
32. Otter HS. 2000. Complex Adaptive Land use Systems; an Interdisciplinary Approach with Agent- Based Models. Eburon: Delft.
33. Parsons T. 1951. The Social System. Free Press: Chicago.
34. Parsons W. 1995. Public Policy: An Introduction to the Theory and Practice of Policy Analysis. Cambridge University Press: Cambridge.
35. Patton MQ. 1978. Utilization-Focused Evaluation. Sage Publications: Beverly Hills.
36. Patton MQ. 1985. Local incompatibilities and pragmatism. Evaluation and Program Planning 8: 307-308
37. Patton MQ. 2011. Developmental Evaluation. Applying Complexity Concepts to Enhance Innovation and Use. The Guilford Press: New York.
38. Pawson R, Tilley N. 1997. Realistic Evaluation. Sage Publications: London.
39. Pel B. 2009. The complexity of self-organization: boundary judgments in traffic management. In Managing Complex Governance Systems. Dynamics, Self-Organization and Coevolution in Public Investments, Teisman G, Van Buuren A, Gerrits L (eds.). Routledge: New York/ London; 116-133.
40. Pinzón L, Midgley G. 2000. Developing a systemic model for the evaluation of conflicts. Systems Research and Behavioral Science 17: 493-512.
41. Ragin C. 2000. Fuzzy set Social Science. University of Chicago Press: Chicago.
42. Rescher N. 1998. Complexity: A Philosophical Overview. Transaction Publishers: London.
43. Rogers EM. 2003. Diffusion of Innovations. Fifth edn. Free Press: New York.
44. Rogers PJ. 2008. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 14(1): 29-48.
45. Sanderson I. 2000. Evaluation in complex policy systems. Evaluation 6(4): 433-454.
46. Stake RE. 2000. Program evaluation: particularly responsive evaluation. In Evaluation Models, Stufflebeam DL, Madaus GF, Kellaghan T (eds.). Kluwer Academic Publishers: Boston; 343-362.
47. Stame N. 2004. Theory-based evaluation and types of complexity. Evaluation 10(1): 58-76.
48. Taket A, White L. 1997. Working with heterogeneity: a pluralist strategy for evaluation. Systems Research and Behavioral Science 14(2): 101-111.
49. Teisman GR. 2005. Publiek Management op de Grens van Chaos en Orde. Over Leidinggeven en Organiseren in Complexiteit. Sdu Uitgevers: Den Haag.
50. Teisman GR. 2008. Complexity and management of improvement programmes. Public Management Review 10(3): 341-359.
51. Teisman G, Van Buuren A, Gerrits L. 2009. Managing Complex Governance Systems. Dynamics, Self-Organization and Coevolution in Public Investments. Routledge: New York/ London.
52. Trott P. 1993. Inward technology transfer as an interactive process: a case study of ICI. PhD Thesis, Innovation and Technology Assessment Centre, Cranfield Institute of Technology
53. Trott P, Cordey-Hayes M, Seaton RAF. 1995. Inward technology transfer as an interactive process. Technovation 15(1): 25-43.
54. Ulrich W. 1983. Critical Heuristics of Social Planning: A new Approach to Practical Philosophy. Haupt: Bern.
55. Wadsworth Y. 2001. Becoming responsive - and some consequences for evaluation as dialogue across distance. New Directions for Evaluation 92: 45-58.