Systemic evaluation: A participative, multi-method approach

Journal of the Operational Research Society

Volumn 58, Issue 10, 2007, Pages 1306-1320

  Boyd, A ^a   Geerling, T ^b   Gregory, W J ^c   Kagan, C ^d   Midgley, G ^c,e   Murray, P ^b   Walsh, M P ^f  

^a UNIVERSITY OF MANCHESTER   (United Kingdom)

^b UNIVERSITY OF HULL   (United Kingdom)

^c ESR Christchurch Science Centre   (New Zealand)

^d MANCHESTER METROPOLITAN UNIVERSITY   (United Kingdom)

^e VICTORIA UNIVERSITY OF WELLINGTON   (New Zealand)

^f North Star UK Ltd   (United Kingdom)

Author keywords

Community health services; Community operational research; Critical systems thinking; Health; Participation; Systems methodology

Indexed keywords

LINEAR PROGRAMMING; OPERATIONS RESEARCH; PROJECT MANAGEMENT; SYSTEMS ANALYSIS;

COMMUNITY HEALTH SERVICES; COMMUNITY OPERATIONAL RESEARCH; CRITICAL SYSTEMS THINKING; STAKEHOLDER PARTICIPATION; SYSTEMS METHODOLOGY;

HEALTH CARE;

EID: 35448984218     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/palgrave.jors.2602281     Document Type: Review

References (94)

1. Ackoff RL (1981). Creating the Corporate Future. Wiley: New York.
2. Baker V, Foote J, Gregor J, Houston D and Midgley G (2004). Boundary critique and community involvement in small watershed management. In: Dew K and Fitzgerald R (eds). Challenging Science: Science and Society Issues in New Zealand. Dunmore Press: Palmerston North.
3. Beer S (1985). Diagnosing the System for Organizations. Wiley: Chichester.
4. Boyd A (2002). Capacity-Building for Evaluation: Follow Up to the HAZE Project. Centre for Systems Studies, Business School, University of Hull: Hull.
5. Boyd A, Brown M and Midgley G (1999). Home and Away: Developing Services with Young People Missing from Home or Care. Centre for Systems Studies: Hull.
6. Boyd A, Brown M and Midgley G (2004). Systemic intervention for community OR: developing services with young people (under 16) living on the streets. In: Midgley G and Ochoa-Arias AE (eds). Community Operational Research: OR and Systems Thinking for Community Development. Kluwer/Plenum: New York.
7. Boyd A, Geerling T, Gregory W, Kagan C, Midgley G, Murray P and Walsh M (2001). Capacity-Building for Evaluation: A Report on the HAZE Project to the Manchester, Salford and Trafford Health Action Zone. Centre for Systems Studies, Business School, University of Hull: Hull.
8. Brocklesby J and Cummings S (1996). Foucault plays Habermas: an alternative philosophical underpinning for critical systems thinking (CST). J Opl Res Soc 47: 741-754.
9. Brockwell PJ and Davis RA (2002). Introduction to Time Series and Forecasting, 2nd edn. Springer-Verlag: New York.
10. Brown M (1996). A framework for assessing participation. In: Flood RL and Romm NRA (eds). Critical Systems Thinking: Current Research and Practice. Plenum: New York.
11. Chambers R (1997). Whose Reality Counts? Putting the Last First. Intermediate Technology Publications: London.
12. Charnes A, Cooper W, Lewin AY and Seiford LM (eds) (1995). Data Envelopment Analysis: Theory, Methodology and Applications. Kluwer: London.
13. Checkland P (1981). Systems Thinking, Systems Practice. Wiley: Chichester.
14. Checkland P and Scholes J (1990). Soft Systems Methodology in Action. Wiley: Chichester.
15. Churchman CW (1970). Operations research as a profession. Mngt Sci 17: B37-B53.
16. Cilliers P (1998). Complexity and Post-Modernism. Routledge: London.
17. Clemson M and Jackson MC (1988). Evaluating organizations with multiple goals. OR Insight 1(2): 2-5.
18. Codling S (1995). Best Practice Benchmarking. Gower: Aldershot.
19. Cohen C and Midgley G (1994). The North Humherside Diversion from Custody Project for Mentally Disordered Offenders: Research Report. Centre for Systems Studies: Hull.
20. Cooper WW, Seiford LM and Zhu J (eds) (2004). Handbook on Data Envelopment Analysis. Kluwer: Boston.
21. Drury C (1985). Management and Cost Accounting. Van Nostrand Reinhold (UK): Wokingham.
22. Dutt PK (1994). Problem contexts - a consultant's perspective. Systems Pract 7: 539-550.
23. Eden C (1989). Using cognitive mapping for strategic options development and analysis. In: Rosenhead J (ed). Rational Analysis for a Problematic World: Problem Structuring Methods for Complexity, Uncertainty and Conflict. Wiley: Chichester.
24. Fishman GS (2001). Discrete-Event Simulation: Modeling, Programming, and Analysis. Springer-Verlag: Berlin.
25. Flood RL (1995). Solving Problem Solving. Wiley: Chichester.
26. Flood RL and Jackson MC (eds) (1991a). Critical Systems Thinking: Directed Readings. Wiley: Chichester.
27. Flood RL and Jackson MC (1991b). Creative Problem Solving: Total Systems Intervention. Wiley: Chichester.
28. Foucault M (1976). Two lectures. In: Gordon C (ed). Michel Foucault: Power/Knowledge. Harvester Wheatsheaf: London.
29. Friend JK and Hickling A (1987). Planning under Pressure: The Strategic Choice Approach. Pergamon: Oxford.
30. Gregory AJ (1995). Organizational evaluation: a complementarist approach. PhD thesis, University of Hull.
31. Gregory AJ (1996a). The road to integration: reflections on the development of organizational evaluation theory and practice. Omega 24(3): 295-307.
32. Gregory AJ (1996b). Long-term evaluation systems. OR Insight 9(1): 29-32.
33. Gregory AJ (1997). Evaluation practice and the tricky issue of coercive contexts. Systems Pract 10: 589-609.
34. Gregory AJ and Jackson MC (1992a). Evaluation methodologies: a system for use. J Opl Res Soc 43: 19-28.
35. Gregory AJ and Jackson MC (1992b). Evaluating organizations: a systems and contingency approach. Systems Pract 5: 37-60.
36. Gregory WJ (1992). Critical systems thinking and pluralism: a new constellation. PhD thesis, City University, London.
37. Gregory WJ (1996). Discordant pluralism: a new strategy for critical systems thinking. Systems Pract 9: 605-625.
38. Guba E and Lincoln Y (1989). Fourth Generation Evaluation. Sage: London.
39. Hearn J and Parkin W (1993). Organizations, multiple oppressions and postmodernism. In: Hassard J and Parker M (eds). Postmodernism and Organizations. Sage: London.
40. Hughes A and Halsall DN (2002). Comparison of the 14 deadly diseases and the business excellence model. Total Qual Mngt 13(2): 255-263.
41. Jackson MC (1991). The origins and nature of critical systems thinking. Systems Pract 4: 131-149.
42. Jackson MC (2000). Systems Approaches to Management. Kluwer/Plenum: New York.
43. Jackson MC and Keys P (1984). Towards a system of systems methodologies. J Opl Res Soc 35: 473-486.
44. Jackson MC and Medjedoub S (1988). Designing evaluation systems: theoretical groundings and a practical intervention. In: Trappl R (ed). Cybernetics and Systems. Reidel: Dordrecht.
45. Jackson N and Carter P (1991). In defence of paradigm incommensurability. Organ Stud 12: 109-127.
46. Mason RO and Mitroff II (1981). Challenging Strategic Planning Assumptions. Wiley: New York.
47. Maturana HR and Varela FJ (1980). Autopoiesis and Cognition: The Realization of the Living. Reidel: Dordrecht.
48. Midgley G (1988). A systems analysis and evaluation of microjob: a vocational rehabilitation and information technology training centre for people with disabilities. MPhil thesis, City University, London.
49. Midgley G (1990). Creative methodology design. Systemist 12: 108-113.
50. Midgley G (1992). The sacred and profane in critical systems thinking. Systems Pract 5: 5-16.
51. Midgley G (1994). Ecology and the poverty of humanism: a critical systems perspective. Systems Res 11: 67-76.
52. Midgley G (1996). What is this thing called CST? In: Flood RL and Romm NRA (eds). Critical Systems Thinking: Current Research and Practice. Plenum: New York.
53. Midgley G (1997a). Dealing with coercion: critical systems heuristics and beyond. Systems Pract 10: 37-57.
54. Midgley G (1997b). Developing the methodology of TSI: from the oblique use of methods to creative design. Systems Pract 10: 305-319.
55. Midgley G (1999). Ethical Dilemmas: a reply to Richard Ormerod. J Opl Res Soc 50: 549-553.
56. Midgley G (2000). Systemic Intervention: Philosophy, Methodology, and Practice. Kluwer/Plenum: New York.
57. Midgley G and Floyd M (1988). Microjob: A Computer Training Service for People with Disabilities. Rehabilitation Resource Centre: London.
58. Midgley G and Floyd M (1990). Vocational training in the use of new technologies for people with disabilities. Behav Inform Technol 9: 409-424.
59. Midgley G, Munlo I and Brown M (1998). The theory and practice of boundary critique: developing housing services for older people. J Opl Res Soc 49: 467-478.
60. Midgley G and Ochoa-Arias AE (2004). An introduction to community operational research. In: Midgley G and Ochoa-Arias AE (eds). Community Operational Research: OR and Systems Thinking for Community Development. Kluwer/Plenum: New York.
61. Mingers JC (1992). What are real friends for? A reply to Mike Jackson. J Opl Res Soc 43: 732-735.
62. Mingers JC (1997). Towards critical pluralism. In: Mingers J and Gill A (eds). Multimethodology: The Theory and Practice of Combining Management Science Methodologies. Wiley: Chichester.
63. Ochoa-Arias AE (2004). An interpretive systemic exploration of community action in Venezuela. In: Midgley G and Ochoa-Arias AE (eds). Community Operational Research: OR and Systems Thinking for Community Development. Kluwer/Plenum: New York.
64. Ormerod RJ (1999). Viewpoint - ethical dilemmas. J Opl Res Soc 50: 546-548.
65. Owen H (1997). Open Space Technology: A User's Guide, 2nd edn. Berrett-Koehler: San Francisco.
66. Pratt J, Gordon P and Plamping D (1999). Working Whole Systems. King's Fund: London.
67. Prigogine I and Stengers I (1984). Order out of Chaos: Man's New Dialogue with Nature. Fontana: London.
68. Probyn E (1990). Travels in the postmodern: making sense of the local. In: Nicholson LJ (ed). Feminism/Postmodernism. Routledge: London.
69. Puchta C and Potter J (2004). Focus Group Practice. Cassell: London.
70. Ritchie C, Taket A and Bryant J (eds) (1994). Community Works: 26 Case Studies showing Community Operational Research in Action. Pavic Press: Sheffield.
71. Rosenau PM (1992). Post-Modernism and the Social Sciences: Insights, Inroads, and Intrusions. Princeton University Press: Princeton, NJ.
72. Rosenhead J, (ed) (1989). Rational Analysis for a Problematic World: Problem Structuring Methods for Complexity, Uncertainty and Conflict. Wiley: Chichester.
73. Rosenhead J and Mingers J. (eds) (2001). Rational Analysis for a Problematic World Revisited: Problem Structuring Methods for Complexity, Uncertainty and Conflict. Wiley: Chichester.
74. Schecter D (1991). Critical systems thinking in the 1980s: a connective summary. In: Flood RL and Jackson MC (eds). Critical Systems Thinking: Directed. Readings. Wiley: Chichester.
75. Shaddish WR, Cook TD and Leviton LC (1991). Foundations of Program Evaluation: Theories of Practice. Sage: London.
76. Spaul MWJ (1997). Multimethodology and critical theory: an intersection of interests? In: Mingers J and Gill A (eds). Multimethodology: The Theory and Practice of Combining Management Science Methodologies. John Wiley: Chichester.
77. Stacey RD, Griffin D and Shaw P (2000). Complexity and Management: Fad or Radical Challenge to Systems Thinking? Routledge: London.
78. Stake RE (1980). Program evaluation, particularly responsive evaluation. In: Dockrell WB and Hamilton D (eds). Rethinking Educational Research. Hodder and Stoughton: London, pp 72-87.
79. Stewart DW and Shamdasani PN (1990). Focus Groups: Theory and Practice. Sage: Thousand Oaks, CA.
80. Sudman S and Bradburn NM (1982). Asking Questions: A Practical Guide to Questionnaire Design. Jossey Bass: San Francisco.
81. Taket A and White L (1993). After OR: an agenda for postmodernism and poststructuralism in OR. J Opl Res Soc 44: 867-881.
82. Taket A and White L (1994). The death of the expert. J Opl Res Soc 45: 733-748.
83. Taket A and White L (1996). Pragmatic pluralism-an explication. Systems Pract 9(6): 571-586.
84. Taket A and White L (1997). Working with heterogeneity: a pluralist strategy for evaluation. Systems Res Behav Sci 14(2): 101-111.
85. Taket A and White L (2000). Partnership and Participation: Decision-Making in the Multiagency Setting. Wiley: Chichester.
86. Taket A and White L (2004). Playing with PANDA: The CybOrg and the rhizome. In: Midgley G and Ochoa-Arias AE (eds). Community Operational Research: OR and Systems Thinking for Community Development. Kluwer/Plenum: New York.
87. Ulrich W (1983). Critical Heuristics of Social Planning: A New Approach to Practical Philosophy. Haupt: Bern.
88. Ulrich W (1993). Some difficulties of ecological thinking considered from a critical systems perspective: a plea for critical holism. Systems Pract 6: 583-611.
89. Weil S (1998). Rhetorics and realities in public service organizations: systemic practice and organizational learning as critically reflexive action research (CRAR). Systemic Pract Action Res 11: 37-62.
90. Whittaker A, Gardner S and Kershaw J (1991). Service Evaluation by People with Learning Difficulties. Kings Fund: London.
91. Wolstenholme EF (1990). System Enquiry: A System Dynamics Approach. Wiley: Chichester.
92. Wright DS, Taylor A, Davies DR, Sluckin W, Lee SGM and Reason JT (1970). Introducing Psychology: An Experimental Approach. Penguin: Harmondsworth.
93. Yuchtman E and Seashore SE (1967). A system resource approach to organizational effectiveness. Am Soc Rev 32: 891-903.
94. Zhu J (2002). Quantitative Models for Performance Evaluation and Benchmarking: Data Envelopment Analysis with Spreadsheets and DEA Excel Solver. Kluwer: Boston.