Towards a new framework for evaluating systemic and participative methods

International Society for the Systems Sciences - 51st Annual Meeting of the International Society for the Systems Sciences, ISSS 2007

Volumn , Issue , 2007, Pages 1130-1150

  Midgley, Gerald ^a   Foote, Jeff ^a   Ahuriri Driscoll, Annabel ^a   Wood, David ^a  

^a ESR Christchurch Science Centre   (New Zealand)

Author keywords

Evaluation of methods; Methodology; Participative methods; Systems methods

Indexed keywords

ASSOCIATED TOOL; CONTEXTUAL FACTORS; EVALUATION APPROACH; EVALUATION OF METHODS; INTERNATIONAL RESEARCHES; METHODOLOGY; PARTICIPATIVE METHODS; PILOT STUDIES; PROJECT PARTICIPANTS; QUALITATIVE CRITERIA; STANDARD METRICS;

SURVEYS;

RESEARCH;

EID: 84865784966     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (72)

1. Adams, R., and McCullough, A. (2003). The Urban Practitioner and Participation in Research within a Streetwork Context, Community, Work & Family., 6 (3):269-287.
2. Alberts, D.J. (2007). Stakeholders or Subject Matter Experts, Who should be Consulted? Energy Policy., 35:2336-2346.
3. Allsop, J., and Taket, A. (2003). Evaluating User Involvement in Primary Healthcare, International Journal of Healthcare Technology & Management., 5 (1/2):34-44.
4. Alrøe, H.F. (2000). Science as Systems Learning: Some Reflections on the Cognitive and Communicational Aspects of Science, Cybernetics and Human Knowing., 7:57-78.
5. Baker, V., Gregory, W., Midgley, G., and Veth, J. (2006). Ethical Implications and Social Impacts of Forensic DNA Technologies and Applications: Summary Report., ESR, Christchurch.
6. Baker, V., and Midgley, G. (2007). Review of the MoRST Roadmaps Exercise: Final Report., Confidential ESR Client Report, ESR, Wellington.
7. Bateson, G. (1970). Form, Substance, and Difference, General Semantics Bulletin., 37:5-13.
8. Beierle, T.C., and Cayford, J. (2002). Democracy in Practice: Public Participation in Environmental Decisions., RFF Press, Washington DC.
9. Beierle, T.C., and Konisky, D.M. (2000). Values, Conflict, and Trust in Participatory Environmental Planning, Journal of Policy Analysis and Management., 19 (4):587-602.
10. Berry, H., Bowman, S.R., Hernandez, R., and Pratt, C. (2006). Evaluation Tool for Community Development Coalitions, Journal of Extension., 44 (6): http://www.joe.org/joe/2006december/tt2.shtml (accessed: 30.3.07).
11. Bjärås, G., Haglund, B.J.A., and Rifkin, S.B. (1991). A New Approach to Community Participation Assessment, Health Promotion International., 6 (3):199-206.
12. Branch, K.M., and Bradbury, J.A. (2006). Comparison of DOE and Army Advisory Boards: Application of a Conceptual Framework for Evaluating Public Participation in Environmental Risk Decision Making, Policy Studies Journal., 34 (4):723-753.
13. Buysse, V., Wesley, P., and Skinner, D. (1999). Community Development Approaches for Early Intervention, Topics in Early Childhood Special Education., 19 (4):236-243.
14. Charnley, S., and Engelbert, B. (2005). Evaluating Public Participation in Environmental Decision-Making: EPA's Superfund Community Involvement Program, Journal of Environmental Management., 77:165-182.
15. Checkland, P. (1981). Systems Thinking, Systems Practice., Wiley, Chichester.
16. Checkland, P., and Scholes, J. (1990). Soft Systems Methodology in Action., Wiley, Chichester.
17. Chess, C., and Purcell, K. (1999). Public Participation and the Environment: Do We Know what Works? Environmental Science & Technology., 33 (16):2685-2692.
18. Churchman, C.W. (1970). Operations Research as a Profession. Management Science., 17:B37-53.
19. Clayton, A.M.H., and Radcliffe, N.J. (1996). Sustainability: A Systems Approach., Earthscan, London.
20. Cole, M. (2006). Evaluating the Impact of Community Appraisals: Some Lessons from South-West England, Policy & Politics., 34 (1):51-68.
21. Connell, N.A.D. (2001). Evaluating Soft OR: Some Reflections on an Apparently 'Unsuccessful' Implementation Using a Soft Systems Methodology (SSM) Based Approach, Journal of the Operational Research Society., 52:150-160.
22. Douglas, M. (1986). How Institutions Think., Routledge and Kegan Paul, London.
23. Duignan, P., and Casswell, S. (1989). Evaluating Community Development Programs for Health Promotion: Problems Illustrated by a New Zealand Example, Community Health Studies., 13 (1):74-81.
24. Duram, L.A., and Brown, K.G. (1999). Assessing Public Participation in U.S. Watershed Planning Initiatives, Society & Natural Resources., 12:455-467.
25. Eden, C. (1995). On Evaluating the Performance of 'Wide-Band' GDSS, European Journal of Operational Research., 81:302-311.
26. Entwistle, V., Buchan, H., Coulter, A., and Jadad, A. (1999). Towards Constructive Innovation and Rigorous Evaluation: A New Series on Methods for Promoting and Evaluating Participation, Health Expectations., 2:75-77.
27. Flood, R.L. (1995). Solving Problem Solving., Wiley, Chichester.
28. Flood, R.L., and Jackson, M.C. (eds.) (1991). Critical Systems Thinking: Directed Readings., Wiley, Chichester.
29. Flood, R.L., and Romm, N.R.A. (eds.) (1996). Critical Systems Thinking: Current Research and Practice., Plenum, New York.
30. Forrester, J.W. (1969). Principles of Systems., Wright-Allen Press, Cambridge MA.
31. Franco, A., Shaw, D., and Westcombe, M. (2007). Taking Problem Structuring Methods Forward, Journal of the Operational Research Society., 58 (5):545-546.
32. Halvorsen, K.E. (2001). Assessing Public Participation Techniques for Comfort, Convenience, Satisfaction, and Deliberation, Environmental Management., 28 (2):179-186.
33. Hepi, M., Ahuriri-Driscoll, A., Foote, J., Midgley, G., and Winstanley, A. (2007). Research report currently in preparation., ESR, Christchurch.
34. Ho, C.H. (1997). A Critical Process for the Evaluation of Methodology., Ph.D. thesis, University of Hull.
35. Jackson, M.C. (1991). Systems Methodology for the Management Sciences., Plenum, New York.
36. Jackson, M.C., and Keys, P. (1984). Towards a System of Systems Methodologies, Journal of the Operational Research Society., 35:473-486.
37. Jenkins, N.T., and Bennett, M.I.J. (1999). Toward an Empowerment Zone Evaluation, Economic Development Quarterly., 13 (1):23-28.
38. Kelly, K., and Van Vlaenderen, H. (1995). Evaluating Participation Processes in Community Development, Evaluation & Program Planning., 18 (4):371-383.
39. Li, X., and Zheng, H. (1995). Study on General Systems Methodology, in Systems Methodology: Possibilities for Cross-Cultural Learning and Integration, (G. Midgley, and J. Wilby, eds.), Centre for Systems Studies, Hull.
40. Luhmann, N. (1986). Ecological Communication., University of Chicago Press, Chicago.
41. Margerum, R.D. (2002). Collaborative Planning: Building Consensus and Building a Distinct Model for Practice, Journal of Planning Education & Research., 21:237-253.
42. Masozera, M.K., Alavalapati, J.R.R., Jacobson, S.K., and Shrestha, R.K. (2006). Assessing the Suitability of Community-Based Management for the Nyungwe Forest Reserve, Rwanda, Forest Policy & Economics., 8:206-216.
43. McAllister, K. (1999). Understanding Participation: Monitoring and Evaluating Process, Outputs and Outcomes, Working Paper 2., IDRC, Ottawa.
44. McGurk, B., Sinclair, A.J., and Diduck, A. (2006). An Assessment of Stakeholder Advisory Committees in Forest Management: Case Studies from Manitoba, Canada, Society & Natural Resources., 19:809-826.
45. Midgley, G. (1994). Ecology and the Poverty of Humanism: A Critical Systems Perspective, Systems Research., 11:67-76.
46. Midgley, G. (2000). Systemic Intervention: Philosophy, Methodology, and Practice., Kluwer/Plenum, New York.
47. Midgley, G., Ahuriri-Driscoll, A., Baker, V., Foote, J., Hepi, M., Taimona, H., Rogers-Koroheke, M., Gregor, J., Gregory, W., Lange, M., Veth, J., Winstanley, A. and Wood, D. (2007). Practitioner Identity in Systemic Intervention: Reflections on the Promotion of Environmental Health through Mori Community Development, Systems Research and Behavioral Science., 24:233-247.
48. Midgley, G., Winstanley, A., Gregory, W., and Foote, J. (2005). Scoping the Potential Uses of Systems Thinking in Developing Policy on Illicit Drugs., Drug Policy Modelling Project Research Memorandum #13, Turning Point, Melbourne.
49. Mingers, J.C. (1997). Towards Critical Pluralism, in Multimethodology: The Theory and Practice of Combining Management Science Methodologies, (J. Mingers and A. Gill, eds.), Wiley, Chichester.
50. Mingers, J., and Gill, A. (eds.) (1997). Multimethodology: The Theory and Practice of Combining Management Science Methodologies., Wiley, Chichester.
51. Mingers, J., and Rosenhead, J. (2004). Problem Structuring Methods in Action, European Journal of Operational Research., 152:530-554.
52. Morgan, L.M. (2001). Community Participation in Health: Perpetual Allure, Persistent Challenge, Health Policy & Planning., 16 (3):221-230.
53. Murphy-Berman, V., Schnoes, C., and Chambers, J.M. (2000). An Early Stage Evaluation Model for Assessing the Effectiveness of Comprehensive Community Initiatives: Three Case Studies in Nebraska, Evaluation & Program Planning., 23:157-163.
54. Ong, B.N. (2000). Assessing the Context for Partnerships between Communities and the National Health Service in England, Critical Public Health., 10 (3):343-351.
55. Romm, N.R.A. (1996). Inquiry-and-Intervention in Systems Planning: Probing Methodological Rationalities, World Futures., 47:25-36.
56. Rowe, G., and Frewer, L.J. (2000). Public Participation Methods: A Framework for Evaluation, Science, Technology & Human Values., 25 (1):3-29.
57. Rowe, G., and Frewer, L.J. (2004). Evaluating Public Participation Exercises: A Research Agenda, Science, Technology & Human Values., 29 (4):512-556.
58. Rowe, G., Horlick-Jones, T., Walls, J., and Pidgeon, N. (2005). Difficulties in Evaluating Public Engagement Initiatives: Reflections on an Evaluation of the UK GM Nation? Public Debate about Transgenic Crops, Public Understanding of Science., 14:331-352.
59. Rowe, G., Marsh, R., and Frewer, L.J. (2004). Evaluation of a Deliberative Conference, Science, Technology & Human Values., 29 (1):88-121.
60. Shaw, D., Franco, A., and Westcombe, M. (2006). Problem Structuring Methods: New Directions in a Problematic World, Journal of the Operational Research Society., 57 (7):757-758.
61. Shaw, I. (1999). Qualitative Evaluation., Sage, London.
62. Shen, C-Y., and Midgley, G. (2007). Toward a Buddhist Systems Methodology 1: Comparisons between Buddhism and Systems Theory. Systemic Practice and Action Research., 20 (3):167-194.
63. Sieber, R. (2006). Public Participation Geographic Information Systems: A Literature Review and Framework, Annals of the Association of American Geographers., 96 (3):491-507.
64. Smith, L.T. (ed.) (1999). Decolonizing Methodologies: Research and Indigenous Peoples, Zed Books, London.
65. Sykes, C., and Goodwin, W. (2007). Assessing Patient, Carer and Public Involvement in Health Care, Quality in Primary Care., 15:45-52.
66. Tuler, S., Webler, T., and Finson, R. (2005). Competing Perspectives on Public Involvement: Planning for Risk Characterization and Risk Communication about Radiological Contamination from a National Laboratory, Health, Risk & Society., 7 (3):247-266.
67. Ulrich, W. (1983). Critical Heuristics of Social Planning: A New Approach to Practical Philosophy., Haupt, Berne.
68. Warburton, D., Wilson, R., and Rainbow, E. (2007). Making a Difference: A Guide to Evaluating Public Participation in Central Government., Involve, London, http://www.involve.org.uk/evaluation (accessed: 30.5.07).
69. White, L. (2006). Evaluating Problem-Structuring Methods: Developing an Approach to Show the Value and Effectiveness of PSMs, Journal of the Operational Research Society., 57:842-855.
70. Winstanley, A., Baker, V., Foote, J., Gregor, J., Gregory, W., Hepi, M., and Midgley, G. (2005). Water in the Waimea Basin: Community Values and Water Management Options., ESR, Christchurch.
71. Yearley, S. (2006). Bridging the Science-Policy Divide in Urban Air-Quality Management: Evaluating Ways to Make Models More Robust through Public Engagement, Environment and Planning C., 24:701-714.
72. Zhu, Z. (2000). Dealing with a Differentiated Whole: The Philosophy of the WSR Approach. Systemic Practice and Action Research., 13 (1): 21-57.