Evaluating problem-structuring methods: Developing an approach to show the value and effectiveness of PSMs

Journal of the Operational Research Society

Volumn 57, Issue 7, 2006, Pages 842-855

  White, L ^a  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

Author keywords

Evaluation; Problem structuring methods; Soft OR

Indexed keywords

EVALUATION; MULTI AGENT SYSTEMS; OPERATIONS RESEARCH; PROBLEM SOLVING;

MULTI-AGENCY SETTINGS; PROBLEM-STRUCTURING METHODS (PSM); SOFT OR; THEORY-BASED EXERCISE;

STRUCTURAL ANALYSIS;

EID: 33745546932     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/palgrave.jors.2602149     Document Type: Review

References (59)

1. Ackermann F (1996). Participants' perceptions on the role of facilitators using group decision support systems. Group Decision Negotiation 5: 93-112.
2. Anson R, Bostrom R and Wynne B (1995). An experiment assessing GSS and facilitator effects on meeting outcomes. Mngt Sci 41: 189-208.
3. Berger P and Luckmann T (1966). The Social Construction of Reality. Penguin: London.
4. Bryant J and Darwin J (2004). Exploring inter-organisational relationships in the health service: an immersive drama approach. Eur J Opl Res 152: 655-666.
5. Chambers R (1997). Whose Reality Counts? Putting the First Last. Intermediate Technology Publications: London.
6. Checkland P (1981). Systems Thinking, Systems Practice. Wiley: Chichester.
7. Chen HT (1990). Theory-Driven Evaluation. Sage Publications: London.
8. Connell N (2001). Evaluating soft OR: Some reflections on an apparently unsuccessful implementation using a soft systems methodology (SSM) based approach. J Opl Res Soc 52:150-160.
9. Cornwall A and Jewkes K (1995). What is participatory research? Soc Sci Med 41: 1666-1676.
10. Delbecq AL, Ven den Ven AH and Gustafson AH (1975). Group Techniques for Program Planning. Scott Foresman: Glenview, IL.
11. DeSanctis G and Gallupe R (1987). A foundation for the study of group decision support systems. Mngt Sci 33: 589-609.
12. Denzin N and Lincoln Y (2005). Handbook of Qualitative Research. Sage Publications: Thousand Oaks, CA.
13. De Vreede G and Dickson G (2000). Using GSS to design organizational processes and information systems: an action research study on collaborative business engineering. Group Decision Negotiation 9: 161-183.
14. De Vreede G, Niederman F and Paarlberg I (2002). Towards an instrument to measure participants' perceptions on facilitation in group support systems meetings. Group Decision Negotiation 11: 127-144.
15. Eden C (1992). A framework for thinking about group decision support systems (GDSS). Group Decision Negotiation 1: 199-218.
16. Eden C (1995). On evaluating the performance of 'wide-band' GDSS. Ear J Opl Res 81: 302-311.
17. Eden C and Ackermann F (1996). "Horses for courses": a stakeholder approach to the evaluation of GDSSs. Group Decision Negotiation 5: 501-519.
18. Finlay PN (1998). On evaluating the performance of GDSS: furthering the debate. Eur J Opl Res 107: 193-201.
19. Fjermestad J and Hiltz S (1998). An assessment of group support systems experimental research: methodology and results. J Mngt Inform Sys 15(3): 7-149.
20. Franco LA, Cushman M and Rosenhead J (2004). Project review and learning in the construction industry: embedding PSM within a partnership context. Eur J Opl Res 102: 568-601.
21. Friend J and Hickling A (1997). Planning Under Pressure: The Strategic Choice Approach, 2nd edn. Butterworth-Heinemann: Oxford.
22. Glaser B (1993). Basics of Grounded Theory. Sociology Press: Mill Valley, CA.
23. Guba E and Lincoln Y (1989). Fourth Generation Evaluation. Sage: London.
24. Heron J (1999). The Complete Facilitators Handbook. Kogan Page: London.
25. Hjortsø C (2004). Enhancing public participation in natural resource management using Soft OR - an application of strategic option development and analysis in tactical forest planning. Eur J Opl Res 152: 667-683.
26. Huxham C (ed) (1990). Creating Collaborative Advantage. Sage: London.
27. Joldersma C and Roelofs E (2004). The impact of soft OR methods on problem structuring. Eur J Opl Res 102: 696-708.
28. Keys P (1998). OR as technology revisited. J Opl Res Soc 49: 99-108.
29. Latour B (1993). We have Never been Modern. Harvard University: Cambridge, MA.
30. Latour B and Gallon M (1981). Unscrewing the big Leviathan: how actors macrostructure reality and how sociologists help them do it. In: Knorr-Cetina K and Cicourel AV (eds). Advances in Social Theory and Methodology: Toward an Integration of Micro- and Macro-Sociologies. Routledge, Boston, MA, pp 277-303.
31. McCartt A and Rohrbaugh J (1989). Evaluating group decision support system effectiveness: a performance study of decision conferencing. Decision Support Syst 5: 243-253.
32. McKay J (1998). Using cognitive mapping to achieve shared understanding in information requirements determination. Austr Comput J 30: 139-145.
33. Mingers J (2000). Variety is the spice of life: combining soft and hard OR/MS methods. Int Trans Opl Res 7: 673-691.
34. Mingers J and Gill A (1997). Multimethodology. Wiley: Chichester.
35. Mingers J and Taylor S (1990). The use of Soft Systems Methodology in practice. J Opl Res Soc 43: 321-332.
36. Mingers J and Rosenhead J (2004). Problem structuring methods in action. Eur J Opl Res 152: 530-554.
37. Muhr T (1997). Atlas/ti: Short User Manual. Scientific Software Development: Berlin.
38. Pawson R (2002). Evidence-based policy: the promise of 'realist synthesis'. Evaluation 8: 340-358.
39. Pawson R and Tilley N (1997). Realistic Evaluation. Sage: London.
40. Phahlamohlaka J and Friend J (2004). Community planning for rural education in South Africa. Eur J Opl Res 152: 684-695.
41. Pinsonneault A, Barki H, Gallupe RB and Hoppen M (1999). Electronic brainstorm: the illusion of productivity. Inform Syst Res 10: 110-132.
42. Rorty R (1989). Contingency, Irony and Solidarity. Cambridge University Press: Cambridge.
43. Rosenhead J (1996). What's the problem? An introduction to problem structuring methods. Interfaces 26(6): 117-131.
44. Rosenhead J and Mingers M (2001). Rational Analysis of a Problematic World Revisited. Wiley: Chichester.
45. Scriven M (1998). The least theory that practice requires. Am J Eval 19(1): 57-72.
46. Shaw D (2003). Evaluating electronic workshops through analysing the 'brainstormed' ideas. J Opl Res Soc 54: 692-705.
47. Sørensen L, Vidai R and Engström E (2004). Using soft OR in a small company - the case of Kirby. Eur J Opl Res 152: 555-570.
48. Taket A and White L (1996). Pragmatic pluralism: an explication. Systems Pract 9(6): 571-585.
49. Taket A and White L (1997). Working with heterogeneity. A pluralist strategy for evaluation. Syst Res Behav Sci 14(2): 101-111.
50. Taket A and White L (2000). Partnership and Participation: Decision-making in a Multi-agency Setring. Wiley: Chichester.
51. Thunhurst C and Ritchie C (1992). Housing in the Dearne Valley: doing community OR with the Thurnscoe Tenants Housing Co-operative. II. An evaluation. J Opl Res Soc 43: 677-690.
52. Vidai R (2004). Guest Editor's Introduction. Eur J Opl Res 113: 529.
53. Weiss CH (1998). Evaluation - Methods for Studying Programs and Policies. Prentice Hall: Englewood Cliffs, NJ.
54. White L (1994). Development options for a rural community in Belize - alternative development and operational research. Int Trans Opl Res 1: 453-462.
55. White L (2002). Size matters: large group interventions and the process of operational research. J Opl Res Soc 53: 149-160.
56. White L (2003). Report on the Evaluation of the Sure Start on the Ocean. Sure Start on the Ocean Estate: Tower Hamlets, London.
57. White L (2003a). The role of systems research and operational research in community involvement. Syst Res Behav Sci 20: 133-145.
58. White L and Taket A (1997). Beyond appraisal: Participatory Appraisal of Needs and the Development of Action (PANDA). Omega Int J Mngt Sci 25: 523-535.
59. Yin R (1984). Case Study Research: Design and Methods. Sage: Thousand Oaks, CA.