Structuring problems for Multi-Criteria Decision Analysis in practice: A literature review of method combinations

European Journal of Operational Research

Volumn 263, Issue 1, 2017, Pages 1-17

  Marttunen, Mika ^a   Lienert, Judit ^a   Belton, Valerie ^b  

^a SWISS FEDERAL INSTITUTE OF AQUATIC SCIENCE AND TECHNOLOGY   (Switzerland)

^b UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

Multi methodology; Multi stakeholder decision making; Multiple Criteria Decision Analysis; Problem structuring

Indexed keywords

DECISION THEORY; HIERARCHICAL SYSTEMS; OPERATIONS RESEARCH;

DECISION MAKING PROCESS; GENERAL METHODOLOGIES; MULTI CRITERIA ANALYSIS; MULTI-CRITERIA DECISION ANALYSIS; MULTI-METHODOLOGY; MULTI-STAKEHOLDER; MULTIPLE CRITERIA DECISION ANALYSIS; PROBLEM STRUCTURING;

DECISION MAKING;

EID: 85019575469     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2017.04.041     Document Type: Review

References (182)

1. Ackermann, F., Eden, C., Strategic options development and analysis. 2010, Springer, London.
2. Adrianto, L., Matsuda, Y., Sakuma, Y., Assessing local sustainability of fisheries system: a multi-criteria participatory approach with the case of Yoron Island, Kagoshima prefecture, Japan. Marine Policy 29 (2005), 9–23, 10.1016/j.marpol.2004.01.004.
3. Akbulak, C., Cengiz, T., Determining ecotourism strategies using A'WOT hybrid method: case study of Troia Historical National Park, Çanakkale, Turkey. International Journal of Sustainable Development & World Ecology 21 (2014), 380–388, 10.1080/13504509.2014.903383.
4. Azarnivand, A., Chitsaz, N., Adaptive policy responses to water shortage mitigation in the arid regions—a systematic approach based on eDPSIR, DEMATEL, and MCDA. Environmental Monitoring and Assessment, 187, 2015, 10.1007/s10661-014-4225-4.
5. Bana e Costa, C.A., Ensslin, L., Correa, E.C., Vansnick, J.C., Decision Support Systems in action: integrated application in a multicriteria decision aid process. European Journal of Operational Research 113 (1999), 315–335, 10.1016/S0377-2217(98)00219-7.
6. Bana e Costa, C.A., Fernandes, T.G., Correia, P.V.D., Prioritisation of public investments in social infra-structures using multicriteria value analysis and decision conferencing: a case-study. International Transactions in Operational Research 13 (2006), 279–297.
7. Bana e Costa, C.A., Lourenco, J.C., Oliveira, M.D., Bana e Costa, J.C., A socio-technical approach for group decision support in public strategic planning: the Pernambuco PPA case. Group Decision and Negotiation 23 (2014), 5–29, 10.1007/s10726-012-9326-2.
8. Bana e Costa, C.A., Vansnick, J.C., The Macbeth approach: basic ideas, software, and an application. Advances in Decision Analysis 4 (1999), 131–157.
9. Banville, C., Landry, M., Martel, J.M., Boulaire, C., A stakeholder approach to MCDA. Systems Research and Behavioral Science 15 (1998), 15–32, 10.1002/(SICI)1099-1743(199801/02)15:1<15::AID-SRES179>3.0.CO;2-B.
10. Baykasoğlu, A., Gölcuk, I., Development of a novel multiple-attribute decision making model via fuzzy cognitive maps and hierarchical fuzzy TOPSIS. Information Sciences 301 (2015), 75–98, 10.1016/j.ins.2014.12.048.
11. Behzadian, M., Kazemzadeh, R.B., Albadvi, A., Aghdasi, M., PROMETHEE: a comprehensive literature review on methodologies and applications. European Journal of Operational Research 200 (2010), 198–215, 10.1016/j.ejor.2009.01.021.
12. Behzadian, M., Khanmohammadi Otaghsara, S., Yazdani, M., Ignatius, J., A state-of the-art survey of TOPSIS applications. Expert Systems with Applications 39 (2012), 13051–13069, 10.1016/j.eswa.2012.05.056.
13. Belton, V., Ackermann, F., Shepherd, I.A.N., Integrated support from problem structuring through to alternative evaluation using COPE and V•I•S•A. Journal of Multi-Criteria Decision Analysis 6 (1997), 115–130, 10.1002/(SICI)1099-1360(199705)6:3<115::AID-MCDA140>3.0.CO;2-I.
14. Belton, V., Stewart, T.J., Multiple criteria decision analysis - An integrated approach. 2002, Kluwer, Boston.
15. Belton, V., Stewart, T.J., Problem structuring and multiple criteria decision analysis. Ehrgott, M., Figueira, J.R., Greco, S., (eds.) Trends in multiple criteria decision analysis, 2010, Springer.
16. Benini, L., Bandini, V., Marazza, D., Contin, A., Assessment of land use changes through an indicator-based approach: a case study from the Lamone river basin in Northern Italy. Ecological Indicators 10 (2010), 4–14, 10.1016/j.ecolind.2009.03.016.
17. Bhave, A.G., Mishra, A., Raghuwanshi, N.S., A combined bottom-up and top-down approach for assessment of climate change adaptation options. Journal of Hydrology 518 (2014), 150–161, 10.1016/j.jhydrol.2013.08.039.
18. Bizikova, L., Krcmar, E., Integrated scenario planning and multi-criteria decision analysis framework with application to forest planning. Open Journal of Forestry 05 (2015), 139–153, 10.4236/ojf.2015.52014.
19. Borzoni, M., Rizzi, F., Frey, M., Geothermal power in Italy: a social multi-criteria evaluation. Renewable Energy 69 (2014), 60–73, 10.1016/j.renene.2014.03.026.
20. Bottero, M., A multi-methodological approach for assessing sustainability of urban projects. Management of Environmental Quality: An International Journal 26 (2015), 138–154, 10.1108/meq-06-2014-0088.
21. Bottero, M., Ferretti, V., An analytic network process-based approach for location problems the case of a new waste incinerator plant in the Province of Torino (Italy). Journal of Multi-Criteria Decision Analysis 17 (2010), 63–84, 10.1002/mcda.456.
22. Brans, J.P., Vincke, P., Mareschal, B., How to select and how to rank projects - The PROMETHEE method. European Journal of Operational Research 24 (1986), 228–238, 10.1016/0377-2217(86)90044-5.
23. Catron, J., Stainback, G.A., Dwivedi, P., Lhotka, J.M., Bioenergy development in Kentucky: a SWOT-ANP analysis. Forest Policy and Economics 28 (2013), 38–43, 10.1016/j.forpol.2012.12.003.
24. Cerreta, M., Panaro, S., Cannatella, D., Multidimensional spatial decision-making process: local shared values in action. Computational Science and Its Applications - Iccsa 2012, Pt Ii 7334 (2012), 54–70.
25. Checkland, P., Scholes, J., Soft systems methodology in action. 1990, John Wiley, New York.
26. Chung, E.S., Lee, K.S., Prioritization of water management for sustainability using hydrologic simulation model and multicriteria decision making techniques. Journal of Environmental Management 90 (2009), 1502–1511, 10.1016/j.jenvman.2008.10.008.
27. Coelho, D., Antunes, C.H., Martins, A.G., Using SSM for structuring decision support in urban energy planning. Technological and Economic Development of Economy 16 (2010), 641–653, 10.3846/tede.2010.39.
28. Comes, T., Hiete, M., Schultmann, F., An approach to multi-criteria decision problems under severe uncertainty. Journal of Multi-Criteria Decision Analysis 48 (2013), 29–48, 10.1002/mcda.1487.
29. Cooper, P., Socio-ecological accounting: DPSWR, a modified DPSIR framework, and its application to marine ecosystems. Ecological Economics 94 (2013), 106–115, 10.1016/j.ecolecon.2013.07.010.
30. Cuozzo, V., Integrated assessment for a sustainable valorization project. Italian Journal of Regional Science 13 (2014), 71–92.
31. Duchelle, A.E., Guariguata, M.R., Less, G., Albornoz, M.A., Chavez, A., Melo, T., Evaluating the opportunities and limitations to multiple use of Brazil nuts and timber in Western Amazonia. Forest Ecology and Management 268 (2012), 39–48, 10.1016/j.foreco.2011.05.023.
32. Durbach, I., Stewart, T.J., Integrating scenario planning and goal programming. Journal of Multi-Criteria Decision Analysis 12 (2003), 261–271, 10.1002/mcda.362.
33. Dyson, R.G., Strategic development and SWOT analysis at the University of Warwick. European Journal of Operational Research 152 (2004), 631–640, 10.1016/S0377-2217(03)00062-6.
34. Eden, C., On the nature of cognitive maps. Journal of Management Studies 29 (1992), 261–265.
35. Eden, C., Ackermann, F., Detecting emergent strategizing: working with strategy making teams – the oval mapping technique making strategy. The Journey of Strategic Management, 1998, Sage Publications.
36. EEA. Europe's environment: The Dobris assessment. 1995, European Environmental Agency, Copenhagen.
37. Eisenführ, F., Weber, M., Langer, T., Rational decision making. 2010, Springer, Berlin.
38. Ekmekçioglu, M., Can Kutlu, A., Kahraman, C., A fuzzy multi-criteria SWOT analysis: an application to nuclear power plant site selection. International Journal of Computational Intelligence Systems 4 (2011), 583–595, 10.1080/18756891.2011.9727814.
39. Ensslin, L., Dutra, A., Ensslin, S.R., MCDA: a constructivist approach to the management of human resources at a governmental agency. International Transactions in Operational Research 7 (2000), 79–100, 10.1111/j.1475-3995.2000.tb00186.x.
40. Fassio, A., Giupponi, C., Hiederer, R., Simota, C., A decision support tool for simulating the effects of alternative policies affecting water resources: an application at the European scale. Journal of Hydrology 304 (2005), 462–476, 10.1016/j.jhydrol.2004.07.048.
41. Ferreira, F.A.F., Santos, S.P., Rodrigues, P.M.M., Adding value to bank branch performance evaluation using cognitive maps and MCDA: a case study. Journal of the Operational Research Society 62 (2011), 1320–1333, 10.1057/jors.2010.111.
42. Ferreira, F.A.F., Spahr, R.W., Santos, S.P., Rodrigues, P.M.M., A multiple criteria framework to evaluate bank branch potential attractiveness. International Journal of Strategic Property Management 16 (2012), 254–276, 10.3846/1648715x.2012.707629.
43. Franco, L.A., Lord, E., Understanding multi-methodology: evaluating the perceived impact of mixing methods for group budgetary decisions. Omega 39 (2011), 362–372, 10.1016/j.omega.2010.06.008.
44. Franco, L.A., Montibeller, G., Facilitated modelling in operational research. European Journal of Operational Research 205 (2010), 489–500, 10.1016/j.ejor.2009.09.030.
45. Franco, L.A., Montibeller, G., Problem structuring for multicriteria decision analysis interventions. 2011, John Wiley & Sons, Inc, Oxford.
46. French, S., Maule, J., Papamichail, N., Decision behaviour, analysis and support. 2009, Cambridge University Press, New York, NY.
47. French, S., Simpson, L., Atherton, E., Belton, V., Dawes, R., Edwards, W., et al. Problem formulation for multi-criteria decision analysis: report of a workshop. Journal of Multi-Criteria Decision Analysis 7 (1998), 242–262.
48. Gamboa, G., Social multi-criteria evaluation of different development scenarios of the Aysén region. Ecological Economics 59 (2006), 157–170, 10.1016/j.ecolecon.2005.10.014.
49. Gari, S.R., Newton, A., Icely, J.D., A review of the application and evolution of the DPSIR framework with an emphasis on coastal social-ecological systems. Ocean & Coastal Management 103 (2015), 63–77, 10.1016/j.ocecoaman.2014.11.013.
50. Garmendia, E., Gamboa, G., Franco, J., Garmendia, J.M., Liria, P., Olazabal, M., Social multi-criteria evaluation as a decision support tool for integrated coastal zone management. Ocean & Coastal Management 53 (2010), 385–403, 10.1016/j.ocecoaman.2010.05.001.
51. Geneletti, D., Combining stakeholder analysis and spatial multicriteria evaluation to select and rank inert landfill sites. Waste Management 30 (2010), 328–337, 10.1016/j.wasman.2009.09.039.
52. Ghazinoory, S., Zadeh, A.E., Memariani, A., Fuzzy SWOT analysis. Journal of Intelligent & Fuzzy Systems 18 (2007), 99–108.
53. Giupponi, C., Mysiak, J., Fassio, A., Cogan, V., MULINO-DSS: a computer tool for sustainable use of water resources at the catchment scale. Mathematics and Computers in Simulation 64 (2004), 13–24, 10.1016/j.matcom.2003.07.003.
54. Goodwin, P., Wright, G., Enhancing strategy evaluation in scenario planning: a role for decision analysis. Journal of Management Studies 38 (2001), 1–16, 10.1111/1467-6486.00225.
55. Goodwin, P., Wright, G., Decision analysis for management judgment. 2004, J. Wiley, Chichester.
56. Gregory, R., Failing, L., Harstone, M., Long, G., McDaniels, T., Ohlson, D., Structured decision making: A practical guide to environmental management choices. 2012, Wiley-Blackwell, Chichester.
57. Griffiths, A., Wall, S., Economics for business and management. A student text. 2004, Pearson Books.
58. Grimble, R., Wellard, K., Stakeholder methodologies in natural resource management: a review of principles, contexts, experiences and opportunities. Agricultural Systems 55 (1997), 173–193, 10.1016/S0308-521x(97)00006-1.
59. Hermans, L.M., Thissen, W.A.H., Actor analysis methods and their use for public policy analysts. European Journal of Operational Research 196 (2009), 808–818, 10.1016/j.ejor.2008.03.040.
60. Ho, W., Integrated analytic hierarchy process and its applications – A literature review. European Journal of Operational Research 186 (2008), 211–228, 10.1016/j.ejor.2007.01.004.
61. Hodgkinson, G.P., Bown, N.J., Maule, A.J., Glaister, K.W., Pearman, A.D., Breaking the frame: an analysis of strategic cognition and decision making under uncertainty. Strategic Management Journal 20 (1999), 977–985, 10.1002/(Sici)1097-0266(199910)20:10<977::Aid-Smj58>3.0.Co;2-X.
62. Hodgkinson, G.P., Maule, A.J., Bown, N.J., Pearman, A.D., Glaister, K.W., Further reflections on the elimination of framing bias in strategic decision making. Strategic Management Journal 23 (2002), 1069–1076, 10.1002/smj.266.
63. Howick, S., Ackermann, F., Mixing OR methods in practice: past, present and future directions. European Journal of Operational Research 215 (2011), 503–511, 10.1016/j.ejor.2011.03.013.
64. Huang, I.B., Keisler, J., Linkov, I., Multi-criteria decision analysis in environmental sciences: ten years of applications and trends. The Science of the Total Environment 409 (2011), 3578–3594, 10.1016/j.scitotenv.2011.06.022.
65. Huang, H.F., Kuo, J., Lo, S.L., Review of PSR framework and development of a DPSIR model to assess greenhouse effect in Taiwan. Environmental Monitoring and Assessment 177 (2011), 623–635, 10.1007/s10661-010-1661-7.
66. Hwang, C.L., Yoon, K., Multiple attribute decision making: Methods and applications: A state-of-the-art survey. 1981, Springer-Verlag, BerlinNew York.
67. International Association of Public Participation. (2017). Spectrum of public participation. http://c.ymcdn.com/sites/www.iap2.org/resource/resmgr/foundations_course/IAP2_P2_Spectrum_FINAL.pdf. [Accessed 1.5.2017].
68. Johnston, R., Cools, J., Liersch, S., Morardet, S., Murgue, C., Mahieu, M., Zsuffa, I., Uyttendaele, G.P., WETwin: a structured approach to evaluating wetland management options in data-poor contexts. Environmental Science & Policy 34 (2013), 3–17, 10.1016/j.envsci.2012.12.006.
69. Kabir, G., Sadiq, R., Tesfamariam, S., A review of multi-criteria decision-making methods for infrastructure management. Structure and Infrastructure Engineering 10 (2014), 1176–1210, 10.1080/15732479.2013.795978.
70. Kahraman, C., Demirel, N.C., Demirel, T., Prioritization of e-government strategies using a SWOT-AHP analysis: the case of Turkey. European Journal of Information Systems 16 (2007), 284–298, 10.1057/palgrave.ejis.3000679.
71. Kajanus, M., Kangas, J., Kurttila, M., The use of value focused thinking and the A'WOT hybrid method in tourism management. Tourism Management 25 (2004), 499–506, 10.1016/s0261-5177(03)00120-1.
72. Kajanus, M., Leskinen, P., Kurttila, M., Kangas, J., Making use of MCDS methods in SWOT analysis—Lessons learnt in strategic natural resources management. Forest Policy and Economics 20 (2012), 1–9, 10.1016/j.forpol.2012.03.005.
73. Kangas, J., Kangas, A., Leskinen, P., Pykäläinen, J., MCDM methods in strategic planning of forestry on state-owned lands in Finland: applications and experiences. Journal of Multi-Criteria Decision Analysis 10 (2001), 257–271.
74. Kaplan, R.S., Norton, D.P., The balanced scorecard - measures that drive performance. Harvard Business Review 70 (1992), 71–79.
75. Karvetski, C.W., Lambert, J.H., Evaluating deep uncertainties in strategic priority-setting with an application to facility energy investments. Systems Engineering 15 (2012), 483–493, 10.1002/sys.21215.
76. Karvetski, C.W., Lambert, J.H., Keisler, J.M., Linkov, I., Integration of decision analysis and scenario planning for coastal engineering and climate change. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 41 (2011), 63–73.
77. KarvetskI, C.W., Lambert, J.H., Linkov, I., Scenario and multiple criteria decision analysis for energy and environmental security of military and industrial installations. Integrated Environmental Assessment and Management 7 (2011), 228–236, 10.1002/ieam.137.
78. Keeney, R., Developing objectives and attributes. Edwards, W., Miles, R., F., Von winterfeldt, D., (eds.) Advances in decision analysis, 2007, Cambridge University Press, New York.
79. Keeney, R.L., Building models of values. European Journal of Operational Research 37 (1988), 149–157, 10.1016/0377-2217(88)90324-4.
80. Keeney, R.L., Value-focused thinking a path to creative decisionmaking. 1992, Harvard University Press, Cambridge, Massachusetts [etc.].
81. Keeney, R.L., Raiffa, H., Decisions with multiple objectives preferences and value tradeoffs. 1976, Wiley, New York a.o.
82. Kelble, C.R., Loomis, D.K., Lovelace, S., Nuttle, W.K., Ortner, P.B., Fletcher, P., et al. The EBM-DPSER conceptual model: integrating ecosystem services into the DPSIR framework. Plos One, 8(8), 2013, e70766, 10.1371/journal.pone.0070766.
83. Kenis, P., Schneider, V., Policy networks and policy analysis: scrutinizing a new analytical toolbox. Martin, B., Mayntz, R., (eds.) Policy networks: Empirical evidence and theoretical considerations, 1991, Westview Press, Boulder, CO.
84. Kim, Y., Chung, E.-S., Jun, S.-M., Kim, S.U., Prioritizing the best sites for treated wastewater instream use in an urban watershed using fuzzy TOPSIS. Resources, Conservation and Recycling 73 (2013), 23–32, 10.1016/j.resconrec.2012.12.009.
85. Kotiadis, K., Mingers, J., Combining PSMs with hard OR methods: the philosophical and practical challenges. Journal of the Operational Research Society 57 (2006), 856–867, 10.1057/palgrave.jors.2602147.
86. Kotler, P., Marketing management: Analysis, planning, implementation, and control. 1988, Prentice-Hall International Edition.
87. Kowalski, K., Stagl, S., Madlener, R., Omann, I., Sustainable energy futures: methodological challenges in combining scenarios and participatory multi-criteria analysis. European Journal of Operational Research 197 (2009), 1063–1074, 10.1016/j.ejor.2007.12.049.
88. Kpoumié, A., Damart, S., Tsoukiàs, A., Integrating cognitive mapping analysis into multi-criteria decision aiding. Laboratoire d ’Analyses et Modélisation de Systèmes pour l ’Aide à la Décision. , 2017.
89. Kurttila, M., Pesonen, M., Kangas, J., Kajanus, M., Utilizing the analytic hierarchy process AHP in SWOT. Forest Policy and Economics 1 (2000), 41–52.
90. Lambert, J.H., Karvetski, C.W., Spencer, D.K., Sotirin, B.J., Liberi, D.M., Zaghloul, H.H., et al. Prioritizing infrastructure investments in Afghanistan with multiagency stakeholders and deep uncertainty of emergent conditions. Journal of Infrastructure Systems 18 (2012), 155–166, 10.1061/(asce)is.1943-555x.0000078.
91. Lee, M.-T., Lin, T.-F., Developing an interactive decision support system for sustainable coastal tourism of Cijin. Taiwan international symposium on computer, consumer and control by IEEE computer society, Taichung, 2014.
92. Lennox, J., Proctor, W., Russell, S., Structuring stakeholder participation in New Zealand's water resource governance. Ecological Economics 70 (2011), 1381–1394, 10.1016/j.ecolecon.2011.02.015.
93. Leskinen, L.A., Leskinen, P., Kurttila, M., Kangas, J., Kajanus, M., Adapting modern strategic decision support tools in the participatory strategy process - A case study of a forest research station. Forest Policy and Economics 8 (2006), 267–278, 10.1016/j.forpol.2004.06.007.
94. Lewin, K., Force field analysis. 1951, Harper & Row, New York.
95. Li, X., Zhou, Y., Tian, B., Kuang, R., Wang, L., GIS-based methodology for erosion risk assessment of the muddy coast in the Yangtze Delta. Ocean & Coastal Management 108 (2015), 97–108, 10.1016/j.ocecoaman.2014.09.028.
96. Lienert, J., Schnetzer, F., Ingold, K., Stakeholder analysis combined with social network analysis provides fine-grained insights into water infrastructure planning processes. Journal of Environmental Management 125 (2013), 134–148, 10.1016/j.jenvman.2013.03.052.
97. Lienert, J., Scholten, L., Egger, C., Maurer, M., Structured decision-making for sustainable water infrastructure planning and four future scenarios. EURO Journal on Decision Processes 3 (2015), 107–140, 10.1007/s40070-014-0030-0.
98. Linkov, I., Varghese, A., Jamil, S., Seager, T.P., Kiker, G., Bridges, T., Multi-criteria decision analysis: a framework for structuring remedial decisions at contaminated sites. Comparative Risk Assessment and Environmental Decision Making 38 (2004), 15–54.
99. Longaray, A.A., Ensslin, L., Ensslin, S.R., da Rosa, I.O., Assessment of a Brazilian public hospital's performance for management purposes: a soft operations research case in action. Operations Research for Health Care 5 (2015), 28–48, 10.1016/j.orhc.2015.05.001.
100. Longaray, A.A., Ensslin, L., Mackness, J.R., Multicriteria decision analysis to lead about messes problems: an illustrated case. Independent Journal of Management & Production 5 (2014), 677–692, 10.14807/ijmp.v5i3.143.
101. Macharis, C., de Witte, A., Ampe, J., The multi-actor, multi-criteria analysis methodology (MAMCA) for the evaluation of transport projects: theory and practice. Journal of Advanced Transportation 43 (2009), 183–202, 10.1002/atr.5670430206.
102. Macharis, C., Turcksin, L., Lebeau, K., Multi actor multi criteria analysis (MAMCA) as a tool to support sustainable decisions: state of use. Decision Support Systems 54 (2012), 610–620, 10.1016/j.dss.2012.08.008.
103. Marafon, A.D., Ensslin, L., Lacerda, R.T.D.O., Ensslin, S.R., The effectiveness of multi-criteria decision aid methodology. European Journal of Innovation Management 18 (2015), 86–109, 10.1108/ejim-10-2013-0106.
104. Mardani, A., Jusoh, A., Zavadskas, E.K., Fuzzy multiple criteria decision-making techniques and applications - Two decades review from 1994 to 2014. Expert Systems with Applications 42 (2015), 4126–4148, 10.1016/j.eswa.2015.01.003.
105. Margles, S.W., Masozera, M., Rugyerinyange, L., Kaplin, B.A., Participatory planning: sing SWOT-AHP analysis in buffer zone management planning. Journal of Sustainable Forestry 29 (2010), 613–637, 10.1080/10549811003769483.
106. Marttunen, M., Hämäläinen, R.P., Decision analysis interviews in environmental impact assessment. European Journal of Operational Research 87 (1995), 551–563, 10.1016/0377-2217(95)00229-4.
107. Marttunen, M., Hämäläinen, R.P., The decision analysis interview approach in the collaborative management of a large regulated water course. Environmental Management 42 (2008), 1026–1042, 10.1007/s00267-008-9200-9.
108. Marttunen, M., Mustajoki, J., Dufva, M., Karjalainen, T., How to design and realize participation of stakeholders in MCDA processes? A framework for selecting an appropriate approach. EURO Journal on Decision Processes 3 (2015), 187–214, 10.1007/s40070-013-0016-3.
109. Mendoza, G.A., Prabhu, R., Qualitative multi-criteria approaches to assessing indicators of sustainable forest resource management. Forest Ecology and Management 174 (2003), 329–343, 10.1016/S0378-1127(02)00044-0.
110. Meyar-Naimi, H., Vaez-Zadeh, S., Sustainable development based energy policy making frameworks, a critical review. Energy Policy 43 (2012), 351–361, 10.1016/j.enpol.2012.01.012.
111. Mingers, J., Operational research: the science of better?. Journal of the Operational Research Society 58 (2007), 683–686, 10.1057/palgrave.jors.2602333.
112. Mingers, J., Brocklesby, J., Multimethodology: towards a framework for mixing methodologies. Omega-International Journal of Management Science 25 (1997), 489–509, 10.1016/S0305-0483(97)00018-2.
113. Mingers, J., Rosenhead, J., Problem structuring methods in action. European Journal of Operational Research 152 (2004), 530–554, 10.1016/s0377-2217(03)00056-0.
114. Mitroff, I. I., & Emshoff, J. R. (1979). On strategic assumption-making: a dialectical approach to policy and planning academy of management review, 4, 1–12.
115. Montibeller, G., Belton, V., Ackermann, F., Ensslin, L., Reasoning maps for decision aid: an integrated approach for problem-structuring and multi-criteria evaluation. Journal of the Operational Research Society 59 (2008), 575–589, 10.1057/palgrave.jors.2602347.
116. Montibeller, G., Gummer, H., Tumidei, D., Combining scenario planning and multi-criteria decision analysis in practice. Journal of Multi-Criteria Decision Analysis 14 (2006), 5–20, 10.1002/mcda.403.
117. Morton, A., Fasolo, B., Behavioural decision theory for multi-criteria decision analysis: a guided tour. Journal of the Operational Research Society 60 (2009), 268–275, 10.1057/palgrave.jors.2602550.
118. Munda, G., Social multi-criteria evaluation for a sustainable economy. 2004, Springer, Berlin.
119. Munda, G., Social multi-criteria evaluation: methodological foundations and operational consequences. European Journal of Operational Research 158 (2004), 662–677, 10.1016/s0377-2217(03)00369-2.
120. Munro, I., Mingers, J., The use of multimethodology in practice - Results of a survey of practitioners. Journal of the Operational Research Society 53 (2002), 369–378, 10.1057/palgrave/jors/2601331.
121. Myllyviita, T., Lähtinen, K., Hujala, T., Leskinen, L., Sikanen, L., Leskinen, P., Identifying and rating cultural sustainability indicators: a case study of wood-based bioenergy systems in eastern Finland. Environment, Development and Sustainability 16 (2014), 287–304, 10.1007/s10668-013-9477-6.
122. Neves, L.P., Dias, L.C., Antunes, C.H., Martins, A.G., Structuring an MCDA model using SSM: a case study in energy efficiency. European Journal of Operational Research 199 (2009), 834–845, 10.1016/j.ejor.2009.01.053.
123. Nikodinoska, N., Mattivi, M., Notaro, S., Paletto, A., Stakeholders' appraisal of biomass-based energy development at local scale. Journal of Renewable and Sustainable Energy, 7, 2015, 023117, 10.1063/1.4916654.
124. Nordström, E.-M., Eriksson, L.O., Öhman, K., Integrating multiple criteria decision analysis in participatory forest planning: experience from a case study in Northern Sweden. Forest Policy and Economics 12 (2010), 562–574, 10.1016/j.forpol.2010.07.006.
125. O'Higgins, T., Farmer, A., Daskalov, G., Knudsen, S., Mee, L., Achieving good environmental status in the Black Sea: scale mismatches in environmental management. Ecology and Society, 19, 2014, 54, 10.5751/ES-06707-190354.
126. OECD. Core set of indicators for environmental performance reviews: a synthesis report by the group on the state of the environment. Environment monographs, 1993, Organisation for Economic Co-operation and Development, Paris.
127. Öztürk, S., Determining management strategies for the Sarikum nature protection area. Environmental Monitoring and Assessment, 187, 2015, 113, 10.1007/s10661-015-4302-3.
128. Parnell, G.S., Hughes, D.W., Burk, R.C., Driscoll, P.J., Kucik, P.D., Morales, B.L., et al. Invited review-survey of value-focused thinking: applications, research developments and areas for future research. Journal of Multi-Criteria Decision Analysis 20 (2013), 49–60, 10.1002/mcda.1483.
129. Peterson, G.D., Cumming, G.E., S.R., C., Scenario planning: a tool for conservation in an uncertain world. Conservation Biology 17 (2003), 358–366, 10.1046/j.1523-1739.2003.01491.x.
130. Petersson, E., Giupponi, C., Feas', J., Decision support for strategic water management: mdss in the large dam context. Water International 32 (2007), 265–279 http://dx.doi.org/10.1080/02508060708692206.
131. Petkov, D., Petkova, O., Andrew, T., Nepal, T., Mixing multiple criteria decision making with soft systems thinking techniques for decision support in complex situations. Decision Support Systems 43 (2007), 1615–1629, 10.1016/j.dss.2006.03.006.
132. Phillips, L.D., Phillips, M.C., Facilitated work groups - Theory and practice. Journal of the Operational Research Society 44 (1993), 533–549, 10.1057/jors.1993.96.
133. Proctor, W., Drechsler, M., Deliberative multicriteria evaluation. Environment and Planning C-Government and Policy 24 (2006), 169–190, 10.1068/c22s.
134. Ram, C., Montibeller, G., Exploring the impact of evaluating strategic options in a scenario-based multi-criteria framework. Technological Forecasting and Social Change 80 (2013), 657–672, 10.1016/j.techfore.2012.09.019.
135. Ram, C., Montibeller, G., Morton, A., Extending the use of scenario planning and MCDA for the evaluation of strategic options. Journal of the Operational Research Society 62 (2011), 817–829, 10.1057/jors.2010.90.
136. Reed, M.S., Graves, A., Dandy, N., Posthumus, H., Hubacek, K., Morris, J., et al. Who's in and why? A typology of stakeholder analysis methods for natural resource management. Journal of Environmental Management 90 (2009), 1933–1949, 10.1016/j.jenvman.2009.01.001.
137. Ritchey, T., Problem structuring using computer-aided morphological analysis. Journal of the Operational Research Society 57 (2006), 792–801, 10.1057/palgrave.jors.2602177.
138. Rolando, D., Multicriteria decision problem structuring: the strategic choice approach in the context of public projects in Italy. International Journal of Multicriteria Decision Making 5 (2015), 4–38, 10.1504/IJMCDM.2015.067942.
139. Romero, C., Rehman, T, Natural resource management and the use of multiple criteria decision-making techniques: a review European Review of Agricultural Economics, 14, 1987, 61–89 https://doi.org/10.1093/erae/14.1.61.
140. Rosenhead, J., Past, present and future of problem structuring methods. Journal of the Operational Research Society 57 (2006), 759–765, 10.1057/palgrave.jors.2602206.
141. Rosenhead, J., Rational analysis for a problematic world: Problem structuring methods for complexity, uncertainty and conflict. 1989, John Wiley and Sons Ltd, West Sussex, England.
142. Rosenhead, J., Mingers, J., Rational analysis for a problematic world revisited: Problem structuring methods for complexity, uncertainty and conflict. 2001, John Wiley & Sons. Ltd, Chichester, London.
143. Roy, B., The outranking approach and the foundations of ELECTRE methods. Theory and Decision 31 (1991), 49–73, 10.1007/Bf00134132.
144. Saaty, T.L., The analytic hierarchy process. 1980, McGraw-Hill, New York.
145. Saaty, T.L., Theory and applications of the analytic network process decision making with benefits, opportunities, costs, and risks. 2005, RWS Publications, Pittsburgh, PA.
146. Schaffernicht, M., Causal loop diagrams between structure and behaviour: a critical analysis of the relationship between polarity, behaviour and events. Systems Research and Behavioral Science 27 (2010), 653–666, 10.1002/sres.1018.
147. Schnaars, S.P., How to develop and use scenarios. Long Range Planning 20 (1987), 105–114, 10.1016/0024-6301(87)90038-0.
148. Schoemaker, P.J.H., Scenario planning: a tool for strategic thinking. Sloan Management Review 36 (1995), 25–40.
149. Scholten, L., Schuwirth, N., Reichert, P., Lienert, J., Tackling uncertainty in multi-criteria decision analysis - An application to water supply infrastructure planning. European Journal of Operational Research 242 (2015), 243–260, 10.1016/j.ejor.2014.09.044.
150. Scolozzi, R., Schirpke, U., Morri, E., D'amato, D., Santolini, R., Ecosystem services-based SWOT analysis of protected areas for conservation strategies. Journal of Environmental Management 146 (2014), 543–551, 10.1016/j.jenvman.2014.05.040.
151. Sevkli, M., Oztekin, A., Uysal, O., Torlak, G., Turkyilmaz, A., Delen, D., Development of a fuzzy ANP based SWOT analysis for the airline industry in Turkey. Expert Systems with Applications 39 (2012), 14–24, 10.1016/j.eswa.2011.06.047.
152. Shao, C., Guan, Y., Chu, C., Shi, R., Ju, M., Shi, J., Trends analysis of ecological environment security based on DPSIR model in the coastal zone: a survey study in Tianjin, China. International Journal of Environmental Research 8 (2014), 765–778.
153. Shrestha, R.K., Alavalapati, J.R.R., Kalmbacher, R.S., Exploring the potential for silvopasture adoption in south-central Florida: an application of SWOT-AHP method. Agricultural Systems 81 (2004), 185–199, 10.1016/j.agsy.2003.09.004.
154. Smeets, E., Weterings, R., Environmental indicators: typology and overview. TNO centre for strategy, technology and policy, 1999, European Environment Agency, The Netherlands.
155. Srdjevic, Z., Bajcetic, R., Srdjevic, B., Identifying the criteria set for multicriteria decision making based on SWOT/PESTLE analysis: a case study of reconstructing a water intake structure. Water Resources Management 26 (2012), 3379–3393, 10.1007/s11269-012-0077-2.
156. Steuer, R.E., Na, P., Multiple criteria decision making combined with finance: a categorized bibliographic study. European Journal of Operational Research 150 (2003), 496–515, 10.1016/S0377-2217(02)00774-9.
157. Stewart, T.J., Scenario analysis and multicriteria decision making. Clímaco, J., (eds.) Multicriteria analysis proceedings of the XIth international conference on MCDM, 1997, Springer, CoimbraPortugalBerlin 1-6 August 1994 [etc.].
158. Stewart, T.J., Dealing with uncertainties in MCDA. Figueira, J.R., Greco, S., Ehrgott, M., (eds.) Multiple criteria decision analysis: State of the art surveys, 2005, Springer, New York.
159. Stewart, T.J., French, S., Rios, J., Integrating multicriteria decision analysis and scenario planning—Review and extension. Omega 41 (2013), 679–688, 10.1016/j.omega.2012.09.003.
160. Straton, A.T., Jackson, S., Marinoni, O., Proctor, W., Woodward, E., Exploring and evaluating scenarios for a river catchment in Northern Australia using scenario development, multi-criteria analysis and a deliberative process as a tool for water planning. Water Resources Management 25 (2011), 141–164, 10.1007/s11269-010-9691-z.
161. Suriya, S., Mudgal, B.V., Soft systems methodology and integrated flood management: a study of the Adayar watershed, Chennai, India. Water and Environment Journal 27 (2013), 462–473, 10.1111/j.1747-6593.2012.00365.x.
162. Terrados, J., Almonacid, G., Pérez-Higueras, P., Proposal for a combined methodology for renewable energy planning. Application to a Spanish region. Renewable and Sustainable Energy Reviews 13 (2009), 2022–2030, 10.1016/j.rser.2009.01.025.
163. Tikkanen, J., Isokaanta, T., Pykalainen, J., Leskinen, P., Applying cognitive mapping approach to explore the objective-structure of forest owners in a Northern Finnish case area. Forest Policy and Economics 9 (2006), 139–152, 10.1016/j.forpol.2005.04.001.
164. Trutnevyte, E., Stauffacher, M., Scholz, R.W., Supporting energy initiatives in small communities by linking visions with energy scenarios and multi-criteria assessment. Energy Policy 39 (2011), 7884–7895, 10.1016/j.enpol.2011.09.038.
165. Trutnevyte, E., Stauffacher, M., Scholz, R.W., Linking stakeholder visions with resource allocation scenarios and multi-criteria assessment. European Journal of Operational Research 219 (2012), 762–772, 10.1016/j.ejor.2012.01.009.
166. Tscherning, K., Helming, K., Krippner, B., Sieber, S., & Paloma, S. G. Y. (2012). Does research applying the DPSIR framework support decision making? Land use policy, 29, 102–110. doi: 10.1016/j.landusepol.2011.05.009.
167. Turcksin, L., Macharis, C., Lebeau, K., Boureima, F., Van Mierlo, J., Bram, S., et al. A multi-actor multi-criteria framework to assess the stakeholder support for different biofuel options: the case of Belgium. Energy Policy 39 (2011), 200–214, 10.1016/j.enpol.2010.09.033.
168. Vacik, H., Kurttila, M., Hujala, T., Khadka, C., Haara, A., Pykalainen, J., et al. Evaluating collaborative planning methods supporting programme-based planning in natural resource management. Journal of Environmental Management 144 (2014), 304–315, 10.1016/j.jenvman.2014.05.029.
169. Van der Heijden, K., Scenarios: The art of strategic conversation. 1996, John Wiley & Sons, Chichester.
170. van der Pas, J.W.G.M., Walker, W.E., Marchau, V.A.W.J., Van Wee, G.P., Agusdinata, D.B., Exploratory MCDA for handling deep uncertainties: the case of intelligent speed adaptation implementation. Journal of Multi-Criteria Decision Analysis 17 (2010), 1–23, 10.1002/mcda.450.
171. Ventura, A., Dias, L., Clímaco, J., On facilitating group decision making processes with VIP analysis. Zaraté, P., Kersten, G.E., Hernández, J.E., (eds.) Group decision and negotiation - A process-oriented view, 2014, Springer International Publishing, Switzerland.
172. Wack, P., Scenarios - uncharted waters ahead. Harvard Business Review 63 (1985), 72–89.
173. Wallenius, J., Dyer, J.S., Fishburn, P.C., Steuer, R.E., Zionts, S., Deb, K., Multiple criteria decision making, multiattribute utility theory: recent accomplishments and what lies ahead. Management Science 54 (2008), 1336–1349, 10.1287/mnsc.1070.0838.
174. Wang, Q., Poh, K.L., A survey of integrated decision analysis in energy and environmental modeling. Energy 77 (2014), 691–702, 10.1016/j.energy.2014.09.060.
175. Weihrich, H., The tows matrix - A tool for situational analysis. Long Range Planning 15 (1982), 54–66, 10.1016/0024-6301(82)90120-0.
176. Wolfslehner, B., Vacik, H., Evaluating sustainable forest management strategies with the analytic network process in a pressure-state-response framework. Journal of Environmental Management 88 (2008), 1–10, 10.1016/j.jenvman.2007.01.027.
177. Wolfslehner, B., Vacik, H., Mapping indicator models: from intuitive problem structuring to quantified decision-making in sustainable forest management. Ecological Indicators 11 (2011), 274–283, 10.1016/j.ecolind.2010.05.004.
178. Wright, G., Bradfield, R., Cairns, G., Does the intuitive logics method – and its recent enhancements – produce “effective” scenarios?. Technological Forecasting and Social Change 80 (2013), 631–642, 10.1016/j.techfore.2012.09.003.
179. Wright, G., Goodwin, P., Future-focussed thinking: combining scenario planning with decision analysis. Journal of Multi-Criteria Decision Analysis 8 (1999), 311–321, 10.1002/1099-1360(199911)8:6<311::Aid-mcda256>3.0.co;2-t.
180. Wright, G., Goodwin, P., Eliminating a framing bias by using simple instructions to ‘think harder’ and respondents with managerial experience: comment on ‘breaking the frame’. Strategic Management Journal 23 (2002), 1059–1067, 10.1002/smj.265.
181. Yu, R., Tzeng, G.-H., A soft computing method for multi-criteria decision making with dependence and feedback. Applied Mathematics and Computation 180 (2006), 63–75, 10.1016/j.amc.2005.11.163.
182. Yüksel, İ., Dağdeviren, M., Using the analytic network process (ANP) in a SWOT analysis – A case study for a textile firm. Information Sciences 177 (2007), 3364–3382, 10.1016/j.ins.2007.01.001.