Tackling uncertainty in multi-criteria decision analysis - An application to water supply infrastructure planning

European Journal of Operational Research

Volumn 242, Issue 1, 2015, Pages 243-260

  Scholten, Lisa ^a   Schuwirth, Nele ^a   Reichert, Peter ^a,b   Lienert, Judit ^a  

^a SWISS FEDERAL INSTITUTE OF AQUATIC SCIENCE AND TECHNOLOGY   (Switzerland)

^b ETH ZURICH   (Switzerland)

Author keywords

Decision analysis; Multi attribute utility theory; Preference elicitation; Uncertainty modeling and global sensitivity, analysis; Water infrastructure planning

Indexed keywords

DECISION MAKING; DECISION THEORY; ECONOMICS; PREDICTIVE ANALYTICS; SENSITIVITY ANALYSIS; WATER CONSERVATION; WATER SUPPLY; WATER SUPPLY SYSTEMS;

GLOBAL SENSITIVITY; GLOBAL SENSITIVITY ANALYSIS; MULTI-ATTRIBUTE UTILITY THEORY; MULTI-CRITERIA DECISION ANALYSIS; PREFERENCE ELICITATION; SOCIO-ECONOMIC DEVELOPMENT; WATER INFRASTRUCTURE; WATER SUPPLY INFRASTRUCTURES;

UNCERTAINTY ANALYSIS;

EID: 84920715563     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2014.09.044     Document Type: Article

References (115)

1. Abdellaoui, M., Bleichrodt, H., & Paraschiv, C. (2007). Loss aversion under prospect theory: A parameter-free measurement. Management Science, 53, 1659-1674.
2. Allais, M. (1953). Le comportement de l'homme rationel devant le risque: Critique des postulats et axiomes de l'ecole américaine. Econometrica, 21, 503-546.
3. Ananda, J., & Herath, G. (2009). A critical review of multi-criteria decision making methods with special reference to forest management and planning. Ecological Economics, 68, 2535-2548.
4. Ashley, R., Blackwood, D., Butler, D., Jowitt, P., Davies, J., Smith, H., et al. (2008). Making asset investment decisions for wastewater systems that include sustainability. Journal of Environmental Engineering-ASCE, 134, 200-209.
5. Ayyub, B. M. (2001). Elicitation of expert opinions for uncertainty and risks (1st ed.) CRC Press LLC.
6. Belton, V., & Stewart, T. J. (2002). Multiple criteria decision analysis: An integrated approach Kluwer Academic Publishers.
7. Belton, V., & Stewart, T. J. (2010). Problem structuring for multiple criteria analysis. In M. Ehrgott (Ed.), Trends in multiple criteria decision analysis (pp. 209-239).
8. Ben-Akiva, M., & Lerman, S. (1989). Discrete choice analysis. USA: MIT Press.
9. Bleichrodt, H., Pinto, J. L., & Wakker, P. P. (2001). Making descriptive use of prospect theory to improve the prescriptive use of expected utility. Management Science, 47, 1498-1514.
10. Bond, S. D., Carlson, K. A., & Keeney, R. L. (2008). Generating objectives: Can decision makers articulate what they want?. Management Science, 54, 56-70.
11. Bond, S. D., Carlson, K. A., & Keeney, R. L. (2010). Improving the generation of decision objectives. Decision Analysis, 7, 238-255.
12. Borcherding, K., Eppel, T., & von Winterfeldt, D. (1991). Comparison of weighting judgements in multiattribute utility measurement. Management Science, 37, 1603-1619.
13. Butler, J., Jia, J., & Dyer, J. (1997). Simulation techniques for the sensitivity analysis of multi-criteria decision models. European Journal of Operational Research, 103, 531-546.
14. Cobb, C. W., & Douglas, P. H. (1928). A theory of production. The American Economic Review, 18, 139-165.
15. Cooke, R. M. (1991). Experts in uncertainty: Opinion and subjective probability in science. New York: Oxford University Press.
16. Cox, J. C., Sadiraj, V., Vogt, B., & Dasgupta, U. (2012). Is there a plausible theory for decision under risk? A dual calibration critique. Economic Theory, 1-29.
17. Dominguez, D., Worch, H., Markard, J., Trujillo Alvarez, R., & Gujer, W. (2009). Closing the capability gap: Strategic planning for the infrastructure sector. California Management Review, 51, 30-50.
18. Durbach, I. N., & Stewart, T. J. (2009). Using expected values to simplify decisionmaking under uncertainty. Omega, 37, 312-330.
19. Durbach, I. N., & Stewart, T. J. (2011). An experimental study of the effect of uncertainty representation on decision making. European Journal of Operational Research, 214, 380-392.
20. Durbach, I. N., & Stewart, T. J. (2012a). A comparison of simplified value function approaches for treating uncertainty in multi-criteria decision analysis. Omega, 40, 456-464.
21. Durbach, I. N., & Stewart, T. J. (2012b). Modeling uncertainty in multi-criteria decision analysis. European Journal of Operational Research, 223, 1-14.
22. Dyer, J. S., & Sarin, R. K. (1979). Measurable multiattribute value functions. Operations Research, 27, 810-822.
23. Dyer, J. S., & Sarin, R. K. (1982). Relative risk aversion. Management Science, 28, 875-886.
24. Economides, J. A. (2012). Public outreach: An engineer's perspective. Journal - American Water Works Association, 104, 74-76.
25. Eisenführ, F., Weber, M., & Langer, T. (2010). Rational decision making (1st ed.) Springer.
26. Ellsberg, D. (1961). Risk, ambiguity, and the Savage axioms. Quarterly Journal of Economics, 75, 643-669.
27. Ferguson, B. C., Frantzeskaki, N., & Brown, R. R. (2013). A strategic program for transitioning to a Water Sensitive City. Landscape and Urban Planning, 117, 32-45.
28. Franco, L. A., & Montibeller, G. (2011). Problem structuring for multicriteria decision analysis interventions. In J. J. E. Cochran (Ed.), Encyclopedia of operations research and management science (pp. 1-14). Oxford: John Wiley & Sons.
29. French, S. (1995). Uncertainty and imprecision: Modelling and analysis. Journal of the Operational Research Society, 46, 70-79.
30. French, S. (2003). Modelling, making inferences and making decision: The roles of sensitivity analysis. Sociedad de Estadística e Investigación Operativa (TOP), 11, 229-251.
31. Gómez Delgado, M., & Bosque Sendra, J. (2004). Sensitivity analysis in multicriteria spatial decision-making: A review. Human and Ecological Risk Assessment: An International Journal, 10, 1173-1187.
32. Gómez Delgado, M., & Tarantola, S. (2006). Global sensitivity analysis, GIS and multicriteria evaluation for a sustainable planning of a hazardous waste disposal site in Spain. International Journal of Geographical Information Science, 20, 449-466.
33. Goodwin, P., & Wright, G. (2001). Enhancing strategy evaluation in scenario planning: A role for decision analysis. Journal of Management Studies, 38, 1-16.
34. Gregory, R., Failing, L., Harstone, M., Long, G., McDaniels, T., & Ohlson, D. (2012). Structured decision making - A practical guide to environmental management choices (1st ed.) WileyBlackwell.
35. Hajkowicz, S. (2008). A comparison of multiple criteria analysis techniques for water resource management. European Journal of Operational Research, 255-265.
36. Hajkowicz, S., & Collins, K. (2007). A review of multiple criteria analysis for water resource planning andmanagement. Water Resources Management, 21, 1553-1566.
37. Hershey, J. C., & Schoemaker, P. J. H. (1985). Probability versus certainty equivalence methods in utility measurement - Are they equivalent?. Management Science, 31, 1213-1231.
38. Hoeffler, S., & Ariely, D. (1999). Constructing stable preferences: A look into dimensions of experience and their impact on preference stability. Journal of Consumer Psychology, 8, 113-139.
39. Huang, I. B., Keisler, J., & Linkov, I. (2011). Multi-criteria decision analysis in environmental sciences: Ten years of applications and trends. Science of the Total Environment, 409, 3578-3594.
40. Hyde, K. M., Maier, H., & Colby, C. (2004). Reliability-based approach to multicriteria decision analysis for water resources. Journal of Water Resources Planning and Management, 130, 429-438.
41. Hyde, K. M., Maier, H. R., & Colby, C. B. (2005). A distance-based uncertainty analysis approach to multi-criteria decision analysis for water resource decision making. Journal of Environmental Management, 77, 278-290.
42. Jacobi, S. K., & Hobbs, B. F. (2007). Quantifying and mitigating the splitting bias and other value tree-induced weighting biases. Decision Analysis, 4, 194-210.
43. Jessop, A. (2011). Using imprecise estimates for weights. Journal of the Operational Research Society, 62, 1048-1055.
44. Jiménez, A., Ríos-Insua, S., & Mateos, A. (2006). A generic multi-attribute analysis system. Computers & Operations Research, 33, 1081-1101.
45. Joubert, A., Stewart, T. J., & Eberhard, R. (2003). Evaluation of water supply augmentation andwater demand management options for the City of Cape Town. Journal of Multi-Criteria Decision Analysis, 17-25.
46. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-291.
47. Kangas, A. S., & Kangas, J. (2004). Probability, possibility and evidence: Approaches to consider risk and uncertainty in forestry decision analysis. Forest Policy and Economics, 169-188.
48. Karvetski, C. W., Lambert, J. H., & Linkov, I. (2009). Emergent conditions and multiple criteria analysis in infrastructure prioritization for developing countries. Journal of Multi-Criteria Decision Analysis, 16, 125-137.
49. Karvetski, C. W., Lambert, J. H., & Linkov, I. (2009). Scenario and multiple criteria decision analysis for energy and environmental security of military and industrial installations. Integrated Environmental Assessment and Management, 16, 125-137.
50. Keeney, R. L. (1982). Decision analysis: An overview. Operations Research, 30, 803-838.
51. Keeney, R. L., & Raiffa, H. (1993). Decisions with multiple objectives. Preferences and Value tradeoffs (2nd ed.). Cambridge: Cambridge University Press.
52. Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30, 81-93.
53. Kilgour, D. M., & Eden, C. (2010). Handbook of group decision and negotiation. Dordrecht, Heidelberg, London, New York: Springer.
54. Kynn, M. (2008). The 'heuristics and biases' bias in expert elicitation. Journal of the Royal Statistical Society: Series A (Statistics in Society), 171, 239-264.
55. Lahdelma, R., Hokkanen, J., & Salminen, P. (1998). SMAA - Stochastic multiobjective acceptability analysis. European Journal of Operational Research, 106, 137-143.
56. Lahdelma, R., & Salminen, P. (2012). The shape of the utility or value function in stochastic multicriteria acceptability analysis. OR Spectrum, 34, 785-802.
57. Langhans, S. D., Lienert, J., Schuwirth, N., & Reichert, P. (2013). How to make river assessments comparable: A demonstration for hydromorphology. Ecological Indicators, 264-275.
58. Langhans, S. D., Reichert, P., & Schuwirth, N. (2014). The method matters: Indicator aggregation in ecological assessment. Ecological Indicators, 45, 494-507.
59. Lieberherr, E., Klinke, A., & Finger, M. (2012). Towards legitimate water governance? The partially privatized Berlin waterworks. Public Management Review, 14, 923-946.
60. Lienert, J., Duygan, M., & Zheng, J. (in preparation). Preference stability over time using two methods to elicit weights for wastewater infrastructure planning (working title).
61. Lienert, J., Schnetzer, F., & Ingold, K. (2013). Stakeholder analysis combined with social network analysis provides fine-grained insights into water infrastructure planning processes. Journal of Environmental Management, 125, 134-148.
62. Lienert, J., Scholten, L., Egger, C., & Maurer, M. (2014a). Structured decision making for sustainable water infrastructure planning and four future scenarios. EURO Journal on Decision Processes http://dx.doi.org/10.1007/s40070-40014-40030-40070.
63. Lienert, J., Scholten, L., Egger, C., & Maurer, M. (2014b). Additional information for Structured decision making for sustainable water infrastructure planning and four future scenarios (Working Papers in Environmental Social Sciences 2014-3). Dübendorf, Switzerland: Department of Environmental Social Sciences, Swiss Federal Institute of Aquatic Science and Technology (Eawag). http://www.eawag.ch/forschung/ess/workingpapers/. Accessed 06 December 2013.
64. Martin, W. E., Bender, H. W., & Shields, D. J. (2000). Stakeholder objectives for public lands: Rankings of forest management alternatives. Journal of Environmental Management, 21-32.
65. Marttunen, M., & Hämäläinen, R. P. (2008). The decision analysis interview approach in the collaborative management of a large regulated water course. Environmental Management, 1026-1042.
66. Mendoza, G. A., & Martins, H. (2006). Multi-criteria decision analysis in natural resource management: A critical review of methods and new modelling paradigms. Forest Ecology and Management, 1-22.
67. Milly, P. C. D., Betancourt, J., Falkenmark, M., Hirsch, R. M., Kundzewicz, Z. W., Lettenmaier, D. P., et al. (2008). Climate change - Stationarity is dead: Whither water management?. Science, 319, 573-574.
68. Montibeller, G., Gummer, H., & Tumidei, D. (2006). Combining scenario planning and multi-criteria decision analysis in practice. Journal of Multi-Criteria Decision Analysis, 14, 5-20.
69. Morton, A., & Fasolo, B. (2009). Behavioural decision theory for multi-criteria decision analysis: A guided tour. Journal of the Operational Research Society, 60, 268-275.
70. Mullen, K. M., Ardia, D., Gil, D. L., Windover, D., & Cline, J. (2011). DEoptim: An R package for global optimization by differential evolution. Journal of Statistical Software, 40.
71. Mustajoki, J. (2011). Comparison of weight distributions in multi-attribute value tree theory. In V. Kostaglou, G. Arabatzis, & L. Karamitopoulos (Eds.). International symposium and 10th Balkan conference on operational research (BALCOR 2011): Vol. 1 (pp. 300-307). Greece: Thessaloniki.
72. Mustajoki, J. (2012). Effects of imprecise weighting in hierarchical preference programming. European Journal of Operational Research, 218, 193-201.
73. Mustajoki, J., Hämälainen, R. P., & Lindstedt, M. R. K. (2006). Using intervals for global sensitivity and worst-case analyses in multiattribute value trees. European Journal of Operational Research, 174, 278-292.
74. Mustajoki, J., Hämäläinen, R. P., & Marttunen, M. (2004). Participatory multicriteria decision analysis with Web-HIPRE: A case of lake regulation policy. Environmental Modelling & Software, 19, 537-547.
75. Mustajoki, J., Hämäläinen, R. P., & Salo, A. (2005). Decision support by interval SMART/SWING - Incorporating imprecision in the SMART and SWING methods. Decision Sciences, 36, 317-339.
76. Nash, J. C., & Varadhan, R. (2011). Unifying optimization algorithms to aid software system users: Optimx for R. Journal of Statistical Software, 43, 1-14.
77. O'Hagan, A., Buck, C. E., Daneshkhah, A., Eiser, J. R., Garthwaite, P. H., Jenkinson, D. J., et al. (2006). Uncertain judgements: Eliciting experts' probabilities John Wiley & Sons.
78. Phillips, L. D., & Bana e Costa, C. A. (2007). Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision conferencing. Annals of Operations Research, 154, 51-68.
79. Pöyhönen, M., Vrolijk, H., & Hämäläinen, R. P. (2001). Behavioral and procedural consequences of structural variation in value trees. European Journal of Operational Research, 134, 216-227.
80. Pujol, G., Iooss, B., & Janon, A. (2012). Sensitivity: Sensitivity analysis (pp. R package version 1.6-1).
81. Qualtrics. (2012). Qualtrics Research Suite (2.227s ed.). Pravo, Utah, USA.
82. R Development Core Team. (2011). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
83. Rabin, M. (2000). Risk aversion and expected-utility theory: A calibration theorem. Econometrica, 68, 1281-1292.
84. Raju, K. S., & Pillai, C. R. S. (1999). Multicriterion decision making in performance evaluation of an irrigation system. European Journal of Operational Research, 479-488.
85. Raju, K. S., & Vasan, A. (2007). Multi attribute utility theory for irrigation system evaluation. Water Resources Management, 21, 717-728.
86. Refsgaard, J. C., van der Sluijs, J. P., Højberg, A. L., & Vanrolleghem, P. A. (2007). Uncertainty in the environmental modelling process - A framework and guidance. Environmental Modelling & Software, 22, 1543-1556.
87. Reichert, P., Schuwirth, N., & Langhans, S. D. (2013). Constructing, evaluating, and visualizing value and utility functions for decision support. Environmental Modelling & Software, 46, 283-291.
88. Ruth, M., Bernier, C., Jollands, N., & Golubiewski, N. (2007). Adaptation of urban water supply infrastructure to impacts from climate and economic changes: The case of Hamilton, New Zealand. Water Resources Management, 1031-1045.
89. Saltelli, A. (2008). Global sensitivity analysis: The primer. Chichester: John Wiley.
90. Saltelli, A., Annoni, P., Azzini, I., Campolongo, F., Ratto, M., & Tarantola, S. (2010). Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Computer Physics Communications, 181, 259-270.
91. Saltelli, A., Ratto, M., Tarantola, S., & Campolongo, F. (2006). Sensitivity analysis practices: Strategies for model-based inference. Reliability Engineering and System Safety, 91, 1109-1125.
92. Saltelli, A., Tarantola, S., Campolongo, F., & Ratto, M. (2004). Sensitivity analysis in practice: A guide to assessing scientific models John Wiley & Sons Ltd.
93. Saltelli, A., Tarantola, S., & Chan, K. (1999a). A role for sensitivity analysis in presenting the results from MCDA studies to decisionmakers. Journal of Multi-Criteria Decision Analysis, 8, 139-145.
94. Saltelli, A., Tarantola, S., & Chan, K. P. S. (1999b). A quantitative model-independent method for global sensitivity analysis of model output. Technometrics, 41, 39-56.
95. Scheidegger, A. (2012). adaptMCMC: Implementation of a generic adaptive Monte Carlo Markov Chain sampler. CRAN R project (v1.0.3 ed.).
96. Schmidt, U., Starmer, C., & Sugden, R. (2008). Third-generation prospect theory. Journal of Risk and Uncertainty, 36, 203-223.
97. Schuwirth, N., Reichert, P., & Lienert, J. (2012). Methodological aspects of multi-criteria decision analysis for policy support: A case study on pharmaceutical removal from hospital wastewater. European Journal of Operational Research, 220, 472-483.
98. Sharma, A., Burn, S., Gardner, T., & Gregory, A. (2010). Role of decentralised systems in the transition of urban water systems. Water Science and Technology: Water Supply, 10, 577-583.
99. Smidts, A. (1997). The relationship between risk attitude and strength of preference: A test of intrinsic risk attitude. Management Science, 43, 357-370.
100. Stewart, T. J. (1995). Simplified approaches for multicriteria decision making under uncertainty. Journal of Multi-Criteria Decision Analysis, 4, 246-258.
101. Stewart, T. J. (2005). Dealing with uncertainties in MCDA (multi-criteria decision analysis). In J. Figueira, S. Greco, & M. Ehrgott (Eds.). Multiple criteria decision analysis - State of the art annotated surveys: Vol. 78 (pp. 445-470). New York: Springer.
102. Stewart, T. J., French, S., & Rios, J. (2013). Integrating multicriteria decision analysis and scenario planning-Review and extension. Omega, 41, 679-688.
103. Störmer, E., Truffer, B., Dominguez, D., Gujer, W., Herlyn, A., Hiessl, H., et al. (2009). The exploratory analysis of trade-offs in strategic planning: Lessons from Regional Infrastructure Foresight. Technological Forecasting and Social Change, 1150-1162.
104. Torrance, G. W., Feeney, D. H., Furlong, W. J., Barr, R. D., Zhang, Y., & Wang, Q. (1996). Multiattribute utility function for a comprehensive health status classification system: Health utilities index mark 2. Medical Care, 34, 702-722.
105. von Neumann, J., & Morgenstern, O. (1947). Theory of games and economic behavior (2nd ed.) Princeton University Press.
106. von Nietzsch, R, & Weber, M. (1991). Bandbreiten-Effekt bei der Bestimmung von Zielgewichten. Zeitschrift für betriebswirtschaftliche Forschung, 43, 971-986.
107. Wakker, P., & Deneffe, D. (1996). Eliciting von Neumann-Morgenstern utilities when probabilities are distorted or unknown. Management Science, 42, 1131-1150.
108. Walker, W. E., Harremoës, P., Rotmans, J., van der Sluijs, J. P., van Asselt, M. B. A., Janssen, P., et al. (2003). Defining uncertainty: A conceptual basis for uncertainty management in model-based decision support. Integrated Assessment, 4, 5-17.
109. Wallenius, J., Dyer, J. S., Fishburn, P. C., Steuer, R. E., Zionts, S., & Deb, K. (2008). Multiple criteria decision making, multiattribute utility theory: Recent accomplishments and what lies ahead. Management Science, 54, 1336-1349.
110. Weber, M. (1987). Decision making with incomplete information. European Journal of Operational Research, 44-57.
111. Weber, M., & Borcherding, K. (1993). Behavioral influences on weight judgments in multiattribute decision-making. European Journal of Operational Research, 67, 1-12.
112. Wickham, H. (2007). Reshaping data with the reshape package. Journal of Statistical Software, 21.
113. Wickham, H. (2009). ggplot2: Elegant graphics for data analysis. New York: Springer.
114. Wong, T. H. F., & Brown, R. R. (2009). The water sensitive city: Principles for practice. Water Science and Technology, 60, 673-682.
115. Zhou, P., & Ang, B. W. (2009). Comparing MCDA aggregation methods in constructing composite indicators using the Shannon-Spearman measure. Social Indicators Research, 94, 83-96.