A review and classification of approaches for dealing with uncertainty in multi-criteria decision analysis for healthcare decisions

PharmacoEconomics

Volumn 33, Issue 5, 2015, Pages 445-455

  Broekhuizen, Henk ^a   Groothuis Oudshoorn, Catharina G M ^a   van Til, Janine A ^a   Hummel, J Marjan ^a   IJzerman, Maarten J ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

BAYES THEOREM; CLASSIFICATION; ECONOMIC EVALUATION; FUZZY SYSTEM; HEALTH CARE POLICY; MEDICAL DECISION MAKING; MEDICAL LITERATURE; MULTI CRITERIA DECISION ANALYSIS; PRIORITY JOURNAL; REVIEW; SENSITIVITY AND SPECIFICITY; DECISION SUPPORT SYSTEM; ECONOMICS; FUZZY LOGIC; HEALTH CARE DELIVERY; ORGANIZATION; ORGANIZATION AND MANAGEMENT; RISK ASSESSMENT; STATISTICAL MODEL; UNCERTAINTY;

BAYES THEOREM; DECISION MAKING, ORGANIZATIONAL; DECISION SUPPORT TECHNIQUES; DELIVERY OF HEALTH CARE; FUZZY LOGIC; MODELS, STATISTICAL; RISK ASSESSMENT; UNCERTAINTY;

EID: 84938293016     PISSN: 11707690     EISSN: 11792027     Source Type: Journal    
DOI: 10.1007/s40273-014-0251-x     Document Type: Review

References (82)

1. Diaby V, Campbell K, Goeree R. Multi-criteria decision analysis (MCDA) in health care: a bibliometric analysis. Oper Res Health Care. 2013;2:20–4.
2. Belton V, Stewart TJ. Multiple criteria decision analysis: an integrated approach. 2nd ed. Dordrecht: Kluwer Academic Publishers; 2002.
3. Hummel JM, Bridges JFP, IJzerman MJ. Group decision making with the analytic hierarchy process in benefit-risk assessment: a tutorial. Patient. 2014;7:129–40.
4. Holden W. Benefit-risk analysis: a brief review and proposed quantitative approaches. Drug Saf. 2003;26:853–62.
5. Mussen F, Salek S, Walker S. A quantitative approach to benefit-risk assessment of medicines—part 1: the development of a new model using multi-criteria decision analysis. Pharmacoepidemiol Drug Saf. 2007;16:S2–15.
6. Guo JJ, Pandey S, Doyle J, Bian B, Lis Y, Raisch DW. A review of quantitative risk-benefit methodologies for assessing drug safety and efficacy-report of the ISPOR risk-benefit management working group. Value Health. 2010;13:657–66.
7. Phillips LD, Fasolo B, Zafiropoulos N, Beyer A. Is quantitative benefit–risk modelling of drugs desirable or possible? Drug Discov Today Technol. 2011;8:e3–10.
8. Levitan BS, Andrews EB, Gilsenan A, Ferguson J, Noel RA, Coplan PM, et al. Application of the BRAT framework to case studies: observations and insights. Clin Pharmacol Ther. 2011;89:217–24.
9. Van Valkenhoef G, Tervonen T, Zhao J, de Brock B, Hillege HL, Postmus D. Multicriteria benefit–risk assessment using network meta-analysis. J Clin Epidemiol. 2012;65:394–403.
10. Diaby V, Goeree R. How to use multi-criteria decision analysis methods for reimbursement decision-making in healthcare: a step-by-step guide. Expert Rev Pharmacoecon Outcomes Res. 2014;14:81–99.
11. Dolan JG. Shared decision-making: transferring research into practice: the analytic hierarchy process (AHP). Patient Educ Couns. 2008;73:418–25.
12. Thokala P, Duenas A. Multiple criteria decision analysis for health technology assessment. Value Health. 2012;15:1172–81.
13. Devlin NJ, Sussex JON. Incorporating multiple criteria in HTA: methods and processes. London: The Office of Health Economics; 2011.
14. Bojke L, Claxton K, Sculpher M, Palmer S. Characterizing structural uncertainty in decision analytic models: a review and application of methods. Value Health. 2009;12:739–49.
15. Briggs AH, Weinstein MC, Fenwick EL, Karnon J, Sculpher MJ, Paltiel AD. Model parameter estimation and uncertainty: a report of the ISPOR-SMDM modeling good research practices task force-6. Value Health. 2012;15:835–42.
16. Marsh K, Lanitis T, Neasham D, Orfanos P, Caro J. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. Pharmacoeconomics. 2014;32(4):345–65.
17. Durbach IN, Stewart TJ. Modeling uncertainty in multi-criteria decision analysis. Eur J Oper Res. 2012;223:1–14.
18. Kangas AS, Kangas J. Probability, possibility and evidence: approaches to consider risk and uncertainty in forestry decision analysis. For Policy Econ. 2004;6:169–88.
19. Felli J, Hazen GB. Sensitivity analysis and the expected value of perfect information. Med Decis Mak. 1998;18:95–109.
20. Churilov L, Liu D, Ma H, Christensen S, Nagakane Y, Campbell B, et al. Multiattribute selection of acute stroke imaging software platform for extending the time for thrombolysis in emergency neurological deficits (EXTEND) clinical trial. Int J Stroke. 2013;8:204–10.
21. Parthiban P, Abdul Zubar H. An integrated multi-objective decision making process for the performance evaluation of the vendors. Int J Prod Res. 2013;51:3836–48.
22. Hyde KM, Maier HR, Colby CB. A distance-based uncertainty analysis approach to multi-criteria decision analysis for water resource decision making. J Environ Manage. 2005;77:278–90.
23. Cox R, Sanchez J, Revie CW. Multi-criteria decision analysis tools for prioritising emerging or re-emerging infectious diseases associated with climate change in Canada. PLoS One. 2013;8:e68338.
24. Hopfe CJ, Augenbroe GLM, Hensen JLM. Multi-criteria decision making under uncertainty in building performance assessment. Build Environ. 2013;69:81–90.
25. Haakma W, Steuten LMG, Bojke L, IJzerman MJ. Belief elicitation to populate health economic models of medical diagnostic devices in development. Appl Health Econ Health Policy. 2014;12:327–34.
26. Betrie GD, Sadiq R, Morin KA, Tesfamariam S. Selection of remedial alternatives for mine sites: a multicriteria decision analysis approach. J Environ Manage. 2013;119:36–46.
27. Prado-Lopez V, Seager TP, Chester M, Laurin L, Bernardo M, Tylock S. Stochastic multi-attribute analysis (SMAA) as an interpretation method for comparative life-cycle assessment (LCA). Int J Life Cycle Assess. 2013;19:405–16.
28. Broekhuizen H, Groothuis-Oudshoorn CGM, Hauber AB, IJzerman MJ. Integrating patient preferences and clinical trial data in a Bayesian model for benefit-risk assessment. 34th Annual Meeting of the Society of Medical Decision Making. Phoenix, AZ; 2012.
29. Fenton N, Neil M. Making decisions: using Bayesian nets and MCDA. Knowl Based Syst. 2001;14:307–25.
30. Albert J. Bayesian computation with R. 1st ed. In: Gentleman R, Hornik K, Parmigiani G, editors. New York: Springer Science+Business Media, Inc.; 2007.
31. Beynon MJ. The Role of the DS/AHP in identifying inter-group alliances and majority rule within group decision making. Gr Decis Negot. 2005;15:21–42.
32. Srivastava RP. An introduction to evidential reasoning for decision making under uncertainty: Bayesian and belief function perspectives. Int J Acc Inf Syst. 2011;12:126–35.
33. Ma W, Xiong W, Luo X. A model for decision making with missing, imprecise, and uncertain evaluations of multiple criteria. Int J Intell Syst. 2013;28:152–84.
34. Beynon M, Curry B, Morgan P. The Dempster–Shafer theory of evidence: an alternative approach to multicriteria decision modelling. Omega. 2000;28:37–50.
35. Zadeh L. Fuzzy sets. Inf Control. 1965;8:338–53.
36. Chen S-J, Hwang C-L. Fuzzy multiple attribute decision making. 1st ed. Berlin: Springer; 1992.
37. Saaty RW. The analytical hierarchy process: what it is and how it is used. Math Model. 1987;9:161–76.
38. Montazar A, Gheidari ON, Snyder RL. A fuzzy analytical hierarchy methodology for the performance assessment of irrigation projects. Agric Water Manag. 2013;121:113–23.
39. Pitchipoo P, Venkumar P, Rajakarunakaran S. Fuzzy hybrid decision model for supplier evaluation and selection. Int J Prod Res. 2013;51:3903–19.
40. Ju-Long D. Control problems of grey systems. Syst Control Lett. 1982;1:288–94.
41. Kuang H, Hipel KW, Kilgour DM. Evaluation of source water protection strategies in Waterloo Region based on Grey Systems Theory and PROMETHEE II. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC), Seoul, South Korea; 2012. p. 2775–9.
42. Franc M, Frangiosa T. Pharmacogenomic study feasibility assessment and pharmaceutical business decision-making. In: Cohen N, editor. Pharmacogenomics and Personalized Medicine. Methods in Pharmacology and Toxicology. 1st ed. New York: Springer; 2008. p. 253–65.
43. Bertsch V, Geldermann J. Preference elicitation and sensitivity analysis in multicriteria group decision support for industrial risk and emergency management. Int J Emerg Manag. 2008;5:7–24.
44. Bouchard C, Abi-Zeid I, Beauchamp N, Lamontagne L, Desrosiers J, Rodriguez M. Multicriteria decision analysis for the selection of a small drinking water treatment system. J Water Supply Res Technol. 2010;59:230–42.
45. Francisque A, Rodriguez MJ, Sadiq R, Miranda LF, Proulx F. Reconciling, “actual” risk with “perceived” risk for distributed water quality: a QFD-based approach. J Water Supply Res Technol. 2011;60:321–42.
46. Hilgerink MP, Hummel MJ, Manohar S, Vaartjes SR, IJzerman MJ. Assessment of the added value of the Twente Photoacoustic Mammoscope in breast cancer diagnosis. Med Devices (Auckl). 2011;4:107–15.
47. Lee CW, Kwak NK. Strategic enterprise resource planning in a health-care system using a multicriteria decision-making model. J Med Syst. 2011;35:265–75.
48. Richman MB, Forman EH, Bayazit Y, Einstein DB, Resnick MI, Stovsky MD. A novel computer based expert decision making model for prostate cancer disease management. J Urol. 2005;174:2310–8.
49. Wilson E, Sussex J, Macleod C, Fordham R. Prioritizing health technologies in a primary care trust. J Health Serv Res Policy. 2007;12:80–5.
50. Rafiee R, Ataei M, Kamali M. Probabilistic stability analysis of Naien water transporting tunnel and selection of support system using TOPSIS approach. Sci Res Essays. 2011;6:4442–54.
51. Tervonen T, van Valkenhoef G, Buskens E, Hillege HL, Postmus D. A stochastic multicriteria model for evidence-based decision making in drug benefit-risk analysis. Stat Med. 2011;30:1419–28.
52. Karimi AR, Mehrdadi N, Hashemian SJ, Nabi Bidhendi GR, Tavakkoli Moghaddam R. Selection of wastewater treatment process based on the analytical hierarchy process and fuzzy analytical hierarchy process methods. Int J Environ Sci Technol. 2011;8:267–80.
53. Tesfamariam S, Sadiq R, Najjaran H. Decision making under uncertainty: an example for seismic risk management. Risk Anal. 2010;30:78–94.
54. Yang AL, Huang GH, Qin XS, Fan YR. Evaluation of remedial options for a benzene-contaminated site through a simulation-based fuzzy-MCDA approach. J Hazard Mater. 2012;213–214:421–33.
55. Zhang K, Achari G, Pei Y. Incorporating linguistic, probabilistic, and possibilistic information in a risk-based approach for ranking contaminated sites. Integr Environ Assess Manag. 2010;6:711–24.
56. Uzoka FME, Barker K. Expert systems and uncertainty in medical diagnosis: a proposal for fuzzy-ANP hybridisation. Int J Med Eng Inform. 2010;2:329–42.
57. Castro F, Caccamo LP, Carter KJ, Erickson BA, Johnson W, Kessler E, et al. Sequential test selection in the analysis of abdominal pain. Med Decis Mak. 1996;16:178–83.
58. Rios Insua D, French S. A framework for sensitivity analysis in discrete multi-objective decision-making. Eur J Oper Res. 1991;54:176–90.
59. Helton J. Uncertainty and sensitivity analysis techniques for use in performance assessment for radioactive waste disposal. Reliab Eng Syst Saf. 1993;42:327–67.
60. Claxton K. Exploring uncertainty in cost-effectiveness analysis. PharmacoEconomics. 2008;26:781–98.
61. Ribeiro F, Ferreira P, Araújo M. Evaluating future scenarios for the power generation sector using a multi-criteria decision analysis (MCDA) tool: the Portuguese case. Energy. 2013;52:126–36.
62. Srdjevic Z, Samardzic M, Srdjevic B. Robustness of AHP in selecting wastewater treatment method for the coloured metal industry: Serbian case study. Civ Eng Environ Syst. 2012;29:147–61.
63. Durbach IN. Outranking under uncertainty using scenarios. Eur J Oper Res. 2014;232:98–108.
64. Vahdani B, Mousavi SM, Tavakkoli-Moghaddam R, Hashemi H. A new design of the elimination and choice translating reality method for multi-criteria group decision-making in an intuitionistic fuzzy environment. Appl Math Model. 2013;37:1781–99.
65. Yang Y. Extended grey numbers and their operations. In: IEEE International Conference on Systems, Man and Cybernetics, 2007, Montreal, Quebec; 2007. p. 2181–6.
66. Lahdelma R, Hokkanen J. SMAA-stochastic multiobjective acceptability analysis. Eur J Oper Res. 1998;2217:137–43.
67. Zavadskas EK, Kaklauskas A. Multi-attribute decision-making model by applying grey numbers. Informatica. 2009;20:305–20.
68. Caro J, Möller J. Decision-analytic models: current methodological challenges. Pharmacoeconomics. 2014;32(10):943–50.
69. Tuffaha HW, Gordon LG, Scuffham P. Value of information analysis in health care: a review of principles and applications. J Med Econ. 2014;17(6):377–88.
70. Zadeh LA. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets Syst. 1978;1:3–28.
71. Keeney R, Raiffa H. Decisions with multiple objectives. Cambridge: Cambridge University Press; 1976.
72. Ishizaka A, Nemery P. Multi-criteria decision analysis: methods and software. 1st ed. Chichester: Wiley; 2013.
73. Bilcke J, Beutels P, Brisson M, Jit M. Accounting for methodological, structural, and parameter uncertainty in decision-analytic models: a practical guide. Med Decis Mak. 2011;31:675–92.
74. Winterfeldt D. Structuring decision problems for decision analysis. Acta Psychol (Amst). 1980;45:71–93.
75. Kahneman D, Tvsersky A. Prospect theory: an analysis of decision under risk. Econometrica. 1979;47:263–91.
76. Belton V, Pictet J. A framework for group decision using a MCDA model: sharing, aggregating or comparing individual information? J Decis Syst. 1997;6:283–303.
77. Liu W. Propositional, probabilistic and evidential reasoning. Heidelberg: Physica-Verlag HD; 2001.
78. Bouyssou D, Marchant T, Pirlot M, Tsoukias A, Vincke P. Evaluation and decision models with multiple criteria: stepping stones for the analyst. New York: Springer Science+Business Media, Inc.; 2006.
79. Winterfeldt D, Edwards W. Decision analysis and behavioral research. Cambridge: Cambridge University Press; 1986.
80. Opricovic S. Multicriteria optimization of civil engineering systems. Belgrade: Faculty of Civil Engineering; 1998.
81. Proctor W, Drechsler M. Deliberative multicriteria evaluation. Environ Plan C Gov Policy. 2006;24:169–90.
82. Autran Monteiro Gomes LF, Duncan Rangel LA. An application of the TODIM method to the multicriteria rental evaluation of residential properties. Eur J Oper Res. 2009;193:204–11.