Survey of applications of entropy in decision analysis

Kongzhi yu Juece/Control and Decision

Volumn 23, Issue 4, 2008, Pages

  Zhou, Rong Xi ^a   Liu, Shan Cun ^b   Qiu, Wan Hua ^b  

^a BEIJING UNIVERSITY OF CHEMICAL TECHNOLOGY   (China)

^b BEIHANG UNIVERSITY   (China)

Author keywords

Bayesian decision; Entropy; Multiobjective decision; Probability distribution; Utility functions

Indexed keywords

MULTIOBJECTIVE OPTIMIZATION; PROBABILITY DISTRIBUTIONS;

BAYESIAN DECISION; MULTIOBJECTIVE DECISION; UTILITY FUNCTIONS;

DECISION THEORY;

EID: 44249098280     PISSN: 10010920     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (65)

1. Shannon C E. A mathematical theory of communication[J]. Bell Systems Technical J, 1948, 27(3): 379-428.
2. Jaynes E T. Information theory and statistical mechanics[J]. The Physical Review, 1957, 106(2): 620-630.
3. Aida C G, Lazo V, Rathie P N. On the entropy of continuous probability distributions[J]. IEEE Trans on Information Theory, 1978, 24(1): 120-122.
4. Alexis De Vos. The entropy of a mixture of probability distributions[J]. Entropy, 2005, 7(1): 15-37.
5. Thomas M U. A generalized maximum entropy principle[J]. Operations Research, 1979, 27(6): 1188-1196.
6. Kullback S, Leibler R A. On information and sufficiency[J]. The Annals of Mathematical Statistics, 1951, 22(1): 79-86.
7. Kesavan H K, Kapur J N. The generalized maximum entropy principle[J]. IEEE Trans on Systems, Man and Cybernetics, 1989, 19(5): 1042-1052.
8. Alhassid A N, Levine R D. An algorithm for finding the distribution of maximal entropy[J]. J of Computational Physics, 1979, 30(2). 250-259.
9. Mead L R, Papanicolaou N. Maximum entropy in the problem of moments[J]. J of Mathematical Physics, 1984, 25(8): 2404-2417.
10. Zellner A, Highfield R A. Calculation of maximum entropy distributions and approximation of marginal posterior distributions[J]. J of Econometrics, 1988, 37(2): 195-209.
11. Ormoneit D, White H. An efficient algorithm to compute maximum entropy densities[J]. Econometric Reviews, 1999, 18(2): 127-140.
12. Abbas Ali E. Entropy methods for joint distributions in decision analysis[J]. IEEE Trans on Engineering Management, 2006, 53(1). 146-159.
13. Michael R, Eric J. Entropy densities with an application to autoregressive conditional skewness and kurtosis[J]. J of Econometrics, 2002, 106(1): 119-142.
14. Barron H, Schmidt C P. Senstivity analysis of additive multiattribute value models[J]. Operations Research, 1988, 36(1): 122-127.
15. Soofi E S. Generalized entropy-based weights for multiattribute value models[J]. Operations Research, 1990, 38(2): 362-363.
16. Jiang Dan, Qian Yu-mei. Effect risk entropy[J]. J of China University of Science and Technology, 1994, 24(4): 461-469.
17. Lehrer E, Smorodinsky R. Relative entropy in sequential decision problems[J]. J of Mathematical Economics, 2000, 33(4). 425-439.
18. Candeal J C, De Miguel J R, Indur' Ain E, et al. Utility and entropy[J]. Economic Theory, 2001, 17(1): 233-238.
19. Abbas A E. Entropy methods for adaptive utility elicitation[J]. IEEE Trans on Systems, Man and Cybernetics - Part A, 2004, 34 (2): 169-178.
20. Abbas A E. Maximum entropy utility[J]. Operations Research, 2006, 54(2): 277-290.
21. Yang J P, Qiu W H. A measure of risk and a decisionmaking model based on expected utility and entropy[J]. European J of Operational Research, 2005, 164(3): 792-799.
22. Darooneh A H. Utility function from maximum entropy principle[J]. Entropy, 2006, 8(1): 18-24.
23. Yue Chao-yuan. Decision theory and method[M]. Beijing: Science Press, 2003.
24. Qiu Wan-hua. Management decision and application entropy[M]. Beijing: China Machine Press, 2001.
25. Gu Chang-yao, Qiu Wan-hua. Complex entropy and its application in Bayes decision analysis[J]. Control and Decision, 1991, 6(4): 251-259.
26. Qiu Wan-hua, Yang Min. Improvement of information-decision analysis[J]. Control and Decision, 1997, 12(4): 353-356.
27. Qiu Wan-hua, Gao Jian-wei. The entropy-Bayes decision making model of information value risky analysis[J]. Systems Engineering Theory and Practice, 2001, 21(8): 14-18.
28. Zhao Heng-feng, Qiu Wan-hua, Wang Bo, et al. An exante decision method of sampling information acquiring at prior information condition[J]. Control and Decision, 1998, 13(4): 289-294.
29. Yan Ji-ping, Qiu Wan-hua, Wei Cun-ping. The study of influence of the accuracy of information in Bayesian decision analysis[J]. Systems Engineering Theory and Practice, 2000, 20(7): 41-44.
30. Vetschera R. Entropy and the value of information[J]. Central European J of Operations Research, 2000, 8(3): 195-208.
31. Liu Shan-cun, Qiu Wan-hua. Further study on the evaluation of information by entropy[J]. Systems Engineering Theory and Practice, 1999, 19(11): 8-12.
32. Zhou R X, Chen X C, Ma Y H. The analysis of information sensitivity in entropy-Bayes decision[C]. ICIM 2006: Proc of the 8th Int Conf on Industrial Management. China Aviation Industry Press, 2006: 549-553.
33. Zhan Hao-ke, Jiang Li-ping. Bayesian estimation based on maximum entropy conjugate priors[J]. Operations Research and Management Science, 2002, 11(6): 27-31.
34. O'Hagan M. Aggregating template or rule antecedents in real-time expert systems with fuzzy, set logic[C]. Proc 22nd Annu IEEE Asilomar Conf on Signals, Systems, Computers. California, 1988: 681-689.
35. Filev D, Yager R R. Analytic properties of maximum entropy OWA operatorsp[J]. Information Sciences, 1995, 85(1): 11-27.
36. Fuller R, Majlender P. An analytic approach for obtaining maximal entropy OWA operator weights[J], Fuzzy Sets and Systems, 2001, 124(1): 53-57.
37. Majlender P. OWA operators with maximal Renyi entropy[J]. Fuzzy Sets and Systems, 2005, 155(3): 340-360.
38. Liu X W. On the maximum entropy parameterized interval approximation of fuzzy numbers[J]. Fuzzy Sets and Systems, 2006, 157(7): 869-878.
39. Kojadinovic I, Marichal J L. Entropy of bi-capacities[J]. European J of Operational Research, 2007, 178(1): 164-184.
40. Lei Gong-yan. A note on the application of relative entropy to analytic hierarchy process[J]. Systems Engineering Theory and Practice, 1995, 3(3): 65-68.
41. Qin Xue-zhi, Wang Xue-hua, Yang De-li. Some entropy methods for determining the uniformity of judgement matrix[J]. Systems Engineering, 1998, 16(5): 67-70.
42. You Tian-hui, Fan Zhi-ping, Yu Zhu-chao. Method of determining entropy weights on attributes in uncertain multiple attribute decision making[J]. J of Northeastern University, 2004, 25(6): 589-592.
43. You Tian-hui, Fan Zhi-ping. An error propagation method for assessing entropy weights in uncertain multiple attribute decision making[J]. Systems Engineering, 2003, 21(1): 101-103.
44. Wang Ze-yan, Gu Hong-fang, Yi Xiao-xin, et al. A method of determining the linear combination weights based on entropy[J], Systems Engineering Theory and Practice, 2003, 23(3): 111-115.
45. Huo Ying-bao, Han Zhi-jun. Research on giving weight for multi-indicator based on GME principle and GA[J]. Application of Statistics and Management, 2005, 24(3): 39-45.
46. Zhang Rui-qing, Qiu Wan-hua. An algorithm for a class of maximum entropy problems and its application[J]. Systems Engineering Theory and Practice, 1996, 16(11): 39-43.
47. Sun Di-hua, Liu Wei-ning, Song Wei. A model with the evaluation of the equilibrium of attribute indexes based on the relative entropy measuring[J]. Systems Engineering Theory and Practice, 2001, 21(6): 83-86.
48. He Da-yi, Qiu Wan-hua. Solving continuous stochastic decision-making problem under uncertainty by the maximum entropy formulism[J]. Systems Engineering Theory and Practice, 2002, 22(9): 97-100.
49. Shi Bao-chang, Chen Yang, Hu Xin-sheng. A maximum entropy method for multiobjective minimax problems and its convergence[J]. J of Huazhong University of Science and Technology, 1997, 25(1): 95-98.
50. Liu Shan-cun, Qiu Wan-hua, Wei Cun-ping. A maximum entropy method for solving bilevel multiple-objective decision making problem[J]. Systems Engineering Theory and Practice, 2000, 20(3): 99-103.
51. Liu Hai-yan, Chen Gao-bo, Peng Chuan. Solving multi-objective programming problems with maximal entropy method and genetic algorithm[J]. J of Southwest Jiaotong University, 2003, 38(1): 8-11.
52. Wang Hai-jun, Cao De-xin, Deng Ke-zhong. A maximum entropy algorithm for finding weak efficient solutions to multiobjective problems[J]. Systems Engineering, 2004, 22(5): 23-25.
53. Guo Chong-hui, Sun Jian-tao, Lu Yu-chang. Maximum entropy approach for generalized support vector machine optimization problems[J]. Systems Engineering Theory and Practice, 2005, 25(6): 27-32.
54. Levy W B, Delig H. Maximum entropy aggregation of individual opinions[J]. IEEE Trans on Systems, Man and Cybernetics, 1994, 24(4): 606-613.
55. Myung I J, Ramamoorti S, Bailey R D. Maximum entropy aggregation of expert predictions[J]. Management Science, 1996, 42(10): 1420-1436.
56. Qiu Wan-hua. An entropy model on group decision system[J]. Control and Decision, 1995, 10(1): 50-54.
57. Chen Ye-hua, Qiu Wan-hua. Maximum entropy method for optimizing multiobjective collaborative group decision[J]. Systems Engineering Theory and Practice, 1998, 18(9): 96-100.
58. Wei Cun-ping, Qiu Wan-hua, Yang Ji-ping. Minimum relative entropy aggregation model on group decision making[J]. Systems Engineering Theory and Practice, 1999, 19(8): 38-42.
59. Chen Hua-you, Liu Chun-lin. Relative entropy aggregation method in group decision making based on different types of preference information[J]. J of Southeast University, 2005, 35(2): 311-315.
60. Zhang Qi-shan, Li Xi-chun, Deng Ju-long. The grey entropy method in uncertainty decision[J]. Policymaking Reference, 1995, 11(6): 37-39.
61. Zhang Qi-shan, Guo Xi-jiang, Deng Ju-long. Grey relation entropy method of grey relation analysis[J]. Systems Engineering Theory and Practice, 1996, 16(8): 7-11.
62. Bi Jian-dong, Yang Gui-fang. Algorithm for merging of branches in decision tree induction[J]. J of Harbin Institute of Technology, 1997, 29(2): 44-46.
63. Li De-guang, Hu Yun-quan, Zhang Ming-li. Research on quantifying R and D experience uncertainty of space systems by applying Markov information source entropy[J]. Engineering Theory and Practice, 2001, 7(21): 96-100.
64. Wang Hong-wei, Li Chen, Liu Hui-xin. Entropic measurements of complexity for Markov decision processes[J]. Control and Decision, 2004, 19(9): 983-988.
65. Mi Chuan-min, Liu Si-feng, Dang Yao-guo, et al. Study on grey entropy weight clustering decisionmaking[J]. Systems Engineering and Electronics, 2006, 28(12): 1823-1825.