Maximising entropy on the nonparametric predictive inference model for multinomial data

European Journal of Operational Research

Volumn 212, Issue 1, 2011, Pages 112-122

  Abellán, Joaquín ^a   Baker, Rebecca M ^b   Coolen, Frank P A ^b  

^a UNIVERSITY OF GRANADA   (Spain)

^b DURHAM UNIVERSITY   (United Kingdom)

Author keywords

Entropy maximization; Imprecise probabilities; Nonparametric predictive inference; Uncertainty measures

Indexed keywords

CONVEX SET; ENTROPY MAXIMIZATION; IMPRECISE PROBABILITIES; LINEAR PROGRAMS; LOWER AND UPPER PROBABILITIES; MAXIMUM ENTROPY; MEASURE OF UNCERTAINTY; MULTINOMIAL DATA; NEW MODEL; NONPARAMETRIC PREDICTIVE INFERENCE; POLYHEDRAL SET; UNCERTAINTY MEASURES;

ALGORITHMS; DECISION MAKING; ENTROPY; FUNCTIONS; INFERENCE ENGINES; MATHEMATICAL MODELS; OPTIMIZATION; SET THEORY;

PROBABILITY DISTRIBUTIONS;

EID: 79952706236     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2011.01.020     Document Type: Article

References (43)

1. J. Abellán Uncertainty measures on probability intervals from Imprecise Dirichlet model International Journal of General Systems 35 5 2006 509 528 (Pubitemid 44728624)
2. J. Abellán Application of uncertainty measures on credal sets on the Naive Bayes classifier International Journal of General Systems 35 6 2006 675 686 (Pubitemid 44728620)
3. J. Abellán, and A. Masegosa Requirements for total uncertainty measures in Dempster-Shafer theory of evidence International Journal of General Systems 37 6 2008 733 747
4. J. Abellán, and A. Masegosa A filter-wrapper method to select variables for the Naive Bayes classifier based on credal decision trees International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 17 6 2009 833 854
5. J. Abellán, and A. Masegosa An ensemble method using credal decision trees European Journal of Operational Research 205 1 2010 218 226
6. J. Abellán, G.J. Klir, and S. Moral Disaggregated total uncertainty measure for credal sets International Journal of General Systems 35 1 2006 29 44 (Pubitemid 46508739)
7. J. Abellán, and S. Moral Maximum entropy for credal sets International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 11 5 2003 587 597
8. J. Abellán, and S. Moral Building classification trees using the total uncertainty criterion International Journal of Intelligent Systems 18 12 2003 1215 1225
9. J. Abellán, and S. Moral An algorithm that computes the upper entropy for order-2 capacities International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 14 2 2005 141 154
10. T. Augustin, and F.P.A. Coolen Nonparametric predictive inference and interval probability Journal of Statistical Planning and Inference 124 2 2004 251 272 (Pubitemid 38830077)
11. R.M. Baker, Multinomial Nonparametric Predictive Inference: Selection, Classification and Subcategory Data, PhD thesis, Durham University, 2010.
12. J.M. Bernard An introduction to the imprecise Dirichlet model for multinomial data International Journal of Approximate Reasoning 39 2005 123 150
13. L.M. De Campos, J.F. Huete, and S. Moral Probability intervals: A tool for uncertainty reasoning International Journal of Uncertainty, Fuzziness and Knowledge-Based System 2 1994 167 196
14. A. Chateauneuf, and J.Y. Jaffray Some characterizations of lower probabilities and other monotone capacities through the use of Möbius inversion Mathematical Social Sciences 17 1989 263 283
15. G. Choquet Théorie des Capacités Annales de l'Institute Fourier 5 1953/54 131 292
16. F.P.A. Coolen, International encyclopedia of statistical sciences, chapter nonparametric predictive inference, Springer, 2010.
17. F.P.A. Coolen, T. Augustin, Learning from multinomial data: A nonparametric predictive alternative to the imprecise Dirichlet model, in: F.G. Cozman, R. Nau, T. Seidenfeld (Eds.), ISIPTA'05, Proceedings of the 4th International Symposium on Imprecise Probabilities and Their Applications, Pittsburg, Pennsylvania, 2005, pp. 125-134.
18. F.P.A. Coolen, and T. Augustin A nonparametric predictive alternative to the Imprecise Dirichlet Model: The case of a known number of categories International Journal of Approximate Reasoning 50 2 2009 217 230
19. A.P. Dempster Upper and lower probabilities induced by a multivalued mapping The Annals of Mathematical Statistics 38 1967 325 339
20. M. Grabisch The interaction and Möbius representations of fuzzy measures on finite spaces, k-additive measures: A survey M. Grabisch, Fuzzy Measures and Integrals: Theory and Applications 2000 Springer-Verlag New York
21. D. Harmanec, and G.J. Klir Measuring total uncertainty in Dempster-Shafer Theory: A novel approach International Journal General System 22 1994 405 419
22. D. Harmanec, G. Resconi, G.J. Klir, and Y. Pan On the computation of uncertainty measure in Dempster-Shafer theory International Journal General System 25 2 1996 153 163 (Pubitemid 126601176)
23. R.V.L. Hartley Transmission of information The Bell Systems Technical Journal 7 1928 535 563
24. B.M. Hill Posterior distribution of percentiles: Bayes theorem for sampling from a population Journal of the American Statistical Association 63 322 1968 677 691
25. B.M. Hill de Finettis theorem, induction, and A(n) or Bayesian nonparametric predictive inference (with discussion) Bernardo Bayesian Statistics vol. 3 1988 Oxford University Press 211 241
26. E.T. Jaynes Information Theory and Statistical Mechanics Physical Review Series II 106 4 1957 620 630
27. E.T. Jaynes Information theory and statistical mechanics II Physical Review Series II 108 2 1957 171 190
28. E.T. Jaynes On the rationale of maximum-entropy methods Proceeding of the IEEE 70 9 1982 939 952
29. A.-L. Jousselme, C. Liu, D. Grenier, and É. Bossé Measuring ambiguity in the evidence theory IEEE Transactions on Systems Man and Cybernetics-Part A: Systems and Humans 36 5 2006 890 903
30. G.J. Klir Uncertainty and Information: Foundations of Generalized Information Theory 2006 John Wiley Hoboken, New Jersey
31. G.J. Klir, and H.W. Lewis Remarks on measuring ambiguity in the evidence theory IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans 38 4 2008 994 995
32. H.E. Kyburg Bayesian and non-Bayesian evidential updating Artificial Intelligence 31 1987 271 293
33. C. Liu, D. Grenier, A.-L. Jousselme, and É. Bossé Reducing algorithm complexity for computing an aggregate uncertainty measure IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans 37 5 2007 669 679 (Pubitemid 47323532)
34. A. Piatti, M. Zaffalon, F. Trojani, Limits of learning from Imperfect Observations under Prior Ignorance: The Case of the Imprecise Dirichlet Model, in: F.G. Cozman, R. Nau, T. Seidenfeld (Eds.), ISIPTA'05, Proceedings of the 4th International Symposium on Imprecise Probabilities and Their Applications, Pittsburg, Pennsylvania, 2005, pp. 176-186.
35. A. Rényi Probability Theory 1970 North-Holland Amsterdam
36. G. Shafer A Mathematical Theory of Evidence 1976 Princeton University Press Princeton
37. C.E. Shannon A mathematical theory of communication The Bell System Technical Journal 27 1948 379 423 623-656
38. V.N. Huynh, and Y. Nakamori Notes on reducing algorithm complexity for computing an aggregate uncertainty measure IEEE Transactions on Systems, Man and Cybernetics-Part A: Systems and Humans 40 1 2010 205 209
39. P. Walley Statistical Reasoning with Imprecise Probabilities 1991 Chapman and Hall London
40. P. Walley Inferences from multinomial data: Learning about a bag of marbles Journal of the Royal Statistical Society: Series B 58 1996 3 57
41. Z. Wang, and G.J. Klir Fuzzy Measure Theory 1992 Plenum Press New York
42. L. Wasserman, and J.B. Kadane Bayesian Analysis in Statistics and Econometrics 1996 Wiley New York
43. K. Weichselberger, Elementare Grundbegriffe einer allgemeineren Wahrscheinlichkeitsrechnung I. Intervalwahrscheinlichkeit als umfassendes Konzept, Physika, Heidelberg, 2001.