An approach for constructing complex discriminating surfaces based on Bayesian interference of the maximum entropy

Information Sciences

Volumn 163, Issue 4, 2004, Pages 275-291

  El Chakik, Fadi ^a   Shahine, Ahmad ^b   Jaam, Jihad ^c   Hasnah, Ahmad ^c  

^a Centre Universitaire de Technologie   (Lebanon)

^b NOTRE DAME UNIVERSITY   (Lebanon)

^c Qatar University   (Qatar)

Author keywords

Classification; Hebbian learning; Maximum entropy; Neural networks; Probability estimation

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; ENTROPY; LEARNING SYSTEMS; MATHEMATICAL MODELS; NEURAL NETWORKS; PROBABILITY DISTRIBUTIONS; SET THEORY; STATISTICS;

CLASSIFICATION; HEBBIAN LEARNING; MAXIMUM ENTROPY; PROBABILITY ESTIMATION;

INFORMATION SCIENCE;

EID: 2642514779     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2003.06.011     Document Type: Article

References (23)

1. Akaike H. On entropy maximisation principle. Krishniah P.R. Application of Statistics. 1977;27-42 North-Holland, Amsterdam.
2. Aizerman M.A., Braverman E.M., Rozonoer L.I. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control. 25:1964;821-837.
3. Bertero M. Regularizations methods for linear inverse problems. Talenti C.G. Inverse Problems. 1986;Springer-Verlag, Berlin.
4. P. Bessière, Un Possible Paradigme Synthétique pour le Connexionisme: l'Inférence Probabiliste, in: Proceedings of the NSI'90, 1990.
5. Bessière P. Toward a synthetic cognitive paradigm: probabilistic inference. Kohonen T., Fogelman-Soulié F. Cognitiva '90. 1990;Elsevier Science Publishers, Amsterdam.
6. Bishop C.M. Neural Networks for Pattern Recognition. 1995;Clarendon Press, Oxford.
7. Breiman L., Friedman J.H., Olshen R.A., Stone C.J. Classification and Regression Trees. 1984;Wadsworth and Brooks/Cole, Monterey, CA.
8. Buck B., Macaulay V.A. Maximum Entropy in Action. 1991;Clarendon Press, Oxford.
9. F. El Chakik, Maximum d'Entropie et Réseaux de Neurones pour la classification. Thesis INP, Grenoble/France, 1998.
10. Courant R., Hilbert D. Methods of Mathematical Physics. vol. 2:1962;Interscience, London England.
11. Duda R.O., Hart P.E. Pattern Classification and Scene Analysis. 1973;Wiley-Interscience, New York.
12. O. Gascuel, Symenu, Collective Paper (Gascuel O. coordinator) Technical Report, 5èmes Journées Nationales du PRC-IA Teknea, Nancy, 1995.
13. F. Girosi, M.E. Jones, T. Poggio, Priors, Stabilizers and basis functions: from regularization to radial, tensor and additive Splines, A.I. Memo, No. 1430 Artificial Intelligence Laboratory, Massachusetts Institute of Technology, 1993.
14. Evgeniou T., Pontil M., Poggio T. Regularization networks and support vector machines. Advances in Computational Mathematics. 13:2000.
15. Jaynes E.T. Where do we stand on maximum entropy. Levine R.D., Tribus M. The Maximum Entropy Formalism. 1982;MIT Press.
16. Jaynes E.T. On the rational of maximum entropy methods. Proc. IEEE. 70:1982;939-1952.
17. Kaptur J.N., Kesavan H.K. Generalized Maximum Entropy Principle (with Application). 1987;Sanford Education Press Waterloo, Canada.
18. Mikhlin S.G. The problem of the minimum of a quadratic functional. 1965;Holdem-Day, San Francisco, CA.
19. Morozov V.A. Methods for solving incorrectly posed problems. Talenti C.G. Inverse Problems. 1984;Springer-Verlag, Berlin.
20. Poggio T., Girosi F. Networks for approximation and learning. Proceedings of the IEEE. 78(9):1990;1481-1497.
21. Ripley B.D. Pattern Recognition And Neural Networks. 1996;Cambridge University Press.
22. Tikhonov A.N. Solution of incorrectly formulated problems and the regularized method. Soviet Mathematical Doklady. 4:1963;1035-1-38.
23. Tikhonov A.N., Arsenin V.Y. Solution of Ill-posed Problems. 1977;W.H. Wimston, Washington, DC.