The geometry of prior selection

Neurocomputing

Volumn 67, Issue 1-4 SUPPL., 2005, Pages 214-244

  Snoussi, Hichem ^a,b  

^a ECOLE CENTRALE DE NANTES   (France)

^b UNIVERSITÉ DE TECHNOLOGIE DE TROYES   (France)

Author keywords

Bayesian learning; Blind source separation; Differential geometry; Mixture of Gaussians; Prior selection

Indexed keywords

BLIND SOURCE SEPARATION; CLASSIFICATION (OF INFORMATION); DIFFERENTIATION (CALCULUS); ERROR ANALYSIS; LEARNING SYSTEMS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING; VARIATIONAL TECHNIQUES;

BAYESIAN LEARNING FRAMEWORK; DATA SPACE; DECISION ERRORS;

COMPUTATIONAL GEOMETRY;

ARTICLE; BAYES THEOREM; COMPUTER MODEL; GEOMETRY; LEARNING; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NORMAL DISTRIBUTION; PRIORITY JOURNAL; PROBABILITY; SYSTEM ANALYSIS;

EID: 21744457127     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2004.11.038     Document Type: Article

References (15)

1. S. Amari, Differential-Geometrical Methods in Statistics, Springer Lecture Notes in Statistics, vol. 28, Springer, New York, 1985.
2. S. Amari, H. Nagaoka, Methods of information geometry, in: Translations of Mathematical Monographs, vol. 191, 2000, AMS, Oxford University Press, Oxford.
3. V. Balasubramanian, A geometric formulation of Occam's razor for inference of parametric distributions, Technical Report, Princeton, Preprint PUPT-1588 and http://xyz.lanl.gov/adap-org/9601001, January 1996.
4. V. Balasubramanian, Statistical inference, Occam's razor and statistical mechanics on the space of probability distributions, Neural Comput. 9(2) (1997) (cond-mat/9601030).
5. G.E.P. Box G.C. Tiao Bayesian Inference in Statistical Analysis 1972 Addison-Wesley Reading, MA
6. R.E. Kass, L. Wasserman, Formal rules for selecting prior distributions: a review and annotated bibliography, Technical Report No. 583, Department of Statistics, Carnegie Mellon University, 1994.
7. K. Knuth A Bayesian approach to source separation in: Proceedings of Independent Component Analysis Workshop 1999 283-288
8. A. Mohammad-Djafari A Bayesian approach to source separation in: J.R.G. Erikson C. Smith (Eds.), Bayesian Inference and Maximum Entropy Methods, Boise, ih, MaxEnt Workshops July 1999 Amer. Inst. Physics New York
9. C. Rodríguez, Entropic priors, Technical Report, Electronic form http://omega.albany.edu:8008/entpriors.ps, 1991.
10. C. Rodríguez Entropic priors for discrete probabilistic networks and for mixtures of Gaussians models in: R.L. Fry (Ed.), Bayesian Inference and Maximum Entropy Methods, MaxEnt Workshops August 2001 Amer. Inst. Physics New York 410-432
11. H. Snoussi A. Mohammad-Djafari Penalized maximum likelihood for multivariate Gaussian mixture in: R.L. Fry (Ed.), Bayesian Inference and Maximum Entropy Methods, MaxEnt Workshops August 2001 Amer. Inst. Physics New York 36-46
12. H. Snoussi A. Mohammad-Djafari Information geometry and prior selection in: C. Williams (Ed.), Bayesian Inference and Maximum Entropy Methods, MaxEnt Workshops August 2002 Amer. Inst. Physics New York 307-327
13. H. Snoussi, A. Mohammad-Djafari, MCMC joint separation and segmentation of hidden Markov fields, in: Neural Networks for Signal Processing XII, IEEE Workshop, September 2002, pp. 485-494.
14. H. Zhu R. Rohwer Bayesian invariant measurements of generalisation Neural Proc. Lett. 2 6 1995 28-31
15. H. Zhu, R. Rohwer, Bayesian invariant measurements of generalisation for continuous distributions, Technical Report, NCRG/4352, ftp://cs.aston.ac.uk/neural/zhuh/continuous.ps.z, Aston University, 1995.