Mutual information theory for adaptive mixture models

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 23, Issue 4, 2001, Pages 396-403

  Yang, Zheng Rong ^b   Zwolinski, Mark ^a,c  

^a IEEE   (United Kingdom)

^b UNIVERSITY OF EXETER   (United Kingdom)

^c UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Adaptive mixtures; Entropy; Mutual information; Pattern recognition; Statistical dependence; Uncertainly

Indexed keywords

ADAPTIVE MIXTURE MODEL; MUTUAL INFORMATION THEORY; STATISTICAL DEPENDENCE; UNCERTAINTY;

ALGORITHMS; INFORMATION THEORY; MATHEMATICAL MODELS; NORMAL DISTRIBUTION; PROBABILITY DENSITY FUNCTION; STATISTICAL METHODS; UNCERTAIN SYSTEMS;

PATTERN RECOGNITION SYSTEMS;

EID: 0035306657     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.917574     Document Type: Article

References (29)

1. Using mutual information for selecting features in supervised neural net learning
2. Minimum class entropy: A maximum information approach to layered networks
3. Training stochastic model recognition algorithms as networks can lead to mutual information estimation of parameters
4. The consistency of a smoothed minimum distance estimate
5. Penalized minimum-distance estimates in finite mixture models
6. The estimation of the order of a mixture model
7. Independent coordinates for strange attractors from mutual information
8. The reduced parzen classifier
9. On estimating of the constitutes of a finite mixture of continuous distributions
10. An estimator for the number of components of finite mixtures and its applications
11. Nonparametric density estimation with a parametric start
12. Mutual information functions vs. Correlation functions
13. How to generate ordered maps by maximizing the mutual information between input and output signals
14. On estimation of a probability density function and mode
15. Adaptive mixture density estimation
16. Adaptive mixture density estimation
17. Adaptive mixtures
18. Practical bayesian density estimation using mixtures of normals
19. Statistical estimation of a mixture of Gaussian distributions
20. Mapping neural network derived from the parzen window estimator
21. The mathematical theory of communication
22. Prediction and entropy of printed English
23. Probabilistic neural networks for classification, mapping, or associative memory
24. Probabilistic neural networks
25. A general regression neural network
26. On convergence properties of the EM algorithm for Gaussian mixtures
27. Robust maximum likelihood training of probabilistic neural networks
28. Stochastic estimation of a mixture of normal density functions using an information criterion