Data mapping by probabilistic modular networks and information-theoretic criteria

IEEE Transactions on Signal Processing

Volumn 46, Issue 12, 1998, Pages 3378-3397

  Wang, Yue ^a   Lin, Shang Hung ^a   Li, Huai ^a   Kung, Sun Yuan ^a  

^a Catholic University of America ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATA PROCESSING; DATABASE SYSTEMS; MATHEMATICAL TECHNIQUES; OBJECT RECOGNITION;

DATA MAPPING;

INFORMATION THEORY;

EID: 0032301582     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/78.735311     Document Type: Article

References (41)

1. L. Perlovsky and M. McManus, "Maximum likelihood neural networks for sensor fusion and adaptive classification," Neural Networks, vol. 4, pp. 89-102, 1991.
2. H. Gish, "A probabilistic approach to the understanding and training of neural network classifiers," in Proc. IEEE Intl. Conf. Acoust., Speech, Signal Process., 1990, pp. 1361-1364.
3. D. M. Titterington, A. F. M. Smith, and U. E. Markov, Statistical Analysis of Finite Mixture Distributions. New York: Wiley, 1985.
4. Y. Wang, "Database mapping by mixture of experts in computer-aided diagnosis," Tech. Rep., Georgetown Univ. Med. Cent., Washington, DC, July 1996.
5. S. Y. Kung and J. S. Taur, "Decision-based neural networks with signal/image classification applications," IEEE Trans. Neural Networks, vol. 1, pp. 170-181, Jan. 1995.
6. S. H. Lin, S. Y. Kung, and L. J. Lin, "Face recognition/detection by probabilistic decision-based neural network," IEEE Trans. Neural Networks, Special Issue on Artificial Neural Networks and Pattern Recognition, vol. 8, Jan. 1997.
7. H. Li et al., "Detection of masses on mammograms using advanced segmentation techniques and an HMOE classifier," in Proc. 3rd Int. Workshop Digital Mammography, Chicago, IL, June 1996, pp. 397-4100.
8. P. Santago and H. D. Gage, "Quantification of MR brain images by mixture density and partial volume modeling," IEEE Trans. Med. Imag., vol. 12, pp. 566-574, Sept. 1993.
9. A. J. Worth and D. N. Kennedy, "Segmentation of magnetic resonance brain images using analog constraint satisfaction neural networks," Inform. Process. Med. Imag., pp. 225-243, 1993.
10. D. P. Helmbold, R. E. Schapire, Y. Singer, and M. K. Warmuth, "A comparison of new and old algorithms for a mixture estimation problem," Tech. Rep., Univ. Calif., Santa Cruz and AT&T Lab., 1996.
11. E. Weinstein, M. Feder, and A. V. Oppenheim, "Sequential algorithms for parameter estimation based on the Kullback-Leibler information measure," IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1652-1654, Sept. 1990.
12. Y. Wang and T. Adali, "Efficient learning of finite normal mixtures for image quantification," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Atlanta, GA, 1996, pp. 3422-3425.
13. F. S. Samaria and A. C. Harter, "Parameterization of a stochastic model for human face identification," in Proc. IEEE Workshop Appl. Comput. Vision, Sarasota, FL, 1994.
14. S. Lawrence, C. L. Giles, A. C. Tsoi, and A. D. Back, "Face recognition: A convolutional neural network approach," Tech. Rep., NEC Res. Inst., 1995.
15. F. S. Saramia, "Face recognition using hidden markov model," Ph.D. dissertation, Univ. Cambridge, Cambridge, U.K., 1994.
16. M. Turk and A. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, pp. 71-86, 1991.
17. M. I. Jordan and R. A. Jacobs, "Hierarchical mixture of experts and the EM algorithm," Neural Comput., vol. 6, pp. 181-214, 1994.
18. C. E. Priebe, "Adaptive mixtures," J. Amer. Stat. Assoc., vol. 89, no. 427, pp. 910-912, 1994.
19. R. A. Redner and N. M. Walker, "Mixture densities, maximum likelihood and the EM algorithm," SIAM Rev., vol. 26, pp. 195-239, 1984.
20. R. M. Neal and G. E. Hinton, "A new view of the EM algorithm that justifies incremental and other variants," Biometrika, 1993.
21. L. Xu and M. I. Jordan, "On convergence properties of the EM algorithm for Gaussian mixture," Tech. Rep., Artif. Intell. Lab., Mass. Inst. Technol, Cambridge, Jan. 1995.
22. J. L. Marroquin and F. Girosi, "Some extensions of the K-means algorithm for image segmentation and pattern classification," Tech. Rep., Artif. Intell. Lab., Mass. Inst. Technol, Cambridge, Jan. 1993.
23. D. M. Titterington, "Comments on 'application of the conditional population-mixture model to image segmentation,'" IEEE Trans. Pattern Anal. Machine Intell, vol. PAMI-6, pp. 656-658, Sept. 1984.
24. Y. Wang and T. Adali, "Probabilistic neural networks for parameter quantification in medical image analysis," Biomed. Eng. Recent Development, 1994.
25. J. L. Marroquin, "Measure fields for function approximation," IEEE Trans. Neural Networks, vol. 6, pp. 1081-1090, May 1995.
26. J. H. Friedman, "On bias, variance, 0/1-loss, and the curse-of-dimensionality," Tech. Rep., Stanford Univ., Stanford, CA, 1996.
27. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Automat. Contr., vol. AC-19, Dec. 1974.
28. J. Rissanen, "A universal prior for integers and estimation by minimum description length," A. Stat., vol. 11, no. 2, 1983.
29. E. T. Jaynes, "Information theory and statistical mechanics," Phys. Rev., vol. 108, no. 2, pp. 620-630/171-190, May 1957.
30. J. Rissanen, "Minimax entropy estimation of models for vector processes," Syst. Identification: Advances Case Studies, pp. 97-119, 1987.
31. S. Geman, E. Bienenstock, and R. Doursat, "Neural networks and the bias/variance dilemma," Neural Comput., vol. 4, pp. 1-52, 1992.
32. Y. Wang, "Image quantification and the minimum conditional bias/variance criterion," in Proc. 30th Conf. Inform. Sci. Syst., Princeton, NJ, Mar. 20-22, 1996, pp. 1061-1064.
33. L. I. Perlovsky, "Cramer-Rao bounds for the estimation of normal mixtures," Pattern Recognit. Lett., vol. 10, pp. 141-148, 1989.
34. J. Zhang and J. M. Modestino, "A model-fitting approach to cluster validation with application to stochastic model-based image segmentation," IEEE Trans. Pattern Anal. Machine Intell, vol. 12, pp. 1009-1017, Oct. 1990.
35. R. A. Jacobs, "Increased rates of convergence through learning rate adaptation," Neural Networks, vol. 1, pp. 295-307, 1988.
36. S. Haykin, Neural Networks: A Comprehensive Foundation. New York: MacMillan, 1994.
37. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
38. H. V. Poor, An Introduction to Signal Detection and Estimation. New York: Springer-Verlag, 1988.
39. A. S. Pandya and R. B. Macy, Pattern Recognition with Neural Networks in C++. Boca Raton, EL: CRC, 1996.
40. R. Gray and L. Davisson, Random Processes-A Mathematical Approach for Engineers. Englewood Cliffs, NJ: Prentice-Hall, 1986.
41. M. J. Blanchi, A. Rios, and M. Kabuka, "An algorithm for detection of masses, skin contours, and enhancement of microcalcifications in mammograms," in Proc. Comput.-Assisted Radial., Winston-Salem, NC, June 1994, pp. 57-64.