Gaussian mixtures and their applications to signal processing

Advanced Signal Processing Handbook: Theory and Implementation for Radar, Sonar, and Medical Imaging Real Time Systems

Volumn , Issue , 2000, Pages

  Plataniotis, Kostantinos N ^a   Hatzinakos, Dimitris ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85027435700     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (81)

1. D.M. Tittirington, A.F.M. Smith, and U.F. Makov, Statistical Analysis of Finite Distributions, Wiley, New York, 1985.
2. G.J. McLachlam and K.E. Basford, Mixture Models: Inference and Applications to Clustering, Marcel Dekker, New York, 1988.
3. B.S. Everitt and D.J. Hand, Finite Mixture Distributions, Chapman & Hall, London, 1981.
4. R.O. Duda and P.E. Hart, Pattern Recognition and Scene Analysis, Wiley, New York, 1973.
5. E.A. Patrick, Fundamentals of Pattern Recognition, Prentice-Hall, Englewood Cliffs, NJ, 1972.
6. R.S. Bucy and P.D. Joseph, Filtering for Stochastic Process with Application to Guidance, Interscience, New York, 1968.
7. J. Koreyaar, Mathematical Methods, Vol. 1, pp 330-333, Academic Press, New York, 1968.
8. W. Feller, An Introduction to Probability and Its Applications, Vol. 2, p. 249, John Wiley & Sons, New York, 1966.
9. M. Aitkin and D.B. Rubin, Estimation and hypothesis testing in finite mixture models, J. R. Stat. Soc. B, 47, 67-75, 1985.
10. K.E. Basford and G.J. MacLachlan, Likelihood estimation with normal mixture models, Appl. Stat., 34, 282-289, 1985.
11. J. Behboodian, On a mixture of normal distributions, Biometrika, 57, 215-217, 1970.
12. J.G. Fryer and C.A. Robertson, A comparison of some methods for estimating mixed normal distributions, Biometrika, 59, 639-648, 1972.
13. A.S. Zeevi and R. Meir, Density estimation through convex combination of densities: Approximation and estimation bounds, Neural Networks, 10(1), 99-109, 1997.
14. S.S. Gupta and W.T. Huang, On mixtures of distributions: A survey and some new results on ranking and selection, Sankhya Ser. B, 43, 245-290, 1981.
15. V. Husselblad, Estimation of finite mixtures of distributions from exponential family, J. Am. Stat. Assoc., 64, 1459-1471, 1969.
16. R.J. Hathaway, Another interpretation of the EM algorithm for mixture distributions, Stat. Probability Lett., 4, 53-56.
17. R.A. Maronna, Robust M-estimators of multivariate location and scatter, Ann. Stat., 4, 51-67, 1976.
18. R.A. Render and H.F. Walker, Mixture densities, maximum likelihood and the EM algorithm, SIAM Rev., 26(2), 195-293, 1984.
19. T. Hastie and R. Tibshirani, Discriminant analysis by Gaussian mixtures, J. R. Stat. Soc. B, 58(1), 155-176, January 1996.
20. S.J. Yakowitz and J.D. Sprangins, On the identifiability of finite mixtures, Ann. Math. Stat., 39, 209-214, 1968.
21. S.J. Yakowitz, Unsupervised learning and the identification of finite mixtures, IEEE Trans. Inf. Theory, IT-16, 258-263, 1970.
22. S.J. Yakowitz, A consistent estimator for the identification of finite mixtures, Ann. Math. Stat., 40, 1728-1735, 1968.
23. H.G.C. Traven, A neural network approach to statistical pattern classification by semiparametric estimation of probability density function, IEEE Trans. Neural Networks, 2(3), 366-377, 1991.
24. H. Amindavar and J.A. Ritchey, Pade approximations of probability functions, IEEE Trans. Aerosp. Electron. Syst., AES-30, 416-424, 1994.
25. D.F. Specht, Probabilistic neural networks, Neural Networks, 3, 109-118, 1990.
26. T.Y. Young and G. Copaluppi, Stochastic estimation of a mixture of normal density functions using an information criterion, IEEE Trans. Inf. Theory, IT-16, 258-263, 1970.
27. J.C. Rajapakse, J.N. Gieldd, and J.L. Rapaport, Statistical approach to segmentation of singlechannel cerebral MR images, IEEE Trans. Med. Imaging, 16(2), 176-186, 1997.
28. P. Schroeter, J.M. Vesin, T. Langenberger, and R. Meuli, Robust parameter estimation of intensity distributions for brain magnetic resonance images, IEEE Trans. Med. Imaging, 27(2), 172-186, 1998.
29. J.C. Rajapakse and F. Kruggel, Segmentation of MR images with intensity inhomogeneities, Image Vision Comput., 16(3), 165-180, 1998.
30. S.G. Sanjay and T.J. Hebert, Bayesian pixel classification using spatially variant finite mixtures and the generalized EM algorithm, IEEE Trans. Image Process., 7(7), 1024-1028, 1998.
31. H. Teicher, Identifiability of finite mixtures, Ann. Stat., 34, 1265-1269, 1963.
32. A. P. Dempster, N.M. Laird, and D.B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J.R. Stat. Soc. B, 39, 1-38, 1977.
33. T.K. Moon, The expectation-maximization algorithm, IEEE Signal Process. Mag., 16(2), 47-60, 1997.
34. C.E. Priebe, Adaptive mixtures, J. Am. Stat. Assoc., 89, 796-806, 1994.
35. J. Diebolt and C. Robert, Estimation of finite mixture distributions through Bayesian sampling, J. R. Stat. Soc. B, 56, 363-375, 1994.
36. M. Escobar and M. West, Bayesian density estimation and inference using mixtures, J. Am. Stat. Assoc., 90, 577-588, 1995.
37. D.M. Titterington, Some recent research in the analysis of mixture distribution, Statistics, 21, 619-640, 1990.
38. P. McKenzie and M. Alder, Initializing the EM algorithm for use in Gaussian mixture modelling, in Pattern Recognition in Practice IV, E.S. Gelsema and L.N. Kanal, Eds., Elsevier Science, New York, pp 91-105, 1994.
39. A. Witkin, Scale space filtering, Proc. Int. J. Conf. Artificial Intelligence, IJCAI-83, 1019-1022, 1983.
40. M.J. Carlotto, Histogram analysis using a scale space approach, IEEE Trans. Pattern Recognition Mach. Intelligence, PAMI-9(1), 121-129, 1987.
41. A. Goshtasby and W.D. O’Neill, Curve fitting by a sum of Gaussians’, Graphical Models Image Process., 56(4), 281-288, 1994.
42. G. Celeux and J. Diebolt, The SEM algorithm: A probabilistic teacher algorithm derived from the EM algorithm for the mixture problem, Computat. Stat. Q., 2, 35-52, 1986.
43. H.H. Bock, Probability models and hypotheses testing in partitioning cluster analysis, in Clustering and Classification, P. Arabie, L.J. Hubert, and G. DeSoete, Eds., pp 377-453, World Scientific Publishers, Singapore, 1996.
44. J.L. Solka, W.L. Poston, E.J. Wegman, and B.C. Wallet, A new iterative adaptive mixture type estimator, Proc. 28th Symp. Interface, in press.
45. C.E. Priebe and D.M. Marchette, Adaptive mixtures: Recursive nonparametric pattern recognition, Pattern Recognition, 24, 1197-1209, 1991.
46. D.B. Cooper and P.W. Cooper, Nonsupervised adaptive signal detection and pattern recognition, Inf. Control, 7, 416-444, 1964.
47. B.S. Everitt, Graphical Techniques for Multivariate Data, Heinemann, London, 1978.
48. R.S. Bucy, Liner and non-linear filtering, Proc. IEEE, 58, 854-864, 1970.
49. D.G. Lainiotis, Partitioning: A unifying framework for adaptive systems I: Estimation, Proc. IEEE, 64, 1126-1143, 1976.
50. R.S. Bucy and K.D. Senne, Digital synthesis of non-linear filters, Automatica, 7, 287-298, 1971.
51. H.W. Sorenson and D.L. Alspach, Recursive Bayesian estimation using Gaussian sums, Automatica, 7, 465-479, 1971.
52. H.W. Sorenson and A.R. Stubberud, Nonlinear filtering by approximation of a-posteriori density, Int. J. Control, 18, 33-51, 1968.
53. T. Numera and A.R. Stubberud, Gaussian sum approximation for non-linear fixed point prediction, Int. J. Control, 38, 1047-1053, 1983.
54. D.L. Alspach, Gaussian sum approximations in nonlinear filtering and control, Inf. Sci., 7, 271-290, 1974.
55. T.S. Rao and M. Yar, Linear and non-linear filters for linear, but non-Gaussian processes, Int. J. Control, 39, 235-246, 1983.
56. D. Lerro and Y. Bar-Shalom, Tracking with debiased consistent converted measurements versus EKF, IEEE Trans Aerosp. Electron. Syst., 29(3), 1015-1022, 1993.
57. W.-I. Tam, K.N. Plataniotis, and D. Hatzinakos, An adaptive Gaussian sum algorithm for target tracking, Signal Process., 77(1), 85-104, August 1999.
58. R. Vijayan and H.V. Poor, Nonlinear techniques for interference suppression in spread-spectrum systems, IEEE Trans. Commun., COM-38, 1060-1065, 1990.
59. K.S. Vastola, Threshold detection in narrowband non-Gaussian noise, IEEE Trans. Commun., COM-32, 134-139, 1984.
60. L.M. Garth and H.V. Poor, Narrowband interference suppression in impulsive environment, IEEE Trans. Aerosp. Electron. Syst., AES-28, 15-33, 1992.
61. C.J. Masreliez, Approximate non-Gaussian filtering with linear state and observation relations, IEEE Trans. Autom. Control, AC-20, 107-110, 1975.
62. W.R. Wu and A. Kundu, Recursive filtering with non-Gaussian noises, IEEE Trans. Signal Process., 44(4), 1454-1468, 1996.
63. W.R. Wu and P.P. Cheng, A nonlinear IMM algorithm for maneuvering target tracking, IEEE Trans. Aerosp. Electron. Syst., AES-30, 875-885, 1994.
64. G.A. Hewer, R.D. Martin, and J. Zeh, Robust preprocessing for Kalman filtering of glint noise, IEEE Trans. Aerosp. Electron. Syst., AES-23, 120-128, 1987.
65. Z.M. Durovic and B.D. Kovacevic, QQ-plot approach to robust Kalman filtering, Int. J. of Control, 61(4), 837-857, 1994.
66. A.R. Webb, Functional approximation by feed-forward networks: A least squares approach to generalization, IEEE Trans. Neural Networks, 5, 363-371, 1994.
67. J. Mooddy and C.J. Darken, Fast learning in networks of locally-tuned processing units, Neural Computat., 1, 281-294, 1989.
68. L. Jin, M.M. Gupta, and P.N. Nikiforuk, Neural networks and fuzzy basis functions for functional approximation, in Fuzzy Logic and Intelligent Systems, H. Li and M.M. Gupta, Eds., Kluwer Academic Publishers, Dordrecht, 1996.
69. T. Poggio and F. Girosi, Networks for approximation and learning, Proc. IEEE, 78, 1481-1497, 1990.
70. D.A. Cohn, Z. Ghrahramani, and M.I. Jordan, Active learning with statistical models, J. Artificial Intelligence Res., 4, 129-145, 1996.
71. M.I. Jordan and C.M. Bishop, Neural Networks, A.I. Memo No. 1562, Massachusetts Institute of Technology, Boston, 1996.
72. B. Mulgrew, Applying radial basis functions, IEEE Signal Process. Mag., 13(2), 50-65, 1996.
73. H.M. Kim and J.M. Mendel, Fuzzy basis functions: Comparisons with other basis functions, IEEE Trans. Fuzzy Syst., 3, 158-168, 1995.
74. A. Jepson and M. Black, Mixture Models for Image Representation, Technical Report ARK96-PUB-54, Department of Computer Science, University of Toronto, Canada, March 1996.
75. P. Kontkane, P. Myllymaki, and H. Tirri, Predictive data mining with finite mixtures, in Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining, IEEE Computer Society Press, Portland, OR, pp 176-182, 1996.
76. I. Caballero, C.J. Pantaleon-Prieto, and A. Artes-Rodriguez, Sparce deconvolution using adaptive mixed-Gaussian models, Signal Process., 54, 161-172, 1996.
77. Y. Zhao, X. Zhuang, and S.J. Ting, Gaussian mixture density modeling of non-Gaussian source for autoregressive process, IEEE Trans. Signal Process., 43(4), 894-903, 1995.
78. J. Park and I.W. Sandberg, Universal approximation using radial-basis function networks, Neural Computat., 3, 246-257, 1991.
79. I. Cha and S.A. Kassam, Gaussian-mixture basis function networks for nonlinear signal processing, Proc. 1995 Workshop Nonlinear Signal Process., 1, 44-47, 1995.
80. I. Cha and S.A. Kassam, RBNF restoration of nonlinear degraded images, IEEE Trans Image Process., 5(6), 964-975, 1996.
81. R.A. Render, R.J. Hathaway, and J.C. Bezdeck, Estimating the parameters of mixture models with modal estimators, Commun. Stat. Part A: Theory and Methods, 16, 2639-2660, 1987.