Speeding up the EM algorithm for mixture model-based segmentation of magnetic resonance images

Pattern Recognition

Volumn 37, Issue 8, 2004, Pages 1573-1589

  Ng, Shu Kay ^a   McLachlan, Geoffrey J ^a  

^a UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

EM algorithm; Hidden Markov random field; Image segmentation; Magnetic resonance imaging; Mixture models; Multiresolution kd trees; Sparse incremental EM algorithm; Statistical pattern recognition

Indexed keywords

BRAIN; IMAGE SEGMENTATION; MAGNETIC RESONANCE; MATHEMATICAL MODELS; PROBLEM SOLVING;

DATA SETS; MIXTURE MODELS;

PATTERN RECOGNITION;

IMAGE PROCESSING;

EID: 2642550607     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2004.02.012     Document Type: Article

References (33)

1. Jain A.K. Duin R.P.W. Mao J. Statistical pattern recognition: A review IEEE Trans. Pattern Anal. Mach. Intell. 22 1 2000 4-38
2. McKenna S.J. Gong S. Raja Y. Modelling facial colour and identity with Gaussian mixtures Pattern Recognition 31 12 1998 1883-1892
3. G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition, Wiley, New York, 1992 (Chapter 13).
4. Freund M. Hahnel S. Thomsen M. Sartor K. Treatment planning in severe scoliosis: The role of MRI Neuroradiology 43 6 2001 481-484
5. Cascino G.D. Jack C.R. Parisi J.E. Sharbrough F.W. Hirschorn K.A. Meyer F.B. Marsh W.R. O'Brien P.C. Magnetic resonance imaging-based volume studies in temporal lobe epilepsy: Pathological correlations Ann. Neurol. 30 1 1991 31-36
6. Wolf R.L. Alsop D.C. Levy-Reis I. Meyer P.T. Maldjian J.A. Gonzalez- Atavales J. French J.A. Alavi A. Detre J.A. Detection of mesial temporal lobe hypoperfusion in patients with temporal spin labeled lobe epilepsy by use of arterial perfusion MR imaging Am. J. Neurolradiol. 22 7 2001 1334-1341
7. Jancke L. Buchanan T.W. Lutz K. Shah N.J. Focused and nonfocused attention in verbal and emotional dichotic listening: An FMRI study Brain Lang. 78 3 2001 349-363
8. Stiller D. Gaschler-Markefski B. Baumgart F. Schindler F. Tempelmann C. Heinze H.J. Scheich H. Lateralized processing of speech prosodies in the temporal cortex: A 3-T functional magnetic resonance imaging study Magn. Reson. Mater. Phys. 5 4 1997 275-284
9. H.S. Choi, D.R. Haynor, Y. Kim, Multivariate tissue classification of MRI images for 3D volume reconstruction-a statistical approach, Proceedings SPIE Medical Imaging III: Image Processing, Vol. 1092, 1989, pp. 183-193.
10. Vannier M.W. Butterfield R.L. Jordan D. Murphy W.A. Levitt R.G. Gado M. Multispectral analysis of magnetic-resonance images Radiology 154 1 1985 221-224
11. G.J. McLachlan, S.K. Ng, G. Galloway, D. Wang, Clustering of magnetic resonance images, Proceedings of the American Statistical Association (Statistical Computing Section), American Statistical Association, Alexandria, VA, 1996, pp. 12-17.
12. Dempster A.P. Laird N.M. Rubin D.B. Maximum likelihood from incomplete data via the EM algorithm (with discussion) J. Roy. Stat. Soc. Ser. B 39 1 1977 1-38
13. Besag J.E. On the statistical analysis of dirty pictures (with discussion) J. Roy. Stat. Soc. Ser. B 48 3 1986 259-302
14. Celeux G. Forbes F. Peyrard N. EM procedures using mean field-like approximations for Markov model-based image segmentation Pattern Recognition 36 1 2003 131-144
15. Zhang J. Modestino J.W. Langan D.A. Maximum-likelihood parameter- estimation for unsupervised stochastic model-based image segmentation IEEE Trans. Image Process. 3 4 1994 404-420
16. McLachlan G.J. Krishnan T. The EM Algorithm and Extensions 1997 Wiley New York
17. A.W. Moore, Very fast EM-based mixture model clustering using multiresolution kd-tree, in: M.S. Kearns, S.A. Solla, D.A. Cohn (Eds.), Advances in Neural Information Processing Systems, Vol. 11, MIT Press, Cambridge, MA, 1999, pp. 543-549.
18. Neal R.M. Hinton G.E. A view of the EM algorithm that justifies incremental, sparse, and other variants Jordan M.I. Learning in Graphical Models 1998 355-368 Kluwer Dordrecht
19. McLachlan G.J. Peel D. Finite Mixture Models 2000 Wiley New York
20. Bradley P.S. Fayyad U.M. Reina C.A. Scaling EM (expectation-maximization) clustering to large databases, Technical Report No. MSR-TR-98-35 (revised February, 1999) 1998 Microsoft Research Seattle
21. Thiesson B. Meek C. Heckerman D. Accelerating EM for large databases Mach. Learning 45 3 2001 279-299
22. Ng S.K. McLachlan G.J. On the choice of the number of blocks with the incremental EM algorithm for the fitting of normal mixtures Stat. Comput. 13 1 2003 45-55
23. Priebe C.E. Marchette D.J. Adaptive mixture density estimation Pattern Recognition 26 5 1993 771-785
24. Kanungo T. Mount D.M. Netanyahu N.S. Piatko C.D. Silverman R. Wu A.Y. An efficient k-means clustering algorithm: Analysis and implementation IEEE Trans. Pattern Anal. Mach. Intell. 24 7 2002 881-892
25. Pelleg D. Moore A.W. Accelerating exact k-means algorithms with geometric reasoning Chaudhuri S. Madigan D. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1999 277-281 ACM Press New York
26. A. McCallum, K. Nigam, L.H. Ungar, Efficient clustering of high- dimensional data sets with application to reference matching, Proceeding of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery, New York, 2000, pp. 169-178.
27. Liang Z. MacFall J.R. Harrington D.P. Parameter estimation and tissue segmentation from multispectral MR images IEEE Trans. Med. Imaging 13 3 1994 441-449
28. S.J. Nowlan, Soft competitive adaptation: Neural network learning algorithms based on fitting statistical mixtures, Ph.D. Thesis, School of Computer Science, Carnegie Mellon University, Pittsburgh, 1991.
29. Kochar S.C. Korwar R. On random sampling without replacement from a finite population Ann. Inst. Statist. Math. 53 3 2001 631-646
30. Mettu R.R. Plaxton C.G. Optimal time bounds for approximate clustering Darwiche A. Friedman N. Proceedings of the 18th Conference in Uncertainty in Artificial Intelligence 2002 344-351 Morgan Kaufmann San Francisco
31. Sand P. Moore A.W. Repairing faulty mixture models using density estimation Brodley C.E. Danyluk A.P. Proceedings of the 18th International Conference on Machine Learning 2001 457-464 Morgan Kaufmann San Francisco
32. Jimenez L.O. Landgrebe D.A. Hyperspectral data analysis and supervised feature reduction via projection pursuit IEEE Trans. Geosci. Remote 37 6 1999 2653-2667
33. Dasgupta S. Experiments with random projection Boutillier C. Goldszmidt M. Proceedings of the 16th Conference in Uncertainty in Artificial Intelligence 2000 143-151 Morgan Kaufmann San Francisco