Wallace's approach to unsupervised learning: The snob program

Computer Journal

Volumn 51, Issue 5, 2008, Pages 571-578

  Jorgensen, Murray A ^a   McLachlan, Geoffrey J ^b  

^a UNIVERSITY OF WAIKATO   (New Zealand)

^b UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Cluster analysis; Computer program; EM algorithm; Minimum message length; Mixture model

Indexed keywords

PROGRAMMING THEORY;

CLUSTER ANALYSIS; COMPUTER PROGRAM; EM ALGORITHM; MINIMUM MESSAGE LENGTH; MIXTURE MODEL;

POISSON DISTRIBUTION;

EID: 50949129543     PISSN: 00104620     EISSN: 14602067     Source Type: Journal    
DOI: 10.1093/comjnl/bxm121     Document Type: Article

References (33)

1. Wallace, C.S. and Boulton, D.M. (1968) An information measure for classification. Comput. J., 11, 185-194.
2. Boulton, D.M. and Wallace, C.S. (1970) A program for numerical classification. Comput. J., 13, 63-69.
3. Wolfe, J. (1965) A Computer Program for the Computation of Maximum Likelihood Analysis of Types. Research Memo SRM 65-12. U.S. Naval Personnel Research Activity, San Diego.
4. Wolfe, J. (1967) NORMIX: Computations for Estimating the Parameters of Multivariate Normal Mixtures of Distributions. Research Memo SRM 68-2. U.S. Naval Personnel Research Activity, San Diego.
5. Wolfe, J.H. (1970) Pattern clustering by multivariate mixture analysis. Multivariate Behav. Res., 5, 329-350.
6. Wolfe, J. (1971) A Monte Carlo Study of Sampling Distribution of the Likelihood Ratio for Mixtures Of Multi Normal Distributions. Technical Bulletin STB 672-2. U.S. Naval Personnel Research Activity, San Diego.
7. Hasselblad, V. (1966) Estimation of parameters for a mixture of normal distributions. Technometrics, 8, 431-444.
8. Hasselblad, V. (1969) Estimation of finite mixtures of distributions from the exponential family. J. Am. Statist. Assoc., 64, 1459-1471.
9. Day, N. (1969) Estimating the components of a mixture of two normal distributions. Biometrika, 56, 463-474.
10. Hartley, H. and Rao, J. (1968) Classification and estimation in analysis of variance problems, Int. Statist. Rev., 36, 141-147.
11. Scott, A.J. and Symons, M.J. (1971) Clustering methods based on likelihood ratio criteria. Biometries, 27, 387-397.
12. Anderberg, M.R.C. (1973) Cluster Analysis for Applications. Academic Press, New York.
13. Hartigan, J.A. (1975) Clustering Algorithms. Wiley, New York.
14. Wallace, C.S. (1986) An Improved Program for Classification. Proc. 9th Australian Computer Science Conf., pp. 357-366. Australian Computer Science Society.
15. Dempster, A.P., Laird, N.M. and Rubin, D.B. (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. Roy. Statist. Soc. Ser. B, 39, 1-38.
16. Banfield, J.D. and Raftery, A.E. (1993) Model-based Gaussian and non-Gaussian clustering. Biometries, 49, 803-821.
17. McLachlan, G.J. and Basford, K.E. (1988) Mixture Models: Inference and Applications to Clustering. Dekker, New York.
18. Wallace, C.S. (2005) Statistical and Inductive Inference by Minimum Message Length. Information Science and Statistics. Springer, New York.
19. McLachlan, G.J. and Krishnan, T. (1997) The EM Algorithm and Extensions. Wiley, New York.
20. Jorgensen, M.A. (2001) EM algorithm. In El-Shaarawi, A.H. and Piegorsch, W.W.(eds), Encyclopedia of Environmetrics, Vol. 2, pp. 637-653. Wiley, New York.
21. Wallace, C.S. (1984) An Improved Program for Classification. Technical Report 47. Department of Computer Science, Monash University, Melbourne.
22. McLachlan, G.J. and Peel, D. (2000) Finite Mixture Models. Wiley, New York.
23. Wallace, C.S. and Freeman, P.R. (1987) Estimation and inference by compact coding. J. Roy. Statist. Soc. Ser. B, 49, 240-252.
24. Conway, J.H. and Sloane, N.J.A. (1988) Sphere Packings, Lattices and Groups. Springer, London.
25. Bouguila, N. and Ziou, D. (2007) High-dimensional unsupervised selection and estimation of a finite generalized Dirichlet mixture model based on minimum message length. IEEE Trans. Pattern Anal. Mach. Intell., 29, 1716-1731.
26. Baxter, R.A. and Oliver, J.J. (2000) Finding overlapping components with MML. Stat. Comput., 10, 5-16.
27. Jorgensen, M.A. (2005) Minimum message length estimation using EM methods: A case study. Comput. Stat. Data Anal., 49, 147-167.
28. Wallace, C.S. and Freeman, P.R. (1992) Single factor analysis by minimum message length estimation. J. Roy. Statist. Soc. Ser. B, 54, 195-209.
29. Wallace, C.S. (1998) Intrinsic classification of spatially correlated data. Comput. J., 41, 602-411.
30. Visser, G. and Dowe, D.L. (2007) Minimum Message Length Clustering of Spatially-Correlated Data with Varying Inter-Class Penalties. Proc. 6th IEEE Int. Conf on Computer and Information Science (ICIS) y2007, 17-22.
31. Wallace, C.S. and Dowe, D.L. (2000) MML mixture modelling of multi-state, Poisson, von Mises circular and Gaussian distributions. Stat. Comput., 10, 73-83.
32. Agusta, Y. and Dowe, D.L. (2003) Unsupervised Learning of Correlated Multivariate Gaussian Mixture Models Using MML. In Gedeon, T.D. and Fung, L.C.C.(eds), Lecture Notes in Computer Science, Vol. 2903, pp. 477-489. Springer, New York.
33. Hunt, L.A. and Jorgensen, M.A. (1999) Mixture model clustering using the Multimix program. Aust. N. Z. J. Statist., 41, 901-919.