Simulating data to study performance of finite mixture modeling and clustering algorithms

Journal of Computational and Graphical Statistics

Volumn 19, Issue 2, 2010, Pages 354-376

  Maitra, Ranjan ^a   Melnykov, Volodymyr ^b  

^a Department of Statistics Center for Statistics and Applications in Forensic Evidence Iowa State University 2438 Osborn Dr Ames   (United States)

^b NORTH DAKOTA STATE UNIVERSITY   (United States)

Author keywords

Cluster overlap; Eccentricity of ellipsoid; Mclust; MixSim; Mixture distribution; Parallel distribution plots

Indexed keywords

EID: 77956705120     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/jcgs.2009.08054     Document Type: Article

References (42)

1. Anderson, E. (1935), "The Irises of the Gaspe Peninsula," Bulletin of the American Iris Society, 59, 2-5. [354,362]
2. Atlas, R., and Overall, J. (1994), "Comparative Evaluation of Two Superior Stopping Rules for Hierarchical Cluster Analysis," Psychometrika, 59, 581-591. [355]
3. Bartlett, M. S. (1939), "A Note on Tests of Significance in Multivariate Analysis," Proceedings of the Cambridge Philosophical Society, 35, 180-185. [358]
4. Biernacki, C, Celeux, G., and Govaert, G. (2003), "Choosing Starting Values for the EM Algorithm for Getting the Highest Likelihood in Multivariate Gaussian Mixture Models," Computational Statistics and Data Analysis, 413, 561-575. [370]
5. Blashfield, R. K. (1976), "Mixture Model Tests of Cluster Analysis-Accuracy of 4 Agglomerative Hierarchical Methods," Psychological Bulletin, 83, 377-388. [355]
6. Box, G. E. P., and Draper, N. R. (1987), Empirical Model-Building and Response Surfaces, New York: Wiley. [355]
7. Brodatz, P. (1966), A Photographic Album for Artists and Designers, New York: Dover. [354,362]
8. Campbell, N. A., and Mahon, R. J. (1974), "A Multivariate Study of Variation in Two Species of Rock Crab of Genus Leptograsus," Australian Journal of Zoology, 22, 417-425. [354,362]
9. Dasgupta, S. (1999), "Learning Mixtures of Gaussians," in Proc. IEEE Symposium on Foundations of Computer Science, Washington: IEEE Computer Society, pp. 633-644. [355,361]
10. Davies, R. (1980), "The Distribution of a Linear Combination of x Random Variables," Applied Statistics, 29, 323-333. [356,358,359]
11. Everitt, B. S., Landau, S., and Leesem, M. (2001), Cluster Analysis (4th ed.), New York: Hodder Arnold. [354]
12. Forina, M. (1991), PARVUS-An Extendible Package for Data Exploration, Classification and Correlation, Genoa, Italy: Institute of Pharmaceutical and Food Analysis and Technologies. [362]
13. Forsythe, G., Malcolm, M., and Moler, C. (1980), Computer Methods for Mathematical Computations, Moscow: Mir. [360]
14. Fraley, C, and Raftery, A. E. (2002), "Model-Based Clustering, Discriminant Analysis, and Density Estimation," Journal of the American Statistical Association, 97, 611-631. [354]
15. - (2006), "MCLUST Version 3 for R: Normal Mixture Modeling and Model-Based Clustering," Technical Report 504, University of Washington, Dept. of Statistics, Seattle, WA. [364,370]
16. Gold, E. M., and Hoffman, P. J. (1976), "Flange Detection Cluster Analysis," Multivariate Behavioral Research, 11, 217-235. [355]
17. Hartigan, J. (1985), "Statistical Theory in Clustering," Journal of Classification, 2, 63-76. [354]
18. Hubert, L., and Arabie, P. (1985), "Comparing Partitions," Journal of Classification, 2, 193-218. [362,364]
19. Inselberg, A. (1985), "The Plane With Parallel Coordinates," The Visual Computer, 1, 69-91. [368]
20. Kaufman, L., and Rousseuw, P. J. (1990), Finding Groups in Data, New York: Wiley. [354]
21. Kettenring, J. R. (2006), "The Practice of Cluster Analysis," Journal of Classification, 23, 3-30. [354]
22. Kuiper, F. K., and Fisher, L. (1975), "A Monte Carlo Comparison of Six Clustering Procedures," Biometrics, 31, 777-783. [355]
23. Likas, A., Vlassis, N., and Verbeek, J. J. (2003), "The Global £-Means Clustering Algorithm," Pattern Recognition, 36, 451-461. [355]
24. Maitra, R. (2009), "Initializing Partition-Optimization Algorithms," IEEE/ACM Transactions on Computational Biology and Bioinformatics, 6, 144-157. [355,361,370,371]
25. Maitra, R., and Ramler, I. P. (2009), "Clustering in the Presence of Scatter," Biometrics, 65, 341-352. [361]
26. McIntyre, R. M., and Blashfield, R. K. (1980), "A Nearest-Centroid Technique for Evaluating the Minimum-Variance Clustering Procedure," Multivariate Behavioral Research, 15, 225-238. [355]
27. McLachlan, G. J., and Basford, K. E. (1988), Mixture Models: Inference and Applications to Clustering, New York: Marcel Dekker. [354]
28. Milligan, G. W. (1985), "An Algorithm for Generating Artificial Test Clusters," Psychometrika, 50, 123-127. [355]
29. Murtagh, F. (1985), Multi-Dimensional Clustering Algorithms, Würzburg: Springer-Verlag. [354]
30. Nakai, K., and Kinehasa, M. (1991), "Expert System for Predicting Protein Localization Sites in Gram-Negative Bacteria," PROTEINS: Structure, Function, and Genetics, 11, 95-110. [362]
31. Newman, D. J., Hettich, S., Blake, C. L., and Merz, C. J. (1998), "UCI Repository of Machine Learning Databases," University of California, Irvine, Dept. of Information and Computer Sciences, available at http://www.ics.uci.edu/~mlearn/MLRepository.html. [362]
32. Press, S. J. (1966), "Linear Combinations of Non-Central Chi-Square Variates," Annals of Mathematical Statistics, 37, 480-487. [359]
33. Qiu, W., and Joe, H. (2006a), "Generation of Random Clusters With Specified Degree of Separation," Journal of Classification, 23, 315-334. [355,356]
34. - (2006b), "Separation Index and Partial Membership for Clustering," Computational Statistics and Data Analysis, 50, 585-603. [355]
35. Ramey, D. B. (1985), "Nonparametric Clustering Techniques," in Encyclopedia of Statistical Science, Vol. 6, New York: Wiley, pp. 318-319. [354]
36. Ruspini, E. (1970), "Numerical Methods for Fuzzy Clustering," Information Science, 2, 319-350. [354,362]
37. Slater, L. J. (1960), Confluent Hypergeometric Functions, London: Cambridge University Press. [359]
38. Steinley, D., and Henson, R. (2005), "OCLUS: An Analytic Method for Generating Clusters With Known Overlap," Journal of Classification, 22, 221-250. [355]
39. Tseng, G. C, and Wong, W H. (2005), "Tight Clustering: A Resampling-Based Approach for Identifying Stable and Tight Patterns in Data," Biometrics, 61, 10-16. [361]
40. Verbeek, J., Vlassis, N., and Nunnink, J. (2003), "A Variational EM Algorithm for Large-Scale Mixture Modeling," in Annual Conference of the Advanced School for Computing and Imaging, The Netherlands: University of Amsterdam, pp. 1-7. [355]
41. Waller, N. G, Underhill, J. M., and Kaiser, H. A. (1999), "A Method for Generating Simulated Plasmodes and Artificial Test Clusters With User-Defined Shape, Size, and Orientation," Multivariate Behavioral Research, 34, 123-142. [355]
42. Wegman, E. (1990), "Hyperdimensional Data Analysis Using Parallel Coordinates," Journal of the American Statistical Association, 85, 664-675. [368]