On potts model clustering, kernel k-means, and density estimation

Journal of Computational and Graphical Statistics

Volumn 17, Issue 3, 2008, Pages 629-658

  Murua, Alejandro ^a   Stanberry, Larissa ^b   Stuetzle, Werner ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Consensus clusters; Gene expression; Monte Carlo; Multiway normalized cut; Penalized Wolff algorithm; Superparamagnetic method

Indexed keywords

EID: 53549094708     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186008X318855     Document Type: Article

References (59)

1. Abramson, I. S. (1982), "On Bandwidth Variation in Kernel Estimates - A Square Root Law," The Annals of Statistics, 10, 1217-1223.
2. Agrawal, H., and Domany, E. (2003), "Potts Ferromagnets on Coexpressed Gene Networks: Identifying Maximally Stable Partitions," Physical Review Letters, 90, 158102.
3. Azzalini, A., and Bowman, A. W. (1990), "A Look at Some Data on the Old Faithful Geyser," Applied Statistics, 39, 357-365.
4. Banfield, J. D., and Raftery, A. E. (1993), "Model-Based Gaussian and Non-Gaussian Clustering," Biometrics, 49, 803-821.
5. Blatt, M., Wiseman, S., and Domany, E. (1996a), "Super-Paramagnetic Clustering of Data," Physical Review Letters, 76, 3251-3255.
6. (1996b), "Clustering Data Through an Analogy to the Potts Model," in Advances in Neural Information Processing Systems, eds. D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, Cambridge: MIT Press, pp. 416-422.
7. (1997), "Data Clustering Using a Model Granular Magnet," Neural Computation, 9, 1805-1842.
8. Breiman, L., Meisel, W., and Purcell, E. (1977), "Variable Kernel Estimates of Multivariate Densities," Techno metrics, 19, 135-144.
9. Buta, R. (1987), "The Structure and Dynamics of Ringed Galaxies, III: Surface Photometry and Kinematics of the Ringed Nonbarred Spiral NGC7531," The Astrophysical Journal Supplement Series, 64, 1-37.
10. Celeux, G., and Govaert, G. (1995), "Gaussian Parsimonious Clustering Models," Pattern Recognition, 28, 781-793.
11. Chambers, J. M., and Hastie, T. J. (eds.) (1992), "Statistical Models in S," Pacific Grove, CA: Wadsworth and Brooks, p. 352.
12. Creutz, M. (1979), "Confinement and the Critical Dimensionality of Space-Time," Physics Review Letters, 43, 553-556.
13. Cho, R. J., Campbell, M. J., Winzeler, E. A., Steinmetz, L., Conway, A., Wodicka, L., Wolfsberg, T. G., Gabrielian, A. E., Landsman, D., Lockhart, D. J., and Davis, R. W. (1998), "A Genome-Wide Transcriptional Analysis of the Mitotic Cell Cycle," Molecular Cell, 2, 65-73.
14. Dhillon, I. S., Guan, Y., and Kulis, B. (2004), "Kernel k-means, Spectral Clustering and Normalized Cuts," in Proceedings of the Tenth ACM SIGKDD International Conference, pp. 551-556.
15. Dimitriadou, E., Weingessel, A., and Hornik, K. (2001), "Voting-Merging: An Ensemble Method for Clustering," in Proceedings of the International Conference on Artificial Neural Networks, pp. 217-224.
16. Domany, E. (2003), "Cluster Analysis of Gene Expression Data," Journal of Statistical Physics, 110 (3-6), 1117.
17. Domany, E., Blatt, M., Gdalyahu, Y., and Weinshall, D. (1999), "Superparamagnetic Clustering of Data: Application to Computer Vision," Computer Physics Communications, 121-122, 5-12.
18. Dudoit, S., and Fridlyand, J. (2003), "Bagging to Improve the Accuracy of a Clustering Procedure," Bioinfor matics, 19, 1090-1099.
19. Edwards, R. G., and Sokal, A. D. (1988), "Generalization of the Fortuin-Kasteleyn-Swendsen-Wang Representation and Monte Carlo Algorithm," Physical Review D, 38, 2009-2012.
20. Einav, U., Tabach, Y., Getz, G., Yitzhaky, A., Ozbek, U., Amarglio, N., Izraeli, S., Rechavi, G., and Domany, E. (2005), "Gene Expression Analysis Reveals a Strong Signature of an Interferon-Unduced Pathway in Childhood Lymphoblastic Leukemia as Well as in Breast and Ovarian Cancer," Oncogene, 24, 6367-6375.
21. Eisen, M.B., Spellman, P.T., Brown, P.O., and Botstein D. (1998), "Cluster Analysis and Display of Genome-Wide Expression Patterns," PNAS, 95, 14863-14868.
22. Fern, X. Z., and Brodley, C. E. (2003), "Random Projection for High Dimensional Data Clustering: A Cluster Ensemble Approach," in Proceedings of the 20th International Conference on Machine Learning, 186-193.
23. Fred, A. L. N., and Jain, A. K. (2002), "Data Clustering Using Evidence Accumulation," in Proceedings of the 16th International Conference Pattern Recognition, pp. 276-280.
24. Geman, S., and Geman, D. (1984), "Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
25. Getz, G., Levine, E., Domany, E., and Zhang, M. (2000), "Super-Paramagnetic Clustering of Yeast Gene Expression Profiles," Physica A, 279 (1-4), 457-464.
26. Geyer, C. J. (1991), "Markov Chain Monte Carlo Maximum Likelihood," in in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, ed. E. M. Keramigas, pp. 156-163.
27. Geyer, C. J., and Thompson, E. A. (1995), "Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference," Journal of the American Statistical Association, 90, 909-920.
28. Girolami, M. (2002), "Mercer Kernel Based Clustering in Feature Space," IEEE Transactions on Neural Networks, 13, 669-688.
29. Grenander, U. (1983), "Tutorial on Pattern Theory," Technical Report, Division of Applied Mathematics, Brown University.
30. Hastings, W. K. (1970), "Monte Carlo Sampling Methods using Markov Chains and their Applications," Biometrika, 57, 97-109.
31. Hubert, L., and Arabie, P. (1985), "Comparing Partitions," Journal of Classification, 2, 193-218.
32. Kent Ridge Bio-Medical Dataset Repository, available online at http://sdmc.lit.org.sg/GEDatasets/Datasets.html.
33. Marinari, E., and Parisi, G. (1992), "Simulated Tempering: A New Monte Carlo Scheme," Europhysics Letters, 19, 451.
34. McKinney, S. (1995), "Autopaint: A Toolkit for Visualizing Data in 4 or more Dimensions," unpublished PhD Thesis, University of Washington, Seattle.
35. Meila, M., and Xu, L (2003), "Multiway Cuts and Spectral Clustering," Technical Report, University of Washington, Seattle.
36. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., and Teller, E. (1953), "Equations of State Calculations by Fast Computing Machines," Journal of Chemical Physics, 21, 1087-1092.
37. Milligan, G. W, and Cooper, M. C. (1986), "A Study of the Comparability of External Criteria for Hierarchical Cluster Analysis," Multivariate behavioral Research, 21, 441-458.
38. Ott, T., Kern, A., Schuffenhauer, A., Popov, M., Acklin, P., Jacoby, E., and Stoop, R. (2004), "Sequential Superparamagnetic Clustering for Unbiased Classification of High-Dimensional Chemical Data," Journal of Chemical Information and Computer Sciences, 44, 1358-1364.
39. Ott, T., Kern, A., Steeb, W., and Stoop, R. (2005), "Sequential Clustering: Tracking Down the Most Natural Clusters," Journal of Statistical Mechanics: Theory and Experiment, 11, P11014.
40. Quiroga, R. Q., Nadasdy, Z., and Ben-Shaul, Y. (2004), "Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering," Neural Computation, 16, 1661-1687.
41. Rand, W. M. (1971), "Objective Criteria for the Evaluation of Clustering Methods," Journal of the American Statistical Association, 66, 846-850.
42. Reichardt, J., and Bornholdt, S. (2004), "Detecting Fuzzy Community Structures in Complex Networks with a Potts Model," Physical Review Letters, 93, 218701.
43. Shi, J., and Malik, J. (2000), "Normalized Cuts and Image Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 888-905.
44. Silverman, B. W. (1986), Density Estimation for Statistics and Data Analysis, London: Chapman and Hall.
45. Sokal, A. D. (1996), "Monte Carlo Methods in Statistical Mechanics: Foundations and New Algorithms," Lectures at the Cargese Summer School on Functional Integration: Basics and Applications.
46. Stanberry, L., Murua, A., and Cordes, D. (2007), "Functional Connectivity Mapping using the Ferromagnetic Potts Spin Model," Human Brain Mapping, 29, 422-440.
47. Stanberry, L., Nandy, R., and Cordes, D. (2003), "Cluster Analysis of fMRI Data using Dendrogram Sharpening," Human Brain Mapping, 20, 201-219.
48. Swendsen, R. H., and Wang, J. S. (1987), Physical Review Letters, 58, 86.
49. Tantrum, J., Murua, A., and Stuetzle, W. (2003), "Assessment and Pruning of Hierarchical Model Based Clustering," KDD 2003, Washington, DC, USA.
50. (2004), "Hierarchical Model-Based Clustering of Large Datasets through Fractionation and Refractionation," Information Systems, 29, 315-326.
51. Topchy, A., Jain, A. K., and Punch, W. (2005), "Clustering Ensembles: Models of Consensus and Weak Partitions," IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1866-1881.
52. Tukey, J. W. (1949), "Comparing Individual Means in the Analysis of Variance," Biometrics, 5, 99-114.
53. Wang, S., and Swendsen, R. H. (1990), "Cluster Monte Carlo Algorithms," Physica A, 167, 565-579.
54. Wiseman, S., Blatt, M., and Domany, E. (1998), "Superparamagnetic Clustering of Data," Physical Review E, 57, 3767-3783.
55. Wolff, U. (1989), "Collective Monte Carlo Updating for Spin Systems," Physical Review Letters, 62, 361-364.
56. Yeoh, E. J., Ross, M. E., Shurtleff, S. A., Williams, W. K., Patel, D., Mahfouz, R., Behm, F. G., Raimondi, S. C., Relling, M. V., Patel, A., Cheng, C., Campana, D., Wilkins, D., Zhou, X., Li, J., Liu, H., Pui, C. H., Evans, W. E., Naeve, C., Wong, L., and Downing, J. R. (2002), "Classification, Subtype Discovery, and Prediction of Outcome in Pediatric Acute Lymphoblastic Leukemia by Gene Expression Profiling," Cancer Cell, 1, 133-143.
57. Yeung, K. Y., Fraley, C., Murua, A., Raftery, A. E., and Ruzzo, W. L. (2001), "Model-Based Clustering and Data Transformations for Gene Expression Data," Bioinformatics, 17, 977-987.
58. Yu, S. X., and Shi, J. (2003), "Multiclass Spectral Clustering," International Conference on Computer Vision, 2003.
59. Zhang, R., and Rudnicky, A. I. (2002), "A Large Scale Clustering Scheme for Kernel K-means," in Proceedings of the 16th International Conference Pattern Recognition, pp. 289-292.