Sampling and Subsampling for Cluster Analysis in Data Mining: With Applications to Sky Survey Data

Data Mining and Knowledge Discovery

Volumn 7, Issue 2, 2003, Pages 215-232

  Rocke, David M ^a   Dai, Jian ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Clustering algorithm; Mixture likelihood; Sampling; Star galaxy classification

Indexed keywords

ALGORITHMS; DATA MINING; DATA REDUCTION; GALAXIES; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILITY DISTRIBUTIONS; SURVEYS; TREES (MATHEMATICS);

CLUSTER ANALYSIS; CLUSTERING; DATA SETS;

ASTRONOMY;

EID: 0037287745     PISSN: 13845810     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022497517599     Document Type: Article

References (33)

1. Banfield, J.D. and Raftery, A.E. 1993. Model-based Gaussian and non-Gaussian clustering. Biometrics, 49:803-821.
2. Battiti, R. and Tecchiolli, G. 1994. The reactive tabu search. ORSA Journal on Computing, 6:126-140.
3. Bradley, P.S. and Fayyad, U.M. 1998. Refining initial points for k-means clustering. In Proc. 15th Int. Conf. on Machine Learning, J. Shavlik (Ed). San Francisco: Morgan Kaufman, pp. 91-99.
4. Cheeseman, P. and Stutz, J. 1996. Bayesian classification (AutoClass): Theory and results. In Advances in Knowledge Discovery and Data Mining, U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy (Eds.). Cambridge, MA: The MIT Press, pp. 153-180.
5. Dasgupta, A. and Raftery, A. 1995. Detecting features in spatial point processes with clutter via model-based clustering. Technical Report No. 195, Department of Statistics, University of Washington.
6. Dempster, A.P., Laird, N.M., and Robin, D.B. 1977. Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society B, 39:1-38.
7. Everitt, B.S. and Hand, D.J. 1981. Finite Mixture Distributions. Monographs on Applied Probability and Statistics. New York, NY: Chapman and Hall Ltd.
8. Fayyad, U.M. 1997. "Editorial", Data Mining and Knowledge Discovery, 1:5-10.
9. Fayyad, U.M. 1991. On the induction of decision trees for multiple concept learning. Ph.D. Thesis, EECS Department. The University of Michigan, Ann Arbor.
10. Fayyad, U.M., Djorgovski, S.G., and Weir, N. 1996. Automating the analysis and cataloging of sky surveys. In Advances in Knowledge Discovery and Data Mining, U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, and R. Uthurusamy (Eds.). Cambridge, MA: The MIT Press, pp. 471-493.
11. Fayyad, U.M., Reina, C., and Bradley, P.S. 1998. Initialization of iterative refinement clustering algorithms. In Proc 4th Int. Conf. on Knowledge Discovery and Data Mining KDD-98, R. Agrawal, P. Stolorz, and G. Piatetsky-Shapiro (Eds.). Menlo Park, CA: AAAI Press, pp. 193-198.
12. Fraley, C. and Raftery, A.E. 1998. How many clusters? Which clustering method? Answers via model-based cluster analysis. Technical Report No. 329, Department of Statistics, University of Washington, Box 354322, Seattle, QA 98195-4322.
13. Hawkins, D.M. 1981. A new test for multivariate normality and homoscedasticity. Technometrics, 23:105-110.
14. Hawkins, D.M., Muller, M.W., and ten Krooden, J.A. 1982. Cluster analysis. In Topics in Applied Multivariate Analysis, D.M. Hawkins (Ed.). Cambridge: Cambridge University Press, pp. 303-356.
15. Kaufman, L. and Rousseeuw, P.J. 1990. Finding Groups in Data: An Introduction to Cluster Analysis. New York: John Wiley & Sons.
16. Kendall, M.G. and Stuart, A. 1963. The Advanced Theory of Statistics III. Griffin, London.
17. Kirkpaterick, S., Gelatt, J., and Vecchi, M.P. 1983. Optimization by simulated annealing. Science, 220:671-680.
18. McLachlan, G.J. 1987. On bootstrapping the likelihood ratio test statistic for the number of components in a normal mixture. Applied Statistics, 36:318-324.
19. McLachlan, G.J. and Basford, K. 1988. Mixture Models: Inference and Applications to Clustering. New York: Marcel Dekker.
20. McLachlan, G.J. and Krishnan, T. 1997. The EM Algorithm and Extensions. New York: John Wiley & Sons.
21. McLachlan, G.J. and Peel, D. 1998. MIXFIT: An algorithm for the automatic fitting and testing of normal mixture models. Center for Statistics, Department of Mathematics, University of Queensland, St. Lucia, Queensland 4072, Australia.
22. Odewahn, S.C., Djorgovski, S.G., Brunner, R.J., and Gal, R. 1998. Data from the digitized palomar sky survey. Department of Astronomy, California Institute of Technology, Pasadena, CA 91125.
23. Rocke, D.M. 1996. "Robustness properties of S-estimators of multivariate location and shape in high dimension. The Annals of Statistics, 24:1327-1345.
24. Rocke, D.M. 1998. Constructive Statistics: Estimators, Algorithms, and Asymptotics. Center for Image Processing and Integrated Computing, University of California, Davis, CA 95616.
25. Rocke, D.M. and Woodruff, D.L. 1996. Identification of outliers in multivariate data. Journal of the American Statistical Association, 91:1047-1061.
26. Rousseeuw, P.J. and Van Driessen, K. 1999. A fast algorithm for the minimum covariance determinant estimator. Techometrics, 41:212-223.
27. Smyth, P. 1996. Clustering using Monte Carlo cross-validation. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. Menlo Park, CA: AAAI Press.
28. Titterington, D.M., Smith, A.F.M., and Makov, U.E. 1985. Statistical Analysis of Finite Mixture Distributions.
29. Weir, N., Fayyad, U.M., and Djorgovski, S.G. 1995. Automated star/galaxy classification for digitized POSS-II. The Astronomical Journal, 109:2401-2414.
30. White, R.L. 1997. Object classification in astronomical images. In Statistical Challenges in Modern Astronomy II, G.J. Babu and E.D. Feigelson (Ed.). New York: Springer-Verlag, pp. 135-148.
31. Wolf, J. 1971. A Monte Carlo study of the sampling distribution of the likelihood ratio for mixtures of multinormal distributions. Technical Report STB 72-2, San Diego: U.S. Naval Personnel and Training Research Laboratory.
32. Woodruff, D.L. and Rocke, D.M. 1994. Computable robust estimation of multivariate location and shape in high dimension using compound estimators. Journal of the American Statistical Association, 89:888-896.
33. Wu, C.F.J. 1983. On convergence properties of the EM algorithm for Gaussian mixtures. Annals of Statistics, 11:95-103.