Cluster analysis of massive datasets in astronomy

Statistics and Computing

Volumn 17, Issue 3, 2007, Pages 253-262

  Jang, Woncheol ^a   Hendry, Martin ^b  

^a UNIVERSITY OF GEORGIA   (United States)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Clustering; Density contour cluster; Fast Fourier transform; Level set

Indexed keywords

EID: 34547868556     PISSN: 09603174     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11222-007-9027-x     Document Type: Article

References (43)

1. Bahcall, N., et al.: The cluster mass function from early Sloan digital sky survey data: cosmological implications. Astrophys. J. 585, 182-190 (2003)
2. Báillo, A., Cuesta-Albertos, J.A., Cuevas, A.: Convergence rates in nonparametric estimation of level sets. Stat. Probab. Lett. 53, 27-35 (2001)
3. Chaudhuri, A.R., Basu, A., Bhandari, S., Chaudhuri, B.: An efficient approach, to consistent set estimation. Sankhyā Ser. B 61, 496-513 (1999)
4. Cole, S., Hatton, S., Weinberg, D.H., Frenk, C.S.: Mock 2df and sdss galaxy redshift surveys. Mon. Not. Roy. Astron. Soc. 300, 945-966 (1998)
5. Cooray, A., Sheth, R.K.: Halo models of large scale structure. Phys. Rep. 372, 1-129 (2002)
6. Cuevas, A., Fraiman, R.: A. plugin approach to support estimation. Ann. Stat. 25, 2300-2312 (1997)
7. Cuevas, A., Rodriguez-Casal, A.: On boundary estimation. Adv. Appl. Probab. 36, 340-354 (2004)
8. Cuevas, A., Febrero, M., Fraiman, R.: Estimating the number of clusters. Can. J. Stat. 28, 367-382 (2000)
9. Cuevas, A., Febrero, M., Fraiman, R.: Cluster analysis: a further approach based on density estimation. Comput. Stat. Data Anal. 36, 441-459 (2001)
10. Dekel, A., Lahav, O.: Stochastic non-linear galaxy biasing. Astrophys. J. 520, 24-34 (1999)
11. Devroye, L., Wise, G.: Detection of abnormal behavior via nonparametric estimation of the support. SIAM J. Appl. Math. 38, 480-488 (1980)
12. Dodelson, S.: Modern Cosmology. Academic, New York (2003)
13. Fraley, C., Raftery, A.: Model-based clustering, discriminant analysis, and density estimation. J. Am. Stat. Assoc. 97, 611-631 (2002)
14. Genovese, C.R., Miller, C.J., Nichol, R.C., Arjunwadkar, M., Wasserman, L.: Nonparametric inference for the cosmic microwave background. Stat. Sci. 19, 308-321 (2004)
15. Gray, A., Moore, A.: Rapid evaluation of multiple density models. Artif. Intell. Stat. (2003)
16. Hall, P., Wand, M.: On the accuracy of binned kernel density estimators. J. Multivar. Anal. 56, 165-184 (1996)
17. Hartigan, J.: Clustering Algorithms. Wiley, New York (1975)
18. Hartigan, J.: Statistical clustering. Tech. Rep., Department of Statistics, Yale University (2000)
19. Jang, W.: Nonparametric density estimation and galaxy clustering. In: Statistical Challenges in Astronomy, pp. 443-445. Springer, New York (2003)
20. Jang, W.: Nonparametric density estimation and clustering in astronomical sky surveys. Comput. Stat. Data Anal. 50, 760-774 (2006)
21. Jang, W., Genovese, C., Wasserman, L.: Nonparametric confidence sets for densities. Tech. Rep. 795, Department of Statistics, Carnegie Mellon University (2004)
22. Kaiser, N.: Clustering in real space and in redshift space. Mon. Not. Roy. Astron. Soc. 227, 1-21 (1987)
23. Korostelev, A., Tsybakov, A.: Minimax Theory of Image Reconstruction. Springer, New York (1993)
24. Martínez, V, Saar, E.: Statistics of the Galaxy Distribution. Chapman and Hall, London (2002)
25. McLachlan, G., Peel, D.: Finite Mixture Model. Wiley, New York (2000)
26. Moore, A.: Very fast em-based mixture model clustering using multiresolution kd-trees. In: Advances in Neural Information Processing Systems, pp. 543-549 (1999)
27. Narasimhan, G., Zhu, J., Zachariasen, M.: Experiments with computing geometric minimum, spanning trees. In: Proceedings of ALENEX'00. Lecture Notes in Computer Science, pp. 183-196. Springer, New York (2000)
28. Nichol, R.: Private communication (2006)
29. Nichol, R.C, Connolly, A.J., Moore, A.W., Schneider, J., Genovese, C., Wasserman, L.: Computational AstroStatistics: fast algorithms and efficient statistics for density estimation in large astronomical datasets. In: Proceedings of Virtual Observatories of the Future. ASP Conference Series, vol. 225, p. 265. San Francisco (2001)
30. Parkinson, D., Mukherjee, P., Liddle, A.R.: Bayesian model selection analysis of WMAP3. Phys. Rev. D 73, 123523 (2006)
31. Press, W.H., Schechter, P.: Formation of galaxies and clusters of galaxies by self-similar gravitational condensation. Astrophys. J. 187, 425-438 (1974)
32. R Development Core Team: R: a language and environment for statistical computing. R Foundation for Statistical Computing, http://www.R-project.org (2006)
33. m? Astrophys. J. 518, 521-532 (1999)
34. Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice-Hall, Upper Saddle River (2002)
35. Scott, C.D., Nowak, R.D.: Learning minimum volume sets. J. Mach. Learn. Res. 7, 665-704 (2006)
36. Silverman, B.W.: Algorithm AS 176: Kernel density estimation using the fast Fourier transform. Appl. Stat. 31, 93-99 (1982)
37. Steinwart, I., Hush, D., Scovel, C.: A classification framework for anomaly detection. J. Mach. Learn. Res. 6, 211-232 (2005)
38. Stuetzle, W.: Estimating the cluster tree of a density by analyzing the minimal spanning tree of a sample. J. Classif. 20, 25-47 (2003)
39. Wand, M.: Fast computation of multivariate kernel estimators. J. Comput. Graph. Stat. 3, 433-445 (1994)
40. Wand, M., Jones, M.: Kernel Smoothing. Chapman and Hall, London (1995)
41. Willett, R., Nowak, R.: Minimax optimal level set estimation. Unpublished manuscript, http://www.ee.duke/edu/~willett/ (2006)
42. Wong, W.-K., Moore, A.: Efficient algorithms for non-parametric clustering with clutter. Comput. Sci. Stat. 34, 541-553 (2002)
43. Zhou, R., Hansen, E.A.: A breadth-first approach to memory-efficient graph search. In: Proceedings of the 21st National Conference on Artificial Intelligence (AAAI-06), Boston, MA (2006)