Padmini: A peer-to-peer distributed astronomy data mining system and a case study

Proceedings of the 2010 Conference on Intelligent Data Understanding, CIDU 2010

Volumn , Issue , 2010, Pages 243-257

  Mahule, Tushar ^a   Borne, Kirk ^b   Dey, Sandipan ^a   Arora, Sugandha ^a   Kargupta, Hillol ^a,c  

^a UNIVERSITY OF MARYLAND BALTIMORE COUNTY   (United States)

^b GEORGE MASON UNIVERSITY   (United States)

^c Agnik LLC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS PROCESS; COMPUTE-INTENSIVE TASKS; DATA MINING SYSTEM; DISTRIBUTED DATA MINING ALGORITHMS; OUTLIER DETECTION; PEER TO PEER (P2P) NETWORK; VIRTUAL OBSERVATORY; WEB-BASED SYSTEM;

ALGORITHMS; ASTRONOMY; DATA MINING; NASA; PEER TO PEER NETWORKS; RESEARCH;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84893347805     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. 2MASS: Two Micron All Sky Survey. http://www.ipac.caltech.edu/2mass/ releases/allsky/.
2. The AUTON Project. http://www.autonlab.org/autonweb/showProject/3/.
3. K. Bhaduri, K. Das, K. Borne, C. Giannella, T. Mahule, and H. Kargupta. Distributed Change Point Detection for Mining Astronomy Data Streams. In review.
4. BlueGrit: A supercomputer located at UMBC in association with the Multicore Computational Center (MC2). http://bluegrit.cs.umbc.edu/.
5. K. Borne. A machine learning classification broker for the LSST transient database. In Astronomische Nachrichten, pages 255-258. Copyright 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim, 2008.
6. K. Borne. Scientific Data Mining in Astronomy. CRC Press: Taylor & Francis, Boca Raton, FL, 2009.
7. The ClassX Project: Classifying the High-Energy Universe. http://heasarc.gsfc.nasa.gov/classx/.
8. K. Das, K. Bhaduri, S. Arora, W. Griffin, K. D. Borne, C. Giannella, and H. Kargupta. Scalable Distributed Change Detection from Astronomy Data Streams Using Local, Asynchronous Eigen Monitoring Algorithms. In SDM, pages 245-156, 2009.
9. S. Datta, K. Bhaduri, C. Giannella, R. Wolff, and H. Kargupta. Distributed data mining in peer-to-peer networks. IEEE Internet Computing special issue on Distributed Data Mining, 10: 2006, 2006.
10. S. Datta, C. R. Giannella, and H. Kargupta. Approximate Distributed K-Means Clustering over a Peer-to-Peer Network. IEEE Transactions on Knowledge and Data Engineering, 21: 1372-1388, 2008.
11. Digital Dig - Data Mining in Astronomy. http://www.astrosociety.org/pubs/ ezine/datamining.html.
12. DDMT: Distributed data mining toolkit. http://www.umbc.edu/ddm/Software/ DDMT/.
13. J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. Communications of the ACM, 51(1): 107-113, 2008.
14. H. Dutta, C. Giannella, K. D. Borne, and H. Kargupta. Distributed Top-K Outlier Detection from Astronomy Catalogs using the DEMAC System. In SDM, 2007.
15. H. Dutta and H. Kargupta. Distributed Data Mining in Astronomy Databases, 2006. The 9th Workshop on Mining Scientific and Engineering Data Sets(held in conjunction with SDM 2006.
16. H. Dutta, X. Zhu, T. Mahule, H. Kargupta, K. Borne, C. Lauth, F. Holz, and G. Heyer. TagLearner: A P2P Classifier Learning System from Collaboratively Tagged Text Documents. In ICDMW '09: Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, pages 495-500, Washington, DC, USA, 2009. IEEE Computer Society.
17. Framework for Mining and Analysis of Space Science Data. http://www.itsc.uah.edu/f-mass/.
18. GALEX: Galaxy Evolution Explorer. http://galex.stsci.edu/GR4/.
19. C. Giannella, H. Dutta, K. Borne, R. Wolff, and H. Kargupta. Distributed Data Mining for Astronomy Catalogs. In SIAM International Conference on Data Mining (SDM), 2006.
20. GRIST: Grid Data Mining for Astronomy. http://grist.caltech.edu/.
21. Hadoop. http://hadoop.apache.org/.
22. International Virtual Observatory Alliance. http://www.ivoa.net/.
23. H. Kargupta, Byung-Hoon, D. Hershberger, and E. Johnson. Collective Data Mining: A New Perspective Toward Distributed Data Analysis. In Advances in Distributed and Parallel Knowledge Discovery, pages 133-184. AAAI/MIT Press, 1999.
24. H. Kargupta, W. Huang, K. Sivakumar, and E. Johnson. Distributed Clustering Using Collective Principal Component Analysis. Knowledge and Information Systems, 3: 2001, 1999.
25. H. Kargupta and K. Sivakumar. Existential pleasures of distributed data mining. Data Mining: Next Generation Challenges and Future Directions, pages 1-25, 2004.
26. LSST: Large Synoptic Survey Telescope. http://www.lsst.org/lsst.
27. P. Luo, H. Xiong, K. Liu, and Z. Shi. Distributed classification in peer-to-peer networks. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 968-976, New York, NY, USA, 2007. ACM.
28. T. Mahule, S. Arora, S. Dey, N. Kumar, X. Zhu, K. Borne, and H. Kargupta. PADMINI: A Peer-to-Peer Distributed Data Mining System for Astronomy Virtual Observatories. In review.
29. M. Mehyar, D. Spanos, J. Pongsajapan, S. Low, and R. Murray. Distributed Averaging on a Peer-to-Peer Network. In Proceedings of IEEE Conference on Decision and Control, 2005.
30. B.-H. Park and H. Kargupta. Distributed Data Mining: Algorithms, Systems, and Applications, 2002.
31. SDSS quasar dataset. http://astrostatistics.psu.edu/datasets/SDSSquasar. html.
32. Scientific Data Mining, Integration and Visualization Workshop. http://www.anc.ed.ac.uk/sdmiv/.
33. SDSS: Sloan Digital Sky Survey. http://www.sdss.org/.
34. US National Virtual Observatory. http://us-vo.org/.
35. WSDL: Web Services Description Language. http://www.w3.org/TR/wsdl.