Data mining using high performance data clouds: Experimental studies using sector and sphere

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2008, Pages 920-927

  Grossman, Robert ^a   Gu, Yunhong ^a  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

Cloud computing; Distributed data mining; High performance data mining

Indexed keywords

CLOUD COMPUTING; COMPUTER CLUSTERS; DISTRIBUTED DATA MINING; DISTRIBUTED DATUM; EXPERIMENTAL STUDIES; HIGH PERFORMANCE DATA MINING; HIGH PERFORMANCE NETWORKS; LARGE DATA SETS; PROGRAMMING PARADIGMS; STORAGE SERVICES; WIDE AREAS;

MINING; SPHERES; WIDE AREA NETWORKS;

KNOWLEDGE MANAGEMENT;

EID: 63149115819     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1401890.1402000     Document Type: Conference Paper

References (20)

1. Amazon. Amazon Simple Storage Service (Amazon S3). www.amazon.com/s3.
2. Jay Beale, Andrew R Baker, and Joel Esler. Snort IDS and IPS Toolkit. Syngress, 2007.
3. Dhruba Borthaku. The hadoop distributed file system: Architecture and design. retrieved from lucene.apache.org/hadoop, 2007.
4. Leo Breiman, Jerome H. Friedman, Richard A. Olshen, and Charles J. Stone. Classification and Regression Trees. Chapman and Hall, New York, 1984.
5. Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified data processing on large clusters. In OSDI'04: Sixth Symposium on Operating System Design and Implementation, 2004.
6. National Center for Data Mining at the University of Illinois at Chicago. The large data archives project.
7. Ian Foster and Carl Kesselman. The Grid 2: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco, California, 2004.
8. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung. The Google File System. In SOSP, 2003.
9. Jim Gray and Alexander S. Szalay. The world-wide telescope. Science, 293:2037-2040, 2001.
10. William Gropp, Ewing Lusk, and Anthony Skjellum. Using MPI: Portable Parallel Programming with the Message Passing Interface, 2nd Edition. MIT Press, 1999.
11. Robert L. Grossman and Yunhong Gu. Sc 2006 bandwidth challenge: National center for data mining - udt. retrieved from https://scinet.supercomp.org/2006/ bwc/graphs/challenge-ncdm.png, 2006.
12. Robert L Grossman, Michael Sabala, Yunhong Gu, Anushka Anand, Matt Handley, Rajmonda Sulo, and Lee Wilkinson. Distributed discovery in e-science: Lessons from the angle project. In Next Generation Data Mining (NGDM '07), 2008.
13. Yunhong Gu and Robert L. Grossman. UDT: UDP-based data transfer for high-speed wide area networks. Computer Networks, 51(7):1777-1799, 2007.
14. Yunhong Gu, Robert L. Grossman, Alex Szalay, and Ani Thakar. Distributing the sloan digital sky survey using udt and sector. In Proceedings of e-Science 2006, 2006.
15. Hillol Kargupta. Proceedings of Next Generation Data Mining 2007. Taylor and Francis, 2008.
16. Amazon Web Services LLC. Amazon web services developer connection, retrieved from developer.amazonwebservices.com on November 1, 2007.
17. John D. Owens, David Luebke, Naga Govindaraju, Mark Harris, Jens Kruger, Aaron E. Lefohn, and Timothy J.Purcell. A survey of general-purpose computation on graphics hardware. In Eurographics 2005, pages 21-51, 2005.
18. The Sector Project. Sector, a distributed storage and computing infrastructure, version 1.4.
19. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H Bolakrishnana. Chord: A scalable peer to peer lookup service for internet applications. In Proceedings of the ACM SIGCOMM '01, pages 149-160, 2001.
20. Hbose Development Team. Hbase: Bigtoble-like structured storage for hadoop hdfs. http://wiki.apache.org/lucene-hadoop/Hbase, 2007.