FreeCycles - Efficient data distribution for volunteer computing

Proceedings of the 4th International Workshop on Cloud Data and Platforms, CloudDP 2014

Volumn , Issue , 2014, Pages

  Bruno, Rodrigo ^a   Ferreira, Paulo ^a  

^a INSTITUTO SUPERIOR TÉCNICO   (Portugal)

Author keywords

BitTorrent; Data Distribution; MapReduce; Volunteer Computing

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS;

BIT TORRENTS; COMPUTATIONAL POWER; DATA AVAILABILITY; DATA DISTRIBUTION; LARGE SCALE INTERNET; MAP-REDUCE; PROGRAMMING PARADIGMS; VOLUNTEER COMPUTING;

DIGITAL STORAGE;

EID: 84899754811     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2592784.2592788     Document Type: Conference Paper

References (21)

1. A. Alexandrov, M. Ibel, K. Schauser, and C. Scheiman. Superweb: towards a global web-based parallel computing infrastructure. In Parallel Processing Symposium, 1997. Proceedings., 11th International, pages 100-106, 1997.
2. D. Anderson. Boinc: a system for public-resource computing and storage. In Grid Computing, 2004. Proceedings. Fifth IEEE/ACM International Workshop on, pages 4-10, 2004.
3. A. Baratloo, M. Karaul, Z. Kedem, and P. Wijckoff. Charlotte: Metacomputing on the web. Future Generation Computer Systems, 1999. ISSN 0167-739X.
4. A. Chakravarti, G. Baumgartner, and M. Lauria. The organic grid: self-organizing computation on a peer-to-peer network. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, 2005. ISSN 1083-4427.
5. L. Cherkasova and J. Lee. Fastreplica: Efficient large file distribution within content delivery networks. In USENIX Symposium on Internet Technologies and Systems, 2003.
6. F. Costa, L. Veiga, and P. Ferreira. Internet-scale support for map-reduce processing. Journal of Internet Services and Applications, 2013. ISSN 1867-4828.
7. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, Jan. 2008. ISSN 0001-0782.
8. D. T. Fabrizio Marozzo and P. Trunfio. Adapting mapreduce for dynamic environments using a peer-to-peer model, 2008.
9. G. Fedak, C. Germain, V. Neri, and F. Cappello. Xtremweb: a generic global computing system. In Cluster Computing and the Grid, 2001. Proceedings. First IEEE/ACM International Symposium on, pages 582-587, 2001.
10. G. Fedak, H. He, and F. Cappello. Bitdew: A data management and distribution service with multi-protocol file transfer and metadata abstraction. Journal of Network and Computer Applications, 2009. ISSN 1084-8045.
11. S. Y. Ko, I. Hoque, B. Cho, and I. Gupta. Making cloud intermediate data fault-tolerant. In Proceedings of the 1st ACM symposium on Cloud computing, pages 181-192. ACM, 2010.
12. H. Lin, X. Ma, J. Archuleta, W.-c. Feng, M. Gardner, and Z. Zhang. Moon: Mapreduce on opportunistic environments. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing, HPDC '10, pages 95-106, New York, NY, USA, 2010. ACM. ISBN 978-1-60558-942-8.
13. V. Lo, D. Zappala, D. Zhou, Y. Liu, and S. Zhao. Cluster computing on the fly: P2p scheduling of idle cycles in the internet. In Peer-to-Peer Systems III, pages 227-236. Springer, 2005.
14. J. Pouwelse, P. Garbacki, D. Epema, and H. Sips. The ittorrent p2p file-sharing system: Measurements and analysis. In Peer-to-Peer Systems IV, pages 205-216. Springer, 2005.
15. L. F. Sarmenta and S. Hirano. Bayanihan: building and studying web-based volunteer computing systems using java. Future Generation Computer Systems. ISSN 0167-739X.
16. M. Silberstein, A. Sharov, D. Geiger, and A. Schuster. Gridbot: execution of bags of tasks in multiple grids. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC '09, pages 11:1-11:12, New York, NY, USA, 2009. ACM. ISBN 978-1-60558-744-8.
17. B. Tang, M. Moca, S. Chevalier, H. He, and G. Fedak. Towards mapreduce for desktop grid computing. In P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2010 International Conference on, pages 193-200, 2010.
18. D. Thain, T. Tannenbaum, and M. Livny. Distributed computing in practice: the condor experience. Concurrency and Computation: Practice and Experience, 2005. ISSN 1532-0634.
19. B. Wei, G. Fedak, and F. Cappello. Scheduling independent tasks sharing large data distributed with bittorrent. In Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing, pages 219-226. IEEE Computer Society, 2005.
20. B. Wei, G. Fedak, and F. Cappello. Towards efficient data distribution on computational desktop grids with bittorrent. Future Generation Computer Systems, 2007.
21. T. White. Hadoop: the definitive guide. O'Reilly, 2012.