Optimizing data distribution in desktop grid platforms

Parallel Processing Letters

Volumn 18, Issue 3, 2008, Pages 391-410

  Costa, Fernando ^a   Silva, Luis ^a   Fedak, Gilles ^b   Kelley, Ian ^c  

^a UNIVERSITY OF COIMBRA   (Portugal)

^b UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur   (France)

^c CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

BitTorrent; BOINC; Content distribution network; Data distribution; Desktop grids; Peer to peer

Indexed keywords

COMPUTER NETWORKS; DISTRIBUTED COMPUTER SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; DISTRIBUTION OF GOODS; TELECOMMUNICATION SYSTEMS;

BITTORRENT; BOINC; CONTENT DISTRIBUTION NETWORK; DATA DISTRIBUTION; DESKTOP GRIDS; PEER-TO-PEER;

NETWORK PROTOCOLS;

EID: 56049109084     PISSN: 01296264     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129626408003466     Document Type: Article

References (31)

1. David Anderson, BOINC: A System for Public-Resource Computing and Storage, In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA, November 2004.
2. Berkeley Open Infrastructure for Network Computing (BOINC). See web site at: http://boinc.berkeley.edu/.
3. H. Balakrishnan, F. Dabek, M.F. Kaashoek, D.R. Karger, D. Liben-Nowell, R. Morris, and I. Stoica, Chord: a scalable peer-to-peer lookup protocol for Internet applications, Networking, IEEE/ACM Transactions on, Volume 11, February 2003.
4. J. Liang, R,. Kumar, K. W. Ross, The KaZaA Overlay: A Measurement Study, Computer Networks Journal, Oct. 2005.
5. M. Izal, G. Urvoy-Keller, E.W. Biersack, P. A. Felber, A. A. Hamra, and L. Garces-Erice, Dissecting BitTorrent: Five Months in a Torrents Lifetime, In Proceedings of Passive and Active Measurements (PAM), 2004.
6. Peer-to-Peer Architecture for Data-Intensive Cycle Sharing (P2P-ADICS). See web site at: http://www.p2p-adics.org/
7. Bram Cohen, Incentives build robustness in BitTorrent, Proceedings of IPTPS, 2003
8. J. Dilley, B. Maggs, J. Parikh, H. Prokop, R. Sitaraman, and B. Weihl. Globally Distributed Content Delivery. IEEE Internet Computing, pp. 50-58, September 2002.
9. L. Wang, K. Park, R. Pang, V. S. Pai, and L. Peterson. Reliability and security in the CoDeeN content distribution network. In Proceedings of the USENIX Annual Technical Conference, Boston, MA, June 2004.
10. Al-Mukaddim Khan Pathan and Rajkumar Buyya. A Taxonomy and Survey of Content Delivery Netwoks. Technical Report, GRIDS-TR-2007-4, Grid Computing and Distributed Systems Laboratory, The University of Melbourne, Australia, 2006.
11. Michael J. Freedman, Eric Freudenthal, and David Mazires. Democratizing Content Publication with Coral. In Proc. 1st USENIX/ACM Symposium on Networked Systems Design and Implementation (NSDI'04), San Francisco, CA, March 2004.
12. David Anderson, Volunteer Computing: Planting the Flag, PCGrid 2007 Workshop, Long Beach, March 30 2007.
13. Derrick Kondo, David P. Anderson and John McLeod VII, Performance Evaluation of Scheduling Policies for Volunteer Computing, 3rd IEEE International Conference on e-Science and Grid Computing, Bangalore, India, December 10-13 2007.
14. F. Cappello, S. Djilali, G. Fedak, T. Herault, F. Magniette, V. Neri, and O. Lodygensky, Computing on large-scale distributed systems: XtromWeb architecture, programming models, security, tests and convergence with Grid, FGCS Future Generation Computer Science, 2004.
15. Gnutella Project. See web site at: http://www.gnutella.com/
16. J. Kubiatowicz, D. Bindel, Y. Chen, S. Czerwinski, P. Eaton, D. Geels, R. Gummadi, S. Rhea, H. Weatherspoon, W. Weimer, C. Wells and B. Zhao, Occanstore: An architecture for global-scale persistent storage, 9th International Conference on Architectural Support for Programming Languages and Operating Systems, 2000.
17. Alexandre Freire da Silva, Francisco Gatto, and Fabio Kon, Cigarra - A Peer-to-Peer Cultural Grid, Proceedings of the FISL Workshop on Free Software, pp. 177-183. Porto Alegre, 2005.
18. B. Goldsmith, Enabling Grassroots Distributed Computing with CompTorrent, Sixth International Workshop on Agents and Peer-to-Peer Computing (AP2PC 2007), Honolulu, Hawaii, USA.
19. Baohua Wei, G. Fedak, and F. Cappello, Scheduling independent tasks sharing large data distributed with BitTorrent, Grid Computing, 2005. The 6thIEEE/ACM International Workshop on, IEEE ComputcrSociety, 2005, pages 219-226.
20. C. Briquet, X. Dalem, S. Jodogne and P.A. de Marneffe, Scheduling data-intensive bags of tasks in P2P grids with bittorrent-enabled data distribution, In Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks, Monterey, California, 2007.
21. J. Kim, A. Chandra, and J. B. Weissman, Exploiting Heterogeneity for Collective Data Downloading in Volunteer-based Networks, in Proc. of the 7th IEEE International Symposium on Cluster Computing and the Grid (CCGRID07), pp. 275-282, 2007.
22. G. Pierre, and M. van Steen. Globule: A Collaborative Content Delivery Network. IEEE Communications, Vol. 44, No. 8, August 2006.
23. Akamai Technologies, Inc. See web site at: http://www.akamai.com/.
24. GNU wget: http://www.gnu.org/software/wget/wget.html
25. N. Fujita, Y. Ishikawa, A. Iwata, and R. Izmailov. Coarse-grain Replica Management Strategies for Dynamic Replication of Web Contents. Computer Networks: The International Journal of Computer and Telecommunications Networking, Vol. 45, Issue 1, pp. 19-34, May 2004.
26. L. Cherkasova and J. Lee. FastReplica: Efficient large file distribution within Content Delivery Networks. In Proceedings of the 4th USITS, Seattle, WA, March 2003.
27. J. Li, J. Stribling, R. Morris, M. F. Kaashoek, and T. M. Gil, A performance vs. cost framework for evaluating DHT design tradeoffs under churn, IEEE Conference on Computer Communications (INFOCOM), 2005.
28. Azureus. See web site at: http://azureus.sourceforge.net/
29. Grid5000. See web site at: http://www.grid5000.fr/
30. M. L. Massie, B. N. Chun, and D. E. Culter, The Ganglia Distributed Monitoring System: Design, Implementation, and Experience, Parallel Computing, vol. 30, pp. 817-840, July 2004
31. libtorrent. See web site at: http://libtorrent.sourceforge.net/