MOB: Zero-configuration high-throughput multicasting for grid applications

Proceedings of the 16th International Symposium on High Performance Distributed Computing 2007, HPDC'07

Volumn , Issue , 2007, Pages 159-168

  Den Burger, Mathijs ^a   Kielmann, Thilo ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

Bandwidth adaptation; Cluster computing; Peer to peer

Indexed keywords

BANDWIDTH; CLUSTER ANALYSIS; DATA TRANSFER; GRID COMPUTING; TREES (MATHEMATICS);

BANDWIDTH ADAPTATION; CLUSTER COMPUTING; PEER-TO-PEER;

MULTICASTING;

EID: 34548105885     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1272366.1272387     Document Type: Conference Paper

References (30)

1. O. Beaumont, L. Marchal, and Y. Robert. Broadcast Trees for Heterogeneous Platforms. In 19th International Parallel and Distributed Processing Symposium (IPDPS'05), Denver, CO, USA, April 3-8 2005.
2. R. Bindal, P. Cao, W. Chan, J. Medval, G. Suwala, T. Bates, and A. Zhang. Improving traffic locality in BitTorrent via biased neighbor selection. In The 26th International Conference on Distributed Computing Systems (ICDCS 2006), Lisboa, Portugal, July 4-7 2006.
3. M. Castro, P. Druschel, A. Kermarrec, A. Nandi, A. Rowstron, and A. Singh. SplitStream: High-bandwidth multicast in cooperative environments. In ACM Symposium on Operating System Principles (SOSP), Lake Bolton, NY, USA, October 2003.
4. B. Cohen. Incentives build robustness in BitTorrent. In Proceedings of Workshop on Economics of Peer-to-Peer Systems, Berkeley, CA, USA, May 2003. http://www.bittorrent.org/bittorrentecon.pdf.
5. R. Cohen and G. Kaempfer. A Unicast-based Approach for Streaming Multicast. In 20th Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE INFOCOM 2001), pages 440-448, Anchorage, AK, USA, April 22-26 2001.
6. Y. Cui, B. Li, and K. Nahrstedt. On Achieving Optimized Capacity Utilization in Application Overlay Networks with Multiple Competing Sessions. In 16th annual ACM symposium on parallelism in algorithms and architectures (SPAA '04), pages 160-169, Barcelona, Spain, June 27-30 2004. ACM Press.
7. Y. Cui, Y. Xue, and K. Nahrstedt. Max-min Overlay Multicast: Rate Allocation and Tree Construction. In 12th IEEE International Workshop on Quality of Service (IwQoS '04), Montreal, Canada, June 7-9 2004.
8. Linux Advanced Routing and Traffic Control. http://lartc.org/.
9. The Distributed ASCI Supercomputer 2. http://www.cs.vu.nl/das2/, 2002.
10. The Distributed ASCI Supercomputer 3. http://www.cs.vu.nl/das3/, 2006.
11. M. den Burger, T. Kielmann, and H. E. Bal. Balanced multicasting: High-throughput communication for grid applications. In Supercomputing 2005 (SC05), Seattle, WA, USA, November 12-18 2005.
12. M. Devera. HTB Linux queuing discipline manual - user guide, http://luxik.cdi.cz/~devik/qos/htb/userg.pdf.
13. C. Dovrolis, P. Ramanathan, and D. Moore. What Do Packet Dispersion Techniques Measure? In 20th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2001), Anchorage, AK, USA, April 22-26 2001.
14. A. Plaza et. al. Commodity Cluster-based Parallel Processing of Hyperspectral Imagery. Journal of Parallel Distributed Computing, 66(3):345-358, 2006.
15. T. Gross, B. Lowekamp, R. Karrer, N. Miller, and P. Steenkiste. Design, Implementation and Evaluation of the Remos Network. Journal of Grid Computing, 1(1):75-93, May 2003.
16. S. Hemminger. Network Emulation with NetEm. Linux Conf Au, April 2005.
17. R. Izmailov, S. Ganguly, and N. Tu. Fast Parallel File Replication in Data Grid. In Future of Grid Data Environments workshop (G GF-IO), Berlin, Germany, March 2004.
18. N. T. Karonis, B. R. de Supinski, I. Foster, W. Gropp, E. Lusk, and J. Bresnahan. Exploiting Hierarchy in Parallel Computer Networks to Optimize Collective Operation Performance. In 14th International Parallel and Distributed Processing Symposium (IPDPS '00), pages 377-384, Cancun, Mexico, May 1-5 2000.
19. T. Kielmann, H.E. Bal, S. Gorlatch, K. Verstoep, and R.F.H. Hofman. Network Performance-aware Collective Communication for Clustered Wide Area Systems. Parallel Computing, 27(11):1431-1456, 2001.
20. T. Kielmann, R. F.H. Hofman, H. E. Bal, A. Plaat, and R. A.F. Bhoedjang. MagPIe: MPI's Collective Communication Operations for Clustered Wide Area Systems. ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), pages 131-140, May 1999.
21. M.S. Kim, S.S. Lam, and D.Y. Lee. Optimal Distribution Tree for Internet Streaming Media. In 23rd International Conference on Distributed Computing Systems (ICDCS 'OS), Providence, RI, USA, May 19-22 2003.
22. B. Lowekamp, B. Tierney, L. Cottrell, R. Hughes-Jones, T. Kielmann, and M. Swany. A Hierarchy of Network Performance Characteristics for Grid Applications and Services. Proposed Recommendation GFD-R-P.023, Global Grid Forum, 2004.
23. J. Maassen and H. E. Bal. Solving the Connectivity Problems in Grid Computing. In Proceedings of The 16th IEEE International Symposium on High-Performance Distributed Computing (HPDC), Monterey, CA, USA, June 2007.
24. J. Maassen, R.V. Nieuwpoort, T. Kielmann, and K. Verstoep. Middleware Adaptation with the Delphoi Service. In A GridM 2004, Workshop on Adaptive Grid Middleware, Antibes Juan-les-Pins, France, September 2004.
25. J.A. Pouwelse, P. Garbacki, J. Wangand, A. Bakker, J. Yang, A. Iosup, D. Epema, M.Reinders, M.R. van Steen, and H.J. Sips. Tribler: A social-based based peer to peer system. In 5th Int'l Workshop on Peer-to-Peer Systems (IPTPS), Santa Barbara, CA, USA, February 27-28 2006.
26. V. Ribeiro, R. Reidi, R Baraniuk, J. Navratil, and L. Cottrel. PathChirp: Efficient Available Bandwidth Estimation for Network Paths. In Passive and Active Measurement workshop (PAM 2003), La Jolla, CA, USA, April 6-8 2003.
27. F.J. Seinstra, J.M. Geusebroek, D. Koelma, C.G.M. Snoek, M. Worring, and A.W.M. Smeulders. High-Performance Distributed Image and Video Content Analysis with Parallel-Horus. IEEE Multimedia, 2007. to appear.
28. R.V. van Nieuwpoort, J. Maassen, G. Wrzesinska, R. Hofman, C. Jacobs, T. Kielmann, and H.E. Bal. Ibis: A Flexible and Efficient Java-based Grid Programming Environment. Concurrency & Computation: Practice & Experience, 17(7-8):1079-1107, June-July 2005.
29. K. Verstoep, K. Langendoen, and H.E. Bal. Efficient Reliable Multicast on Myrinet. In International Conference on Parallel Processing, volume 3, pages 156-165, Bloomingdale, IL, USA, August 1996.
30. R. Wolski. Experiences with Predicting Resource Performance On-line in Computational Grid Settings. ACM SIGMETRICS Performance Evaluation Review, 30(4):41-49, March 2003.