A fast topology inference: A building block for network-aware parallel processing

Proceedings of the 16th International Symposium on High Performance Distributed Computing 2007, HPDC'07

Volumn , Issue , 2007, Pages 11-22

  Shirai, Tatsuya ^a   Saito, Hideo ^a   Taura, Kenjiro ^a  

^a UNIVERSITY OF TOKYO   (Japan)

Author keywords

Broadcast; Measurements; Topology inference

Indexed keywords

BROADCASTING; INFERENCE ENGINES; MULTICASTING; NATURAL SCIENCES COMPUTING; PARALLEL PROCESSING SYSTEMS;

DATA INTENSIVE COMPUTING; GRID ENVIRONMENTS; PHYSICAL TOPOLOGY; TOPOLOGY INFERENCE;

COMPUTER NETWORKS;

EID: 34548063682     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1272366.1272369     Document Type: Conference Paper

References (19)

1. O. Aumage and G. Mercier. MPICH/MADIII: a Cluster of Clusters Enabled MPI Implementation. 3rd International Symposium on Cluster Computing and the Grid, pages 26-33, 2003.
2. R. Black, A. Donnelly, and C. Fournet. Ethernet Topology Discovery without Network Assistance. In ICNP, pages 328-339, 2004.
3. Y. Breitbart, M. Garofalakis, B. Jai, C. Martin, R. Rastogi, and A. Silberschatz. Topology discovery in heterogeneous IP networks: the NetInventory system. IEEE/ACM Trans. Netw., 12(3):401-414, 2004.
4. J. W. Byers, A. Bstavros, and K. A. Harfoush. Inference and Labeling of Metric-Induced Network Topologies. IEEE Trans. Parallel Distrib. Syst., 16(11):1053-1065, 2005.
5. M. Coates, R. Castro, R. Nowak, M. Gadhiok, R. King, and Y. Tsang. Maximum likelihood network topology identification from edge-based unicast measurements. SIGMETRICS Perform. Eval. Rev., 30(1):11-20, 2002.
6. M. Coates, M. Rabbat, and R. Nowak. Merging logical topologies using end-to-end measurements. In IMC '03: Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, pages 192-203, New York, NY, USA, 2003. ACM Press.
7. M. den Burger, T. Kielmann, and H. E. Bal. "TOPOMON": A Monitoring Tool for Grid Network Topology. In ICCS '02: Proceedings of the International Conference on Computational Science-Part II, pages 558-567, London, UK, 2002. Springer-Verlag.
8. M. den Burger, T. Kielmann, and H. E. Bal. Balanced Multicasting: High-throughput Communication for Grid Applications. In Proceedings of the 2005 ACM/IEEE Conference on Supercomputing, 2005.
9. B. Donnet, P. Raoult, T. Friedman, and M. Crovella. Efficient algorithms for large-scale topology discovery. SIGMETRICS Perform. Eval. Rev., 33(1):327-338, 2005.
10. N. Duffield, J. Horowitz, F. L. Presti, and D. Towsley. Multicast topology inference from measured end-to-end loss. IEEE Transactions in Information Theory, 48:26-45, 2002.
11. E. Gabriel, M. Resch, T. Beisel, and R. Keller. Distributed Computing in a Heterogeneous Computing Environment. In Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 180-187, London, UK, 1998. Springer-Verlag.
12. T. Imamura, Y. Tsujita, H. Koide, and H. Takemiya. An Architecture of Stampi: MPI Library on a Cluster of Parallel Computers. In Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 200-207, London, UK, 2000. Springer-Verlag.
13. N. T. Karonis, B. Toonen, and I. Foster. MPICH-G2: a Grid-enabled implementation of the Message Passing Interface. J. Parallel Distrib. Comput., 63(5):551-563, 2003.
14. T. Kielmann, R. F. H. Hofman, H. E. Bal, A. Plaat, and R. A. F. Bhoedjang. MagPIe: MPPs collective communication operations for clustered wide area systems. In PPoPP '99: Proceedings of the seventh ACM SIGPLAN symposium on Principles and practice of parallel programming, pages 131-140, New York, NY, USA, 1999. ACM Press.
15. B. Lowekamp, D. O'Hallaron, and T. Gross. Topology discovery for large ethernet networks. In SIGCOMM '01: Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, pages 237-248, New York, NY, USA, 2001. ACM Press.
16. B. B. Lowekamp, B. Tierney, L. Cottrell, R. Hughes-Jones, T. Kielmann, and M. Swany. Enabling Network Measurement Portability Through a Hierarchy of Characteristics. In GRID '03: Proceedings of the Fourth International Workshop on Grid Computing, page 68, Washington, DC, USA, 2003. IEEE Computer Society.
17. G. Shao, F. Berman, and R. Wolski. Using Effective Network Views to Promote Distributed Application Performance. In Proceedings of the 1999 International Conference on Parallel and Distributed Processing Techniques and Applications, pages 2649-2656, 1999.
18. Skitter. http://www.caida.org/tools/measurement/skitter.
19. R. Wolski, N. T. Spring, and J. Hayes. The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing. Journal of Future Generation Computing Systems, 15(5-6), pages 757-768, Oct 1999.