Practical large-scale latency estimation

Computer Networks

Volumn 52, Issue 7, 2008, Pages 1343-1364

  Szymaniak, Michal ^a   Presotto, David ^b   Pierre, Guillaume ^a   van Steen, Maarten ^a  

^a VU UNIVERSITY AMSTERDAM   (Netherlands)

^b GOOGLE INC   (United States)

Author keywords

Large scale distributed systems; Latency estimation; Network modeling

Indexed keywords

INFORMATION DISSEMINATION; INFORMATION SYSTEMS; LARGE SCALE SYSTEMS; ONLINE SEARCHING; SCHEDULING;

LARGE SCALE DISTRIBUTED SYSTEMS; LATENCY ESTIMATION SYSTEMS; NETWORK MODELING;

INTERNET;

EID: 41449083054     PISSN: 13891286     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comnet.2007.11.022     Document Type: Article

References (41)

1. Zari M., Saiedian H., and Naeem M. Understanding and reducing Web delays. IEEE Computer 34 12 (2001) 30-37
2. F. Dabek, J. Li, E. Sit, J. Robertson, F. Kaashoek, R. Morris, Designing a DHT for low latency and high throughput, in: Proceedings of the 1st Symposium on Networked Systems Design and Implementation, USENIX, March 2004.
3. J. Pereira, L. Rodrigues, A. Pinto, R. Oliveira, Low latency probabilistic broadcast in wide area networks, in: Proceedings of the 23rd International Symposium on Reliable Distributed Systems, IEEE Computer Society, New York, October 2004.
4. M. Szymaniak, G. Pierre, M. van Steen, Latency-driven replica placement, in: Proceedings of the 2005 International Symposium on Applications and the Internet, IEEE Computer Society, New York, February 2005.
5. L. Amini, H. Schulzrinne, Client clustering for traffic and location estimation, in: Proceedings of the 24th International Conference on Distributed Computing Systems, IEEE Computer Society, New York, March 2004.
6. Wolski R., Spring N., and Hayes J. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 15 5-6 (1999) 757-768
7. Brin S., and Page L. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems 30 1-7 (1998) 107-117
8. T.S. Eugene Ng, H. Zhang, Predicting Internet network distance with coordinates-based approaches, in: Proceedings of the 21st INFOCOM Conference, IEEE Computer Society, New York, June 2002.
9. Y. Shavitt, T. Tankel, Big-bang simulation for embedding network distances in Euclidean space, in: Proceedings of the 22nd INFOCOM Conference, IEEE Computer Society, New York, April 2003.
10. S. Srinivasan, E. Zegura, An empirical evaluation of landmark placement on Internet coordinate schemes, in: Proceedings of the International Conference on Computer Communications and Networks, IEEE Computer Society, New York, October 2004.
11. L. Tang, M. Crovella, Virtual landmarks for the Internet, in: Proceedings of the Internet Measurement Conference, ACM, New York, October 2003.
12. R. Cox, F. Dabek, F. Kaashoek, J. Li, R. Morris, Practical, distributed network coordinates, in: Proceedings of the 2nd Workshop on Hot Topics in Networks, ACM, New York, November 2003.
13. H. Lim, J. Hou, C. Choi, Constructing Internet coordinate system based on delay measurements, in: Proceedings of the Internet Measurement Conference, ACM, New York, October 2003.
14. P. Pietzuch, J. Ledlie, M. Seltzer, Supporting network coordinates on PlanetLab, in: Proceedings of the 2nd Workshop on Real, Large Distributed Systems, USENIX, December 2005.
15. M. Castro, M. Costa, P. Key, A. Rowstron, PIC: Practical Internet coordinates for distance estimation, Technical Report MSR-TR-2003-53, Microsoft Research, September 2003.
16. M. Pias, J. Crowcroft, S. Wilbur, T. Harris, S. Bhatti, Lighthouses for scalable distributed location, in: Proceedings of the 2nd International Workshop on Peer-to-Peer Systems, February 2003.
17. F. Dabek, R. Cox, F. Kaashoek, R. Morris, Vivaldi: a decentralized network coordinate system, in: Proceedings of the SIGCOMM Conference, ACM, New York, August 2004.
18. T.S. Eugene Ng, H. Zhang, A network positioning system for the Internet, in: Proceedings of the 4th Symposium on Internet Technologies and Systems, USENIX, June 2004.
19. Barroso L., Dean J., and Holzle U. Architecture, Web search for a planet: the Google cluster. IEEE Micro 23 2 (2003) 22-28
20. Nelder J., and Mead R. A simplex method for function minimization. The Computer Journal 4 7 (1965) 308
21. M. Szymaniak, G. Pierre, M. van Steen, Scalable cooperative latency estimation, in: Proceedings of the 10th International Conference on Parallel and Distributed Systems, IEEE Computer Society, New York, July 2004.
22. M. Waldvogel, R. Rinaldi, Efficient topology-aware overlay network, in: Proceedings of the 1st Workshop on Hot Topics in Networks, ACM, New York, October 2002.
23. The PlanetLab Project Web page, (accessed: 21.05.07).
24. Y. Shavitt, T. Tankel, The curvature of the Internet and its usage for overlay construction and distance estimation, in: Proceedings of the 23rd INFOCOM Conference, IEEE Computer Society, New York, April 2004.
25. M. Andrews, B. Shepherd, A. Srinivasan, P. Winkler, F. Zane, Clustering and server selection using passive monitoring, in: Proceedings of the 21st INFOCOM Conference, IEEE Computer Society, New York, June 2002.
26. The Site Meter Web page, (accessed: 21.05.07).
27. R. Kokku, P. Yalagandula, A. Venkataramani, M. Dahlin, NPS: A non-interfering deployable Web prefetching system, in: Proceedings of the 4th Symposium on Internet Technologies and Systems, USENIX, March 2003.
28. C. Wootton, JavaScript Weirdness, Web Developer's Journal, 1999, .
29. D. Fisher, G. Saksena, SYNOPSIS: Link prefetching in Mozilla: a server-driven approach, in: Proceedings of the 8th International Workshop on Web Content Caching and Distribution, IBM Research, September 2003.
30. D. Duchamp, Prefetching hyperlinks, in: Proceedings of the 2nd Symposium on Internet Technologies and Systems, USENIX, October 1999.
31. R. Fielding, J. Gettys, J. Mogul, H. Frystyk, L. Masinter, P. Leach, T. Berners-Lee, Hypertext transfer protocol - HTTP/1.1. RFC 2616, IETF, June 1999.
32. The Mozilla Firefox Web page, (accessed: 21.05.07).
33. N. Brinkman, Mozilla's browsers global usage share is still growing, Onestat.com, July 2006.
34. V. Kudallur, IE7 networking improvements in content caching and decompression, MSDN Blog, October 2005.
35. H. Zheng, E. Keong Lua, M. Pias, T. Griffin, Internet routing policies and round-trip times, in: Proceedings of the Passive and Active Measurement Workshop, Springer, New York, March 2005.
36. E. Keong Lua, T. Griffin, M. Pias, H. Zheng, J. Crowcroft, On the accuracy of embeddings for Internet coordinate systems, in: Proceedings of the Internet Measurement Conference, ACM, New York, October 2005.
37. A. Shaikh, R. Tewari, M. Agrawal, On the effectiveness of DNS-based server selection, in: Proceedings of the 20th INFOCOM Conference, IEEE Computer Society, New York, April 2001.
38. B. Krishnamurthy, J. Wang, On network-aware clustering of Web clients, in: Proceedings of the SIGCOMM Conference, ACM, New York, August 2000.
39. Z. Morley Mao, C. Cranor, F. Douglis, M. Rabinovich, O. Spatscheck, J.A. Wang, Precise and efficient evaluation of the proximity between Web clients and their local DNS servers, in: Proceedings of the Annual Technical Conference, USENIX, June 2002.
40. J. Stribling, All-pairs Ping Data for PlanetLab, January 2006.
41. F. Georgatos, F. Gruber, D. Karrenberg, M. Santcroos, A. Susanj, H. Uijterwaal, R. Wilhelm, Providing active measurements as a regular service for ISP's, in: Proceedings of the Passive and Active Measurements Workshop, RIPE, April 2001.