Fundamental bounds on the accuracy of network performance measurements

Performance Evaluation Review

Volumn 33, Issue 1, 2005, Pages 253-264

  Roughan, Matthew ^a  

^a UNIVERSITY OF ADELAIDE   (Australia)

Author keywords

Error estimation; Internet measurement; Load balancing; Measurement planning; Network performance

Indexed keywords

ERROR ANALYSIS; INTERNET; MEASUREMENT THEORY;

ERROR ESTIMATION; INTERNET MEASUREMENT; LOAD BALANCING; MEASUREMENT PLANNING; NETWORK PERFORMANCE;

COMPUTER NETWORKS;

EID: 33244463097     PISSN: 01635999     EISSN: 01635999     Source Type: Conference Proceeding    
DOI: 10.1145/1071690.1064241     Document Type: Conference Paper

References (41)

1. V. Paxson, G. Aimes, J. Mahdavi, and M. Mathis, "Framework for IP performance metrics." IETF, IP Performance Metrics, Request for Comments: 2330, 1998.
2. J. Mahdavi and V. Paxson, "IPPM metrics for measuring connectivity." IETF, IP Performance Metrics, Request for Comments: 2678, 1999.
3. G. Aimes, S. Kalidindi, and M. Zekauskas, "A one-way delay metric for IPPM." IETF, IP Performance Metrics, Request for Comments: 2679, 1999.
4. G. Aimes, S. Kalidindi, and M. Zekauskas, "A one-way packet loss metric for IPPM." IETF, IP Performance Metrics, Request for Comments: 2680, 1999.
5. G. Aimes, S. Kalidindi, and M. Zekauskas, "A round-trip delay metric for IPPM." IETF, IP Performance Metrics, Request for Comments: 2681, 1999.
6. S.Floyd and V.Jacobson, "Random early detection gateways for congestion avoidance," IEEE/ACM Transactions on Networking, vol. 1, pp. 397-413, August 1993.
7. J. M.McQuillan, G. Falk, and I. Richer, "A review of the development and performance of the ARPANET routing algorithm," IEEE Transactions on Communication, vol. COM-26, pp. 60-74, December 1978.
8. A. Basu, A. Lin, and S. Ramanathan, "Routing using potentials: A dynamic traffic-aware routing algorithm," in Proc. ACM SIGCOMM, (Karlsruhe, Germany), 2003.
9. "CAIDA performance measurement tools taxonomy." http://www.caida.org/tools/taxonomy/performance.xml.
10. J.D.Case, M.Fedor, M.L.Schoffstall, and C.Davin, "Simple Network Management protocol (SNMP)." IEFT, Request for Comments: 1157, 1990.
11. D. R. Mauro and K. J. Schmidt, Essential SNMP. O'Reilly, 2001.
12. N. Brownlee, "Packet matching for NeTraMet distributions." http://www2.auckland.ac.nz/net/Internet/rtfm/meetings/47-, March 2000.
13. Y. Zhang, L. Breslau, V. Paxson, and S. Shenker, "On the characteristics and origins of Internet flow rates," in ACM SIGCOMM, (Pittsburgh, Pennsylvania, USA), August 2002.
14. S. B. Moon, P. Skelly, and D. Towsley, "Estimation and removal of clock skew from network delay measurements," Tech. Rep. 98-43, Department of Computer Science, University of Massachusetts at Amherst, 1998.
15. V. Paxson, Measurements and Analysis of End-to-End Internet Dynamics. PhD thesis, U.C. Berkeley, 1997.ftp://ftp.ee.lbl.gov/papers/vp-thesis/dis.ps.gz.
16. V. Paxson, J. Mahdavi, A. Adams, and M. Mathis, "An architecture for large-scale Internet measurement," IEEE Communications Magazine, 1998.
17. P. Barford and J. Sommers, "Comparison of probe-based and router-based methods for measuring packet loss." in submission, (see http://www.cs.wise.edu/pb/publications.html).
18. Y. Zhang, N. Duffield, V. Paxson, and S. Shenker, "On the constancy of Internet path properties," in ACM SIGCOMM Internet Measurement Workshop (IMW '2001), (San Francisco, California, USA), November 2001.
19. R. Wolff, "Poisson arrivals see time averages," Opns. Res., vol. 30, pp. 223-231, 1982.
20. G. S. Fishman and P. J. Kiviat, "The analysis of simulation-generated time series," Management Science, vol. 13, pp. 525-557, Mar 1967.
21. G. S. Fishman, "Estimating sample size in computing simulation experiments," Management Science, vol. 18, pp. 21-38, Sep 1971.
22. G. S. Fishman, "Statistical analysis for queueing simulations," Management Science, vol. 20, pp. 363-369, Nov 1973.
23. A. M. Law, "Efficient estimators for simulated queueing systems," Management Science, vol. 22, pp. 30-41, 1975.
24. W. Whitt, "Planning queueing simulations," Management Science, vol. 35, no. 11, pp. 1341-1366, 1989.
25. W. Whitt, "Asymptotic formulas for Markov processes with applications to simulation," Operations Research, vol. 40, no. 2, 1992.
26. P. M. Morse, "Stochastic properties of waiting Vines," Journal of the Operations Research Society of America, vol. 3, no. 3, pp. 255-261, 1955.
27. J. Abate and W. Whitt, "Transient behaviour of the M/M/1 queue via Laplace transforms," Advances in Applied Probability, vol. 20, pp. 145-178, 1988.
28. J. Abate and W. Whitt, "The correlation functions of RBM and M/M/1," Stochastic Models, vol. 4, no. 2, pp. 315-359, 1988.
29. J. Abate and W. Whitt, "Transient behavior of the M/M/1 queue: Starting at the origin," Queueing Systems: Theory and Applications, vol. 2, no. 1, pp. 41-65, 1987.
30. J. Abate and W. Whitt, "Transient behavior of the M/G/1 workload process," Operations Research, vol. 42, no. 4, pp. 750-764, 1994.
31. J. A. Schormans and T. Timotijevic, "Evaluating the accuracy of active measurement of delay and loss in packet networks," in 6th IFIP/IEEE Conf. on Management of Multimedia Networks and Services (MMNS), pp. 409-421, Sept. 2003.
32. T.Timotijevic, C.M.Leung, and J.Schormans, "Accuracy of measurements techniques supporting QoS in packet-based intranet and extranet VPNs," IEE Proc.-Commin, vol. 151, pp. 89-94, Feb. 2004.
33. Andren, Hilding, and Veitch, "Understanding end-to-end internet traffic dynamics," in Proceeding Globecom'98, (Sydney, Australia), pp. 1118-1122, 1998.
34. L. Kleinrock, Queueing Systems, vol. II: Computer Applications. John Wiley and Sons, 1975.
35. W. E. Leland, M. S. Taqqu, W. Willinger, and D. V. Wilson, "On the self-similar nature of Ethernet traffic (extended version)," IEEE/ACM Transactions on Networking, vol. 2, pp. 1-15, Feb 1994.
36. V. Paxson and S. Floyd, "Wide-area traffic: The failure of Poisson modeling," IEEE/ACM Transactions on Networking, vol. 3, no. 3, pp. 226-244, 1995.
37. J. Beran, Statistics for Long-Memory Processes. Chapman and Hall, New York, 1994.
38. A. Erramilli, J. Gordon, and W. Willinger, "Applications of fractals in engineering for realistic traffic processes," in Proceedings of the 14th International Teletraffic Congress -ITC 14 (J. Labetoulle and J. W. Roberts, eds.), vol. 1a, pp. 35-44, Elsevier, Amsterdam, 1994.
39. M. E. Crovella and L. Lipsky, "Long-lasting transient conditions in simulations with heavy-tailed workloads," in Proceedings of the 1997 Winter Simulation Conference
40. M. Roughan and D. Veitch, "Measuring long-range dependence under changing traffic conditions," in IEEE INFOCOM'99, (NY, NY), IEEE Computer Society Press, Los Alamitos, California, March 1999.
41. J. M.McQuillan, I. Richer, and E. C. Rosen, "A new routing algorithm for the ARPANET," IEEE Transactions on Communication, vol. COM-28, pp. 711-719, May 1980.