Towards optimal sampling for flow size estimation

Proceedings of the ACM SIGCOMM Internet Measurement Conference, IMC

Volumn , Issue , 2008, Pages 243-255

  Tune, Paul ^a,b   Veitch, Darryl ^a,b  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b CSIRO   (Australia)

Author keywords

Fisher information; Flow size distribution; Internet measurement; Routers; Sampling

Indexed keywords

APPROACH FLOWS; COMPUTATIONAL COSTS; DUAL SAMPLINGS; FISHER INFORMATION; FLOW QUALITIES; FLOW SIZE DISTRIBUTION; FLOW SIZE ESTIMATIONS; INTERNET DATUM; INTERNET MEASUREMENT; OPTIMAL SAMPLINGS; PACKET SAMPLINGS; PACKET-BASED; RELATIVE PERFORMANCE; RESOURCE REQUIREMENTS; SAMPLED DATUM; SAMPLING SCHEMES; STATISTICAL PERFORMANCE; TCP FLOWS; TRAFFIC MODELING;

DIELECTRIC RELAXATION; FISHER INFORMATION MATRIX; INTERNET; PACKET NETWORKS; ROUTERS; SEMICONDUCTING INTERMETALLICS; SIZE DISTRIBUTION;

SAMPLING;

EID: 63049099280     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1452520.1452550     Document Type: Conference Paper

References (19)

1. N. Duffield, C. Lund, and M. Thorup, "Estimating Flow Distributions from Sampled Flow Statistics," IEEE/ACM Trans. Networking, vol. 13, no. 5, pp. 933-946, Oct 2005.
2. N. Hohn and D. Veitch, "Inverting Sampled Traffic," in Proc. 2003 ACM SIGCOMM Internet Measurement Conference, Miami, October 2003, pp. 222-233, winner best student paper award. [Online]. Available: http://www.cubinlab.ee.unimelb.edu.au/~darryl/Publications/thinning-camera.pdf
3. -, "Inverting Sampled Traffic," IEEE/ACM Transactions on Networking, vol. 14, no. 1, pp. 68-80, 2006. [Online]. Available: http://www.cubinlab.ee.unimelb.edu.au/~darryl/Publications/ToN-sampling-revised. pdf
4. B. Ribeiro, D. Towsley, T. Ye, and J. Bolot, "Fisher information on sampled packets: an application to flow size estimation," in Proc. ACM/SIGCOMM Internet Measurement Conf., Rio de Janeiro, Oct 2006, pp. 15-26.
5. G. Varghese, Network Algorithmics. San Francicso: Elsevier/Morgan Kaufmann, 2005.
6. L. Yang and G. Michailidis, "Estimation of flow lengths from sampled traffic," in Proc. GLOBECOM, San Francisco, CA, Nov 2006.
7. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. John Wiley and Sons, Inc., 2006.
8. A. Hero, J. Fessler, and M. Usman, "Exploring estimator bias-variance tradeoffs using the Uniform CR bound," IEEE Trans. Sig. Proc., vol. 44, no. 8, pp. 2026-2041, Aug 1996.
9. P. Tune and D. Veitch, "Fisher information in flow size distribution estimation: Technical report," Dept. E&EE, The University of Melbourne, Tech. Rep., 2008, available:http://www.ee.unimelb.edu.au/people/ lsptune/index.html/.
10. J. D. Gorman and A. O. Hero, "Lower bounds for parametric estimation with constraints," IEEE Trans. Info. Th., vol. 26, no. 6, pp. 1285-1301, Nov 1990.
11. D. Harville, Matrix Algebra from a Statistician's Perspective. Springer-Verlag, 1997.
12. J. E. Strum, "Binomial matrices," The Two Year College Mathematics Journal, vol. 8, no. 5, pp. 260-266, November 1977.
13. R. Zamir, "A proof of the Fisher information inequality via a data processing argument," IEEE Trans. Info. Th., vol. 44, no. 3, pp. 1246-1250, May 1998.
14. E. L. Lehmann and G. Casella, Theory of Point Estimation, 2nd ed., ser. Springer Texts in Statistics. Springer, 1998.
15. R. T. Rockafellar, Convex Analysis, ser. Princeton Landmarks in Mathematics and Physics. Princeton University Press, 1970.
16. C. Estan, K. Keyes, D. Moore, and G. Varghese, "Building a better netflow," in Proc. ACM Sigcomm 2004, Portland, OR, Aug 2004.
17. NLANR, Leipzig-II Trace Data, http://pma.nlanr.net/Special/leip2.html.
18. F. Zhang, Matrix Theory: Basic Results and Techniques. Springer-Verlag, 1999.
19. K. S. Miller, "On the inverse of the sum of matrices," Mathematics Magazine, vol. 54, no. 2, March 1981.