Flow sampling under hard resource constraints

Performance Evaluation Review

Volumn 32, Issue 1, 2004, Pages 85-96

  Duffield, Nick ^a   Lund, Carsten ^a   Thorup, Mikkel ^a  

^a AT AND T LABS RESEARCH   (United States)

Author keywords

IP flows; Sampling; Variance reduction

Indexed keywords

ALGORITHMS; DATA ACQUISITION; DECISION MAKING; NETWORK PROTOCOLS; PACKET NETWORKS; SAMPLING; THEOREM PROVING;

DATA TRAFFIC VOLUMES; IP FLOWS; VARIANCE REDUCTION;

RESOURCE ALLOCATION;

EID: 8344289246     PISSN: 01635999     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1012888.1005699     Document Type: Conference Paper

References (25)

1. B.C. Arnold and N. Balakrishnan, "Relations, Bounds and Approximations for Order Statistics", Lecture Notes in Statistics, vol. 53, Springer, New York, 1988.
2. S. Chaudhuri, R. Motwani, V.R. Narasayya: On Random Sampling over Joins. SIGMOD Conference 1999: 263-274
3. B.-Y. Choi, J.Park, Zh.-L. Zhang, "Adaptive Random Sampling for Load Change Detection", ACM SIGMETRICS 2002 (Extended Abstract).
4. T. H. Cormen, C. E. Leiserson, R. L. Rivest, C. Stein, "Introduction to algorithms", 2nd Edition, MIT Press, McGraw-Hill, 2001.
5. H.A. David, "Order Statistics", Second Edition, Wiley Series in Probability and Mathematical Statistics, Wiley, New York, 1981
6. Cisco NetFlow; for further information see http://www.cisco.com/warp/ public/732/netflow/index.html.
7. N.G. Duffield (Editor), "A Framework for Passive Packet Measurement", Internet Draft, December 2003, draft-ietf-psamp-framework-05, work in progress.
8. N. G. Duffield and M. Grossglauser, "Trajectory Sampling for Direct Traffic Observation", IEEE/ACM Transactions on Networking, vol. 9, pp. 280-292, 2001. Abridged version in Proc. ACM Sigcomm 2000, Computer Communications Review, Vol 30, No 4, October 2000, pp. 271-282.
9. N. G. Duffield and M. Grossglauser, "Trajectory Sampling for Direct Traffic Observation", IEEE/ACM Transactions on Networking, vol. 9, pp. 280-292, 2001. Abridged version in Proc. ACM Sigcomm 2000, Computer Communications Review, Vol 30, No 4, October 2000, pp. 271-282.
10. N.G. Duffield and C. Lund, "Predicting Resource Usage and Estimation Accuracy in an IP Flow Measurement Collection Infrastructure", ACM SIGCOMM Internet Measurement Conference 2003, Miami Beach, Fl, October 27-29, 2003
11. N.G. Duffield, C. Lund, M. Thorup, "Charging from sampled network usage," ACM SIGCOMM Internet Measurement Workshop 2001, San Francisco, CA, November 1-2, 2001.
12. N.G. Duffield, C. Lund, M. Thorup, "Learn More, Sample Less: Control of Volume and Variance in Network Measurement", Technical Report.
13. N.G. Duffield, C. Lund, M. Thorup, "Estimating flow distributions from sampled flow statistics", ACM Sigcomm 2003, Karlsruhe, Germany, August 25-29, 2003.
14. C. Estan and G. Varghese, "New Directions in Traffic Measurement and Accounting", Proc SIGCOMM 2002, Pittsburgh, PA, August 19-23, 2002.
15. A. Feldmann, A. Greenberg, C. Lund, N. Reingold, J. Rexford, F. True, "Deriving traffic demands for operational IP networks: methodology and experience", In Proc. ACM Sigcomm 2000, Computer Communications Review, Vol 30, No 4, October 2000, 257-270.
16. A. Feldmann, J. Rexford, and R. Cáceres, "Efficient Policies for Carrying Web Traffic over Flow-Switched Networks," IEEE/ACM Transactions on Networking, vol. 6, no.6, pp. 673-685, December 1998.
17. E.A. Hernandez, M.C. Chidester, A.D. George, "Adaptive Sampling for Network Management", Technical Report, Department of Electrical and Computer Engineering, University of Florida.
18. N. Hohn, D. Veitch, "Inverting Sampled Traffic", ACM SIGCOMM Internet Measurement Conference 2003, Miami Beach, Fl, October 27-29, 2003
19. D.G. Horvitz and D.J. Thompson, "A Generalization of Sampling without replacement from a Finite Universe", J. Amer. Statist. Assoc. Vol. 47, pp. 663-685, 1952.
20. Inmon Corporation, "sFlow accuracy and billing", see: http://www.inmon.com/PDF/sFlowBilling.pdf
21. M. Kodialam, T. V. Lakshman, S. Mohanty, "Runs bAsed Traffic Estimator (RATE): A Simple, Memory Efficient Scheme for Per-Flow Rate Estimation", in Proc. IEEE Infocom 2004, Hong Kong, March 7-11, 2004.
22. R.T. Rockafellar, "Convex analysis", Princeton University Press, Princeton, NJ, 1970.
23. S.K. Thompson and G.A.F. Seber, "Adaptive Sampling", Wiley Series in Probability and Statistics, Wiley, New York, 1996.
24. M. Thorup, "Equivalence between Priority Queues and Sorting", Proc. 43rd IEEE Symposium on Foundations of Computer Science (FOCS), pp. 125-134, 2002.
25. J.S. Vitter: Random Sampling with a Reservoir. ACM Trans. Math. Softw. 11(1): 37-57 (1985)