Design principles and algorithms for effective high-speed IP flow monitoring

Computer Communications

Volumn 29, Issue 10, 2006, Pages 1653-1664

  Molina, M ^a   Chiosi, A ^a   D'Antonio, S ^b   Ventre, G ^c  

^a NEC LABORATORIES EUROPE   (Germany)

^b CINI Consortium   (Italy)

^c UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

IP flow monitoring; Passive traffic measurements

Indexed keywords

ALGORITHMS; DATA FLOW ANALYSIS; DATA STORAGE EQUIPMENT; INFORMATION ANALYSIS; INTERNET; MATHEMATICAL MODELS; PACKET NETWORKS;

INTER-ARRIVAL TIME; IP FLOW MONITORING; PACKET CLASSIFICATION; PASSIVE TRAFFIC MEASUREMENTS;

NETWORK PROTOCOLS;

EID: 33745266078     PISSN: 01403664     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.comcom.2005.07.024     Document Type: Article

References (25)

1. IETF IP Flow Information eXport working group: http://www.ietf.org/html.charters/ipfix-charter.html.
2. C. Estan, G. Varghese, New directions in traffic measurement and accouning, In Proceedings Of SIGCOMM 2002, Pittsburg (US), July 2002.
3. Molina M. A scalable and efficient methodology for flow monitoring in the Internet. ITC18 (2003)
4. Molina M., Tartarelli S., Raspall F., and Niccolini S. Implementation of an IPFIX compliant flow traffic meter: challenges and performance assessment. IPOM 03 (2003)
5. N. Duffield, C. Lund, M. Thorup, Properties and prediction of Flow Statistics from Sampled Packet Streams, ACM SIGCOMM Internet Meas. Workshop 2002 http://www.research.att.com/~duffield/pubs/DLT02-flows.pdf.
6. N. Duffield, C. Lund, M. Thorup. Learn More, Sample Less: Control of Volume and Variance in Network Measurements www.research.att.com/~duffield/pubs/DLT02-optimal.pdf.
7. T. Zseby, M. Molina, N. Duffield, S. Niccolini, F. Raspall Sampling and Filtering Techniques for IP Packet Selection draft-ietf-psamp-sample-tech, February 2004. - Work in progress.
8. Gupta P., and McKeown N. Algorithms for packet classification. IEEE Network 15 2 (2001) 24-32
9. B.-Y. Choi, J. Park, Z.-L. Zhang, Adaptive random sampling for load change detection, Proceedings of ACM SIGMETRICS '02 2002.
10. Zseby T. Deployment of Sampling Methods for SLA Validation with Non-Intrusive Measurements. PAM 2002 Workshop (2002)
11. J. Quittek, T. Zseby, B. Claise, S. Zander. Requirements for IP Flow Information - draft-ietf-ipfix-reqs - Nov. 03 - Work in progress.
12. B. Claise, - IPFIX Protocol Specifications - IETF draft-ietf-ipfix-protocol, Jan 2004 - Work in progress.
13. Brownlee N. Traffic Flow Measurement: Experiences with NeTraMet. RFC 2123 (1997)
14. Brownlee N., and Claffy K. Understanding Internet traffic streams: dragonflies and tortoises. IEEE Communication Magazine (2002)
15. Endace esurement systems web site: http://www.endace.com/networkMCards.htm.
16. http://www.caida.org/tools/measurement/coralreef/.
17. Libpcap library-publicly available following the libpcap link at http://www-nrg.ee.lbl.gov/.
18. Halevi S., and Krawczyk H. MMH: software message authentication in the Gbit/second rates. Fourth Workshop on Fast Software Encryption vol. 1267 (1997), Springer, LNCS pp.172-189
19. M. Molina, S. Niccolini, N. Duffield, A comparative experimental study of hash functions applied to Packet Sampling, submitted for publication. (Summary of results is in [7]).
20. B. Claise, Cisco Systems NetFlow Services Export Version 9, IETF draft-claise-netflow-9 - April 2004 - Work in progress.
21. Molina M., Castelli P., and Foddis G. Web traffic modelling exploiting TCP connections' temporal clustering through HTML-REDUCE. IEEE Network (2000)
22. MAWI Working Group Traffic Archive: http://tracer.csl.sony.co.jp/mawi/.
23. N. Hohn, D. Veitch. Inverting sampled traffic, Proceedings of the Third ACM SIGCOMM Conference on Internet Measurement, pp. 222-233.
24. N. Duffied, C. Lund. Predicting resource usage and estimation accuracy in an IP Flow Measurement Collection Infrastructure, Proceedings of Third CM SIGCOMM Conference on Internet Measurement, 179-191 2003.
25. C. Estan, K. Keys, D. Moore, G. Varghese. Building a better NetFlow, Proceedings of ACM SIGCOMM 2004, pp. 245-256.