Fisher information of sampled packets: An application to flow size estimation

Proceedings of the ACM SIGCOMM Internet Measurement Conference, IMC

Volumn , Issue , 2006, Pages 15-26

  Ribeiro, Bruno ^a   Towsley, Don ^a   Ye, Tao ^b   Bolot, Jean ^b  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

^b Sprint Applied Research & Advanced Technology Labs California   (United States)

Author keywords

Efficient estimator; Fisher information; Flow size distribution; Maximum likelihood estimation; Packet sampling; Probabilistic sampling

Indexed keywords

EFFICIENT ESTIMATORS; FLOW SIZE DISTRIBUTION; PACKET SAMPLING; PROBABILISTIC SAMPLING;

CRAMER-RAO BOUNDS; FISHER INFORMATION MATRIX; INTERNET; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILISTIC LOGICS; TELECOMMUNICATION TRAFFIC;

PACKET NETWORKS;

EID: 34547402403     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1177080.1177083     Document Type: Conference Paper

References (23)

1. Weifeng Chen, Yong Huang, Bruno F. Ribeiro, Kyoungwon Suh, Honggang Zhang, Edmundo de Souza e Silva, Jim Kurose, and Don Towsley. Exploiting the IPID field to infer network path and end-system characteristics. In Proceeding of the 2005 Passive and Active Measurement (PAM'05) Workshop, March 2005.
2. Thomas M. Cover and Joy A. Thomas. Elements of Information Theory. John Wiley & sons, 1991.
3. Nick Duffield, Carsten Lund, and Mikkel Thorup. Estimating flow distributions from sampled flow statistics. IEEE/ACM Transactions on Networking, 13(5):933-946, 2005.
4. Nick Duffield, Carsten Lund, and Mikkel Thorup. Optimal combination of sampled network measurements. In IMC 05: Proceeding of the 5th ACM/USENIX Internet Measurement Conference, October 2005.
5. Nick G. Duffield, Carsten Lund, and Mikkel Thorup. Learn more, sample less: control of volume and variance in network measurement. 51(5):1756-1775, 2005.
6. Cristian Estan, Stefan Savage, and George Varghese. Automatically Inferring Patterns of Resource Consumption in Network Traffic. In Proc. ACM SIGCOMM '03, Karlsruhe, Germany, Aug. 2003.
7. C. Fraleigh, S. Moon, B. Lyles, C. Cotton, M. Khan, D. Moll, R. Rockell, T. Seely, and C. Diot. Packet-level traffic measurements from the sprint IP backbone. IEEE Network, 2003.
8. John D. Gorman and Alfred O. Hero. Lower bounds for parametric estimation with constraints. IEEE Transactions on Information Theory, 36(6):1285-1301, Nov 1990.
9. Nicolas Hohn and Darryl Veitch. Inverting sampled traffic. In IMC '03: Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement, pages 222-233, New York, NY, USA, 2003. ACM Press.
10. Steven M. Kay. Fundamentals of Statistical Signal Processing, Volume I: Estimation Theory. Prentice Hall PTR, March 1993.
11. Ramana Rao Kompella and Cristian Estan. The power of slicing in internet flow measuremet. In IMC '05: Proceeding of the 5th ACM/USENIX Internet Measurement Conference, October 2005.
12. S. Muthukrishnan. Data streams: algorithms and applications. In Proc. of ACM SODA, invited talks, pages 413-413, 2003. A complete version is available at (http://athos.rutgers.edu/~muthu/stream-1-1.ps).
13. William H. Press, Brian P. Flannery, Saul A. Teukolsky, and William T. Vetterling. Numerical Recipes in C : The Art of Scientific Computing. Cambridge University Press, October 1992.
14. Richard A. Redner and Homer F. Walker. Mixture Densities, Maximum Likelihood and the EM Algorithm. SIAM Review, 26(2):195-239, April 1984.
15. RFC791. Internet protocol. September 1981. DARPA Internet Program Protocol Specification.
16. M. J. Schervish. Theory of Statistics. Springer, 1995.
17. Ram Zamir. A Proof of the Fisher Information Inequality via a Data Processing Argument. IEEE Transactions on Information Theory, 44(3):1246-1250, 1998.
18. Qi Zhao, Abhishek Kumar, Jia Wang, and Jun Xu. Data streaming algorithms for accurate and efficient measurement of traffic and flow matrices. In Proc. of ACM SIGMETRICS, June 2005. to appear.
19. Cisco NetFlow. http://www.cisco.com/warp/public/732/Tech/nmp/netflow.
20. IPFIX, IETF Working Group Charter IP Flow Information Export. http://www.ietf.org/html.charters/ipfixcharter.html.
21. Packet Sampling, IETF Working Group Charter PSAMP. http://www.ietf.org/ html.charters/psampcharter.html.
22. sFlow. http://www.sflow.org.
23. Sprint packet trace analysis. http://ipmon.sprint.com/packstat.