A quasi-likelihood approach for accurate traffic matrix estimation in a high speed network

Proceedings - IEEE INFOCOM

Volumn , Issue , 2008, Pages 412-420

  Cao, Jin ^a   Chen, Aiyou ^a   Bu, Tian ^a  

^a LUCENT TECHNOLOGIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; BOOLEAN FUNCTIONS; ERROR ANALYSIS; HIGH SPEED NETWORKS; INTERNET; MANAGEMENT INFORMATION SYSTEMS; MATRIX ALGEBRA; MAXIMUM LIKELIHOOD ESTIMATION; PROBABILITY DISTRIBUTIONS; SPEED; TREES (MATHEMATICS);

TRAFFIC MATRICES; TRAFFIC MATRIX ESTIMATION;

COMPUTER NETWORKS;

EID: 51349138448     PISSN: 0743166X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/INFOCOM.2007.13     Document Type: Conference Paper

References (26)

1. NLNAR Traces. http://www.nlanr.net.
2. N. Alon, P. B. Gibbons, Y. Matias, and M. Szegedy. Tracking join and self-join sizes in limited storage. In PODS, pages 10-20, New York, NY, USA, 1999. ACM Press.
3. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In PODS, 2002.
4. M. Cai, J. Pan, Y.-K. Kwok, and K. Hwang. Fast and accurate traffic matrix measurement using adaptive cardinality counting. In SIGCOMM'05 Workshops, 2005.
5. J. Cao, D. Davis, S. V. Wiel, and B. Yu. Time-varying network tomography: router link data. Journal of American Statistical Association, 95:1063-1075, 2000.
6. A. Chen, J. Cao, and T. Bu. Accurate and scale-free origin-destination flow statistics estimation in high speed networks. In Bell Labs Technical Memorandum, 2006.
7. A. Chen, J. Cao, and T. Bu. A simple and efficient estimation method for stream expression cardinality. In the 33nd International Conference on Very Large Data Bases (VLDB), Vienna, Austria, 2007.
8. J. Considine, F. Li, G. Kollios, and J. Byers. Approximate aggregation techniques for sensor databases. In The 20th International Conference on Data Engineering (ICDE), 2004.
9. A. Dobra, M. Garofalakis, J. Gehrke, and R. Rastogi. Processing complex aggregate queries over data streams. In SIGMOD, pages 61-72, New York. NY USA, 2002. ACM Press.
10. N. G. Duffield and M. Grossglauser. Trajectory sampling for direct traffic observation. In SIGCOMM, pages 271-282, 2000.
11. A. Feldmann, A. G. Greenberg, C. Lund, N. Reingold, J. Rexford, and F. True. Deriving traffic demands for operational IP networks: methodology and experience. In ACM SIGCOMM, pages 257-270, 2000.
12. S. Ganguly. Counting distinct items over update streams. In ISAAC, pages 505-514, 2005.
13. S. Ganguly, M. Garofalakis, and R. Rastogi. Tracking set-expression cardinalities over continuous update streams. The VLDB Journal, 13:354-369, 2004.
14. N. Johnson, S. Kotz, and N. Balakrishnan. Continuous Univariate distributions, Vol. 2. Wiley Series in Probability and Statistics, 1995.
15. G. Liang and B. Yu. Maximum pseudo likelihood estimation in network tomography. IEEE Trans. Signal Processing, 51:2043-2053, 2003.
16. A. Medina, N. Taft, K. Salamatian. S. Bhattacharyya, and C. Diot. Traffic matrix estimation: existing techniques and new directions. In Proceedings of the ACM SIGCOMM, pages 161-174, 2002.
17. A. Nucci, R. Cruz, N. Taft, and C. Diot. Design of igp link weight changes for estimation of traffic matrices. In IEEE INFOCOM, 2004.
18. G. N. M. P. Flajolet. Probabilistic counting. In In Proc. Symp. on Foundations of Computer Science (FOCS), 1983.
19. A. Soule, A. Nucci, R. Cruz, E. Leonardi, and N. Taft. How to identify and estimate the largest traffic matrix elements in a dynamic environment. In ACM Sigmetrics, New York, 2004.
20. C. Tebaldi and M. West. Bayesian inference on network traffic using link count data. Journal of the American Statistical Association, 93(442):557-576, 1998.
21. Y. Vardi. Network tomography: Estimating source-destination traffic intensities from link data. Journal of the American Statistical Association, 91:365-377, 1996.
22. H. White. Maximum likelihood estimation of misspecified models. Econometrica, 50:1-25, 1982.
23. Y. Zhang, M. Roughan, N. Duffield, and A. Greenberg. Fast accurate computation of large-scale ip traffic matrices from link loads. In ACM SIGMETRICS, 2003.
24. Y. Zhang, M. Roughan, C. Lund, and D. Donoho. An information-theoretic approach to traffic matrix estimation. In ACM SIGCOMM, 2003.
25. Q. G. Zhao, Z. Ge, J. Wang, and J. J. Xu. Robust traffic matrix estimation with imperfect information: making use of multiple data sources. In Proceedings of the ACM SIGMETRICS, 2006.
26. Q. G. Zhao, A. Kumar, J. Wang, and J. J. Xu. Data streaming algorithms for accurate and efficient measurement of traffic and flow matrices. In Proceedings of the ACM SIGMETRICS, pages 350-361, 2005.