Modeling skew in data streams

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2006, Pages 181-192

  Korn, Flip ^a   Muthukrishnan, S ^b   Wu, Yihua ^b  

^a AT AND T LABS RESEARCH   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

Estimation; Modeling; Skew; Streaming algorithms

Indexed keywords

DATA STREAM APPLICATIONS; HISTOGRAMS; SKEWED DISTRIBUTIONS;

ALGORITHMS; COMPUTER SIMULATION; DATA MINING; INTRUSION DETECTION; PARAMETER ESTIMATION; PARAMETRIC DEVICES;

DATA STRUCTURES;

EID: 34250648954     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1142473.1142495     Document Type: Conference Paper

References (38)

1. L. Adamic. Zipf, power-law, pareto - a ranking tutorial, http://www.hpl.hp.com/research/idl/ papers/ranking/, 2000.
2. A. Arasu and G. S. Manku. Approximate counts and quantiles over sliding windows. In PODS, 2004.
3. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In PODS, 2002.
4. P. Barford, A. Bestavros, A. Bradley, and M. Crovella. Changes in web client access patterns characteristics and caching implications. In WWW, 1999.
5. A. Belussi and C. Faloutsos. Estimating the selectivity of spatial queries using the 'correlation' fractal dimension. In VLDB, 1995.
6. Z. Bi, C. Faloutsos, and F. Korn. The "dgx" distribution for mining massive, skewed data. In KDD, 2001.
7. CIDR, http://www.webopedia.com/TERM/C/CIDR.html.
8. E. Cohen and M. Strauss. Maintaining time-decaying stream aggregates. In PODS, 2003.
9. G. Cormode, T. Johnson, F. Korn, S. Muthukrishnan, O. Spatscheck, and D. Srivastava. Holistic udafs at streaming speeds. In SIGMOD, 2004.
10. G. Cormode and S. Muthukrishnan. An improved data stream summary: The count-min sketch and its applications. In LATIN, 2004.
11. G. Cormode and S. Muthukrishnan. Summarizing and mining skewed data streams. In SDM, 2005.
12. C. D. Cranor, T. Johnson, O. Spatscheck, and V. Shkapenyuk. Gigascope: A stream database for network applications. In SIGMOD, 2003.
13. M. Datar, A. Gionis, P. Indyk, and R. Motwani. Maintaining stream statistics over sliding windows. In SODA, 2002.
14. A. Deshpande, C. Guestrin, S. Madden, J.M. Hellerstein, and W. Hong. Model-driven data acquisition in sensor networks. In VLDB, 2004.
15. M. Evans, N. Hastings, and B. Peacock. Statistical Distributions. Wiley, New York, 3rd edition, 2000.
16. C. Faloutsos and I. Kamel. Beyond uniformity and independence: Analysis of R- trees using the concept of fractal dimension. In PODS, 1994.
17. C. Faloutsos, Y. Matias, and A. Silberschatz. Modeling skewed distributions using multifractals and the '80-20 law'. In VLDB, 1996.
18. P. Flajolet and G.N. Martin. Probabilistic counting. In FOCS, 1983.
19. X. Gabaix, P. Gopikrishnan, V. Plerou, and H.E. Stanley. A theory of power law distributions in financial market fluctuations. 423:267-270, 2003.
20. J. Gehrke, F. Korn, and D. Srivastava. On computing correlated aggregates over continual data streams. In SIGMOD, 2001.
21. A.C. Gilbert, W. Willinger, and A. Feldmann. Scaling analysis of conservative cascades, with applications to network traffic. In IEEE Transaction on Information Theory, volume 45, pages 971-991, 1999.
22. T. Krishnan G.J. McLachlan. The EM Algorithm and Extensions. Wiley-Interscience, 1996.
23. C. Jr, A. Traina, L. Wu, and C. Faloutsos. Fast feature selection using the fractal dimension. In SBBD, 2000.
24. E. Kohler, J. Li, V. Paxson, and S. Shenker. Observed structure of addresses in ip traffic. In IMC, 2002.
25. B. Krishnamurthy, H. Madhyastha, and O. Spatscheck. Atmen: a triggered network measurement infrastructure. In WWW, 2005.
26. Darpa intrusion detection evaluation, http://www.ll.mit.edu/IST/ideval/ index.html.
27. F. Li, C. Chang, G. Kollios, and A. Bestavros. Characterizing and exploiting reference locality in data stream applications. In ICDE, 2006.
28. B.B. Mandelbrot. Fractals and Scaling in Finance. Springer-Verlag, New York, 1997.
29. S. Muthukrishnan. Data streams: Algorithms and applications. In SODA, 2003.
30. S. Papadimitriou, H. Kitagawa, P. B. Gibbons, and C. Faloutsos. Loci: Fast outlier detection using the local correlation integral. In ICDE, 2003.
31. S.I. Resnick. Heavy tail modeling and teletraffic data. The Annals of Statistics, 25:1805-1869, 1997.
32. M. Roughan and C. Kalmanek. Pragmatic modeling of broad-band access traffic. In Computer Communications 26(8), 2003.
33. M. Schroeder. Fractals, Chaos, Power Laws: Minutes From an Infinite Paradise. W.H. Freeman and Company, New York, 1991.
34. M. Wang, T. Madhyastha, N.H. Chan, S. Papadimitriou, and C. Faloutsos. Data mining meets performance evaluation: Fast algorithm for modeling bursty traffic. In ICDE, 2002.
35. W. Willinger, D. Alderson, and L. Li. A pragmatic approach to dealing with high-variability in network measurements. In IMC, 2004.
36. W. Willinger and V. Paxson. Where mathematics meets the internet. Notices of the American Mathematical Society, 45(8):961-970, 1998.
37. W. Willinger, V. Paxson, and M.S. Taqqu. Self-similarity and Heavy Tails: Structural Modeling of Network Traffic. Chapman & Hall, New York, 1998.
38. A. Wong, L. Wu, P.B. Gibbons, and C. Faloutsos. Fast estimation of fractal dimension and correlation integral on stream data. In Inf. Process. Lett. 93(2): 91-97, 2005.