Summarizing and mining inverse distributions on data streams via dynamic inverse sampling

VLDB 2005 - Proceedings of 31st International Conference on Very Large Data Bases

Volumn 1, Issue , 2005, Pages 25-36

  Cormode, Graham ^a   Muthukrishnan, S ^b   Rozenbaum, Irina ^b  

^a LUCENT TECHNOLOGIES   (United States)

^b RUTGERS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA DISTRIBUTIONS; MINING INVERSE DISTRIBUTIONS; NETWORK DATA STREAMS; STREAM MANAGEMENT SYSTEMS;

ALGORITHMS; APPROXIMATION THEORY; DATA STORAGE EQUIPMENT; MONITORING; PROBLEM SOLVING; SAMPLING;

DATA ACQUISITION;

EID: 33745615174     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. D. Abadi, D. Carney, U. Çetintemel, M. Cherniack, C. Convey, C. Erwin, E. Galvez, M. Hatoun, A. Maskey, A. Rasin, A. Singer, M. Stonebraker, N. Tatbul, Y. Xing, R. Yan, and S. Zdonik. Aurora: a data stream management system. In ACM SIGMOD, 2003.
2. N. Alon, Y. Matias, and M. Szegedy. The space complexity of approximating the frequency moments. In STOC, 1996.
3. B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom. Models and issues in data stream systems. In PODS, 2002.
4. J. L. Carter and M. N. Wegman. Universal classes of hash functions. JCSS, 18(2):143-154, 1979.
5. S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. R. Madden, F. Reiss, and M. A. Shah. TelegraphCQ: continuous dataflow processing. In ACM SIGMOD, 2003.
6. M. Charikar, S. Chaudhuri, R. Motwani, and V. R. Narasayya. Towards estimation error guarantees for distinct values. In PODS, 2000.
7. S. Chaudhuri, R. Motwani, and N. Narasayya. On random sampling over joins. In ACM SIGMOD, 1999.
8. S. Chaudhuri, R. Motwani, and V. Narasayya. Random sampling for histogram construction: How much is enough? In ACM SIGMOD, 1998.
9. G. Cormode, F. Korn, S. Muthukrishnan, T. Johnson, O. Spatscheck, and D. Srivastava. Holistic UDAFs at streaming speeds. In ACM SIGMOD, 2004.
10. G. Cormode and S. Muthukrishnan. What's hot and what's not: Tracking most frequent Items dynamically. In ACM PODS, 2003.
11. C. Cranor, T. Johnson, O. Spatscheck, and V. Shkapenyuk. Gigascope: A stream database for network applications. In ACM SIGMOD, 2003.
12. M. Datar, A. Gionis, P. Indyk, and R. Motwani. Maintaining stream statistics over sliding windows. In SODA, 2002.
13. M. Datar and S. Muthukrishnan. Estimating rarity and similarity over data stream windows. In ESA, 2002.
14. C. Estan and G. Varghese. New directions in traffic measurement and accounting. In ACM SIGCOMM, 2002.
15. P. Flajolet and G. N. Martin. Probabilistic counting algorithms for database applications. Journal of Computer and System Sciences, 31:182-209, 1985.
16. G. Frahling and C. Sohler. Coresets in dynamic geometric data streams. In STOC, May 2005.
17. S. Ganguly, M. Garofalakis, and R. Rastogi. Processing set expressions over continuous update streams. In ACM SIGMOD, 2003.
18. M. Garofalakis, J. Gehrke, and R. Rastogi. Querying and mining data streams: You only get one look. In ACM SIGMOD, 2002.
19. P.Gibbons. Distinct sampling for highly-accurate answers to distinct values queries and event reports. In VLDB, 2001.
20. P. Gibbons and Y. Matias. New sampling-based summary statistics for improving approximate query answers. In ACM SIGMOD, 1998.
21. P. Gibbons and S. Tirthapura. Estimating simple functions on the union of data streams. In SPAA, 2001.
22. P. B. Gibbons, Y. Matias, and V. Poosala. Fast incremental maintenance of approximate histograms. In VLDB, 1997.
23. E. Kushilevitz and N. Nisan. Communication Complexity. Cambridge University Press, 1997.
24. Internet traffic archive, http: //ita.ee.lbl.gov/.
25. D. Madigan. DIMACS working group on monitoring message streams, http://stat.rutgers.edu/~madigan/mms/, 2003.
26. G.S. Manku and R. Motwani. Approximate frequency counts over data streams. In VLDB, 2002.
27. R. Motwani and P. Raghavan. Randomized Algorithms. CUP, 1995.
28. S. Muthukrishnan. Data streams: Algorithms and applications. In SODA, 2003.
29. F. Olken. Random Sampling from Databases. PhD thesis, Berkeley, 1997.
30. Stanford stream data manager. http://www-db. stanford.edu/stream/sqr.
31. J. S. Vitter. Random sampling with a reservoir. ACM Transactions on Mathematical Software, 11(1):37-57, 1985.