Maintaining stream statistics over sliding windows

SIAM Journal on Computing

Volumn 31, Issue 6, 2002, Pages 1794-1813

  Datar, Mayur ^a   Gionis, Aristides ^a   Indyk, Piotr ^b   Motwani, Rajeev ^a  

^a Stanford University   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Approximation algorithms; Data streams; Sliding windows; Statistics

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; BOUNDARY CONDITIONS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; DATABASE SYSTEMS; MONTE CARLO METHODS; RANDOM PROCESSES; THEOREM PROVING; VECTORS;

APPROXIMATION ALGORITHMS; DATA STREAMS; SLIDING WINDOW MODEL;

STATISTICS;

EID: 0036767270     PISSN: 00975397     EISSN: None     Source Type: Journal    
DOI: 10.1137/S0097539701398363     Document Type: Article

References (16)

1. N. Alon, Y. Matias, and M. Szegedy, The space complexity of approximating the frequency moments, in Proceedings of the 28th Annual ACM Symposium on Theory of Computing, ACM, New York, 1996, pp. 20-29.
2. C. Cortes, K. Fisher, D. Pregibon, and A. Rogers, Hancock: A language for extracting signatures from data streams, in Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, New York, 2000, pp. 9-17.
3. S. Chaudhuri, R. Motwani, and V. R. Narasayya, On random sampling over joins, in Proceedings of the ACM SIGMOD International Conference on Management of Data, ACM, New York, 1999, pp. 263-274.
4. M. Fang, H. Garcia-Molina, R. Motwani, N. Shivakumar, and J.D. Ullman, Computing iceberg queries efficiently, in Proceedings of the 24th International Conference on Very Large Data Bases, New York, NY, 1998, pp. 299-310.
5. J. Feigenbaum, S. Kannan, M. Strauss, and M. Viswanathan, An approximate L1-difference algorithm for massive data streams, in Proceedings of the 40th IEEE Symposium on Foundations of Computer Science, IEEE Computer Society, Los Alamitos, CA, 1999, pp. 501-511.
6. P. Flajolet and G. Martin, Probabilistic counting, in Proceedings of the 24th IEEE Symposium on Foundations of Computer Science, IEEE Computer Society, Los Alamitos, CA, 1983, pp. 76-82.
7. C. Fraleigh, S. Moon, C. Diot, B. Lyles, and F. Tobagi, Architecture of a Passive Monitoring System for Backbone IP Networks, Technical report TR00-ATL-101-801, Sprint Advanced Technology Laboratories, Burlingame, CA, 2000.
8. A. Gilbert, Y. Kotidis, S. Muthukrishnan, and M. Strauss, Surfing wavelets on streams: One-pass summaries for approximate aggregate queries, in Proceedings of the 27th International Conference on Very Large Data Bases, Rome, Italy, 2001, pp. 79-88.
9. S. Guha and N. Koudas, Approximating a data stream for querying and estimation: Algorithms and performance evaluation, in Proceedings of the Eighteenth International Conference on Data Engineering, San Jose, CA, 2002, pp. 567-576.
10. S. Guha and N. Koudas, Data-streams and histograms, in Proceedings of the Thirty-Third Annual ACM Symposium on Theory of Computing, ACM, New York, 2001, pp. 471-475.
11. S. Guha, N. Mishra, R. Motwani, and L. O'Callaghan, Clustering data streams, in Proceedings of the 41st Annual IEEE Symposium on Foundations of Computer Science, IEEE Computer Society, Los Alamitos, CA, 2000, pp. 359-366.
12. M. R. Henzinger, P. Raghavan, and S. Rajagopalan, Computing on Data Streams, Technical report TR 1998-011. Compaq Systems Research Center, Palo Alto, CA, 1998.
13. P. Indyk, Stable distributions, pseudorandom generators, embeddings and data stream computation, in Proceedings of the 41st IEEE Symposium on Foundations of Computer Science, IEEE Computer Society, Los Alamitos, CA, 2000, pp. 189-197.
14. H. V. Jagadish, N. Koudas, S. Muthukrishnan, V. Poosala, K. Sevcik, and T. Suel, Optimal histograms with quality guarantees, in Proceedings of the 24th International Conference on Very Large Data Bases, New York, NY, 1998, pp. 275-286.
15. R. Motwani and P. Raghavan, Randomized Algorithms, Cambridge University Press, Cambridge, UK, 1995.
16. Cisco Systems, Netflow Services and Applications, White paper, Cisco Systems, San Jose, CA, 2000; also available online from http://www.cisco.com/warp/public/cc/pd/iosw/ioft/neflct/tech/napps_wp.htm.