Continuous monitoring of distributed data streams over a time-based sliding window

Algorithmica

Volumn 62, Issue 3-4, 2012, Pages 1088-1111

  Chan, Ho Leung ^a   Lam, Tak Wah ^a   Lee, Lap Kei ^b   Ting, Hing Fung ^a  

^a UNIVERSITY OF HONG KONG   (Hong Kong)

^b MAX PLANCK INSTITUTE FOR INFORMATICS   (Germany)

Author keywords

Algorithms; Communication; Distributed data streams; Frequent items; Quantiles

Indexed keywords

ALGORITHMS; COMMUNICATION; ERROR STATISTICS;

CLASSICAL STATISTICS; COMMUNICATION COST; CONTINUOUS MONITORING; DISTRIBUTED DATA STREAMS; FREQUENT ITEMS; GLOBAL STATISTICS; QUANTILES; SLIDING WINDOW;

MONITORING;

EID: 79952701285     PISSN: 01784617     EISSN: 14320541     Source Type: Journal    
DOI: 10.1007/s00453-011-9506-5     Document Type: Article

References (33)

1. Aggarwal, C.: Data Streams: Models and Algorithms. Springer, Berlin (2006)
2. Alon, N., Matias, Y., Szegedy, M.: The space complexity of approximating the frequency moments. J. Comput. Syst. Sci. 58(1), 137-147 (1999)
3. Arackaparambil, C., Brody, J., Chakrabarti, A.: Functional monitoring without monotonicity. In: Proceedings of the 36th International Colloquium on Automata, Languages and Programming, pp. 95-106 (2009)
4. Arasu, A., Manku, G.: Approximate counts and quantiles over sliding windows. In: Proceedings of the 23rd ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 286-296 (2004)
5. Babai, L., Gal, A., Kimmel, P., Lokam, S.: Communication complexity of simultaneous messages. SIAM J. Comput. 33(1), 137-166 (2004)
6. Babcock, B., Datar, M., Motwani, R.: Sampling from a moving window over streaming data. In: Proceedings of the 13th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 633-634 (2002)
7. Babcock, B., Olston, C.: Distributed top-k monitoring. In: Proceedings of the 22nd ACM SIGMOD International Conference on Management of Data, pp. 28-39 (2003)
8. Busch, C., Tirthapua, S.: A deterministic algorithm for summarizing asynchronous streams over a sliding window. In: Proceedings of the 22nd Symposium on Theoretical Aspects of Computer Science, pp. 265-476 (2007)
9. Cormode, G., Garofalakis, M.: Sketching streams through the net: distributed approximate query tracking. In: Proceedings of the 31st International Conference on Very Large Data Bases, pp. 13-24 (2005)
10. Cormode, G., Garofalakis, M., Muthukrishnan, S., Rastogi, R.: Holistic aggregates in a networked world: distributed tracking of approximate quantiles. In: Proceedings of the 24th ACM SIGMOD International Conference on Management of Data, pp. 25-36 (2005)
11. Cormode, G., Korn, F., Tirthapura, S.: Time-decaying aggregates in out-of-order streams. In: Proceedings of the 27th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 89-98 (2008)
12. Cormode, G., Muthukrishnan, S., Yi, K.: Algorithms for distributed functional monitoring. In: Proceedings of the 19th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1076-1085 (2008)
13. Cormode, G., Muthukrishnan, S., Yi, K., Zhang, Q.: Optimal sampling from distributed streams. In: Proceedings of the 29th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 77-86 (2010)
14. Das, A., Ganguly, S., Garofalakis, M., Rastogi, R.: Distributed set-expression cardinality estimation. In: Proceedings of the 30th International Conference on Very Large Data Bases, pp. 312-323 (2004)
15. Datar, M., Gionis, A., Indyk, P., Motwani, R.: Maintaining stream statistics over sliding windows. SIAM J. Comput. 31(6), 1794-1813 (2002)
16. Datar, M., Muthukrishnan, S.: Estimating rarity and similarity over data stream windows. In: Proceedings of the 10th Annual European Symposium on Algorithms, pp. 323-334 (2002)
17. Demaine, E., Lopez-Ortiz, A., Munro, J.: Frequency estimation of internet packet streams with limited space. In: Proceedings of the 10th Annual European Symposium on Algorithms, pp. 348-360 (2002)
18. Gibbons, P., Tirthapura, S.: Distributed streams algorithms for sliding windows. In: Proceedings of the 14th Annual ACM Symposium on Parallel Algorithms and Architectures, pp. 63-72 (2002)
19. Greenwald, M., Khanna, S.: Power-conserving computation of order-statistics over sensor networks. In: Proceedings of the 23rd ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 275-285 (2004)
20. Guha, S., Koudas, N., Shim, K.: Data-streams and histograms. In: Proceedings of the 33rd Annual ACM Symposium on Theory of Computing, pp. 471-475 (2001)
21. Indyk, P.: Stable distributions, pseudorandom generators, embeddings and data stream computation. In: Proceedings of the 41st Annual Symposium on Foundations of Computer Science, pp. 148-155 (2000)
22. Jain, N., Yalagandula, P., Dahlin, M., Zhang, Y.: Insight: A distributed monitoring system for tracking continuous queries. In: Proceedings of the 20th ACM Symposium on Operating Systems Principles, pp. 1-7 (2005)
23. Keralapura, R., Cormode, G., Ramamirtham, J.: Communication-efficient distributed monitoring of thresholded counts. In: Proceedings of the 25th ACM SIGMOD International Conference on Management of Data, pp. 289-300 (2006)
24. Lee, L.K., Ting, H.F.: Maintaining significant stream statistics over sliding windows. In: 17th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 724-732 (2006)
25. Lee, L.K., Ting, H.F.: A simpler and more efficient deterministic scheme for finding frequent items over sliding windows. In: Proceedings of the 25th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 290-297 (2006)
26. Manjhi, A., Shkapenyuk, V., Dhamdhere, K., Olston, C.: Finding (recently) frequent items in distributed data streams. In: Proceedings of the 14th Annual ACM Symposium on Parallel Algorithms and Architectures, pp. 767-778 (2005)
27. Mouratidis, K., Bakiras, S., Papadias, D.: Continuous monitoring of top-k queries over sliding windows. In: Proceedings of the 25th ACM SIGMOD International Conference on Management of Data, pp. 635-646 (2006)
28. Muthukrishnan, S.: Data Streams: Algorithms and Applications. Now Publishers, Hanover (2005)
29. Olston, C., Jiang, J., Widom, J.: Adaptive filters for continuous queries over distributed data streams. In: Proceedings of the 22nd ACM SIGMOD International Conference on Management of Data, pp. 563-574 (2003)
30. Sharfman, I., Schuster, A., Keren, D.: A geometric approach to monitoring threshold functions over distributed data streams. ACM Transactions on Database Systems 32(4) (2007)
31. Yi, K., Zhang, Q.: Optimal tracking of distributed heavy hitters and quantiles. In: Proceedings of the 28th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems, pp. 167-174 (2009)
32. Yi, K., Zhang, Q.: Private communication
33. Yi, K., Zhang, Q.: Multi-dimensional online tracking. In: Proceedings of the 20th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1098-1107 (2009)