Continuously maintaining quantile summaries of the most recent N elements over a data stream

Proceedings - International Conference on Data Engineering

Volumn 20, Issue , 2004, Pages 362-373

  Lin, Xuemin ^a   Lu, Hongjun ^b   Xu, Jian ^a   Yu, Jeffrey Xu ^c  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

AGGREGATION STATISTICS; DATA ELEMENTS; DATA STREAMS; HISTOGRAMS;

ALGORITHMS; COMPUTATION THEORY; DATA REDUCTION; DATA STRUCTURES; DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL MODELS; STATISTICAL METHODS;

DATA MINING;

EID: 2442631384     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2004.1320011     Document Type: Conference Paper

References (22)

1. R. Agrawal and A. Swami. A one-pass space-efficient algorithm for finding quantiles. In S. Chaudhuri, A. Deshpande, and R. Krishnamurthy, editors, COMAD, 1995.
2. K. Alsabti, S. Ranka, and V. Singh. A one-pass algorithm for accurately estimating quantiles for disk-resident data. In The VLDB Journal, pages 346-355, 1997.
3. Y. Chen, G. Dong, J. Han, B. W. Wah, and J. Wang. Multi-dimensional regression analysis of time-series data streams. In VLDB, 2002.
4. A. Das, J. Gehrke, and M. Riedewald. Approximate join processing over data streams. In SIGMOD, 2003.
5. M. Datar, A. Gionis, P. Indyk, and R. Motwani. Maintaining stream statistics over sliding windows: (extended abstract). In ACM-SIAM, pages 635-644, 2002.
6. A. Dobra, M. N. Garofalakis, J. Gehrke, and R. Rastogi. Processing complex aggregate queries over data streams. In SIGMOD, 2002.
7. M. Garofalakis and A. Kumar. Correlating xml data streams using tree-edit distance embeddings. In SIGMOD, 2003.
8. J. Gehrke, F. Korn, and D. Srivastava. On computing correlated aggregates over continual data streams. In SIGMOD, pages 13-24, 2001.
9. A. C. Gilbert, Y. Kotidis, S. Muthukrishnan, and M. J. Strauss. How to summarize the universe: Dynamic maintenance of quantiles. In VLDB, 2002.
10. M. Greenwald and S. Khanna. Space-efficient online computation of quantile summaries. In SIGMOD, pages 58-66, 2001.
11. S. Guha and N. Koudas. Approximating a data stream for querying and estimation: Algorithms and performance evaluation. In ICDE, 2002.
12. S. Guha, N. Koudas, and K. Shim. Data-streams and histograms. In STOC, pages 471-475, 2001.
13. S. Guha, N. Mishra, R. Motwani, and L. O'Callaghan. Clustering data streams. In FOCS, pages 359-366, 2000.
14. A. Gupta and D. Suciu. Stream processing of xpath queries with predicates. In SIGMOD, 2003.
15. J. Kang, J. Naughton, and S. Viglas. Evaluation window joins over undounded streams. In ICDE, 2003.
16. G. Manku and R. Motwani. Approximate frequency counts over data streams. In VLDB, 2002.
17. G. S. Manku, S. Rajagopalan, and B. G. Lindsay. Approximate medians and other quantiles in one pass and with limited memory. In SIGMOD, pages 426-435, 1998.
18. G. S. Manku, S. Rajagopalan, and B. G. Lindsay. Random sampling techniques for space efficient online computation of order statistics of large datasets. In SIGMOD, pages 251-262, 1999.
19. J. Munro and M. Paterson. Selection and sorting wiith limited storage. In TCS12, 1980.
20. C. Olston, J. Jiang, and J. Widom. Adaptive filters for continuous queries over distributed data streams. In SIGMOD, 2003.
21. R. Ramakrishan. Database Management Systems. McGraw-Hill, 2002.
22. Y. Zhu and D. Shasha. Statstream: statistical monitoring of thousands of data streams in real time. In VLDB, 2002.