How to screen a data stream: Quality-driven load shedding in sensor data streams

Proceedings of the 2009 International Conference on Information Quality, ICIQ 2009

Volumn , Issue , 2009, Pages

  Klein, Anja ^a   Hackenbroich, Gregor ^a   Lehner, Wolfgang ^b  

^a SAP RESEARCH   (Germany)

^b DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ERRORS; DATA ITEMS; DATA LOSS; DATA OVERLOAD; DATA QUALITY; DATA QUALITY MANAGEMENT; DATA RATES; DATA STREAM; DATA STREAM MANAGEMENT SYSTEMS; JOIN PROCESSING; LOAD-SHEDDING; LOW-LATENCY; OVERSTRESSES; SENSOR DATA; STREAM PROCESSING; SYSTEM RESOURCES; WEATHER DATA;

APPROXIMATION ALGORITHMS; DATA COMMUNICATION SYSTEMS; DIGITAL STORAGE; INFORMATION ANALYSIS; QUALITY MANAGEMENT;

INFORMATION MANAGEMENT;

EID: 84871576911     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. D. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik. Aurora: A new model and architecture for data stream management. Special Issue on Best Papers of VLDB 2002, 12(2):120-139, 2003.
2. B. Babcock, M. Datar, and R. Motwani. Load shedding for aggregation queries over data streams. In ICDE'04, pages 350-361, 2004.
3. C. Batini and M. Scannapieco. Data Quality: Concepts, Methodologies and Techniques (Data-Centric Systems and Applications). 2006.
4. P. J. Haas. Large-sample and deterministic confidence intervals for online aggregation. In SSDBM'97, pages 51-63, 1997.
5. C. J. Hahn, S. G. Warren, and J. London. Edited synoptic cloud reports from ships and land stations over the globe, 1982-1991, 2008.
6. T. Johnson, S. Muthukrishnan, V. Shkapenyuk, and O. Spatscheck. Query-aware sampling for data streams. In ICDE'07 Workshops, pages 664-673, 2007.
7. J. M. Juran. Juran's quality control handbook. 4. ed edition, 1988.
8. J. Kang, J. F. Naughton, and S. D. Viglas. Evaluating window joins over unbounded streams. In VLDB'02, pages 341-352, 2002.
9. A. Klein. Incorporating quality aspects in sensor data streams. In PIKM'07, pages 77-84, 2007.
10. J. Kraemer and B. Seeger. Pipes - a public infrastructure for processing and exploring streams. In SIGMOD'04, pages 925-926, 2004.
11. Z. Longbo, L. Zhanhuai, W. Zhenyou, and Y. Min. Semantic load shedding for sliding window join- aggregation queries over data streams. In ICCIT'07, pages 2152-2155, 2007.
12. F. Naumann and C. Rolker. Assessment methods for information quality criteria. In ICIQ'00, pages 148-162, 2000.
13. N.N. Engineering statistics handbook, 2008.
14. A. Ojewole, Q. Zhu, and W.-C. Hou. Window join approximation over data streams with importance semantics. In CIKM'06, pages 112-121, 2006. (Pubitemid 47203558)
15. L. Peng and K. S. Candan. Data-quality guided load shedding for expensive in-network data processing. In ICDE'07, pages 1325-1328, 2007. (Pubitemid 47422148)
16. W. Shaw. Renement of the Normal Quantile, Simple improvements to the Beasley-Springer-Moro method of simulating the Normal Distribution, and a comparison with Acklam's method and Wichura's AS241, Kings College working paper, 2007.
17. U. Srivastava and J. Widom. Memory-limited execution of windowed stream joins. In VLDB'04, pages 324-335, 2004.
18. V. C. Storey and R. Y. Wang. An analysis of quality requirements in database design. In ICIQ'03, pages 64-87, 1998.
19. D. M. Strong, Y. W. Lee, and R. Y. Wang. Data quality in context. ACM Communications, 40(5):103-110, 1997.
20. N. Tatbul and S. Zdonik. Window-aware load shedding for aggregation queries over data streams. In VLDB'06, pages 799-810, 2006.
21. T. Urhan and M. J. Franklin. Xjoin: A reactively-scheduled pipelined join operator. IEEE Data Engineering Bulletin, 23:27-33, 2000.
22. R. Y. Wang and D. M. Strong. Beyond accuracy: What data quality means to data consumers. Journal of Management Information Systems, 12(4):5-33, 1996.