An effective multi-layer model for controlling the quality of data

Proceedings of the International Database Engineering and Applications Symposium, IDEAS

Volumn , Issue , 2007, Pages 28-36

  Leung, Carson Kai Sang ^a   Mateo, Mark Anthony F ^a   Nadler, Andrew J ^b  

^a UNIVERSITY OF MANITOBA   (Canada)

^b GOVERNMENT OF MANITOBA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; DECISION SUPPORT SYSTEMS; INFORMATION MANAGEMENT; MINING; QUALITY CONTROL; SEARCH ENGINES; TECHNOLOGY;

AGRICULTURAL APPLICATIONS; CASE STUDIES; DATA CONSISTENCY; DATA QUALITY; DATABASE ENGINEERING; INTERNAL LAYERS; MINING RESULTS; MULTI LAYERING; OBSERVED DATA; QUALITY OF DATA; THREE-LAYER MODELS; WEATHER DATA;

APPLICATIONS;

EID: 47949083402     PISSN: 10988068     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IDEAS.2007.4318086     Document Type: Conference Paper

References (23)

1. M. Agyemang, K. Barker, and R. Alhajj. A comprehensive survey of numeric and symbolic outlier mining techniques. Intelligent Data Analysis, 10(6), pp. 521-538, 2006.
2. M. Benedikt, P. Bohannon, and G. Bruns. Data cleaning for decision support. In Proc. CleanDB 2006.
3. P. Bhattacharya, M. Rahman, and B.C. Desai. Image representation and retrieval using support vector machine and fuzzy c-means clustering based semantical spaces. In Proc. ICPR 2006, pp. 929-935.
4. J.-F. Boulicaut and B. Jeudy. Mining free itemsets under constraints. In Proc. IDEAS 2001, pp. 322-329.
5. W. Cheung and O.R. Zaïane. Incremental mining of frequent patterns with candidate generation or support constraint. In Proc. IDEAS 2003, pp. 111-116.
6. B.T. Dai, N. Koudas, et al. Column heterogeneity as a measure of data quality. In Proc. CleanDB 2006.
7. S. Feng, Q. Hu, and W. Qian. Quality control of daily meteorlogical data in China. Int. J. Climatology, 24(7), pp. 853-870, 2004.
8. M. Halkidi, D. Gunopulos, et al. A framework for semi-supervised learning based on subjective and objective clustering criteria. In Proc. ICDM 2005, pp. 637-640.
9. K. Hubbard, S. Goddard, et al. Performance of quality assurance procedures for an applied climate information system. J. Atmospheric and Oceanic Technology, 22(1), pp. 105-112, 2005.
10. S. Karatas and L. Yalcin. Data quality management. In Proc. TECO 2005.
11. E.M. Knorr, R.T. Ng, and V. Tucakov. Distance-based outliers: algorithms and applications. VLDB J., 8(3-4), pp. 237-253, 2000.
12. C.R. Kondragunta and K. Shrestha. Automated real-time operational rain gauge quality-control tools in NWS hydrologic operations. In Proc. 20th American Meteorological Society Conf. on Hydrology, 2006.
13. L.V.S. Lakshmanan, C.K.-S. Leung, and R.T. Ng. Efficient dynamic mining of constrained frequent sets. ACM TODS, 28(4), pp. 337-389, 2003.
14. J. Lanzante. Resistant, robust and non-parametric techniques for the analysis of climate data: theory and examples, including applications to historical radiosonde station data. Int. J. Climatology, 16(11), pp. 1197-1226, 1996.
15. C.K.-S. Leung. Interactive constrained frequent-pattern mining system. In Proc. IDEAS 2004, pp. 49-58.
16. C.K.-S. Leung and Q.I. Khan. Efficient mining of constrained frequent patterns from streams. In Proc. IDEAS 2006, pp. 61-68.
17. C.K.-S. Leung, Q.I. Khan, and T. Hoque. CanTree: a tree structure for efficient incremental mining of frequent patterns. In Proc. ICDM 2005, pp. 274-281.
18. C.K.-S. Leung, R.K. Thulasiram, and D.A. Bondarenko. An efficient system for detecting outliers from financial time series. In Proc. BNCOD 2006, pp. 190-198.
19. R. Rastogi and K. Shim. PUBLIC: a decision tree classifier that integrates building and pruning. Data Mining and Knowledge Discovery, 4(4), pp. 315-344, 2000.
20. T. Reek, S.R. Doty, and T.W. Owen. A deterministic approach to the validation of historical daily temperature and precipitation data from the cooperative network. Bulletin of the American Meteorological Society, 73(6), pp. 753-762, 1992.
21. F. Vejen (ed.), C. Jacobsson, et al. Quality control of meteorological observations: automatic methods used in the Nordic countries. Report 8/2002 KLIMA, Norwegian Meteorological Institute, Norway, 2002.
22. J. You and K.G. Hubbard. Quality control of weather data during extreme events. J. Atmospheric and Oceanic Technology, 23(2), pp. 184-197, 2006.
23. Y. Zhuang and L. Chen. In-network outlier cleaning for data collection in sensor networks. In Proc. CleanDB 2006.