Data cleansing techniques for large enterprise datasets

Proceedings - 2011 Annual SRII Global Conference, SRII 2011

Volumn , Issue , 2011, Pages 135-144

  Prasad, K Hima ^a   Faruquie, Tanveer A ^a   Joshi, Sachindra ^a   Chaturvedi, Snigdha ^a   Subramaniam, L Venkata ^a   Mohania, Mukesh ^a  

^a IBM INDIA RESEARCH LAB   (India)

Author keywords

[No Author keywords available]

Indexed keywords

DATA CHARACTERISTICS; DATA CLEANSING; DATA QUALITY; DATA SETS; ENTERPRISE DATA; ITERATIVE PROCESS; RIPPLE DOWN RULES;

INFORMATION MANAGEMENT;

DATA REDUCTION;

EID: 80051933614     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SRII.2011.26     Document Type: Conference Paper

References (22)

1. T. Redman, "The impact of poor data quality on the typical enterprise, " Communications of the ACM, vol. 2, pp. 79-82, 1998.
2. W. Eckerson, "Data Quality and the Bottom Line: Achieving Business Success through a Commitment to High Quality Data, " The Data Warehousing Institute, Tech. Rep., 2002.
3. T. C. Redman, "Data: An unfolding quality disaster, " Information Management Magazine, August 2004.
4. L. English, "The high costs of low-quality data, " Information Management Magazine, January 1998.
5. W. W. Eckerson, "Achieving business success through a commitment to high quality data, " TDWI Report Series: The Data Warehousing Institute, 2002.
6. "Global data management survey, " Price Waterhouse Coopers, 2001.
7. "IBM Quality Stage, " 2009, http://www-01.ibm.com/software/ data/infosphere/qualitystage/.
8. "Oracle Product Data Quality, " 2010, http://www.oracle.com/us/ products/middleware/data-integration/data-quality/index.html.
9. "Initiate Quality Solutions, " 2009, http://www.initiate.com/ PRODUCTS/INITIATEDATAQUALITYSUITE/Pages/default.aspx.
10. G. Kothari, T. A. Faruquie, L. V. Subramaniam, K. H. Prasad, and M. K. Mohania, "Transfer of supervision for improved address standardization, " in ICPR, 2010, pp. 2178-2181.
11. "Address Doctor, " 2010, http://www.addressdoctor.com/.
12. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma, "Improving data quality: consistency and accuracy, " in VLDB'07: Proceedings of the 33rd international conference on Very large data bases. VLDB Endowment, 2007, pp. 315-326.
13. S. Y. Sung, Z. Li, and P. Sun, "A fast filtering scheme for large database cleaning, " in Proceedings of the Conference Information and Knowledge Management, 2002.
14. E. Rahm and H. H. Do, "Data cleaning: Problems and current approaches, " in IEEE Data Engineering Bulletin, 2000.
15. M. N. Dani, T. A. Faruquie, R. Garg, G. Kothari, M. K. Mohania, K. H. Prasad, L. V. Subramaniam, and V. N. Swamy, "A knowledge acquisition method for improving data quality in services engagements, " in IEEE SCC, 2010, pp. 346-353.
16. P. Compton and R. Jansen, "A philosophical basis for knowledge acquisition, " Knowledge Acquisition, vol. 2, no. 3, pp. 241 - 257, September 1990.
17. V. H. Ho, P. Compton, B. Benatallah, J. Vayssire, L. Menzel, and H. Vogler, "An incremental knowledge acquisition method for improving duplicate invoices detection, " International Conference on Data Engineering, 2009.
18. A. Z. Broder, S. C. Glassman, M. S. Manasse, and G. Zweig, "Syntactic clustering of the web, " Computer Networks, vol. 29, no. 8-13, pp. 1157- 1166, 1997.
19. M. Henzinger, "Finding near-duplicate web pages: A large-scale evaluation of algorithms, " in In Proceedings of SIGIR, Aug. 2006.
20. M. S. Charikar, "Similarity estimation techniques from rounding algorithms, " in In 34th Annual ACM Symposium on Theory of Computing, May 2002.
21. H. Yu and H. Luo, "A novel possibilistic fuzzy leader clustering algorithm, " in RSFDGrC'09: Proceedings of the 12th International Conference on Rough Sets, Fuzzy Sets, Data Mining and Granular Computing, 2009, pp. 423-430.
22. T. A. Faruquie, K. H. Prasad, L. V. Subramaniam, M. K. Mohania, G. Venkatachaliah, S. Kulkarni, and P. Basu, "Data cleansing as a transient service, " in ICDE'10: Proceedings of the IEEE international conference on data Engineering, 2010. 144.