Semantic-based intelligent data clean framework for big data

Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics, SPAC 2014

Volumn , Issue , 2014, Pages 448-453

  Wang, Jia ^a   Song, Zhijun ^a   Li, Qian ^a   Yu, Jun ^b   Chen, Fei ^c  

^a CHINA ELECTRONICS TECHNOLOGY GROUP CORPORATION   (China)

^b HANGZHOU DIANZI UNIVERSITY   (China)

^c Nanjing Nari Information Communication Technology Co   (China)

Author keywords

Big data; Data cleansing; Parallelized processing; Semantic based framework; Semantic based Keyword Matching

Indexed keywords

BIG DATA;

DATA CLEANSING; INTELLIGENT DATA; KEY WORD MATCHING; MASSIVE DATA; PROCESSING MODEL; RECALL AND PRECISION;

SEMANTICS;

EID: 84920732044     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SPAC.2014.6982731     Document Type: Conference Paper

References (24)

1. Mong Li Lee, Tok Wang Ling,Wai Lup Low. IntelliClean: A Knowledge-Based Intelligent Data Cleaner.In: Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Boston:ACM Press,2000,pp.290-294.
2. Min Chen. Big Data: Related Technologies, Challenges and Future Prospects. Springer Briefs in Computer Science.2014.
3. Peter L. Drools Usage Manual. 2004.
4. Jonathan I Maletic and Andrian Marcus. Data cleansing: Beyond integrity analysis. In IQ,pages 200-209. Citeseer, 2000.
5. C.L.Philip Chen, Chun-Yang Zhang. Data-intensive applications, challenges, techniques and technologies: A survey on Big Data. Information Sciences. Volume 275, Pages 314-347, 10 August 2014.
6. M. Hernandez,S. Stolfo. The merge/purge problem for large databases.In Proceedings of the ACM SIGMOD International Conference on Management of Data, pages 127-138, May 1995.
7. C. Forgy. Rete: A fast algorithm for the many patterns/many objects match problem. Artificial Intelligence, 19(1):17-37, 1982.
8. Lars Kolb, Andreas Thor, Erhard Rahm. Dedoop: Efficient Deduplication with Hadoop. Proceedings of the VLDB Endowment,Vol. 5, No. 12, 2012.
9. LixiaWang,Xiaoyong Huai.Semantic-based Keyword Extraction Algorithm for Chinese Text.Computer Engineering,Vol.38,No.1,Jan 2012.
10. Agirre E, Rigau G. A Proposal for Word Sense Disambiguation Using C onceptual Distance. COLING '96 Proceedings of the 16th conference on Computational linguistics,vol.1, Pages 16-22, 1995.
11. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. OSDI, 2004.
12. Storm, 2012. http://storm-project.net/.
13. TF-IDF,2014. http://en.wikipedia.org/wiki/Tf-idf.
14. Recall/precision,2014. http://en.wikipedia.org/wiki/Precision-and-recall.
15. Jun Yu, Dacheng Tao, Meng Wang and Yong Rui, Learning to Rank usi ng User Clicks and Visual Features for Image Retrieval, IEEE Transacti ons on Cybernetics, 10.1109/TCYB.2014.2336697, 2014.
16. Jun Yu, Yong Rui and Dacheng Tao, Click Prediction for Web Image R eranking using Multimodal Sparse Coding, IEEE Transactions on Image Processing, 23(5): 2019-2032, 2014.
17. Jun Yu,Dongquan Liu, Dacheng Tao, Hock-Soon Seah, Complex Object Correspondence Constructionin 2D Animat ion, IEEE Transactions on Image Processing, 20(11): 3257-3269, 2011.
18. Jun Yu, Dacheng Tao, Meng Wang, Adaptive Hypergraph Learning and Its Application in ImageClassification, IEEE Transactions on Image Pro cessing, 21(7): 3262-3272, 2012.
19. Jun Yu, Meng Wang, and DachengTao, Semi-supervised Multiview Distance Metric Learning for Cartoon Synthesis, IEEE Transactions on Image Processing, 21(11): 4636-4648, 2012.
20. Weifeng Liu, Dacheng Tao, Jun Cheng, Yuanyan Tang: Multiview Hessian discriminative sparse coding for image annotation. Computer Vision and Image Understanding 118: 50-60, 2014.
21. Weifeng Liu, Dacheng Tao: Multiview Hessian Regularization for Image Annotation. IEEE Transactions on Image Processing 22(7): 2676-2687, 2013.
22. Chang Xu, Dacheng Tao, Chao Xu: Large-Margin Multi-View Information Bottleneck. IEEE Trans. Pattern Anal. Mach. Intell. 36(8): 1559-1572, 2014.
23. Zhang Zhang, Dacheng Tao: Slow Feature Analysis for Human Action Recognition. IEEE Trans. Pattern Anal. Mach. Intell. 34(3): 436-450, 2012.
24. Bo Geng, Dacheng Tao, Chao Xu, Linjun Yang, Xian-Sheng Hua: Ensemble Manifold Regularization. IEEE Trans. Pattern Anal. Mach. Intell. 34(6): 1227-1233, 2012.