Cleaning inconsistencies in information extraction via prioritized repairs

Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems

Volumn , Issue , 2014, Pages 164-175

  Fagin, Ronald ^a   Kimelfeld, Benny ^b   Reiss, Frederick ^a   Vansummeren, Stijn ^c  

^a IBM ALMADEN RESEARCH CENTER   (United States)

^b LOGICBLOX INC   (United States)

^c UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

Author keywords

Database repairs; Document spanners; Extraction inconsistency; Information extraction; Prioritized repairs; Regular expressions

Indexed keywords

BIG DATA; CLEANING; DATABASE SYSTEMS; INFORMATION RETRIEVAL; PATTERN MATCHING; SEMANTICS;

CLEANING OPERATIONS; COMPUTATIONAL CHALLENGES; DATABASE REPAIRS; DOCUMENT SPANNERS; EXPRESSIVE POWER; NATURAL LANGUAGES; REGULAR EXPRESSIONS; RELATIONAL SCHEMAS;

REPAIR;

EID: 84904283591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2594538.2594540     Document Type: Conference Paper

References (41)

1. J. Ajmera, H.-I. Ahn, M. Nagarajan, A. Verma, D. Contractor, S. Dill, and M. Denesuk. A CRM system for social media: challenges and experiences. In WWW, pages 49-58, 2013.
2. D. E. Appelt and B. Onyshkevych. The common pattern specification language. In Proceedings of the TIPSTER Text Program: Phase III, pages 23-30, Baltimore, Maryland, USA, 1998.
3. M. Arenas, L. E. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. In PODS, pages 68-79, 1999.
4. E. Benson, A. Haghighi, and R. Barzilay. Event discovery in social media feeds. In ACL, pages 389-398, 2011.
5. L. E. Bertossi, S. Kolahi, and L. V. S. Lakshmanan. Data cleaning and query answering with matching dependencies and matching functions. Theory Comput. Syst., 52(3):441-482, 2013.
6. J. Bleiholder and F. Naumann. Data fusion. ACM Comput. Surv., 41(1), 2008.
7. L. Chiticariu, R. Krishnamurthy, Y. Li, S. Raghavan, F. Reiss, and S. Vaithyanathan. SystemT: An algebraic approach to declarative information extraction. In ACL, pages 128-137, 2010.
8. R. Cox. Regular expression matching: the virtual machine approach. digression: Posix submatching, December 2009. http://swtch.com/rsc/regexp/ regexp2.html.
9. H. Cunningham. Gate, a general architecture for text engineering. Computers and the Humanities, 36(2):223-254, 2002.
10. H. Cunningham, D. Maynard, and V. Tablan. JAPE: a Java Annotation Patterns Engine (Second Edition). Research Memorandum CS-00-10, Department of Computer Science, University of Sheffield, November 2000.
11. G. DeJong. An overview of the frump system. In W. G. Lehnert and M. H. Ringle, editors, Strategies for natural language processing, pages 149-176. Lawrence Erlbaum Associates, 1982.
12. M. Dylla, I. Miliaraki, and M. Theobald. A temporal-probabilistic database model for information extraction. PVLDB, 6(14):1810-1821, 2013.
13. R. Fagin, B. Kimelfeld, Y. Li, S. Raghavan, and S. Vaithyanathan. Rewrite rules for search database systems. In PODS, pages 271-282, 2011.
14. R. Fagin, B. Kimelfeld, F. Reiss, and S. Vansummeren. Spanners: a formal framework for information extraction. In PODS, pages 37-48, 2013.
15. W. Fan. Dependencies revisited for improving data quality. In PODS, pages 159-170, 2008.
16. W. Fan, H. Gao, X. Jia, J. Li, and S. Ma. Dynamic constraints for record matching. VLDB J., 20(4):495-520, 2011.
17. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Interaction between record matching and data repairing. In SIGMOD Conference, pages 469-480, 2011.
18. D. A. Ferrucci and A. Lally. UIMA: an architectural approach to unstructured information processing in the corporate research environment. Natural Language Engineering, 10(3-4):327-348, 2004.
19. G. Fowler. An interpreation of the posix regex standard (2003), 2003. http://gsf.cococlyde.org/download/re-interpretation.tgz.
20. D. Freitag. Toward general-purpose learning for information extraction. In COLING-ACL, pages 404-408, 1998.
21. Q. Fu, J.-G. Lou, Y. Wang, and J. Li. Execution anomaly detection in distributed systems through unstructured log analysis. In ICDM, pages 149-158, 2009.
22. R. Grishman and B. Sundheim. Message understanding conference-6: A brief history. In COLING, pages 466-471, 1996.
23. M. Holzer, M. Kutrib, and A. Malcher. Multi-head finite automata: Characterizations, concepts and open problems. In CSP, volume 1 of EPTCS, pages 93-107, 2008.
24. Institute of Electrical and Electronic Engineers and the Open group. The open group base specifications issue 7, 2013. IEEE Std 1003.1, 2013 Edition.
25. J. D. Lafferty, A. McCallum, and F. C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML, pages 282-289, 2001.
26. V. Laurikari. Efficient submatch addressing for regular expressions. Master's thesis, Helsinki University of Technology, 2001.
27. T. R. Leek. Information extraction using hidden markov models. Master's thesis, UC San Diego, 1997.
28. B. Liu, L. Chiticariu, V. Chu, H. V. Jagadish, and F. Reiss. Automatic rule refinement for information extraction. PVLDB, 3(1):588-597, 2010.
29. S. Ma, W. Fan, and L. Bravo. Extending inclusion dependencies with conditions. Theor. Comput. Sci., 515:64-95, 2014.
30. A. McCallum, D. Freitag, and F. C. N. Pereira. Maximum entropy markov models for information extraction and segmentation. In ICML, pages 591-598, 2000.
31. F. Niu, C. Ré, A. Doan, and J. W. Shavlik. Tuffy: Scaling up statistical inference in Markov Logic Networks using an RDBMS. PVLDB, 4(6):373-384, 2011.
32. S. Okui and T. Suzuki. Disambiguation in regular expression matching via position automata with augmented transitions. In M. Domaratzki and K. Salomaa, editors, CIAA, volume 6482 of Lecture Notes in Computer Science, pages 231-240, 2010.
33. H. Poon and P. Domingos. Joint inference in information extraction. In AAAI, pages 913-918. AAAI Press, 2007.
34. F. Reiss, S. Raghavan, R. Krishnamurthy, H. Zhu, and S. Vaithyanathan. An algebraic approach to rule-based information extraction. In ICDE, pages 933-942, 2008.
35. E. Riloff. Automatically constructing a dictionary for information extraction tasks. In AAAI, pages 811-816, 1993.
36. W. Shen, A. Doan, J. F. Naughton, and R. Ramakrishnan. Declarative information extraction using datalog with embedded extraction predicates. In VLDB, pages 1033-1044, 2007.
37. S. Soderland, D. Fisher, J. Aseltine, and W. G. Lehnert. CRYSTAL: Inducing a conceptual dictionary. In IJCAI, pages 1314-1321, 1995.
38. S. Staworko, J. Chomicki, and J. Marcinkowski. Prioritized repairing and consistent query answering in relational databases. Ann. Math. Artif. Intell., 64(2-3):209-246, 2012.
39. S. Vansummeren. Type inference for unique pattern matching. ACM Trans. Program. Lang. Syst., 28(3):389-428, 2006.
40. H. Xu, S. P. Stenner, S. Doan, K. B. Johnson, L. R. Waitman, and J. C. Denny. Application of information technology: Medex: a medication information extraction system for clinical narratives. JAMIA, 17(1):19-24, 2010.
41. H. Zhu, S. Raghavan, S. Vaithyanathan, and A. Löser. Navigating the intranet with high precision. In WWW, pages 491-500, 2007.