Soft-constrained inference for Named Entity Recognition

Information Processing and Management

Volumn 50, Issue 5, 2014, Pages 807-819

  Fersini, E ^a   Messina, E ^a   Felici, G ^b   Roth, D ^c  

^a UNIVERSITY OF MILANO BICOCCA   (Italy)

^b CNR   (Italy)

^c University of Illinois at Urbana Champaign   (United States)

Author keywords

Conditional Random Fields; Integer linear programming; Named Entity Recognition; Rule extraction

Indexed keywords

NATURAL LANGUAGE PROCESSING SYSTEMS; OPTIMIZATION; RANDOM PROCESSES; SEARCH ENGINES;

CONDITIONAL RANDOM FIELD; DECISION MAKING PROCESS; INTEGER LINEAR PROGRAMMING; INTEGER PROGRAMMING FORMULATIONS; LONG-DISTANCE DEPENDENCIES; NAMED ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; RULE EXTRACTION;

INTEGER PROGRAMMING;

EID: 84904385510     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2014.04.005     Document Type: Article

References (50)

1. Appelt, D. E., Hobbs, J. R., Bear, J., Israel, D. J., Tyson, M. (1993). Fastus: A finite-state processor for information extraction from real-world text. In Proc. of the international joint conference on artificial intelligence (pp. 1172-1178).
2. L.E. Baum, and T. Petrie Statistical inference for probabilistic functions of finite state markov chains The Annals of Mathematical Statistics 37 6 1966 1554 1563
3. Beckerle, M., Martucci, L. A., Ries, S. (2010). Interactive access rule learning: Generating adapted access rule sets. In Proc. of the 2nd international conference on adaptive and self-adaptive systems and applications (pp. 104-110).
4. P. Bohannon, S. Merugu, C. Yu, V. Agarwal, P. DeRose, and A. Iyer et al. Purple sox extraction management system SIGMOD Record 37 2009 21 27
5. Califf, M. E., Mooney, R. J. (1999). Relational learning of pattern-match rules for information extraction. In Proc. of the 16th national conference on artificial intelligence and the 11th innovative applications of artificial intelligence conference innovative applications of artificial intelligence (pp. 328-334).
6. M.E. Califf, and R.J. Mooney Bottom-up relational learning of pattern matching rules for information extraction The Journal of Machine Learning Research 4 2003 177 210
7. Chang, M. -W., Ratinov, L., Roth, D. (2007). Guiding semi-supervision with constraint-driven learning. In Proc. of the 45th annual meeting of the association of computational linguistics (pp. 280-287). Prague, Czech Republic.
8. Chang, M., Ratinov, L., Roth, D. (2008). Constraints as prior knowledge. In ICML workshop on prior knowledge for text and language processing (pp. 32-39).
9. M.-W. Chang, L. Ratinov, and D. Roth Structured learning with constrained conditional models Machine Learning 88 3 2012 399 431
10. Ciravegna, F. (2001). Adaptive information extraction from text by rule induction and generalisation. In Proc. of the 17th international joint conference on artificial intelligence (Vol. 2. pp. 1251-1256).
11. P. Clifford Markov random fields in statistics; disorder in physical systems: A volume in honour of John M. Hammersley 1990 Oxford University Press
12. Cohn, T., Smith, A., Osborne, M. (2005). Scaling conditional random fields using error-correcting codes. In Proceedings of the 43rd annual meeting on association for computational linguistics (pp. 10-17). Association for Computational Linguistics.
13. A. Culotta, T. Kristjansson, A. McCallum, and P. Viola Corrective feedback and persistent learning for information extraction Artificial Intelligence 170 14â"15 2006 1101 1122 (Pubitemid 44573089)
14. I. Cvejic, J. Zhang, J. Marx, and J. Tjoe Automated search for patient records: classification of free-text medical reports using conditional random fields Proc. of the 2nd ACM SIGHIT international health informatics symposium 2012 ACM New York, NY, USA 691 696
15. Daumé, H., III, Marcu, D. (2005). Learning as search optimization: Approximate large margin methods for structured prediction. In Proc. of the 22nd international conference on machine learning (pp. 169-176). (Pubitemid 43183330)
16. L. Deléger, K. Molnár, G. Savova, F. Xia, T. Lingren, and Q. Li et al. Large-scale evaluation of automated clinical note de-identification and its impact on information extraction JAMIA 20 1 2013 84 94
17. G. Felici, and K. Truemper A minsat approach for learning in logic domains INFORMS Journal on Computing 14 2002 20 36
18. G. Felici, and K. Truemper The lsquare system for mining logic data Encyclopedia of data warehousing and mining 2005 Idea Group Publishing 693 697
19. Fersini, E., Messina, E. (2013). Named entities in judicial transcriptions: Extended conditional random fields. In Proc. of the 14th international conference on intelligent text processing and computational linguistics (pp. 317-328).
20. E. Fersini, E. Messina, F. Archetti, and M. Cislaghi Semantics and machine learning: A new generation of court management systems A. Fred, J. Dietz, K. Liu, J. Filipe, Knowledge discovery, knowledge engineering and knowledge management Communications in computer and information science Vol. 272 2013 Springer Berlin Heidelberg 382 398
21. Galen, A. (2006). A hybrid Markov/semi-Markov conditional random field for sequence segmentation. In Proc. of the 2006 conference on empirical methods in natural language processing (pp. 465-472).
22. Grenager, T., Klein, D., Manning, C. D. (2005). Unsupervised learning of field segmentation models for information extraction. In Proceedings of the 43rd annual meeting on association for computational linguistics (pp. 371-378). Association for Computational Linguistics.
23. Hammersley, J., Clifford, P. (1971). Markov fields on finite graphs and lattices. Unpublished.
24. T.B. Ho, and D.D. Nguyen Chance discovery and learning minority classes New Generation Computing 21 2 2003 149 161
25. Khaitan, S., Ramakrishnan, G., Joshi, S., Chalamalla, A. (2008). Rad: A scalable framework for annotator development. In Proc. of the International Conference on Data Engineering (Vol. 0. pp. 1624-1627).
26. Kristjansson, T., Culotta, A., Viola, P., McCallum, A. (2004). Interactive information extraction with constrained conditional random fields. In Proc. of the 19th national conference on artifical intelligence (pp. 412-418).
27. Lafferty, J. D., McCallum, A., Pereira, F. C. N. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proc. of the 18th international conference on machine learning (pp. 282-289).
28. N. Landwehr, K. Kersting, and L.D. Raedt Integrating naive bayes and foil The Journal of Machine Learning Research 8 2007 481 507
29. C. Lee, Y.-G. Hwang, H.-J. Oh, S. Lim, J. Heo, and C.-H. Lee et al. Fine-grained named entity recognition using conditional random fields for question answering Information retrieval technology 2006 Springer 581 587 (Pubitemid 44812233)
30. Lehnert, W., McCarthy, J., Soderland, S., Riloff, E., Cardie, C., Peterson, J., et al. (1993). Umass/hughes: Description of the circus system used for muc-5. In Proc. of the 5th conference on message understanding (pp. 277-291).
31. Malouf, R. (2002). A comparison of algorithms for maximum entropy parameter estimation. In Proc. of the 6th conference on natural language learning (Vol. 20. pp. 1-7).
32. A. McCallum, D. Freitag, and F.C.N. Pereira Maximum entropy markov models for information extraction and segmentation Proceedings of the seventeenth international conference on machine learning ICML '00 2000 Morgan Kaufmans Publishers Inc. San Francisco, CA, USA 591 598
33. J. Nocedal, and S. Wright Numerical optimization 2000 Springer
34. L. Qi, and L. Chen A linear-chain crf-based learning approach for web opinion mining Proc. of the 11th international conference on web information systems engineering 2010 Springer-Verlag 128 141
35. J.R. Quinlan Learning logical definitions from relations Machine Learning 5 3 1990 239 266
36. A. Ratnaparkhi Learning to parse natural language with maximum entropy models Machine Learning 34 1-3 1999 151 175
37. Rau, L. (1991). Extracting company names from text. In Proc. of the 7th IEEE conference on artificial intelligence applications (Vol. i. pp. 29 -32).
38. M. Richardson, and P. Domingos Markov logic networks Machine Learning 62 2006 107 136 (Pubitemid 43202307)
39. Riloff, E. (1993). Automatically constructing a dictionary for information extraction tasks. In Proc. of the 11th national conference on artificial intelligence (pp. 811-816).
40. Roth, D., Yih, W. -t. (2005). Integer linear programming inference for conditional random fields. In Proc. of the 22nd international conference on machine learning (pp. 736-743).
41. Sarawagi, S., Cohen, W. W. (2004). Semi-markov conditional random fields for information extraction. In Advances in neural information processing systems (pp. 1185-1192).
42. Seymore, K., McCallum, A., Rosenfeld, R. (1999). Learning hidden Markov model structure for information extraction. In AAAI'99 workshop on machine learning for information extraction (pp. 37-42).
43. S. Shariaty, and S. Moghaddam Fine-grained opinion mining using conditional random fields Proc. of the 11th international conference on data mining workshops 2011 IEEE Computer Society 109 114
44. S. Soderland Learning information extraction rules for semi-structured and free text Machine Learning 34 1999 233 272
45. Sutton, C. A. (2008). Efficient training methods for conditional random fields. Ph.D. thesis, University of Massachusetts.
46. Takeuchi, K., Collier, N. (2002). Use of support vector machines in extended named entity recognition. In Proc. of the 6th conference on natural language learning (Vol. 20. pp. 1-7).
47. Tjong Kim Sang, E.F., De Meulder, F. (2003). Introduction to the conll-2003 shared task: Language-independent named entity recognition. In W. Daelemans, M. Osborne (Eds.), Proceedings of CoNLL-2003 (pp. 142-147). Edmonton, Canada.
48. Tkachenko, M., Simanovsky, A. (2012). Selecting features for domain-independent named entity recognition. In Empirical methods in natural language processing (p. 248).
49. K. Truemper Design of logic-based intelligent systems 2004 Wiley-Interscience
50. Y.A. Zuev Representations of boolean functions by systems of linear inequalities Cybernetics and Systems Analysis 21 1985 567 571