Exploiting structured reference data for unsupervised text segmentation with conditional random fields

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 1, Issue , 2008, Pages 420-431

  Chang, Zhao ^a   Mahmud, Jalal ^a   Ramakrishnan, I V ^a  

^a USA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADMINISTRATIVE DATA PROCESSING; DATA MINING; DECISION SUPPORT SYSTEMS; INFORMATION MANAGEMENT; INFORMATION RETRIEVAL SYSTEMS; LABELING; LEARNING SYSTEMS; MATHEMATICAL TECHNIQUES; MINING; QUERY PROCESSING; ROOM AND PILLAR MINING; SEARCH ENGINES;

APPLIED MATHEMATICS; COMPUTING MACHINERY; CONDITIONAL RANDOM FIELDS; DATA DOMAINS; INTERNATIONAL CONFERENCES; LABELED TRAINING DATA; LABOR-INTENSIVE PROCESSES; LEARNING MODELS; PROBABILISTIC MODELLING; REFERENCE DATA; STRUCTURED DATA; TEXT DATA; TEXT SEGMENTATION; TRAINING DATA;

DATA PROCESSING;

EID: 52649088310     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. http://crf.sourceforge.net/.
2. http://www.isi.edu/info-agents/RISE/index.html.
3. http://www.it.iitb.ac.in/sunita/data/personalBib.tar.gz.
4. E. Agichtein and V. Ganti. Mining reference tables for automatic text segmentation. In KDD'04, pages 20-29, August 2004.
5. B. Aldelberg. Nodose: A tool for semi-automatically extracting structured and semistructured data from text documents. In SIGMOD, 1998.
6. D. Beeferman, A. Berger, and J. Lafferty. Statistical models for text segmentation. Machine Learning, 34(1-3), 1999.
7. V. Borkar, K. Deshmukh, and S. Sarawagi. Automatic segmentation of text into structured records. In ACM SIGMOD Conference, pages 175-186, 2001.
8. M. E. Califf and R. J. Mooney. Relational learning of pattern-match rules for information extraction. In Sixteenth National Conference on Artificial Intelligence, 1999.
9. W. W. Cohen and S. Sarawagi. Exploiting dictionaries in named entity extraction: Combining semi-markov extraction processes and data integration methods. In Proceedings of the Tenth A CM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, USA, 2004.
10. J. Lafferty, A. McCallum, and F. Pereira. Conditional random fields: probabilistic models for segmenting and labeling sequence data. In 18th International Conference on Machine Learning, pages 282-289, 2001.
11. M. Lapata. Probabilistic text structuring: Experiments with sentence ordering. In Proceedings of annual meeting of ACL, 2003.
12. W. Li and A. McCallum. Rapid development of hindi named entity recognition using conditional random fields and feature induction. 2:290-294, 2003.
13. I. R. Mansuri and S. Sarawagi. Integrating unstructured data into relational databases. In ICDE, page 29, 2006.
14. A. McCallum, D. Freitag, and F. C. N. Pereira. Maximum entropy markov models for information extraction and segmentation. In ICML, pages 591-598, 2000.
15. A. McCallum and W. Li. Early results for named entity recognition with conditional random fields. In Proceedings of the seventh conference on Natural language learning (CoNLL-2003), 2003.
16. S. D. Pietra, V. D. Pietra, and J. Lafferty. Inducing features of random fields. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19:380-393.
17. D. Pinto, A. McCallum, X. Lee, and W. Croft. Table extraction using conditional random fields. In Proceedings of the 26th ACM SIGIR, 2003.
18. L. Rabiner. A tutorial on hidden markov models and selected applications in speeck recognition. Proceedings of IEEE, 77(2), 1989.
19. S. Sarawagi and W. W. Cohen. Semi-markov conditional random fields for information extraction. In NIPs, 2004., 1989.
20. K. Seymore, A. McCallum, and R. Rosenfeld. Learning hidden markov model structure for information extraction. In AAAI-99 Workshop on Machine Learning for Information Extraction, 1999.
21. F. Sha and F. Pereira. Shallow parsing with conditional random fields. In 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, pages 134-141, 2003.
22. S. Soderland. Learning information extraction rules for semi-structured and free text. Machine Learning, 34(1-3), 1999.
23. C. Sutton, K. Rohanimanesh, and A. McCallum. Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data. In ICML '04: Proceedings of the twenty-first international conference on Machine learning, page 99, 2004.