Baselines for natural language processing tasks based on soft cardinality spectra

Applied and Computational Mathematics

Volumn 11, Issue 2, 2012, Pages 180-199

  Jimenez, Sergio ^a   Gelbukh, Alexander ^b  

^a UNIVERSIDAD NACIONAL DE COLOMBIA   (Colombia)

^b INSTITUTO POLITÉCNICO NACIONAL   (Mexico)

Author keywords

Entity resolution; G Grams; Information retrieval; NLP baselines; Paraphrase recognition; SC spectra; Soft cardinality; Text similarity; Textual entailment recognition

Indexed keywords

EID: 84865216291     PISSN: 16833511     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (45)

1. Alvaro, E. Monge and Charles Elkan. The field matching problem: Algorithms and applications, In Proceeding of the 2nd International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, OR, 1996, pp.267-270.
2. Andrew Finch, Young-Sook Hwang, and Eiichiro Sumita. Using machine translation evaluation techniques to determine sentence-level semantic equivalence, In Proceedings of the 3rd Int. Workshop on Paraphrasing, Jeju Island, Korea, 2005.
3. Bill Dolan, Chris Quirk, and Chris Brockett. Unsupervised construction of large paraphrase corpora: exploiting massively parallel news sources, In Proceedings of the 20th international conference on Computational Linguistics, COLING '04, Stroudsburg, PA, USA, 2004. Association for Computational Linguistics.
4. Christina Leslie, Eleazar Eskin, and William Stafford Noble. The spectrum kernel: A string kernel for SVM protein classification, In Biocomputing 2002 - Proceedings of the Pacific Symposium, Kauai, Hawaii, USA, 2001, pp.564-575.
5. Colin de la Higuera and Luisa Mico. A contextual normalised edit distance, In 2008 IEEE 24th International Conference on Data Engineering Workshop, Cancun, Mexico, 2008, pp.354-361.
6. Courtney Cor ley and Rada Mihalcea. Measuring the semantic similarity of texts, In Proceedings of the ACL Workshop on Empirical Modeling of Semantic Equivalence and Entailment, EMSEE '05, Stroudsburg, PA, USA, Association for Computational Linguistics, 2005, pp.13-18.
7. Danilo Giampiccolo, Bernardo Magnini, Ido Dagan, and Bill Dolan. The third PASCAL recognizing textual entailment challenge, In Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, RTE '07, Stroudsburg, PA, USA, Association for Computational Linguistics, 2007, pp.1-9.
8. Dekang Lin. An information-theoretic definition of similarity, In Proceedings of the Fifteenth International Conference on Machine Learning, Morgan Kaufmann Publishers Inc., 1998, pp.296-304.
9. Dipanjan Das and Noah A. Smith. Paraphrase identification as probabilistic quasi-synchronous recognition, In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1, ACL '09, Stroudsburg, PA, USA, Association for Computational Linguistics, 2009, pp.468-476.
10. Erwan Moreau, Francois Yvon, and Olivier Cappe1. Robust similarity measures for named entities matching, In Proceedings of the 22nd International Conference on Computational Linguistics, V.l, Manchester, United Kingdom, Association for Computational Linguistics, 2008, pp.593-600.
11. Gerard Salton, Andrew K. C. Wong, and Chung-Shu Yang. A vector space model for automatic indexing, Commun. ACM, V.18, N.1l, 1975, pp.613-620.
12. Gravano, L., Panagiotis, G. Ipeirotis, Nick Koudas, and Divesh Srivastava, Text joins in a RDBMS for web data integration, 2003.
13. Grigori Sidorov, Alberto Barrón-Cedeño, and Paolo Rosso. English-Spanish large statistical dictionary of inflectional forms, In Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10), Valletta, Malta, European Language Resources Association (ELRA), 2010, pp.277-281.
14. Ildar Batyrshin, Raul Herrera-Avelar, Leonid Sheremetov, and Aleksandra Panova. Moving approximation transform and local trend associations in time series data bases, In Ildar Batyrshin, Janusz Kacprzyk, Leonid Sheremetov, and Lotfi Zadeh, editors, Perception-based Data Mining and Decision Making in Economics and Finance, of Studies in Computational Intelligence, V.36, Springer Berlin / Heidelberg, 2007, pp.55-83.
15. Ion Androutsopoulos and Prodromos Malakasiotis, A survey of paraphrasing and textual entailment methods, J. Artif. Int. Res., V.38, N.1, May 2010, pp.135-187.
16. Jakub Piskorski and Marcin Sydow. Usability of String Distance Metrics for Name Matching Tasks in Polish, 2008.
17. Julian R. Ullmann. A binary N-Gram technique for automatic correction of substitution, deletion, insertion and reversal errors in words, The Computer Journal, V.20, N.2, January 1977, pp.141-147.
18. Karen Kukich, Techniques for automatically correcting words in text, ACM Computing Surveys, V.24, December 1992, pp.377-439. (Pubitemid 23687641)
19. Keskustalo, H., Pirkola, A., Visala, K. and Leppanen, E. Non-adjacent digrams improve matching of cross-lingual spelling variants, In LNCS 2857, Manaus, Brazil, 2003, pp.252-265.
20. Lee R. Dice, Measures of the amount of ecologic association between species, Ecology, 1945, pp.297-302.
21. Long Qiu, Min-Yen Kan, and Tat-Seng Chua Paraphrase recognition via dissimilarity significance classification, In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP '06, Stroudsburg, PA, USA, Association for Computational Linguistics, 2006, pp.18-26.
22. Martin Porter An algorithm for suffix stripping, Program, V.3, N.14, October 1980, pp.130-137.
23. Mihai Lintean and Vasile Rus. Paraphrase identification using weighted dependencies and word semantics, In Proceedings of the Twenty-Second International FLAIRS Conference, 2009.
24. Mikhail Bilenko, Raymond Mooney, William Cohen, Pradeep Ravikumar, and Stephen Fienberg Adaptive name matching in information integration, IEEE Intelligent Systems, V.18, N.5, 2003, pp.16-23.
25. Paul Jaccard. Etude comparative de la distribution florare dans une portion des alpes et des jura, Bulletin de la Société Vaudoise des Sciences Naturelles, 1901, pp.547-579.
26. Peter Christen, A comparison of personal name matching: Techniques and practical issues, In Data Mining Workshops, International Conference on, Los Alamitos, CA, USA, IEEE Computer Society, 2006, pp.290-294.
27. Prodromos Malakasiotis, Paraphrase recognition using machine learning to combine similarity measures, In Proceedings of the ACL-IJCNLP 2009 Student Research Workshop, ACLstudent '09, Stroudsburg, PA, USA, Association for Computational Linguistics, 2009, pp.27-35.
28. Quang Xuan Do, Dan Roth, Mark Sammons, Yuancheng Tu, and Vinod V. G. Vydiswaran. Robust, lightweight approaches to compute lexical similarity, Technical report, 2010.
29. Ricardo Baeza-Yates and Berthier Ribeiro-Neto. Modern Information Retrieval, Addison Wesley & ACM Press, 1999.
30. Rudi Cilibrasi and Paul Vitanyi. Clustering by compression, IEEE Transactions on Information Theory, 2005, pp.1523-1545. (Pubitemid 40573236)
31. Sarker, B. The resemblance coefficients in group technology: A survey and comparative study of relational metrics, Computers & Industrial Engineering, V.30, N.1, January 1996, pp.103-116. (Pubitemid 126397726)
32. Sergio Jimenez, Claudia Becerra, and Alexander Gelbukh. Soft cardinality: A parameterized similarity function for text comparison, In In Proceedings of the 6th International Workshop on Semantic Evaluation (Se-mEval 2012), in conjunction with the First Joint Conference on Lexical and Computational Semantics (*SEM 2012), Montreal, Canada, 2012.
33. Sergio Jimenez, Fabio Gonzalez, and Alexander Gelbukh. Text comparison using soft cardinality, In Edgar Chavez and Stefano Lonardi, editors, String Processing and Information Retrieval, volume 6393 of LNCS, Springer Berlin Heidelberg, Berlin, Heidelberg, 2010, pp.297-302.
34. Sergio Jimenez Vargas and Alexander Gelbukh. SC spectra: A Linear-Time soft cardinality approximation for text comparison, In Advances in Soft Computing, volume 7095 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 2011, pp.213-224.
35. Stephen Wan, Mark Dras, Robert Dale, and Cecile Paris. Using Dependency-Based Features to Take the Para-Farce Out of Paraphrase, In Proceedings of the Australasian Language Technology Workshop, Sydney, Australia, 2006.
36. Surajit Chaudhuri, Kris Ganjam, Venkatesh Ganti, and Rajeev Motwani. Robust and efficient fuzzy match for online data cleaning, In Proceedings of the 2003 ACM SIGMOD international conference on management of data, San Diego, California, 2003, pp.313-324.
37. Susan Duma. Latent Semantic Analysis, ARIST Review of Information Science and Technology, 2004.
38. Ted Pedersen, Siddharth Patwardhan, and Jason Michelizzi. WordNet::Similarity: measuring the relatedness of concepts, In Proceedings HLT-NAACL-Demonstration Papers, Stroudsburg, PA, USA, Association for Computational Linguistics, 2004.
39. Thomas Dietterich. Ensemble methods in machine learning, In Multiple Classifier Systems, volume 1857 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, 2000, pp.1-15.
40. Vladimir I. Levenshtein. Binary codes capable of correcting deletions, insertions, and reversals, Soviet Physics Doklady, V.10, N.8, 1966, pp.707-710.
41. Westerman, S.J, Cribbin, T. and Collins, J. Human assessments of document similarity, Journal of the American Society for Information Science and Technology, V.61, N.8, April 2010, pp.1535-1542.
42. William W Cohen, Pradeep Ravikumar, and Stephen E Fienberg. A comparison of string distance metrics for Name-Matching tasks, In Proceedings of the IJCAI2003 Workshop on Information Integration on the Web IIWeb03, August 2003, pp.73-78.
43. William E Winkler. The State of Record Linkage and Current Research Problems, Statistical Research Division, U.S. Census Bureau, 1999.
44. Yitao Zhang and Jon Patrick. Paraphrase Identification by Text Canonicalization, In Proceedings of the Australasian Language Technology Workshop, Sydney, Australia, 2005.
45. Yulia Ledeneva and Grigori Sidorov, Recent advances in computational linguistics, Informatica. International Journal of Computing and Informatics, V.34, N.1, 2010, pp.3-18.