Multilingual sentence categorization and novelty mining

Information Processing and Management

Volumn 47, Issue 5, 2011, Pages 667-675

  Zhang, Yi ^a   Tsai, Flora S ^a   Kwee, Agus Trisnajaya ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Chinese; Malay; Multilingual categorization; Novelty mining; Sentence retrieval

Indexed keywords

CHINESE; MALAY; MULTILINGUAL CATEGORIZATION; NOVELTY MINING; SENTENCE RETRIEVAL;

EID: 79960839217     PISSN: 03064573     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ipm.2010.02.003     Document Type: Article

References (35)

1. Allan, J.; Papka, R.; & Lavrenko, V. (1998). On-line new event detection and tracking. In SIGIR 1998: Proceedings of the 21th annual international ACM SIGIR conference on research and development in information retrieval (pp. 37-45).
2. Allan, J.; Lavrenko, V.; & Jin, H. (2000). First story detection in TDT is hard. In CIKM 2000 (pp. 374-381). VA, USA: McLean.
3. Allan, J.; Wade, C.; Bolivar, A. (2003). Retrieval and novelty detection at the sentence level. In SIGIR 2003: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval (pp. 314-321).
4. Bhanot, D. K. (2008). The first online Malay-English dictionary. < http://dictionary.bhanot.net/ >.
5. Brants, T.; Chen, F.; & Farahat, A. (2003). A system for new event detection. In SIGIR 2003, Toronto, Canada (pp. 330-337).
6. Diaz, F. & Metzler, D. (2006). Improving the estimation of relevance models using large external corpora. In SIGIR 2006, Seattle, USA (pp. 154-161).
7. Eichmann, D. & Srinivasan, P. (2002). Novel results and some answers. In TREC 2002 - the 11th text retrieval conference.
8. Franz, M.; Ittycheriah, A.; McCarley, J.; & Ward, T. (2001). First story detection: Combining similarity and novelty based approach. In Topic detection and tracking workshop.
9. J. Gao, M. Li, A. Wu, and C.-N. Huang Chinese word segmentation and named entity recognition: A pragmatic approach Computational Linguistics 31 4 2005 531 574 (Pubitemid 43677934)
10. Gkanogiannis, A. & Kalamboukis, T. (2008). An algorithm for text categorization. In SIGIR 2008, Singapore (pp. 869-870).
11. Y. Hong, Y. Zhang, J. Fan, T. Liu, and S. Li Chinese topic link detection based on semantic domain language model Journal of Software 19 9 2008 2265 2275
12. Kwee, A. T.; Tsai, F. S.; & Tang, W. (2009). Sentence-level novelty detection in English and Malay. In Lecture notes in computer science (LNCS) (Vol. 5476, pp. 40-51).
13. Kwok, K. L.; Deng, P.; Dinstl, N.; & Chan, M. (2002). TREC2002 web, novelty and filtering track experiments using PIRCS. In Proceedings of TREC11 (pp. 520-528).
14. Lavrenko, V.; & Croft, W. (2008). Relevance based language models. In SIGIR 2001, New Orleans, USA.
15. Li, X. & Croft, W. B. (2005). Novelty detection based on sentence level patterns. In CIKM 2005 (pp. 744-751). (Pubitemid 44022253)
16. Li, Y. & Taylor, J. S. (2003). The SVM with uneven margins and Chinese document categorisation. In Proceedings of the 17th Pacific Asia conference on language, information and computation. (pp. 216-227).
17. Lin, W.-C. & Chen, H.-H. (2003). Merging mechanisms in multilingual information retrieval. In Lecture notes in computer science (pp. 175-186).
18. Ng, K. W.; Tsai, F. S.; Goh, K. C.; & Chen, L. (2007). Novelty detection for text documents using named entity recognition. In Information, communications and signal processing, 2007 6th international conference on (pp. 1-5).
19. M. Porter An algorithm for suffix stripping Readings in Information Retrieval 1997 313 316
20. Powell, A. L.; French, J. C.; Callan, J.; Connell, M.; & Viles, C. L. (2000). The impact of database selection on distributed searching. In SIGIR 2000, Athens, Greece (pp. 232-239).
21. Rocchio, J. 1971. Relevance feedback in information retrieval. In The SMART retrieval system: Experiments in automatic document processing (pp. 313 - 323).
22. Soboroff, I. (2004). Overview of the TREC 2004 novelty track. In TREC 2004 - the 13th text retrieval conference.
23. Tang, W. & Tsai, F. S. (2009). Threshold setting and performance monitoring for novel text mining. In SIAM international conference on data mining, Proceedings in Applied Mathematics (vol. 3, pp. 1310-1319).
24. Tang, W.; Kwee, A. T.; & Tsai, F. S. (2009). Accessing contextual information for interactive novelty detection. In European conference on information retrieval (ECIR) workshop on contextual information access, seeking and retrieval evaluation.
25. Tsai, F. S.; Tang, W.; & Chan, K. L. (2010). Evaluation of metrics for sentence-level novelty mining. Information Sciences, in press.
26. Wang, M.; Sagae, K.; & Mitamura, T. (2006). A fast, accurate deterministic parser for Chinese. In ACL 2006, Sydney, Australia (pp. 425 - 432).
27. Wei, X. & Croft, W. B.; 2006. LDA-based document models for ad-hoc retrieval. In ACM SIGIR 2006: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval (pp. 178 - 185).
28. Wu, Y.; Zhao, J.; & Xu, B. (2003). Chinese named entity recognition combining a statistical model with human knowledge. In ACL 2003 workshop on multilingual and mixed-language named entity recognition (pp. 65-72).
29. Yang, Y.; Zhang, J.; Carbonell, J.; & Jin, C. (2002). Topic-conditioned novelty detection. In SIGKDD 2002 (pp. 688-693).
30. Zhang, Y. & Tsai, F. S. (2009a). Combining named entities and tags for novel sentence detection. In ESAIR '09: Proceedings of the WSDM '09 workshop on exploiting semantic annotations in information retrieval (pp. 30-34).
31. Zhang, Y. & Tsai, F. S. (2009b). Chinese novelty mining. In EMNLP '09: Proceedings of the conference on empirical methods in natural language processing.
32. Zhang, Y.; Callan, J.; & Minka, T. (2002). Novelty and redundancy detection in adaptive filtering. In SIGIR 2002: Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval (pp. 81-88).
33. Zhang, H.-P.; Liu, Q.; Cheng, X.-Q.; Zhang, H.; & Yu, H.-K. (2003). Chinese lexical analysis using hierarchical hidden markov model. In Second SIGHAN workshop affiliated with 41th ACL. (pp. 63-70). < http://ictclas.org/ index.html >.
34. H. Zhang, and Q. Liu Model of Chinese words rough segmentation based on n-shortest paths method Journal of Chinese Information Processing 15 2002 1 7
35. Zheng, W.; Zhang, Y.; Zou, B.; Hong, Y.; & Liu, T. (2007). Research of Chinese topic tracking based on relevance model. In Proceedings of 9th Chinese National Conference on Computational Linguistics.