Threshold setting and performance monitoring for novel text mining

Society for Industrial and Applied Mathematics - 9th SIAM International Conference on Data Mining 2009, Proceedings in Applied Mathematics

Volumn 3, Issue , 2009, Pages 1310-1319

  Tang, Wenyin ^a   Tsai, Flora S ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE THRESHOLDS; FINAL DECISION; GAUSSIANS; INITIAL STAGES; OPTIMIZATION CRITERIA; PARTIAL FEEDBACK; PERFORMANCE MONITORING; PERFORMANCE REQUIREMENTS; RELEVANT DOCUMENTS; TEXT MINING; THRESHOLD SETTING; TRAINING DATA;

OPTIMIZATION;

DATA MINING;

EID: 73449104599     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (14)

1. J. Allan, C. Wade, and A. Bolivar. Retrieval and novelty detection at sentence level. In SIGIR 2003, Toronto, Canada, pages 314-321. ACM, August 2003.
2. A. Arampatzis, J. Beney, C. H. A. Koster, and T. P. Weide. Kun on the trec-9 filtering track: Incrementally, decay, and threshold optimization for adaptive filtering systems. In TREC 9 - the 9th Text Retrieval Conference, 2000.
3. J. Davis and M. Coadrich. The relationship between precision-recall and ROC curves. In Proceedings of the 23rd international conference on Machine learning, pages 233-240. ACM, 2006.
4. X. Li and W. B. Croft. An information-pattern-based approach to novelty detection. Information Processing and Management, 44(3):1159-1188, May 2008.
5. K. W. Ng, F. S. Tsai, K. C. Goh, and L. Chen. Novelty detection for text documents using named entity recognition. In Information, Communications and Signal Processing, 2007 6th International Conference on, pages 1-5, December 2007.
6. S. Robertson. Threshold setting and performance optimization in adaptive filtering. Information Retrieval, 5(2-3):239 - 256, April-July 2002.
7. S. Robertson and I. Soboroff. The TREC 2002 Filtering Track report. In TREC 2002 - the 11th Text Retrieval Conference, 2002.
8. I. Soboroff. Overview of the TREC 2004 Novelty Track. In TREC 2004 - the 13th Text Retrieval Conference, 2004.
9. I. Soboroff and D. Harman. Overview of the TREC 2003 Novelty Track. In TREC 2003 - the 12th Text Retrieval Conference, 2003.
10. C. Zhai, P. Jansen, E. Stoica, N. Grot, and D. A. Evans. Threshold calibration in clarit adaptive filtering. In Proceeding of Seventh Text Retrieval Conference TREC-7, pages 149-156, 1999.
11. H.-P. Zhang, J. Sun, B. Wang, and S. Bai. Computation on sentence semantic distance for novelty detection. Journal of Computer Science and Technology, 20(3):331-337, 2005.
12. Y. Zhang and J. Callan. Maximum likelihood estimation for filtering thresholds. In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, pages 294-302. ACM Press, 2001.
13. Y. Zhang, J. Callan, and T. Minka. Novelty and redundancy detection in adaptive filtering. In SIGIR 2002, Tampere, Finland, pages 81-88. ACM, 2002.
14. L. Zhao, M. Zheng, and S. Ma. The nature of novelty detection. Information Retrieval, 9:527-541, 2006.