Finding structure in noisy text: Topic classification and unsupervised clustering

International Journal on Document Analysis and Recognition

Volumn 10, Issue 3-4, 2007, Pages 187-198

  Natarajan, Prem ^a   Prasad, Rohit ^a   Subramanian, Krishna ^a   Saleem, Shirin ^a   Choi, Fred ^a   Schwartz, Rich ^a  

^a BBN TECHNOLOGIES   (United States)

Author keywords

Clustering; Hidden markov model; Topic classification; Unsupervised topic discovery

Indexed keywords

CLASSIFICATION (OF INFORMATION); CLUSTER ANALYSIS; DATA STRUCTURES; HIDDEN MARKOV MODELS;

NEWSGROUP MESSAGES; NOISY TEXT; TOPIC CLASSIFICATION; UNSUPERVISED CLUSTERING; UNSUPREVISED TOPIC DISCOVERY;

TEXT PROCESSING;

EID: 37249040962     PISSN: 14332833     EISSN: 14332825     Source Type: Journal    
DOI: 10.1007/s10032-007-0057-x     Document Type: Conference Paper

References (23)

1. Schwartz, R., Imai, T., Kubala, F., Nguyen, L., Makhoul, J.: A Maximum Likelihood Model for Topic Classification of Broadcast News. In: Proceedings of EUROSPEECH. ISCA, Rhodes (1997)
2. Joachims, T.: Text Categorization with support vector machines. In: Proceedings of ECML-98, 10th European Conference on Machine Learning. Springer, Chemnitz, pp. 137-142 (1998)
3. Baker, L.D., McCallum A.: Distributional clustering of words for text classification. In: Proceedings of ACM SIGIR. ACM, Melbourne, pp. 96-103 (1998)
4. Rennie J.D.M., Shih L., Teevan J. and Karger D. (2003). Tackling the poor assumptions of Naive-Bayes text classifiers. In: Fawcett, T. and Mishra, N. (eds) Proceedings of the Twentieth International Conference on Machine Learning (ICML-2003), pp 616-623. AAAI Press, Washington, DC
5. Eick, S., Lockwood, J., Loui, R., Moscola, J., Kastner, C., Levine, A., Weishar, D.: Transformation algorithms for data streams. In: Proceedings of IEEE Aerospace Conference, March 2005
6. Wright, J. H., Carey, J. M., Parris, E. S.: Improved topic spotting through statistical modeling of keyword dependencies. In: Proceedings IEEE ICASSP. IEEE, Detroit, pp. 313-316 (1995)
7. Peskin, B., Connolly, S., Gillick, L., Lowe, S., McAllaster, D., Nagesha, V.: Improvements in switchboard recognition and topic identification. In: Proceedings of IEEE ICASSP. IEEE, Atlanta, pp. 303-306 (1996)
8. Subramanian, K., Prasad, R., Natarajan, P., Schwartz, R.: Optimal estimation of rejection thresholds for topic spotting. In: Proceedings of IEEE ICASSP. IEEE, Honolulu (2007)
9. Sista S., Schwartz R., Leek T. and Makhoul J. (2002). An algorithm for unsupervised topic discovery from broadcast news stories. In: Marcus, M. (eds) Proceedings of ACM HLT. ACM, San Diego
10. The 20 Newsgroup (20 NG) Corpus, http://www.people.csail.mit.edu/jrennie/ 20Newsgroups/
11. Differentiable Nonlinear Optimization, http://www.sai.msu.su/sal/B/3/ DONLP2.html
12. Li, H., Abe, N.: Word clustering and disambiguation based on co-occurrence data. In: Proceedings of COLING-ACL, pp. 749-755 (1998)
13. Biswas, G., Weinberg, J., Fisher, D.: ITERATE: A conceptual clustering algorithm for data mining. IEEE Trans. Syst. Man Cybernet. Rev. 28 (2) (1998)
14. Hofmann, T.: The cluster-Ubstraction model: unsupervised learning of topic hierarchies from text data. In: Proceedings of IJCAI. IJCAI, Stockholm, pp. 682-687 (1999)
15. Willet P. (1998). Recent trends in hierarchical document clustering: A critical review. Inform. Process. Manage. 24(5): 577-597
16. Sista, S., Srivastava A., Kubala, F., Schwartz R.: Unsupervised topic discovery applied to segmentation of news transcriptions. In: Proceedings of Eurospeech. ISCA, Geneva, pp. 2833-2836 (2003)
17. Marcken, C.: The unsupervised acquisition of lexicon from continuous speech. In: MIT Artificial Intelligence Laboratory, A.I. Memo No. 1558 (1995)
18. Leek, T.R.: Minimum Description Length (MDL) phrases. BBN Technologies, Technical Report 010405TRL (2001)
19. Bikel D., Schwartz R. and Weischedel R. (1999). An Algorithm that learns what's in a name. Machine Learning 34(1-3): 211-231
20. Salton G. (1971). The SMART Retrieval System: Experiments in Automatic Document Processing. Prentice Hall, Englewood Cliffs
21. Papoulis P. (1984). Probability, Random Variables and Stochastic Processes, 2nd edn. McGraw-Hill, New York
22. Kullback S. and Leibler R.A. (1951). On information and sufficiency. Ann. Mathe. Stat. 22: 79-86
23. Johnson, D., Sinanovic, S.: Symmetrizing the Kullback-Leibler distance. Rice University Working Paper (2001)