Iterative denoising using Jensen-Renyi divergences with an application to unsupervised document categorization

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 2, Issue , 2007, Pages 509-512

  Karakos, Damianos ^a   Khudanpur, Sanjeev ^a   Eisner, Jason ^a   Priebe, Carey E ^a  

^a Johns Hopkins University   (United States)

Author keywords

Clustering methods; Information theory; Text processing; Unsupervised learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATION THEORY; DATA STRUCTURES; DECISION TREES; INFORMATION THEORY; ITERATIVE METHODS;

CLUSTERING METHODS; UNSUPERVISED DOCUMENT CATEGORIZATION;

NOISE ABATEMENT;

EID: 34547522729     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2007.366284     Document Type: Conference Paper

References (21)

1. D. Karakos, S. Khudanpur, J. Eisner, and C.E.Priebe, "Unsupervised classification via decision trees: An information-theoretic perspective," in Proc. 2005 International Conference on Acoustics, Speech and Signal Processing (ICASSP 2005), March 2005.
2. J. Eisner and D. Karakos, "Bootstrapping without the boot," in Proc 2005 Conference on Human Language Technology / Empirical Methods in Natural Language Processing (HLT/EMNLP 2005), October 2005.
3. N. Slonim, N. Friedman, and N. Tishby, "Unsupervised document classification using sequential information maximization," in Proc. SIGIR'02, 25th ACM Int. Conf on Research and Development of Inform. Retrieval, 2002.
4. C.E.Priebe, D.J. Marchette, and D.M. Healy, "Integrated sensing and processing decision trees," IEEE Trans. on Pat. Anal. and Mach. Intel., vol. 26, no. 6, pp. 699-708, June 2004.
5. P. A. Chou, "Optimal partitioning for classification and regression trees," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 13, no. 4, pp. 340-354, April 1991.
6. T. Cover and J. Thomas, Elements of Information Theory, John Wiley and Sons, 1991.
7. I. Csiszár, "Generalized cutoff rates and Rényi's information measures," IEEE Trans. on Information Theory, vol. 41, no. 1, pp. 26-34, January 1995.
8. Y. He, A. Ben Hamza, and H. Krim, "A generalized divergence measure for robust image registration," IEEE Trans. on Signal Processing, vol. 51, no. 5, pp. 1211-1220, May 2003.
9. A.O. Hero, B. Ma, O. Michel, and J. Gorman, "Alpha-divergence for classification, indexing and retrieval," Technical Report CSPL-328, University of Michigan Ann Arbor, Communications and Signal Processing Laboratory, May 2001.
10. K. Lang, "Learning to filter netnews," in Proc. 13th Int. Conf. on Machine Learning, 1995, pp. 331-339.
11. I. Csiszár and J. Körner, Information Theory: Coding Theorems for Discrete Memoryless Systems, New York: Academic, 1981.
12. A. Ben Hamza and H. Krim, "Jensen-Rényi divergence measure: Theoretical and computational perspectives," in Proc. IEEE Int. Symp. on Information Theory, Yokohama, Japan, June 2003.
13. H. Neemuchwala, A. Hero, and P. Carson, "Feature coincidence trees for registration of ultrasound breast images," in Proc. IEEE Int. Conf. on Image Processing, Thesaloniki, Greece, October 2001.
14. S. Martin, J. Liermann, and H. Ney, "Algorithms for bigram and trigram word clustering," Speech Communication, vol. 24, no. 3, pp. 171-192, 1998.
15. David D. Lewis and Philip J. Hayes, "Guest editorial," ACM Transactions on Information Systems, vol. 12, no. 3, pp. 231, July 1994.
16. N. Slonim, "IBA_1.0: Matlab code for information bottleneck clustering algorithms," Available from http://www.princeton.edu/~nslonim/ IB_Release1.0/IB_Release1_0.tar, 2003.
17. C. Fraley and A.E. Raftery, "Mclust: Software for model-based cluster analysis," Journal on Classification, vol. 16, pp. 297-306, 1999.
18. Y. Yang and J. Pedersen, "A comparative study on feature selection in text categorization," in Intl. Conf. on Machine Learning (ICML-97), 1997, pp. 412-420.
19. S.E. Robertson et al., "Okapi at TREC-3," in The Third Text Retrieval Conference (TREC-3), 1995, pp. 109-126.
20. T. Joachims, "Optimizing search engines using clickthrough data," in ACM Conf. on Knowledge Discovery and Data Mining (KDD), 2002.
21. N. Slonim, "Private communication," 2006.