Language independent unsupervised learning of short message service dialect

International Journal on Document Analysis and Recognition

Volumn 12, Issue 3, 2009, Pages 175-184

  Acharyya, Sreangsu ^a   Negi, Sumit ^b   Subramaniam, L Venkata ^b   Roy, Shourya ^c  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b IBM RESEARCH   (United States)

^c Xerox India Innovation Hub   (India)

Author keywords

Clustering; Noisy text; Unsupervised learning

Indexed keywords

ANECDOTAL EVIDENCES; BAUM-WELCH; BAUM-WELCH ALGORITHMS; CLUSTERING; COST EFFECTIVE; GENERATIVE MODEL; HUMAN INTERVENTION; INFERENCE ALGORITHM; INSTANT MESSENGERS; LOG LIKELIHOOD; LOG-LIKELIHOOD FUNCTIONS; MULTILINGUALITY; NOISY TEXT; PAIRWISE DISTANCES; QUALITY OF RESULTS; SHORT MESSAGE SERVICES; TEXT-MINING; TEXTUAL DATA; TRAINING PHASE; UNSUPERVISED METHOD;

HIDDEN MARKOV MODELS; INFERENCE ENGINES; LINGUISTICS; MINING; SYSTEMS ENGINEERING; UNSUPERVISED LEARNING;

MAXIMUM LIKELIHOOD;

EID: 70349967721     PISSN: 14332833     EISSN: 14332825     Source Type: Journal    
DOI: 10.1007/s10032-009-0093-9     Document Type: Conference Paper

References (19)

1. Ahmad, F., Kondrak, G.: Learning a spelling error model from search query logs. In: HLT '05: Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Morristown, NJ, USA. Association for Computational Linguistics. pp. 955-962 (2005)
2. Baum L.E., Petrie T., Soules G., Weiss N.: A maximization technique occurring in the statistical analysis of probabilisitic functions of Markov chains. Ann. Math. Stat. 41(1), 164-171 (1970)
3. Brill, E., Moore, R.C.: An improved model for noisy spelling correction. In: Proceedings of 38th Annual Meeting of the ACL, pp. 286-293 (2000)
4. Brown P.F., Della Pietra V.J., deSouza P.V., Lai J.C., Mercer R.L.: Class-based n-gram models of natural language. Comput. Linguist. 18(4), 467-479 (1992)
5. Choudhury M., Sharaf R., Jain V., Mukherjee A., Sarkar S., Basu A.: Investigation and modeling of the structure of texting language. Int. J. Doc. Anal. Recognit. 10(3-4), 157-174 (1991)
6. Cover T.M., Thomas J.A.: Elements of Information Theory. Wiley, New York (1991)
7. Dempster A.P., Laird N.M., Rubin D.B.: Maximum likelihood from incomplete data via the em algorithm. J. R. Stat. Soc. 39(Series B), 1-38 (1977)
8. Hofmann, T., Puzicha, J.: Unsupervised learning from dyadic data. Technical Report TR-98-042, International Computer Science Insitute, Berkeley (1998)
9. How, Y., Kan, M.-Y.: Optimizing predictive text entry for short message service on mobile phones. In: Proceedings of Human Computer Interfaces International (2005)
10. Karypis, G.: CLUTO - a clustering toolkit. Technical Report #02-017. Department of Computer Science, University of Minnesota (2003)
11. Kothari, G., Negi, S., Faruquie, T.A., Chakaravarthy, V.T., Subramaniam, L.V.: SMS based interface for FAQ retrieval. In: Joint Conference of the Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP 2009), Singapore (2009)
12. Kukich K.: Technique for automatically correcting words in text. ACM Comput. Surv. 24, 377-439 (1992)
13. Lodhi H., Saunders C., Shawe-Taylor J., Cristianini N., Watkins C.: Text classification using string kernels. J. Mach. Learn. Res. 2, 419-444 (2002)
14. Navarro G.: A guided tour to approximate string matching. ACM Comput. Surv. 33(1), 31-88 (2001)
15. Rabiner L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257-286 (1989)
16. Shi J., Malik J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 888-905 (2000)
17. Smyth P., Heckerman D., Jordan M.I.: Probabilistic independence networks for hidden Markov probability models. Neural Comput. 9(2), 227-269 (1992)
18. Sproat R., Black A., Chen S., Kumar S., Ostendorf M., Richards C.: Normalization of non-standard words. Comput. Speech Lang. 15, 287-333 (1992)
19. Toutanova, K., Moore, R.C.: Pronunciation modelling for improved spelling correction. In: Proceedings of 40th Annual Meeting of the ACL, pp. 144-151 (2002)