An adaptive threshold framework for event detection using HMM-based life profiles

ACM Transactions on Information Systems

Volumn 27, Issue 2, 2009, Pages

  Chen, Chien Chin ^a   Chen, Meng Chang ^b   Chen, Ming Syan ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b ACADEMIA SINICA   (Taiwan)

Author keywords

Clustering; Event detection; Hidden Markov models; Life profiles; TDT; Topic detection

Indexed keywords

CLUSTERING; EVENT DETECTION; LIFE PROFILES; TDT; TOPIC DETECTION;

COMPUTATIONAL GRAMMARS; OBJECT RECOGNITION; WAVELET TRANSFORMS;

HIDDEN MARKOV MODELS;

EID: 67649379006     PISSN: 10468188     EISSN: 15582868     Source Type: Journal    
DOI: 10.1145/1462198.1462201     Document Type: Article

References (39)

1. Aggarwal, C. C. 2003. A Framework for diagnosing changes in evolving data streams. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 575-586.
2. Aizen, J., Huttenlocher, D., Kleinberg, J., and Novak, A. 2004. Traffic-based feedback on the web. In Proc. Nat. Acad. Sci. 101, 525-5260.
3. Allan, J., Papka, R., and Lavrenko, V. 1998a. On-line new event detection and tracking. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 37-45.
4. Allan, J., Carbonell, J., Doddington, G., Yamron, J., and Yang, Y. 1998b. Topic detection and tracking pilot study: final report. In Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop. 194-218.
5. Allan, J., Lavrenko, V., Frey, D., and Khandelwal, V. 2000. Proceeding of the TDT Workshop.
6. Baeza-Yates, R. and Ribeiro-Neto, B. 1999. Modern Information Retrieval. Addison-Wesley.
7. Barlas, Y. and Kanar, K. 1999. A dynamic pattern-oriented test for model validation. In Proceedings of 4th Systems Science European Congress. 269-286.
8. Baum, L. E., Petrie, T., Soules, G., and Weiss, N. 1970. A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Statist. 41, 164-171.
9. Chen, C. C., Chen, Y. T., Sun Y., and Chen, M. C. 2003. Life cycle modeling of news events using aging theory. In Proceedings of the 14th European Conference on Machine Learning. 47-59.
10. Chen, C. C., Chen, M. C., and Chen, M. S. 2005. LIPED: HMM-based life profiles for adaptive event detection. In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 556-561.
11. Chou, T. C. and Chen, M. C. 2008. Using incremental PLSI for threshold-resilient online event analysis. IEEE Trans. Know. Data Eng. 20, 3, 289-299.
12. Cormen, T. H., Leiserson, C. E., Rivest, R. L., and Stein, C. 2001. Introduction to Algorithms. MIT Press.
13. Dempster, A. P., Laird, N. M., and Rubin, D. B. 1977. Maximum likelihood from incomplete data via the EM algorithm. J. Royal Statist. Soc. Series B 39, 1-38.
14. Donjerkovic, D. and Ramakrishnan, R. 2000. Dynamic histograms: capturing evolving data sets. In Proceedings of the 16th International Conference on Data Engineering. 86.
15. Fiscus, G. J. and Doddington, G. 2002. Topic detection and tracking evaluation overview. In Topic Detection and Tracking: Event-Based Information Organization. Kluwer Academic Press, 17-30.
16. Frakes, W. B. and Baeza-Yates, R. 1992. Information Retrieval: Data Structures and Algorithms. Prentice Hall.
17. Franz, M., McCarley, J. S., Ward, T., and Zhu, W. J. 2001. Unsupervised and supervised clustering for topic tracking. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 310-317.
18. Ganti, V., Gehrke, J., and Ramakrishnan, R. 1999. A framework for measuring changes in data characteristics. In Proceedings of the Eighteenth ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems. 126-137.
19. Ghahramani, S. 2000. Fundamentals of Probability. Prentice Hall.
20. Hatzivassiloglou, V., Gravano, L., and Maganti, A. 2000. An investigation of linguistic features and clustering algorithms for topical document clustering. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 224-231.
21. Kleinberg, J. 2002. Bursty and hierarchical structure in streams. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 91-101.
22. Leuski, A. and Allan, J. 2002. Improving realism of topic tracking evaluation. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 89-96.
23. Li, Z., Wang, B., Li, M., and Ma, W-Y. 2005. A probabilistic model for retrospective news event detection. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 106-113.
24. Makkonen, J., Ahonen-Myka, H., and Salmenkivi, M. 2004. Simple semantics in topic detection and tracking. Information Retrieval. 7, 3-4, 347-368.
25. Manmatha, R., Feng, A., and Allan, J. 2002. A critical examination of TDT's cost function. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 403-404.
26. Manning, C. D., Raghavan, P., and Schutze, H. 2008. Introduction to Information Retrieval. Cambridge University Press.
27. Markov, A. A. 1913. An example of statistical investigation in the text of 'Eugene Onyegin' illustrating coupling of 'tests' in chains. In Proc. Acad. Sci. 7, 153-162.
28. Martin, A., Doddington, G., Kamm, T., Ordowski, M., and Przybocki, M. 1997. The DET curve in assessment of detection task performance. In Proc. EuroSpeech, 4, 1985-1898.
29. Mitchell, T. M. 1997. Machine Learning. McGraw-Hall.
30. Myers, C., Rabiner, L. R., and Rosenberg, A. E. 1980. Performance tradeoffs in dynamic time warping algorithms for isolated word recognition. IEEE Trans. Acoust. Speech Signal Proc. 28, 6, 623-635.
31. Papka, R. 1999. P.h.D thesis, Department of Computer Science, University of Massachusetts.
32. Rabiner, L. R. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. In Proc. IEEE 77, 2, 257-286.
33. Rijsbergen, C. J. V. 1979. Information Retrieval, 2nd. Butterworths, London.
34. Rocchio, J. J. 1971. Relevance feedback in information retrieval, In The SMART Retrieval System, Prentice Hall, 313-323.
35. Salton, G. 1989. Automatic Text Processing: the Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley.
36. Silverman, B. 1986. Density Estimation for Statistics and Data Analysis. Chapman and Hall.
37. Viterbi, A. J. 1967. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. Inform. Theory IT-13, 1260-1269.
38. Yang, Y., Pierce, T., and Carbonell, J. 1998. A study on retrospective and on-line event detection. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 28-36.
39. Zhang, J., Ghahramani, Z., and Yang, Y. 2004. A probabilistic model for online document clustering with application to novelty detection. In Proceedings of the Conference on Neural Information Processing System. 1617-1624.