Matryoshka: A HMM based temporal data clustering methodology for modeling system dynamics

Intelligent Data Analysis

Volumn 6, Issue 3, 2002, Pages 281-308

  Li, Cen ^a   Biswas, Gautam ^b   Dale, Mike ^c   Dale, Pat ^c  

^a MIDDLE TENNESSEE STATE UNIVERSITY   (United States)

^b VANDERBILT UNIVERSITY   (United States)

^c GRIFFITH UNIVERSITY   (Australia)

Author keywords

Bayesian clustering; Bayesian model selection; BIC; hidden markov model; temporal data clustering

Indexed keywords

BAYESIAN NETWORKS; CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; ION BEAMS;

BAYESIAN CLUSTERING; BAYESIAN MODEL SELECTION; CLUSTERING METHODS; CLUSTERING PROCESS; NUMBER OF CLUSTERS; PARTITION STRUCTURES; SEQUENTIAL SEARCH; TEMPORAL DATA;

HIDDEN MARKOV MODELS;

EID: 11244286295     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2002-6307     Document Type: Conference Paper

References (34)

1. G. Biswas, J. Weinberg and C. Li, Iterate: A conceptual clustering method for knowledge discovery in databases, in: Artificial Intelligence in Petroleum Industry: Symbolic and Computational Applications, B. Braunschweig and R. Day, eds, Teditions Technip, 1995.
2. P. Cheeseman and J. Stutz, Bayesian classification(autoclass): Theory and results, in: Advances in Knowledge Discovery and Data Mining, (Chapter 6), U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth and R. Uthurusamy, eds, AAAI-MIT press, 1996, pp. 153-180.
3. D. Fisher, Knowledge acquisition via incremental conceptual clustering, Machine Learning 2 (1987), 139-172.
4. A.K. Jain and D.C. Dubes, Algorithms for clustering data, Prentice Hall, 1988.
5. C. Li and G. Biswas, Unsupervised learning with mixed nominal and numeric data, IEEE Transactions on Knowledge and Data Engineering 14(4) (July/August, 2002).
6. O.D. Timmons, P.L. Havens and J.C. Fackler, Predicting death in pediatric patients with acute respiratory failure, CHEST 108(3) (Sept. 1995), 789-797.
7. M. Curley, Clinical Predicators of Progress in Weaning Pediatric Patients with Acute Respiratory Falure fro Mechanical Ventilation, Phd thesis, Boston College, Graduate School of Nursing, 1997.
8. L.R. Rabiner, A tutorial on hidden markov models and selected applications in speech recognition, Proceedings of the IEEE 77(2) (Feb. 1989), 257-285.
9. L.R. Rabiner, C.H. Lee, B.H. Juang and J.G. Wilpon, Hmm clustering for connected word recognition, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, 1989.
10. E. Dermatas and G.Kokkinakis, Algorithm for clustering continuous densityhmmby recognition error, IEEE Transactions on Speech and Audio Processing 4(3) (May 1996), 231-234.
11. T. Kosaka, S. Masunaga and M. Kuraoka, Speaker-independent phone modeling based on speaker-dependent hmm's composition and clustering, in: Proceedings of the ICASSP' 95, 1995, pp. 441-444.
12. K.F. Lee, Context-dependent phonetic hidden markov models for speaker-independent continuous speech recognition, IEEE Transactions on Acoustics, Speech, and Signal Processing, 38(4) (1990), 599-609.
13. P. Smyth, Clustering sequences with hidden markov models, Advances in Neural Information Processing, 1997.
14. W.J. Stewart, Introduction to the Numerical Solution of Markov Chains, Princeton University Press, 1994.
15. L.E. Baum, T. Petrie, G. Soules and N. Weiss, A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains, The Annuals of Mathematical Statistics 4(1) (1970), 164-171.
16. L.R. Bahl, P.F. Brown, P.V. De Souza and R.L. Mercer, Maximum mutual information estimation of hidden markov model parameters, in: Proceedings of the IEEE-IECEJ-AS International Conference on Acoustics, Speech, and Signal Processing, (Vol. 1), 1986, pp. 49-52.
17. Y. Singer and M. Warmuth, Training algorithms for hidden markov models using entropy based distance functions, Advances in Neural Information Processing Systems 9 (1996), 641-647.
18. S. Kwong, Q.H. He and K.F. Man, Training approaches for hidden markov models, Electronics Letters 32(17) (1996), 1554-1555.
19. A.P. Dempster, N.M. Laird and D.B. Rubin, Maximum likelihood from incomplete data via the em algorithm, Journal of Royal Statistical Society Series B(methodological) 39 (1977), 1-38.
20. Z. Ghahramani and M.I. Jordan, Factorial hidden markov models, Machine Leaning 29 (1997), 245-273.
21. A. Stolcke and S.M. Omohundro, Best-first model merging for hidden markov model induction, Tech. Rep. TR-94-003, International Computer Science Institute, 1947 Center St., Suite 600, Berkeley, CA 94704-1198, Jan. 1994.
22. J. Takami and S. Sagayama, A successive state splitting algorithm for efficient allophone modeling, in: Proceedings of the International Conference on Acoustics, Speech, and Signal Processing 1, 1992, pp. 573-576.
23. M. Ostendorf and H. Singer, Hmm topology design using maximum likelihood successive state splitting, Computer Speech and Language 11 (1997), 17-41.
24. S. Chib, Marginal likelihood from the gibbs sampling, Journal of the American Statistical Association, Dec. 1995, pp. 1313-1321.
25. G.F. Cooper and E. Herskovits, A bayesian method for the induction of probabilistic network from data, Machine Learning 9 (1992), 309-347.
26. D Heckerman, D. Geiger and D.M. Chickering, A tutorial on learning with bayesian networks, Machine Learning 20 (1995), 197-243.
27. R.E. Kass and A.E. Raftery, Bayes factor, Journal of the American Statistical Association (June 1995), 773-795.
28. G. Casella and E.I. George, Explaining the gibbs sampler, The American Statistician 46(3) (Aug. 1992), 167-174.
29. G. Schwarz, Estimating the dimension of a model, Annuals of Statistics 6 (1978), 461-464.
30. J. Rissanen, A universal prior for integers and estimation by minimum description length, Annual of Statistics 11 (1983), 416-431.
31. C. Li, A Bayesian Approach to Temporal Data Clustering using the Hidden Markov Model Methodology, Ph.D. thesis, Vanderbilt University, Dec. 2000.
32. P.E. Dale, P.T. Dale, K. Hulsman and B.H. Kay, Runnelling to control saltmarsh mosquitoes: long-term efficacy and environmental impacts, Journal of the American Mosquito Control Association (1993), 174-181.
33. P.E. Dale, A.L. Chandica and M. Evans, Using image subtraction and classification to evaluate change in subtropical intertidal wetlands, International Journal of Remote Sensing (1996), 703-719.
34. P.E. Dale and M.B. Dale, Optimal classification to describe environmental change: pictures from the exposition, Community Ecology.