Evolving the structure of hidden Markov Models

IEEE Transactions on Evolutionary Computation

Volumn 10, Issue 1, 2006, Pages 39-49

  Won, Kyoung Jae ^a   Prügel Bennett, Adam ^a   Krogh, Anders ^b  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Biological sequence analysis; Genetic algorithm (GA); Hidden Markov model (HMM); Hybrid algorithm; Machine learning

Indexed keywords

CODES (SYMBOLS); LEARNING SYSTEMS; MARKOV PROCESSES; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY; TOPOLOGY;

BIOLOGICAL SEQUENCE ANALYSIS; HIDDEN MARKOV MODELS; HYBRID ALGORITHM;

GENETIC ALGORITHMS;

EID: 31744447211     PISSN: 1089778X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TEVC.2005.851271     Document Type: Article

References (25)

1. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
2. R. M. Durbin, S. R. Eddy, A. Krogh, and G. Mitchison, Biological Sequence Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1998.
3. T. Yada, M. Ishikawa, H. Tanaka, and K. Asai, "DNA sequence analysis using hidden Markov model and genetic algorithm," Genome Inform., vol. 5, pp. 178-179, 1994.
4. C. W. Chaw, S. Kwong, C. K. Diu, and W. R. Fahrner, "Optimization of HMM by a genetic algorithm," in Proc. Int. Conf. Aucoustics, Speech, Signal Processing, 1997, pp. 1727-1730.
5. X. Yao, "Evolving artificial neural networks," Proc. IEEE, vol. 87, no. 9, pp. 1423-1447, Sep. 1999.
6. I. Poli and A. Roverato, "A genetic algorithm for graphical model selection," J. Italian Statist. Soc., vol. 2, pp. 197-208, 1998.
7. I. Inza, P. Larrañaga, and B. Sierra, "Feature subset selection by Bayesian networks: A comparison with genetic and sequential algorithms," Int. J. Approximate Reasoning, vol. 27, no. 2, pp. 143-164, 2001.
8. A. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Roy. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
9. K. Sjolander, K. Karplus, M. Brown, R. Hughey, A. Krogh, I. S. Mian, and D. Haussler, "Dirichlet mixture: A method for improved detection of weak but significant protein sequence homology," Proc. Comput. Appl. Biol. Sci. (CABIOS), vol. 12, pp. 327-345, 1996.
10. A. Krogh and S. K. Riis, "Hidden neural networks," Neural Computation, vol. 11, pp. 541-563, 1999.
11. L. R. Bahl, F. Jelinek, and R. L. Mercer, "A maximum likelihood approach to continuous speech recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, pp. 179-190, 1983.
12. A. Krogh, B. Larsson, G. von Heijne, and E. Sonnhammer, "Predicting transmembrane protein topology with a hidden Markov model: Application to complete genomes," J. Molecular Biol., vol. 305, no. 3, pp. 567-580, 2003.
13. A. Stolcke, "Bayesian learning of probabilistic language models," Ph.D. dissertation, Univ. California, Berkeley, CA, 1994.
14. Y. Fujiwara, M. Asogawa, and A. Konagaya, "Motif extraction using an improved iterative duplication method for HMM topology learning," in Proc. Pacific Symp. Biocumputing, 1995, pp. 713-714.
15. K.-J. Won, A. Prügel-Bennett, and A. Krogh, "Training HMM structure with genetic algorithm for biological sequence analysis," Bioinformat., vol. 20, pp. 3613-3619, 2004.
16. K. J. Won, Prügel-Bennet, A. Krogh A. "The block hidden Markov model for biological sequence ananlysis," Lecture Notes Artificial Intell., vol. 3213, pp. 64-70, 2004.
17. M. I. Jordan, Learning in Graphical Models. Cambridge, MA: MIT Press, 1999.
18. C. R. Friedman, J. Neimann, H. C. Wegener, and R. V. Tauxe, Epidemiology of Campylobacter jejuni Infection in the United States and Other Industrialized Nations. Washington, DC: ASM, 2000, pp. 121-139.
19. J. M. Berg, J. L. Tymoczko, and L. Stryer, Biochemistry, 5th ed. San Frasncisco, CA: Freeman, 2002.
20. M. M. Wosten, M. Boeve, M. G. Koot, A. C. van Nuene, and B. A. van der Zeijst, "Identification of Campylobacter jejuni promoter sequence," J. Bacteriaol., vol. 180, pp. 594-599, 1998.
21. L. Petersen, T. S. Larsen, D. W. Ussery, S. L. W. On, and A. Krogh, "RpoD promoters in Campylobacter jejuni exhibit a strong periodic signal instead of a -35 box," J. Molecular Biol., vol. 326, no. 5, pp. 1361-1372, 2003.
22. J. E. Baker, "Reducing bias and inefficiency in the selection algorithm," in Proc. 2nd Int. Conf. Genetic Algorithms, Hillsdale, 1987, pp. 14-21.
23. A. Krogh, An Introduction to Hidden Markov Models for Biological Sequences, ser. Computational Methods Molecular Biol. Amsterdam, The Netherlands: Elsevier, 1998, ch. 4, pp. 45-63.
24. J. Rissanen, Stochastic Complexity in Statistical Inquiry. New York: World Scientific, 1999.
25. http://www.ecs.soton.ac.uk/~kjw02r/data.htm