Logical hidden Markov models

Journal of Artificial Intelligence Research

Volumn 25, Issue , 2006, Pages 425-456

  Kersting, Kristian ^a   De Raedt, Luc ^a   Raiko, Tapani ^b  

^a UNIVERSITY OF FREIBURG   (Germany)

^b AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; EVALUATION; FORMAL LOGIC; MARKOV PROCESSES; PARAMETER ESTIMATION;

BIOINFORMATICS; LOGICAL ATOMS; LOGICAL HIDDEN MARKOV MODELS (LOHMM); STRUCTURED SYMBOLS;

ARTIFICIAL INTELLIGENCE;

EID: 33744486342     PISSN: 10769757     EISSN: 10769757     Source Type: Journal    
DOI: 10.1613/jair.1675     Document Type: Article

References (57)

1. Abney, S. (1997). Stochastic Attribute-Value Grammars. Computational Linguistics, 23(4), 597-618.
2. Abney, S., McAllester, D., & Pereira, F. (1999). Relating probabilistic grammars and automata. In Proceedings of 37th Annual Meeting of the Association for Computational Linguistics (ACL-1999), pp. 542-549. Morgan Kaufmann.
3. Anderson, C., Domingos, P., & Weld, D. (2002). Relational Markov Models and their Application to Adaptive Web Navigation. In Proceedings of the Eighth International Conference on Knowledge Discovery and Data Mining (KDD-2002), pp. 143-152 Edmonton, Canada. ACM Press.
4. Baker, J. (1979). Trainable grammars for speech recognition. In Speech communication paper presented at th 97th Meeting of the Acoustical Society of America, pp. 547-550 Boston, MA.
5. Bauer, H. (1991). Wahrscheinlichkeitstheorie (4. edition). Walter de Gruyter, Berlin, New York.
6. Baum, L. (1972). An inequality and associated maximization technique in statistical estimation for probabilistic functions of markov processes. Inequalities, 3, 1-8.
7. Bohnebeck, U., Horváth, T., & Wrobel, S. (1998). Term comparison in first-order similarity measures. In Proceedings of the Eigth International Conference on Inductive Logic Programming (ILP-98), Vol. 1446 of LNCS, pp. 65-79. Springer.
8. Bresnan, J. (2001). Lexical-Functional Syntax. Blackwell, Malden, MA.
9. Carrasco, R., Oncina, J., & Calera-Rubio, J. (2001). Stochastic inference of regular tree languages. Machine Learning, 44(1/2), 185-197.
10. Chandonia, J., Hon, G., Walker, N., Lo Conte, L., P.Koehl, & Brenner, S. (2004). The ASTRAL compendium in 2004. Nucleic Acids Research, 32, D189-D192.
11. Davison, B., & Hirsh, H. (1998). Predicting Sequences of User Actions. In Predicting the Future: AI Approaches to Time-Series Analysis, pp. 5-12. AAAI Press.
12. De Raedt, L., & Kersting, K. (2003). Probabilistic Logic Learning. ACM-SIGKDD Explorations: Special issue on Multi-Relational Data Mining, 5(1), 31-48.
13. De Raedt, L., & Kersting, K. (2004). Probabilistic Inductive Logic Programming. In Ben-David, S., Case, J., & Maruoka, A. (Eds.), Proceedings of the 15th International Conference on Algorithmic Learning Theory (ALT-2004), Vol. 3244 of LNCS, pp. 19-36 Padova, Italy. Springer.
14. Durbin, R., Eddy, S., Krogh, A., &: Mitchison, G. (1998). Biological sequence analysis: Probabilistic models of proteins and nucleic acids. Cambridge University Press.
15. Džeroski, S., & Lavrač, N. (Eds.). (2001). Relational data mining. Springer-Verlag, Berlin.
16. Eddy, S., & Durbin, R. (1994). RNA sequence analysis using covariance models. Nucleic Acids Res., 22(11), 2079-2088.
17. Eisele, A. (1994). Towards probabilistic extensions of contraint-based grammars. In Dörne, J. (Ed.), Computational Aspects of Constraint-Based Linguistics Decription-II. DYNA-2 deliverable R1.2.B.
18. Fine, S., Singer, Y., & Tishby, N. (1998). The hierarchical hidden markov model: analysis and applications. Machine Learning, 32, 41-62.
19. Frasconi, P., Soda, G., & Vullo, A. (2002). Hidden markov models for text categorization in multi-page documents. Journal of Intelligent Information Systems, 18, 195-217.
20. Friedman, N., Getoor, L., Koller, D., & Pfeffer, A. (1999). Learning probabilistic relational models. In Proceedings of Sixteenth International Joint Conference on Artificial Intelligence (IJCAI-1999), pp. 1300-1307. Morgan Kaufmann.
21. Fristedt, B., & Gray, L. (1997). A Modern Approach to Probability Theory. Probability and its applications. Birkhäuser Boston.
22. Ghahramani, Z., & Jordan, M. (1997). Factorial hidden Markov models. Machine Learning, 29, 245-273.
23. Goodman, J. (1997). Probabilistic feature grammars. In Proceedings of the Fifth International Workshop on Parsing Technologies (IWPT-97) Boston, MA, USA.
24. Greenberg, S. (1988). Using Unix: collected traces of 168 users. Tech. rep., Dept. of Computer Science, University of Calgary, Alberta.
25. Hopcroft, J., & Ullman, J. (1979). Introduction to Automata Theory, Languages, and Computation. Addison-Wesley Publishing Company.
26. Horváth, T., Wrobel, S., & Bohnebeck, U. (2001). Relational Instance-Based learning with Lists and Terms. Machine Learning, 43(1/2), 53-80.
27. Hubbard, T., Murzin, A., Brenner, S., & Chotia, C. (1997). SCOP: a structural classification of proteins database. NAR, 27(1), 236-239.
28. Jacobs, N., & Blockeel, H. (2001). The Learning Shell: Automated Macro Construction. In User Modeling 2001, pp. 34-43.
29. Jaeger, M. (1997). Relational Bayesian networks. In Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence (UAI), pp. 266-273. Morgan Kaufmann.
30. Katz, S. (1987). Estimation of probabilities from sparse data for hte language model component of a speech recognizer. IEEE Transactions on Acoustics, Speech, and Signal Processing (ASSP), 35, 400-401.
31. Kersting, K., & De Raedt, L. (2001a). Adaptive Bayesian Logic Programs. In Rouveirol, C., & Sebag, M. (Eds.), Proceedings of the 11th International Conference on Inductive Logic Programming (ILP-01), Vol. 2157 of LNAI, pp. 118-131. Springer.
32. Kersting, K., & De Raedt, L. (2001b). Towards Combining Inductive Logic Programming with Bayesian Networks. In Rouveirol, C., & Sebag, M. (Eds.), Proceedings of the 11th International Conference on Inductive Logic Programming (ILP-01), Vol. 2157 of LNAI, pp. 118-131. Springer.
33. Kersting, K., & Raiko, T. (2005). 'Say EM' for Selecting Probabilistic Models for Logical Sequences. In Bacchus, F., & Jaakkola, T. (Eds.), Proceedings of the 21st Conference on Uncertainty in Artificial Intelligence, UAI 2005, pp. 300-307 Edinburgh, Scotland.
34. Kersting, K., Raiko, T., Kramer, S., & De Raedt, L. (2003). Towards discovering structural signatures of protein folds based on logical hidden markov models. In Altman, R., Dunker, A., Hunter, L., Jung, T., & Klein, T. (Eds.), Proceedings of the Pacific Symposium on Biocomputing (PSB-03), pp. 192-203 Kauai, Hawaii, USA. World Scientific.
35. Koivisto, M., Kivioja, T., Mannila, H., Rastas, P., & Ukkonen, E. (2004). Hidden Markov Modelling Techniques for Haplotype Analysis. In Ben-David, S., Case, J., & Maruoka, A. (Eds.), Proceedings of 15th International Conference on Algorithmic Learning Theory (ALT-04), Vol. 3244 of LNCS, pp. 37-52. Springer.
36. Koivisto, M., Perola, M., Varilo, T., Hennah, W., Ekelund, J., Lukk, M., Peltonen, L., Ukkonen, E., & Mannila, H. (2002). An MDL method for finding haplotype blocks and for estimating the strength of haplotype block boundaries. In Altman, R., Dunker, A., Hunter, L., Jung, T., & Klein, T. (Eds.), Proceedings of the Pacific Symposium on Biocomputing (PSB-02), pp. 502-513. World Scientific.
37. Korvemaker, B., & Greiner, R. (2000). Predicting UNIX command files: Adjusting to user patterns. In Adaptive User Interfaces: Papers from the 2000 AAAI Spring Symposium, pp. 59-64.
38. Kulp, D., Haussler, D., Reese, M., & Eeckman, F. (1996). A Generalized Hidden Markov Model for the Recognition of Human Genes in DNA. In States, D., Agarwal, P., Gaasterland, T., Hunter, L., & Smith, R. (Eds.), Proceedings of the Fourth International Conference on Intelligent Systems for Molecular Biology, (ISMB-96), pp. 134-142 St. Louis, MO, USA. AAAI.
39. Lane, T. (1999). Hidden Markov Models for Human/Computer Interface Modeling. In Rudström, Å. (Ed.), Proceedings of the IJCAI-99 Workshop on Learning about Users, pp. 35-44 Stockholm, Sweden.
40. Lari, K., & Young, S. (1990). The estimation of stochastic context-free grammars using the inside-outside algorithm. Computer Speech and Language, 4, 35-56.
41. Levy, L., & Joshi, A. (1978). Skeletal structural descriptions. Information and Control, 2(2), 192-211.
42. McLachlan, G., & Krishnan, T. (1997). The EM Algorithm and Extensions. Wiley, New York.
43. Mitchell, T. M. (1997). Machine Learning. The McGraw-Hill Companies, Inc.
44. Muggleton, S. (1996). Stochastic logic programs. In De Raedt, L. (Ed.), Advances in Inductive Logic Programming, pp. 254-264. IOS Press.
45. Muggleton, S., & De Raedt, L. (1994). Inductive logic programming: Theory and methods. Journal of Logic Programming, 19(20), 629-679.
46. Ngo, L., & Haddawy, P. (1997). Answering queries from context-sensitive probabilistic knowledge bases. Theoretical Computer Science, 171, 147-177.
47. Pollard, C., & Sag, I. (1994). Head-driven Phrase Structure Grammar. The University of Chicago Press, Chicago.
48. Rabiner, L., & Juang, B. (1986). An Introduction to Hidden Markov Models. IEEE ASSP Magazine, 5(1), 4-16.
49. Riezler, S. (1998). Statistical inference and probabilistic modelling for constraint-based nip. In Schrder, B., Lenders, W., & und T. Portele, W. H. (Eds.), Proceedings of the 4th Conference on Natural Language Processing (KONVENS-98). Also as CoRR cs.CL/9905010.
50. Sakakibara, Y. (1992). Efficient learning of context-free grammars from positive structural examples. Information and Computation, 97(1), 23-60.
51. Sakakibara, Y. (2003). Pair hidden markov models on tree structures. Bioinformatics, 19(Suppl.1), 1232-1240.
52. Sakakibara, Y., Brown, M., Hughey, R., Mian, I., Sjolander, K., & Underwood, R. (1994). Stochastic context-free grammars for tRNA modelling. Nucleic Acids Research, 22(23), 5112-5120.
53. Sanghai, S., Domingos, P., & Weld, D. (2003). Dynamic probabilistic relational models. In Gottlob, G., & Walsh, T. (Eds.), Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI-03), pp. 992-997 Acapulco, Mexico. Morgan Kaufmann.
54. Sato, T., & Kameya, Y. (2001). Parameter learning of logic programs for symbolic-statistical modeling. Journal of Artificial Intelligence Research (JAIR), 15, 391-454.
55. Schölkopf, B., & Warmuth, M. (Eds.). (2003). Learning and Parsing Stochastic Unification-Based Grammars, Vol. 2777 of LNCS. Springer.
56. Turcotte, M., Muggleton, S., & Sternberg, M. (2001). The effect of relational background knowledge on learning of protein three-dimensional fold signatures. Machine Learning, 43(1/2), 81-95.
57. Won, K., Prügel-Bennett, A., & Krogh, A. (2004). The Block Hidden Markov Model for Biological Sequence Analysis. In Negoita, M., Howlett, R., & Jain, L. (Eds.), Proceedings of the Eighth International Conference on Knowledge-Based Intelligent Information and Engineering Systems (KES-04), Vol. 3213 of LNCS, pp. 64-70. Springer.