Reconstruction of epsilon-machines in predictive frameworks and decisional states

Advances in Complex Systems

Volumn 14, Issue 5, 2011, Pages 761-794

  Brodu, Nicolas ^a  

^a UNIVERSITÉ DE RENNES 1   (France)

Author keywords

machines; decisional states; predictions; utility

Indexed keywords

EID: 80055084027     PISSN: 02195259     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219525911003347     Document Type: Article

References (34)

1. Awate, S.P., Adaptive Nonparametric Markov Models and Information -Theoretic Methods for Image Restoration and Segmentation, PhD thesis (University of Utah, USA, 2007).
2. Berger, J.O., Statistical Decision Theory and Bayesian Analysis (Springer-Verlag, New York, 1985).
3. Bertello, G., Arduin, P.-J., Boschetti, F. and Weatherley, D., Application of computational mechanics to the analysis of seismic times-series via numerical optimisation, New Generat. Comput. 27 (2009) 1-23.
4. Besag, J., Spatial interaction and the statistical analysis of lattice systems, J. Roy. Stat. Soc. B 36(2) (1974) 192-236.
5. Bishop, C., Pattern Recognition and Machine Learning (Springer-Verlag, 2006).
6. Brodu, N., Quantifying the effect of learning on recurrent spiking neurons, in Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN), 2007.
7. Brodu, N., A synthesis and a practical approach to complex systems, Complexity 15(1) (2008) 36-60.
8. Brodu, N., Lotte, F. and Lécuyer, A., Exploring two novel features for eeg-based brain-computer interfaces: Multifractal cumulants and predictive complexity, submitted preprint, http://arxiv.org/abs/1003.2879, 2011.
9. Bühlmann, P. and Wyner, A. J., Variable length markov chains, Ann. Stat. 27(2) (1999) 480-513.
10. Cassandra, A.R., Kaelbling, L.P. and Littman, M. L., Acting optimally in partially observable stochastic domains, Proceedings of the Twelfth National Conference on Artificial Intelligence 2 (1994) 1023-1028.
11. Celeux, G. and Durand, J.-B., Selecting hidden markov model state number with cross-validated likelihood, Computation. Stati. 23(4) (2008) 542-564.
12. Crutchfield, J.P. and Young, K., Inferring statistical complexity, Phys. Rev. Lett. 63(2) (1989) 105-108.
13. Duong, T., Bandwidth Selectors for Multivariate Kernel Density Estimation, PhD thesis (University of Western Australia, 2004).
14. Ester, M., Kriegel, H.-P., Sander, J. and Xu, X., A density-based algorithm for discovering clusters in large spatial databases with noise, in Proceeding of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96) (1996).
15. Howard, R.A., Dynamic Programming and Markov Processes (MIT Press, 1960).
16. Jaeger, H., Observable operator models for discrete stochastic time series, Neural Comput. 12(6) (2000) 1371-1398.
17. Jänicke, H., Wiebel, A., Scheuermann, G. and Kollmann, W., Multifield visualization using local statistical complexityalexander wiebel, IEEE Transactions on Visualization and Computer Graphics 13(6) (2007) 1384-1391.
18. Johnson, D. H. and Sinanović, S., Symmetrizing the Kullback-Leibler distance, to be published.
19. Littman, M. L., Sutton, R. S. and Singh, S., Predictive representations of state, Advances in Neural Information Processing Systems 14 (2002) 1555-1561.
20. Löhr, W., Models of Discrete-Time Stochastic Processes and Associated Complexity Measures, Ph.D. thesis (University of Leipzig, 2010).
21. Löhr, W. and Ay, N., On the generative nature of predictions, Adv. Complex Syst. 12(2) (2009) 169-194.
22. McCallum, R.A., Instance-based utile distinctions for reinforcement learning with hidden state, in Proceedings of the Twelfth International Conference on Machine Learning (1995), pp. 387-395.
23. Ray, A., Symbolic dynamic of complex systems for anomaly detection, Signal Process. 84 (2004) 1115-1130.
24. Shalizi, C.R., Causal Architecture, Complexity and Self-Organization in Time Series and Cellular Automata, Ph.D. thesis (University of Wisconsin at Madison, USA, 2001).
25. Shalizi, C.R., Methods and techniques of complex systems science: An overview, Complex Systems Science in Biomedicine (2006), pp. 33-114.
26. Shalizi, C.R., Haslinger, R., Rouquier, J.-B., Klinkner, K. L. and Moore, C., Automatic filters for the detection of coherent structure in spatiotemporal systems, Phys. Rev. E 73 (2006) 036104.
27. Shalizi, C.R. and Shalizi, K. L., Blind construction of optimal nonlinear recursive predictors for discrete sequences, in Proceedings of the Twentieth Conference on Uncertainty in Artificial Intelligence (2004), pp. 504-511.
28. Simonoff, J. S., Smoothing Methods in Statistics (Springer-Verlag, New York, 1996).
29. Still, S., Information theoretic approach to interactive learning, Europhys. Lett. 85(2) (2009) 28005.
30. Tadepalli, P., Givan, R. and Driessens, K., Relational reinforcement learning: An overview, in Proceedings of the ICML'O4 Workshop on Relational Reinforcement Learning (2004).
31. Talvitie, E. N., Simple Partial Models for Complex Dynamical Systems, PhD thesis (University of Michigan, 2010).
32. Theodoridis, S. and Koutroumbas, K., Pattern Recognition, 3rd edn. (Elsevier, 2006).
33. Wierstra, D. andWiering, M., Utile distinction hidden markov models, in Proceedings of the Twenty-First International Conference on Machine Learning (2004).
34. Wolfram, S., Statistical mechanics of cellular automata, Rev. Mod. Phys. 55(3) (1983) 601-644.