State splitting and merging in probabilistic finite state automata for signal representation and analysis

Signal Processing

Volumn 104, Issue , 2014, Pages 105-119

  Mukherjee, Kushal ^a   Ray, Asok ^b  

^a United Technologies Research Center   (Ireland)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

D Markov machines; Probabilistic finite state automata; State merging; State splitting; Symbolic dynamics

Indexed keywords

AUTOMATA THEORY; DAMAGE DETECTION; ECONOMIC AND SOCIAL EFFECTS; POLYCRYSTALLINE MATERIALS; PROBABILITY DISTRIBUTIONS; ROBOTS; TIME SERIES; TIME SERIES ANALYSIS;

COMPUTATIONALLY EFFICIENT; POLYCRYSTALLINE ALLOYS; PROBABILISTIC FINITE STATE AUTOMATON; SIGNAL REPRESENTATIONS; SPLITTING AND MERGING; STATE SPLITTING; STATE-MERGING; SYMBOLIC DYNAMICS;

MERGING;

EID: 84899660625     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2014.03.045     Document Type: Article

References (45)

1. C. Daw, C. Fenney, and E. Tracy A review of symbolic analysis of experimental data Rev. Sci. Instrum. 74 February (2) 2003 915 930
2. H. Kantz, and T. Schreiber Nonlinear Time Series Analysis 2nd ed. 2004 Cambridge University Press Cambridge, UK
3. D. Lind, and B. Marcus Symbolic Dynamics and Coding 1995 Cambridge University Press Cambridge, UK
4. P. Dupont, F. Denis, and Y. Esposito Links between probabilistic automata and hidden Markov models probability distributions, learning models and induction algorithms Pattern Recognit. 38 9 2005 1349 1371 (Pubitemid 40751874)
5. G. Pola, and P. Tabuada Symbolic models for nonlinear control systems alternating approximate bisimulations SIAM J. Control Optim. 48 2 2009 719 733
6. K. Deng, P. Mehta, and S. Meyn Optimal Kullback-Leibler aggregation via spectral theory of Markov chains IEEE Trans. Autom. Control 71 12 2011 2793 2808
7. E. Vidal, F. Thollard, C. de la Higuera, F. Casacuberta, and R. Carrasco Probabilistic finite-state machines - Part I and Part II IEEE Trans. Pattern Anal. Mach. Intell. 27 2005 1013 1039
8. M. Vidyasagar The complete realization problem for hidden Markov models a survey and some new results Math. Control Signals Syst. 23 1-3 2011 1 65
9. P. Adenis, Y. Wen, and A. Ray An inner product space on irreducible and synchronizable probabilistic finite state automata Math. Control Signals Syst. 23 1 2012 281 310
10. P.F. Brown, P.V. deSouza, R.L. Mercer, V.J.D. Pietra, and J.C. Lai Class-based n-gram models of natural language Comput. Linguist. 18 4 1992 467 479
11. M. Mohri, F. Pereira, and M. Riley Weighted finite-state transducers in speech recognition Comput. Speech Lang. 16 1 2002 69 88
12. A. Ray Symbolic dynamic analysis of complex systems for anomaly detection Signal Process. 84 7 2004 1115 1130
13. V. Rajagopalan, and A. Ray Symbolic time series analysis via wavelet-based partitioning Signal Process. 86 11 2006 3309 3320 (Pubitemid 44331420)
14. S. Iyenger, P. Varshney, and T. Damarla A parametric copula-based framework for hypothesis testing using heterogeneous data IEEE Trans. Signal Process. 59 2011 2308 2319
15. A. Sundaresan, and P. Varshney Location estimation of a random signal source based on correlated sensor observations IEEE Trans. Signal Process. 59 2011 787 799
16. C. Rao, A. Ray, S. Sarkar, and M. Yasar Review and comparative evaluation of symbolic dynamic filtering for detection of anomaly patterns Signal Image Video Process. 3 2 2009 101 114
17. X. Jin, S. Sarkar, A. Ray, S. Gupta, and T. Damarla Target detection and classification using seismic and PIR sensors IEEE Sens. J. 12 2012 1709 1718
18. S. Bahrampour, A. Ray, S. Sarkar, T. Damarla, and N. Nasrabadi Performance comparison of feature extraction algorithms for target detection and classification Pattern Recognit. Lett. 34 16 2013 2126 2134
19. C. Bishop Pattern Recognition 2006 Springer New York, NY, USA
20. T. Liao Clustering of time series data - a survey Pattern Recognit. 38 2005 1857 1874 (Pubitemid 41214630)
21. C. Shalizi, K. Shalizi, Blind construction of optimal nonlinear recursive predictors for discrete sequences, in: AUAI 04: Proceedings of the 20th Conference on Uncertainty in Artificial Intelligence, AUAI Press, Arlington, VA, USA, 2004, pp. 504-511.
22. A. Paz Introduction to Probabilistic Automata 1971 Academic Press New York, NY, USA
23. J. Hopcroft, R. Motwani, and J. Ullman Introduction to Automata Theory, Languages, and Computation 2nd ed. 2001 ACM New York, NY, USA 45 138
24. M. Sipser Introduction to the Theory of Computation 3rd ed. 2013 Cengage Publishing Boston, MA, USA
25. G. Mallapragada, A. Ray, and X. Jin Symbolic dynamic filtering and language measure for behavior identification of mobile robots Trans. Syst. Man Cybern. Part B: Cybern. 42 2012 647 659
26. R. Carrasco, J. Oncina, Learning stochastic regular grammars by means of a state merging method, in: Grammatical Inference and Applications, Springer-Verlag, 1994, pp. 139-152.
27. A. Clark, and F. Thollard PAC-learnability of probabilistic deterministic finite state automata J. Mach. Learn. Res. 5 2004 473 497
28. C. Beck, and F. Schlögl Thermodynamics of Chaotic Systems: An Introduction 1993 Cambridge University Press Cambridge, U.K
29. P. Adenis, K. Mukherjee, A. Ray, State splitting and state merging in probabilistic finite state automata, in: American Control Conference, San Francisco, CA, USA, 2011, pp. 5145-5150.
30. F. Thollard, P. Dupont, C. de la Higuera, Probabilistic DFA inference using Kullback-Leibler divergence and minimality, in: Seventeenth International Conference on Machine Learning, Morgan Kauffman, 2000, pp. 975-982.
31. A. Berman, and R. Plemmons Nonnegative Matrices in the Mathematical Sciences 1994 SIAM Publications Philadelphia, PA, USA
32. Y. Wen, K. Mukherjee, and A. Ray Adaptive pattern classification for symbolic dynamic systems Signal Process. 93 2013 252 260
33. T. Cover, and J. Thomas Elements of Information Theory 2nd ed. 2006 Wiley Hoboken, NJ, USA
34. L. Rabiner A tutorial on hidden Markov models and selected applications in speech processing Proc. IEEE 77 2 1989 257 286
35. I. Chattopadhyay, Y. Wen, A. Ray, S. Phoha, Unsupervised inductive learning in symbolic sequences via recursive identification of self-similar semantics, in: Proceedings of American Control Conference, San Francisco, CA, USA, 2011, pp. 125-130.
36. T. Niesler, P. Woodland, A variable-length category-based n-gram language model, in: IEEE Conference on Acoustics, Speech, and Signal Processing, vol. 1, May 1996, pp. 164-167.
37. C. Kermorvant, P. Dupont, Improved smoothing for probabilistic suffix trees seen as variable order Markov chains, in: T. Elomaa, H. Mannila, H. Toivonen (Eds.), Machine Learning:ECML 2002, Lecture Notes in Computer Science, vol. 2430, Springer, Berlin, Heidelberg, 2002, pp. 185-194.
38. P. Halmos Naive Set Theory 1960 Van Nostrand Princeton, NJ 26 29
39. K. Alligood, T. Sauer, and J. Yorke Complexity: Hierarchical Structures and Scaling in Physics 1996 Springer-Verlag York, NY, USA
40. S. Gupta, A. Ray, and E. Keller Symbolic time series analysis of ultrasonic data for early detection of fatigue damage Mech. Syst. Signal Process. 21 2 2007 866 884 (Pubitemid 44667394)
41. D. Singh, S. Gupta, and A. Ray Symbolic dynamic analysis of surface deformation during fatigue crack initiation Measur. Sci. Technol. 21 3 2010 043003 (7 pp.)
42. S. Suresh Fatigue of Materials 2nd ed. 1998 Cambridge University Press Cambridge, UK
43. K. Miettinen Nonlinear Multiobjective Optimization 1998 Kluwer Academic Norwell, MA, USA
44. M. Popel, D. Mareček, Perplexity of n-gram and dependency language models, in: P. Sojka, et al. (Eds.), TSD 2010, Lecture Notes in Artificial Intelligence, vol. 6231, Springer-Verlag, Berlin, Germany, 2010, pp. 173-180.
45. D. Jha, D. Singh, S. Gupta, and A. Ray Fractal analysis of crack initiation in polycrystalline alloys using surface interferometry Eur. Phys. Lett. 98 4 2012 44006 (6 pp.)