Analysis of symbolic sequences using the Jensen-Shannon divergence

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 65, Issue 4, 2002, Pages

  Grosse, Ivo ^a,b   Bernaola Galván, Pedro ^b,c   Carpena, Pedro ^b,c   Román Roldán, Ramón ^d   Oliver, Jose ^d   Stanley, H Eugene ^b  

^a Howard Hughes Medical Institute Cold Spring Harbor Laboratory Cold Spring Harbor   (United States)

^b Boston University   (United States)

^c UNIVERSITY OF MÁLAGA   (Spain)

^d UNIVERSITY OF GRANADA   (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ARBITRARY NUMBERS; JENSEN-SHANNON DIVERGENCE (JSD); KULLBACK DIVERGENCES; SYMBOLIC SEQUENCES;

APPROXIMATION THEORY; CODES (SYMBOLS); COMPUTER SIMULATION; CORRELATION METHODS; DNA; MONTE CARLO METHODS; PROBABILITY;

PROBABILITY DISTRIBUTIONS;

EID: 41349106744     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.65.041905     Document Type: Article

References (54)

1. B. L. Hao, Elementary Symbolic Dynamics and Chaos in Dissipative Systems (World Scientific, Singapore, 1989).
2. B. L. Hao, Physica D 51, 161 (1991).
3. C. E. Shannon and W. W. Weaver, The Mathematical Theory of Communication (University of Illinois Press, Urbana, IL, 1949).
4. W. Li, J. Stat. Phys. 60, 823 (1990).
5. H. Herzel and I. Grosse, Physica A 216, 518 (1995).
6. H. Herzel and I. Grosse, Phys. Rev. E 55, 800 (1997).
7. V. E. Ramensky et al., J. Comput. Biol. 7, 1 (2000).
8. R. F. Voss, Phys. Rev. Lett. 68, 3805 (1992).
9. A. A. Borovkov, Mathematical Statistics (Mir, Moscow, 1984).
10. A. K. C. Wong and M. You, IEEE Trans. Pattern Anal. Mach. Intell. 7, 599 (1985).
11. J. Lin, IEEE Trans. Inf. Theory 37, 145 (1991).
12. M. L. Menéndez, J. A. Pardo, L. Pardo, and M. C. Pardo, J. Franklin Inst. 334B, 307 (1997).
13. P. Bernaola-Galván, R. Román-Roldán, and J. L. Oliver, Phys. Rev. E 53, 5181 (1996).
14. W. Li, G. Stolovitzky, P. Bernaola-Galván, and J. L. Oliver, Genome Res. 8, 916 (1998); W. Li, Phys. Rev. Lett. 86, 5815 (2001).
15. W. Li, G. Stolovitzky, P. Bernaola-Galván, and J. L. Oliver, Genome Res. 8, 916 (1998); W. Li, Phys. Rev. Lett. 86, 5815 (2001).
16. V. Barranco-López, P. Luque-Escamilla, J. Martínez-Aroza, and R. Román-Roldán, Electron. Lett. 31, 867 (1995).
17. P. Carpena and P. Bernaola-Galván, Phys. Rev. B 60, 201 (1999).
18. W. Li, Complexity 3, 33 (1997).
19. R. Roman Roldán, P. Bernaola-Galván, and J. L. Oliver, Phys. Rev. Lett. 80, 1344 (1998).
20. P. Bernaola-Galván, J. L. Oliver, and R. R. Román- Roldán, Phys. Rev. Lett. 83, 3336 (1999).
21. P. Bernaola-Galván, I. Grosse, P. Carpena, J. L. Oliver, R. Román-Roldán, and H. E. Stanley, Phys. Rev. Lett. 85, 1342 (2000).
22. J. Burbea and C. R. Rao, IEEE Trans. Inf. Theory 28, 489 (1982).
23. I. Csiszár, Stud. Sci. Math. Hung. 2, 299 (1967).
24. T. Cover and J. Thomas, Elements of Information Theory (Wiley, New York, 1991).
25. By a symbolic i.i.d. sequence we mean a sequence of independent and identically distributed (i.i.d.) symbols.
26. M. Mansuripur, Introduction to Information Theory (Prentice-Hall, Englewood Cliffs, NJ, 1987).
27. G. A. Miller, Information Theory in Psychology, edited by H. Quaster (Free Press, Glencoe, 1955).
28. G. P. Basharin, Theor. Probab. Appl. 4, 333 (1959).
29. B. Harris, Topics Inf. Theory (Keszhtely) 16, 323 (1975).
30. H. Herzel, A. O. Schmitt, and W. Ebeling, Chaos, Solitons Fractals 4, 97 (1994).
31. M. S. Roulston, Physica D 125, 285 (1999).
32. W. H. Press, S. A. Teukolsky, W. T. Vettering, and B. P. Flannery, Numerical Recipes in C (Cambridge University Press, Cambridge, England, 1994).
33. M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions (Dover, New York, 1970).
34. B. James and K. Ling, Biometrika 74, 71 (1987).
35. M. Pollak and D. Siegmund, Annu. Stat. Suppl. Soc. Secur Bull. 19, 394 (1991).
36. B. Witcher, P. Guttorp, and D. B. Percival, J. Stat. Comput. Simul. 68, 65 (2000).
37. W. Feller, An Introduction to Probability Theory and its Applications (Wiley, New York, 1971).
38. L. Horvath, J. Multivariate Anal. 31, 148 (1989).
39. M. Csorgo and L. Horvath, Limit Theorems in Change Point Analysis (Wiley, New York, 1997).
40. We choose an "excluded volume" of size 15 around the end points of the sequence, because the frequency vector f cannot be reliably computed if the length of the subsequence drops below approximately 15.
41. C.-K. Peng et al., Phys. Rev. E 49, 1685 (1994).
42. C.-K. Peng, S. Buldyrev, A. Goldberger, S. Havlin, F. Sciortino, M. Simons, and H. E. Stanley, Nature (London) 356, 168 (1992).
43. F. R. Blattner et al., Science 277, 1453 (1997).
44. Sequence retrieved from http://www.sanger.ac.uk/HGP/Chr6/MHC.shtml.
45. W. Li, in Proceedings of the Fifth Annual International Conference on Computational Biology (ACM, New York, 2001), p. 204.
46. G. Bernardi et al., Science 228, 953 (1985).
47. E. N. Trifonov, Physica A 249, 511 (1998).
48. G. M. Viswanathan, S. V. Buldyrev, S. Havlin, and H. E. Stanley, Biophys. J. 72, 866 (1997).
49. R. Grantham, C. Gautier, M. Gouy, M. Jacobzone, and R. Mercier, Nucleic Acids Res. 9, R43 (1981).
50. J. C. W. Shepherd, Proc. Natl. Acad. Sci. U.S.A. 78, 1596 (1981).
51. R. Staden and A. D. McLachlan, Nucleic Acids Res. 10, 141 (1982); J. W. Fickett, ibid. 10, 5303 (1982).
52. R. Staden and A. D. McLachlan, Nucleic Acids Res. 10, 141 (1982); J. W. Fickett, ibid. 10, 5303 (1982).
53. A. N. Pettitt, Biometrika 67, 79 (1980).
54. W. Li, P. Bernaola-Galvan, F. Haghighi, and I. Grosse, Comput. Chem. (Oxford) (to be published).