Is Entropy Suitable to Characterize Data and Signals for Cognitive Informatics?

International Journal of Cognitive Informatics and Natural Intelligence (IJCINI)

Volumn 1, Issue 2, 2007, Pages 34-57

  Kinsner, Witold ^a  

^a UNIVERSITY OF MANITOBA   (Canada)

Author keywords

data and signals; entropies; information; metrics; quality measures; signal compression

Indexed keywords

DYNAMICAL SYSTEMS; FRACTALS; METADATA;

COGNITIVE INFORMATICS; DATA AND SIGNALS; ENTROPY MEASURE; ENTROPY-BASED; INFORMATION; METRIC; MULTI-SCALES; QUALITY MEASURES; SHANNON; SIGNAL COMPRESSION;

ENTROPY;

EID: 85001728369     PISSN: 15573958     EISSN: 15573966     Source Type: Journal    
DOI: 10.4018/jcini.2007040103     Document Type: Article

References (57)

1. Alligood, K. T., Sauer, T. D., & Yorke, J. A. (1996). Chaos: An introduction to dynamical systems. New York: Springer Verlag.
2. Atmanspacher, H., & Scheingraber, H. (1987). A fundamental link between system theory and statistical mechanics. Foundations of Physics, 17(9), 939–963.
3. Barnsley, M. (1988). Fractals everywhere. Boston: Academic.
4. Bergson, H. (1960). Time and free will: An essay on the immediate data of consciousness. New York: Harper Torchbooks (Original edition 1889, translated by F.L. Pogson).
5. Brillouin, L. (1964). Scientifc uncertainty and information. New York: Academic.
6. Chan, C. W. (2002). Cognitive informatics: A knowledge engineering perspective. Proceedings of the 1st IEEE International Conference on Cognitive Informatics (pp. 49–56), Calgary, AB, August 19–20, 2002.
7. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. New York: Wiley.
8. Dansereau, R., & Kinsner, W. (2001). New relative multifractal dimension measures. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (Vol. 3, pp. 1741–1744), ICASSP2001, Salt Lake City, UT, May 7–11, 2001.
9. Dansereau, R. M., Kinsner, W., & Cevher, V. (2002). Wavelet packet best basis search using Rényi generalized entropy. Proceedings of the IEEE 2002 Canadian Conference on Electrical & Computer Engineering (Vol. 2, pp. 1005–1008), CCECE02, Winnipeg, MB, May 12–15, 2002.
10. Dubois, D., & Prade, H. (1988). Possibility theory: An approach to computerized processing of uncertainty. New York: Plenum, 263 pp.
11. Farrell, J. E., & Van Den Branden Lambrecht, C. J. (2002, January). Translating human vision research into engineering technology (Special Issue). In Proceedings of the IEEE, 90(1).
12. Grassberger, P., & Procaccia, I. (1983, January 31). Characterization of strange attractors. Physics Review Letters, 50A(5), 346–349.
13. Hartley, R. V. L. (1928). Transmission of information. Bell System Technical Journal, 7(3), 535–563.
14. Hawkins, S. (1996). The illustrated a brief history of time (2nd ed.). Bantam: New York.
15. Held, G. (1987). Data compression: Techniques and applications, hardware, and software considerations (2nd ed.). Wiley: New York
16. ISO/IEC 11172–3. (1993). Information Technology - Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to about 1.5 Mbits/s - Part 3: Audio.
17. Jayant, N. (1992, June). Signal compression: Technology targets and research directions. IEEE Journal on Selected Areas Communications, 10, 796–818.
18. Jayant, N. (1997). Signal compression: Coding of speech, audio, text, image, and video. Singapore: World Scientifc 10(6), 231.
19. Jayant, N. S., Johnson, J. D., & Safranek, R. S. (1993, October). Signal compression based on models of human perception. In Proceedings of the IEEE, 81(10), 1385–1422.
20. Kadanoff, L. P. (1993). From order to chaos: Essays. Singapore: World Scientifc, 555.
21. Kantz, H., & Schreiber, T. (1997). Nonlinear time series analysis. Cambridge, UK: Cambridge Univ. Press, 304.
22. Kinsner, W. (1991). Review of data compression methods, including Shannon-Fano, Huffman, arithmetic, Storer, Lempel-Ziv-Welch, fractal, neural network, and wavelet algorithms. Technical Report DEL91–1. Winnipeg, MB, Canada: Dept. Electrical & Computer Engineering, University of Manitoba, 157 pp.
23. Kinsner, W. (1994). Fractal dimensions: Morphological, entropy, spectrum, and variance classes. Technical Report, DEL94–4. Winnipeg, MB, Canada: Dept. of Electrical & Computer Engineering, University of Manitoba, 146.
24. Kinsner, W. (1996). Fractal and chaos engineering: Postgraduate lecture notes. Winnipeg, MB, Canada: Department of Electrical & Computer Engineering, University of Manitoba, 760 pp.
25. Kinsner, W. (1998). Signal and data compression: Postgraduate lecture notes. Winnipeg, MB, Canada: Department of Electrical & Computer Engineering, University of Manitoba, 642 pp.
26. Kinsner, W. (2002). Compression and its metrics for multimedia. In Proceedings of the 1st IEEE International Conference on Cognitive Informatics (pp. 107–121), Calgary, AB, August 19–20, 2002.
27. Kinsner, W. (2003a). Characterizing chaos with Lyapunov exponents and Kolmogorov-Sinai entropy. Technical Report DEL03–1. Winnipeg, MB, Canada: Dept. Electrical & Computer Engineering, University of Manitoba, 76 pp.
28. Kinsner, W. (2003b). Characterizing chaos through Lyapunov metrics. In Proceedings of the 2nd IEEE International Conference on Cognitive Informatics (pp. 189–201), London UK; August 18–20, 2003.
29. Kinsner, W. (2003c). Is it noise of chaos? Technical Report DEL03–2. Winnipeg, MB, Canada: Dept. Electrical & Computer Engineering, University of Manitoba, 98 pp.
30. Kinsner, W. (2005). A unified approach to fractal dimensions. In Proceedings of the 4th IEEE International Conference on Cognitive Informatics (pp. 58–72), Irvine, CA, August 8–10, 2005.
31. Kinsner, W., & Dansereau, R. (2006). A relative fractal dimension spectrum as a complexity measure. In Proceedings of the 5th IEEE International Conference on Cognitive Informatics, Beijing, China, July 17–19, 2006.
32. Mackey, M. C. (1992). Time's arrow: The origin of thermodynamic behavior. New York: Springer Verlag, 175.
33. Mainzer, K. (2004). Thinking in complexity (4th ed.). New York: Springer Verlag, 456 pp.
34. Mitra, S. K. (1998). Digital signal processing: A computer-based approach. New York: McGraw-Hill, 864. (MatLab Series)
35. Oppenheim A. V., & Schafer, R. W. (1975). Digital signal processing. Englewood Cliffs, NJ: Prentice-Hall, 585.
36. Oppenheim A. V., & Schafer, R. W. (1989). Discrete-time signal processing. Englewood Cliffs, NJ: Prentice-Hall, 879.
37. Oppenheim A. V. & Willsky, A. S. (1983). Signals and systems. Englewood Cliffs, NJ: Prentice-Hall, 796.
38. Painter, T., & Spanias, A. (1998, April). Perceptual coding of digital audio. In Proceedings of the IEEE, 88(4), 451–513.
39. Peitgen, H. O., Jürgens, H., & Saupe, D. (1992). Chaos and fractals: New frontiers of science. New York Springer Verlag, 984 pp.
40. Pennebaker W. B., & Mitchell, J. L. (1993). JPEG still image data compression standard. New York: Van Nostrand Reinhold, 638.
41. Pesin, Y. B. (1977). Characteristic Lyapunov exponents and smooth ergodic theory. Russian Mathematical Surveys, 32(4), 55–114.
42. Prigogine, I. (1996). The end of certainty: Time, chaos, and the new laws of nature. New York: The Free Press, 228.
43. Prigogine, I., & Stengers, I. (1984). Order out of chaos: Man's new dialogue with nature. New York: Bantam, 349.
44. Ruelle, D. (1978). Thermodynamics formalism. Reading, MA: Addison-Wesley-Longman (and Cambridge, UK: Cambridge University Press), 183.
45. Sayood, K. (2000). Introduction to data compression (2nd ed.). San Francisco: Morgan Kaufman, 636.
46. Schrödinger, E. (1944). What is life? (with mind and matter and autobiographical sketches). Cambridge, UK: Cambridge University Press, 184.
47. Schroeder, M. R. (1991). Fractals, chaos, power laws. New York: W.H. Freeman, 429 pp.
48. Shannon, C. E. (1948, July). A mathematical theory of communication. Bell System Technical Journal, 27(7), 398–403.
49. Sprott, J. C. (2003). Chaos and time-series analysis. Oxford, UK: Oxford University Press, 507.
50. Stonier, T. (1990). Information and the internal structure of the universe: An exploration into information physics. New York: Springer Verlag, 155.
51. Tekalp, A. M. (1998, May). Multimedia signal processing (Special Issue). Proceedings of the IEEE, 86(5).
52. Thelen, E., & Smith, L. B. (2002). A dynamic systems approach to the development of cognition and action (5th pr.). Cambridge, MA: MIT Press, 376.
53. Turcotte, D. L. (1997). Fractals and chaos in geology and geophysics (2nd ed.). Cambridge, UK: Cambridge University Press, 398 pp.
54. Vicsek, T. (1992). Fractal growth phenomena (2nd ed.). Singapore: World Scientific, 488.
55. Wang, Y. (2002). On cognitive informatics. In Proceedings of the 1st IEEE International Conference on Cognitive Informatics (pp. 34–42), Calgary, AB, August 19–20, 2002.
56. Williams, G. P. (1997). Chaos theory tamed. Washington, DC: Joseph Henry Press, 499.
57. Wornell, G. W. (1996). Signal processing with fractals: A wavelet-based approach. Upper Saddle River, NJ: Prentice-Hall, 177.