Hypermedia data modeling, coding, and semiotics

Proceedings of the IEEE

Volumn 85, Issue 7, 1997, Pages 1111-1140

  Gonzalez, Ruben ^a,b  

^a UNIVERSITY OF WOLLONGONG   (Australia)

^b GRIFFITH UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA STRUCTURES; IMAGE CODING; INFORMATION RETRIEVAL; PSYCHOLOGY COMPUTING; SIGNAL ENCODING;

HYPERTEXT SYSTEMS; SEMIOTICS PARADIGM;

DIGITAL COMMUNICATION SYSTEMS;

EID: 0031176210     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.611118     Document Type: Article

References (126)

1. J. Conklin,"HyperText: An introduction and survey," IEEE Comput. Mag., pp. 17-41, Sept. 1987.
2. M. H. O'Docherty and C. N. Daskalakis,"Multimedia information systems-The management and semantic retrieval of all electronic data types," Comput. J.. vol. 34, no. 3, pp. 225-238, 1991.
3. J. L. Schnase, J. J. Leggctt, D. L. Hicks, and R. L. Szabo,"Semantic data modeling of hypermedia associations," ACM Trans. Inform. Sst., vol. 11, no. 1, pp. 27-50, 1993.
4. G. H. Scholss and M. J. Wynblatt,"Providing definition and temporal structure for multimedia data," Multimedia Svst., vol. 3, pp. 264-277, 1995.
5. J. Gu and E. J. Neuhold,"A data model for multimedia information retrieval," in Proc. 1st Int. Conf. Multimedia Modeling, Singapore, Nov. 9-12, 1993, pp. 113-127.
6. C. Meghini, F. Rabitti, and C. Thanos,"Conceptual modeling of multimedia documents," IEEE Comput. Mag., pp. 23-29, Oct. 1991.
7. V. Bush,"As we may think," Atlantic Monthlv, pp. 101-108, July 1945.
8. D. C. Engelbart,"A conceptual framework for the augmentation of man's intellect," in Vistas Inform. Handling, vol. 1. Washington, D.C.: Sparton Books, 1963.
9. T. Nelson,"Getting it out of our system," in Information Retrieval: A Critical Review, G. Schlechter, Ed. Washinaton, D.C.: Thompson, 1967.
10. F. Halasz and M. Schwartz,"The Dexter hypertext reference model," Commun. ACM, vol. 37, no. 2, pp. 30-39, Feb. 1994.
11. L. Hardman, D. C. A. Bulterman, and G. van Rossum,"The Amsterdam hypermedia model: Adding time and context to the Dexter model," Commun. ACM, vol. 37, no. 2, pp. 50-62, Feb. 1994.
12. Z. Chen, S. Tan, R. Campbell, and Y. Li,"Real time video and audio in the World Wide Web," in Proc. 4lh Int. World Wide Web Conf., Boston, MA, 1995.
13. "MPEG-4 synthetic/natural hybrid codins call for proposals," ISO/IEC JTCI/SC29/WG11 Ml 195, Firenze, Italy, Mar. 1996.
14. F. G. Halasz,"Reflections on notecards: Seven issues for the next generation of hypermedia systems," Commun. ACM, vol. 31, no. 7, pp. 836-852, July 1988.
15. M. Dunlop,"Multimedia information retrieval," Ph.D. dissertation, Glasgow University, Rep. 1991/R21.
16. D. R. Hardy and M. F. Schwartz,"Customized information extraction as a basis for resource discovery," Dept. Computer Science, University of Colorado, Boulder, Tech. Rep. CU-CS707-94, Mar. 1994; revised Feb. 1995.'See also ACM Trans. Compiit. Svst.. to be published.
17. C. Faloutsbs, R. Barber, M. Flickner, J. Hafner, W. Niblack, D. Petkovic, and W. Equitz,"Efficient and effective querying by imace content," J. Intell. Inform. Svst., no. 3, pp. 231-262, 1994. "
18. M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steel, and P. Yanker,"Query by image and video content: The QBIC system," IEEE Coinpttt. Mag. pp. 23-31, Sept. 1995.
19. R. Weiss, A. Duda, and D. K. Gifford,"Composition and search with a video algebra," IEEE Multimedia Mag., pp. 12-25, Spring 1995.
20. D. Swanberg, C.-F. Shu, and R. Jain,"Knowledge guided parsing in video databases," in Proc. IS&T/SPIE Symp. Electronic Imaging: Science and Technology, San Jose, CA, Feb. 1993.
21. H. Zhang, S. Y. Tan, S. W. Smoliar, and Y. Gong,"Automatic parsing and indexing of news video," Multimedia Syst., vol. 2, pp. 256-266, 1995.
22. S. W. Smoliar and H. Zhang,"Content-based video indexing and retrieval," IEEE Midtimedia Mag., pp. 62-72, Summer 1994.
23. Y. Nakajima,"A video browsing using fast scene cut detection for an efficient networked video database access," IEICE Trans. Inform, and Syst., vol. E77-D, no. 12, Dec. 1994.
24. H. J. Zhang, S. W. Smoliar, and J. H. Wu,"Content-based video browsing tools," in Proc. SPIE Multimedia Computing and NetH-orks, San Jose, CA, Feb. 6-8, 1995, vol. 2417, pp. 389-398.
25. L. Teodosio and W. Bender,"Salient video stills," in Proc. ACM Multimédia'93, Anaheim, CA, 1993, pp. 39-46.
26. N. Dimitrova and F. Golshani,"Nlotion recovery for video content classification," ACM Trans. Inform. Syst., vol. 13, no. . 4, pp. 408-139, Oct. 1995.
27. A. Zakhor and F. Lari,"Edge-based 3-D camera motion estimation with application to video coding," IEEE Trans. Image Processing, vol. 2, pp. 481-498, Oct. 1993.
28. Y. Tonomura, A. Akutsu, Y. Taniguchi, and G. Suzuki,"Structured video computing," IEEE Midtimedia Mag., pp. 34-43, Fall 1994.
29. M. R. Dobie and P. H. Lewis,"Object tracking in multimedia systems," in Proc. 4th Int. Conf. Image Processing Applications, The Netherlands, Apr. 1992, pp. 41-44.
30. Y. Gong and M. Sakauchi,"An object-oriented method for color video image classification using the color and motion features of video images," in Proc. ICARCV '92, 2nd Int. Conf. Animation, Robotics Computer Vision, Sept. 1992, paper CV-10.6.
31. J. Picone,"Continuous speech recognition using hidden Markov models," IEEE Acoust., Speech, Signal Processing Mag., pp. 26-41, July 1990.
32. L. D. Wilcox, I. Smith, and M. A. Bush,"Wordspotting for voice editing and audio indexing," in Proc. CHI, Monterey, CA, Mar. 1992.
33. L. D. Wilcox, F. R. Chen, D. G. Kimber, and V. Balasubrama-. nian,"Segmentation of speech using speaker identification," in Proc. ICASSP'94, Adelaide, Australia, Apr. 1994.
34. F. R. Chen and M. M. Withgott,"The use of emphasis to automatically summarize a spoken discourse," in Proc. 1CASSP'92, San Francisco, CA, Mar. 1992.
35. B. S. Atal and L. R. Rabiner,"A pattern recognition approach to voiced-unvoiced-silence classification with applications to speech recognition," IEEE Trans. Acoust., Speech, Signal Processing vol. ASSP-24, pp. 201-212, June 1976.
36. E. Wold, T. Blum, D. Keislar, and J. Wheaton,"Content-based classification, search and retrieval of audio," IEEE Multimedia Mas-, PP- 27-36, Fall 1996.
37. P. Aigrain, P. J. V. Longuevillc, and P. Lepain,"Representationbased user interfaces for the audiovisual library of year 2000," in Proc. SPIE Multimedia Computing Networks, vol. 2417, San Jose, CA, Feb. 6-8, 1995, pp. 35-45.
38. P. S. Kumar and G. P. Babu,"Intelligent multimedia data: Data + indices + inference," Multimedia Sst. J., to be published.
39. J. K. Wu, Y. H. Ang. P. C. Lam," S. K. Moorthy, and A. D. Narasimhalu,"Facial image retrieval, identification, and inference system," in Proc. ACM Multimedia 93, Singapore, pp. 47-53.
40. A. Tversky,"Features of similarity," Pschological Rev., vol. 84, no. 4, pp. 327-352, July 1977.
41. O. D. Faugeras, Ed., Fundamentals in Computer Vision. Cambridge: Cambridge Univ. Press, 1983.
42. J. Sanz, Ed., Advances in Image Processing and Machine Vision. Berlin: Sprincer Verlaa, 1993/1994.
43. J. D. Foley/A. Van Dam, S. K. Feiner, and J. F. Hughes, Computer Graphics Principles and Practice, 2nd ed. Reading, MA: Addison-Wcsley, 1990.
44. R. A. Earnshaw, R. D. Parslow, and J. R. Woodwark, Eds., Geometric Modeling and Computer Graphics. Brookfield, VT: Cower, 1987.
45. A. P. Pentland,"Perceptual organization and the representation of natural form," in Readings in Computer Vision: Issues, Problems, Principles, ami Paradigms, M. A. Fischlcr and O. Firschein, Eds. Los Altos, CA: Morgan Kaufmann, 1987, pp. 680-699.
46. I. P. Stewart,"Quadtrees: Storage and scan conversion," Comput. J., vol. 29, no. 1, pp. 60-75, 1986.
47. A. Poggi and G. Adoni,"An octree object-oriented geometric modeller," in Proc. SPIE, Vol. 1293: Appl. Artificial Intelligence VIII, 1990, pp. 152-159.
48. A. N. Netravali and B. Prasada,"Adaptive quantization of picture signals using spatial masking," Proc. IEEE, vol. 65, pp. 536-548, Apr. 1977.
49. H. G. Musmann,"Comparison of redundancy reducing codes for facsimile transmission of documents," IEEE Trans. Commun., vol. COM-25, pp. 1425-1433, Nov. 1977.
50. T. S. Huang,"Run-length coding and its extensions," in Picture Bandwidth Compression, T. S. Huang and O. J. Tretiakpp, Eds. New York: Gordon and Breach, 1972, pp. 231-263.
51. T. Hata, S. Tomita, M. Nakada, and R. Ohnishi,"A graphic command coding scheme for multi-color images," in IEEE Global Telecommun. Conf., Dec. 1986, pp. 1143-1149.
52. S. Shlien,"Raster to polygon conversion of images," in Computers & Graphics, vol. 7, nos. 3/4. New York: Pergamon, 1983, pp. 327-332.
53. Y. Cohen, M. S. Landy, and M. Pavel,"Hierarchical coding of binary images," IEEE Trans. Pattern Anal. Machine Intell., vol. 7, pp. 284-298, May 1985.
54. H. Samct, Applications of Spatial Data Structures. Reading, MA: Addison-Wesley, 1989.
55. N. M. Nasrabadi and R. A. King,"Image coding using vector quantization: A review," IEEE Trans. Commun., vol. 36, pp. 957-971, Aug. 1988.
56. M. Rabbani and P. W. Jones, Digital Image Compression Techniques. Bcllingham, VA: SPIE, 1991.
57. M. Kunt, A. Ikonomopoulos, and M. Kocher,"Secondgeneration imaae-codins techniques," Proc. IEEE, vol. 73, pp. 549-573, Apr. 1985!
58. A. E. Jacquin,"Fractal imaae coding: A review," Proc. IEEE, vol. 81, pp. 1451-1465, Oct. 1993.
59. Y. Liu and H. Ma,"u-Orbit finite automata for data compression," in Proc. Data Compression Conf. '91, Snowbird, UT, pp. 166-175.
60. M. Eden and M. Kocher,"On the performance of a contour coding algorithm in the context of image coding-Part I: Contour segment coding," Signal Process., vol. 8, no. 4, pp. 381-386, July 1985.
61. B. B. Chaudhuri and M. K. Kundu,"Digital line segment coding: A new efficient contour coding scheme," Proc. Inst. Elect. Eng.-E, Comput. Digital Techniques, vol. 131, no. 4, pp. 143-147, July 1984.
62. T. Akimoto, Y. Suenaga, and R. S. Wallace,"Automatic creation of 3D facial models," IEEE Comput. Graph. Appl. Mag., vol. 13, pp. 16-22, Sept. 1993.
63. K. Aizawa and T. S. Huang,"Model-based image coding: Advanced video coding techniques for very low bit-rate ap-plications," Proc. IEEE, vol. 83, pp. 259-271, Feb. 1995.
64. D. E. Pearson,"Developments in model-based video codins," Pwc. IEEE, vol. 83, pp. 892-906, June 1995.
65. R. Forchheimer and T. Kronander,"Image coding-From waveforms to animation," IEEE Trans. Acoiist., Speech, Signal Processing, vol. 37, pp. 2008-2023, Dec. 1989.
66. H. Morikawa and H. Harashima,"Structure and motion of deformable objects from image sequences," in Proc. ICASSP'91, Toronto, Ontario, Canada, May 14-17, 1991, pp. 2433-2436.
67. F. Kappei and C. E. Liedtke,"Modeling of a natural 3-D scene consisting of moving objects from a sequence of monocular TV images," in Real Time Image Processing: Concepts and Technologies, vol. 860, Proc. SPIE, 1987, pp. 126-132.
68. A. K. Jain,"Imase data compression: A review," Proc. IEEE, vol. 69, pp. 349-389, Mar. 1981.
69. B. G. Haskell,"Frame replenishment coding of television," in Image Transmission Techniques. New York: Academic, 1979, pp. 189-217.
70. D. N. Hein and N. Ahmed,"Video compression using conditional replenishment and motion prediction," IEEE Trans. Electromag. Compat., vol. EMC-26, pp. 134-142, Aug. 1984.
71. T. Ishiguro and K. linuma, 'Television bandwidth compression transmission by motion-compensated intcrframe coding," IEEECommun. Mag., vol. 20, pp. 24-30, Nov. 1982.
72. R. J. Moorhcad II, S. A. Rajala, and L. W. Cook,"Image sequence compression using a pel-recursive motion-compensated technique," IEEE J. Select. Areas Commun., vol. 5, pp. 1100-1114, Aug. 1987.
73. Y. Nakaya and H. Harashima,"An iterative motion estimation method using triangular patches for motion compensation," in Proc. SPIE Visual Communications Image Processing'91, vol. 1605, pp. 546-557.
74. Y. T. Tse and R. L. Baker,"Global zoom/pan estimation and compensation for video compression," in Proc. ICASSP'91, Toronto, Ontario, Canada, May 14-17, 1991, pp. 2725-2728.
75. S. C. Brofferio,"An object-background image model for predictive video coding," IEEE Trans. Commun., vol. 37, pp. 1391-1394, Dec. 1989.
76. H. G. Musmann, M. Hotter, and J. Ostermann,"Object-oriented analysis-synthesis coding of moving images," Signal Processing: Image Communication, vol. 1, no. 2, pp. 117-138, Oct. 1989.
77. K. Aizawa, H. Harashima, and T. Saito,"Model-based analysis synthesis image coding (MBASIC) system for a person's face," in Signal Processing: Image Communication, vol. 1, no. 2, pp. 139-152, Oct. 1989.
78. J. K. Vega-Riveros and K. Jabbour,"Review of motion analysis techniques," Proc. Inst. Elect. Eng., Pt. I, vol. 136, no. 6, pp. 397-404, Dec. 1989.
79. A. Mitiche and J. K. Aggarwal,"A computational analysis of time-varying images," in Handbook of Pattern Recognition ana" Image Processing, N. G. Einspruch, Ed. New York: Academic, ch. 13, pp. 311-332.
80. D. Ellis and D. Rosenthal,"Mid-level representations for computational auditory scene analysis," presented at the Int. Joint Conf. Artificial Intel!.-Workshop Computational Auditory Scene Anal., Montreal, Quebec, Canada, Aug. 1995.
81. R. Cox et ai,"New directions in subband coding," IEEE J. Select. Areas Commun., vol. 6, pp. 391-409, Feb. 1988.
82. J. D. Johnston,"Transform coding of audio signals using perceptual noise criteria," IEEE J. Select. Areas Commun., vol. 6, Feb. 1988.
83. D. P. W. Ellis and B. L. Vercoc,"A perceptual representation of sound for auditory signal separation," in Proc. 23rd Meeting Acoustical Society America, Salt Lake City, Utah, May 1992.
84. T. F. Quatieri and R. J. McAulay,"Speech transformations based on a sinusoidal representation," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-34, pp. 1449-1463, Dec. 1986.
85. D. L. Thomson,"Parametric models of the magnitude/phase spectrum for harmonic speech coding," in Proc. IEEE ICASSP. 1988.
86. R. A. Brooks,"A robust layered control system for a mobile robot," IEEE Trans. Robot. Automat., vol. RA-2, Mar. 1986.
87. R. G. Crowder and R. K. Wagner, The Psychology of Reading-An Introduction, 2nd ed. London: Oxford Univ. Press, 1992.
88. A. Baddeley,"Working memory," in The Cognitive Nenro-sciences, M. S. Gazzaniga, Ed. Cambridge, MA: MIT, 1995, ch. 47, pp. 755-764.
89. G. A. Miller,"The magic number seven plus or minus two: Some limits on our capacity for information processing," Psychological Rev., vol. 63, no. 2, pp. 81-96, 1956.
90. D. E. Broadbent, Decision and Stress. New York: Academic, 1971.
91. M. W. Eysenck and M. T. Kcane, Cognitive Psychology-A Students Handbook. Hove, U.K.: Lawrence Erlbaum, 1990.
92. H. G. Geissler, Ed., Modem Issues in Perception. New York: North-Holland, 1983.
93. S. M. Kosslyn, Image and Mind. Cambridge, MA: Harvard Univ. Press, 1980.
94. W. J. Rapaport,"Understanding understanding: Syntactic semantics and computational cognition," in Philosophical Perspectives, vol. 9, AI, Connectionism and Philosophical Psycholog, }. E. Tomberlin, Ed. Atascadero, CA: Ridgeview, 1995, pp'. 49-88.
95. B. C. Smith,"The correspondence continuum," Center for the Study of Language and Information, Stanford, CA, Rep. CSLI87-71, 1987.
96. S. Stenström, Optics and the Ee. London: Butterworth, 1964.
97. L. Levi, Applied Optics. New York: Wiley, 1980.
98. L. A. Olzak and J. P. Thomas,"Seeing spatial patterns," in Handbook of Perception and Human Performance, vol. l, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds. New York: Wiley, 1986, ch. 7.
99. A. B. Watson,"Temporal sensitivity," in Handbook of Perception and Performance, Handbook of Perception and Human Performance, vol. 1, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds. New York: Wiley, 1986, ch. 6.
100. G. Wyszecki and W. S. Stiles, Color Science. New York: Wiley, 1967.
101. J. Larimer and T. Piantanida,"The impact of boundaries on color: Stabilized image studies," in SPIE, vol. 901, Image Processing, Analysis, Measurement, and Qualify, Jan. 1988, pp. 241-247.
102. V. Bruce and P. R. Green, Visual Perception: Physiology, Psychologv & Ecology, 2nd ed. Hove, U.K.: Lawrence Erlbaum, 1990. '
103. D. H. Hubel and T. N. Wiesel,"Brain mechanisms of vision," Sci. Amer., vol. 241, no. 3, pp. 130-145, Sept. 1979.
104. R. Von Der Heydt,"Form analysis in visual cortex," in The Cognitive Neurosciences. Cambridge, MA: MIT, 1995, ch. 23.
105. B. Scharf and S. Buus,"Audition I," in Handbook of Perception and Human Performance, vol. 1, K. R. Boff, L. Kaufman, and J. P. Thomas, Eds. New York: Wiley, 1986, ch. 14.
106. B. C. J. Moore, An Introduction to the Psychology of Hearing. New York: Academic, 1989.
107. N. Suga,"Processing of auditory information carried by speciesspecific complex sounds," in The Cognitive Neurosciences. Cambridge, MA: MIT, 1995, ch. 18.
108. M. Konishi,"Neural mechanisms of auditory image formation," in The Cognitive Neurosciences, M. S. Gazzaniga, Ed. Cambridge, MA: MIT, 1995, ch. 16.
109. S. Handel, Listening. Cambridge, MA: MIT, 1989.
110. C. Morris, Foundations of the Theory of Signs. Chicago, IL: Univ. Chicago Press, 1938.
111. _,Signification and Significance. Cambridge, MA: MIT, 1964.
112. W. Nöth, Handbook of Semiotics. Bloomington: Indiana Univ. Press, 1990.
113. H. E. Fiske, Music and Mind. Lewiston, NY: Edwin Meilen, 1990.
114. D. Cooke, The Language of Music. London: Oxford Univ. Press, 1959.
115. R. Monelle, Linguistics and Semiotics in Music. New York: Harwood, 1992.
116. M. Bense, Zeichen und Design: Semiotische Ästhetic. BadenBaden: Agis, 1971.
117. C. L. Carter,"Syntax in language and painting," Structurist, vol. 12, pp. 45-50, 1972.
118. D. Marr, 1sion. New York: Freeman, 1982.
119. S. Worth,"The development of a semiotic of film," Semiotica, vol. I, pp. 282-321.
120. G. Davenport, T. A. Smith, and N. Pincevcr,"Cinematic primitives for multimedia," IEEE Comput. Graph. Appl., pp. 67-74, July 1991.
121. U. Eco, Einführung in die Semiotik. München: Fink, 1968.
122. I. E. Gordon, Theories of Visual Perception. New York: Wiley, 1989.
123. G. Kanizsa,"Subjective contours," Sci. Amer., vol. 234, no. 4, Apr. 1976.
124. K. Koffka, Principles of Gestalt Psychology. New York: Harcourt Brace Jovanovich, 1935.
125. R. Gonzalez,"Software decodeable video for multimedia based on a computer graphics model," Ph.D. dissertation. University of Technology, Sydney, Australia, 1994.
126. R. Gonzalez and A. Ginige,"A video coding scheme for interactive multimedia based on a computer graphics model," in Proc. 1st Int. Conf. Multimedia Modeling, Singapore, Nov. 9-12, 1993, pp. 177-191.