Criteria for the subjective assessment of bimodal perception in interactive AV application systems

Proceedings of the International Symposium on Consumer Electronics, ISCE

Volumn , Issue , 2005, Pages 186-191

  Reiter, Ulrich ^a,b   Köhler, Tom ^c  

^a ILMENAU UNIVERSITY OF TECHNOLOGY   (Germany)

^b Institute of Media Technology   (Germany)

^c NONE

Author keywords

Bimodal perception; Interactive audio visual applications; MPEG 4; Subjective assessment

Indexed keywords

BIOMODAL PERCEPTION; INTERACTIVE AUDIO VISUAL APPLICATIONS; MPEG-4; SUBJECTIVE ASSESSMENT;

CONSUMER ELECTRONICS; IMAGE COMPRESSION;

SENSORY PERCEPTION;

EID: 28444442269     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (30)

1. Woszczyk, Wieslaw; Bech, Soren; Hansen, Villy: "Interactions Between Audio-Visual Factors in a Home Theater System: Definition of Subjective Attributes", AES Audio Engineering Society 99th Convention, Preprint 4133, New York, USA, 1995.
2. Bernstein, Lynne E.; Benoît, Christian: "For Speech Perception by Humans or Machines, Three Senses are Better than One", in Proc. Fourth International Conference on Spoken Language Processing ICSLP, Philadelphia, USA, October 3-6, 1996.
3. Massaro, Dominic W.: "Illusions and Issues in Bimodal Speech Perception", in Proceedings of Auditory Visual Speech Perception '98, Terrigal-Sydney, Australia, December 1998, pp 21-26.
4. Rimell, Andrew N.; Hollier, M.; Voelcker, R.: "The Influence of Cross-Modal Interaction on Audio-Visual Speech Quality Perception", AES Audio Engineering Society 105th Convention, Preprint 4791, 1998.
5. Hollier, Mike P.; Rimell, Andrew N.; Hands, David S.; Voelcker, Rupert M.: "Multi-modal Perception", in BT Technology Journal, Vol 17, No 1, January 1999, pp 35-46.
6. Begault, Durand R.: "Auditory and Non-Auditory Factors that Potentially Influence Virtual Acoustic Imagery", AES 16th International Conference on Spatial Sound Reproduction, March 1999.
7. Battaglia, Peter W.; Jacobs, Robert A.; Aslin, Richard N.: "Bayesian Integration of Visual and Auditory Signals for Spatial Localization", in Journal Opt. Soc. Am., Vol. 20, No. 7, July 2003, pp 1391-1397.
8. Alais, David; Burr, David: 'The Ventriloquist Effect Results from Near-Optimal Bimodal Integration", in Current Biology, Vol. 14, February 3, 2004, pp 257-262.
9. Shams, Ladan; Kamitani, Yukiyasu; Shimojo, Shinsuke: "What You See is What You Hear", in Nature, Vol. 408, 14 December 2000, p 788.
10. Shams, Ladan; Kamitani, Yukiyasu; Shimojo, Shinsuke: "Visual Illusion Induced by Sound", in Cognitive Brain Research, Vol. 14, 2002, pp 147-152.
11. Wuerger, S. M.; Hofbauer, M.; Meyer, G.F.: "The Integration of Auditory and Visual Motion Signals at Threshold", in Perception & Psychophysics, 65 (8), 2003, pp 1188-1196.
12. Larsson, Pontus; Västfjäll, Daniel; Kleiner, Mendel: "On the Quality of Experience: A Multi-Modal Approach to Perceptual Ego-Motion and Sensed Presence in Virtual Environments", in Proceedings First ISCA ITRW on Auditory Quality of Systems AQS-2003, Akademie Mont-Cenis, Germany, April 23-25, 2003, pp 97-100.
13. Kapralos, Bill; Zikovitz, Daniel; Jenkin, Michael R.; Harris, Laurence R.: "Auditory Cues in the Perception of Self Motion", AES Audio Engineering Society 116th Convention, Berlin, Germany, May 2004, Preprint 6078.
14. Kühhirt, Uwe; Drumm, Helge; Reiter, Ulrich; and Rittermann, Marco: "Application Systems for MPEG-4", in Proceedings of the 2002 IEEE 6th International Symposium on Consumer Electronics (ISCE 2002), Erfurt, Germany, September 2002.
15. Reiter, Ulrich: "On the need for a salience model for bimodal perception in interactive applications", in Proceedings of the 2003 IEEE 7th International Symposium on Consumer Electronics (ISCE 2003), Sydney, Australia, December 2003.
16. Reiter, Ulrich; Schwark, Mathias: "A plug-in based audio rendering concept for an MPEG-4 Audio subset", in Proceedings of the 2004 IEEE 8th International Symposium on Consumer Electronics (ISCE 2004), Reading, UK, September 2004, ISBN 0-7803-8526-8.
17. Reiter, Ulrich; Körner, Fabian; Kootz, Michael; Rüffer, Stefan: "A Room Acoustic Design Tool for MPEG-4 Conforming Scene Design", in Proceedings of the 2004 IEEE 8th International Symposium on Consumer Electronics (ISCE 2004), Reading, UK, September 2004, ISBN 0-7803-8526-8.
18. Question ITU-R 102/6, Methodologies for subjective assessment of audio and video quality. International Telecommunication Union, Geneva 1999.
19. Recommendation ITU-R BS.1116-1, Methods for the subjective assessment of small impairments in audio systems including multichannel sound systems, International Telecommunication Union, Geneva 1997.
20. Draft Revision of Recommendation ITU-R BS.1284, General methods for the subjective assessment of sound quality, Telecommunication Union, Geneva 2003.
21. Meehan, Michael; Insko, Brent; Whitton, Mary; Brooks, Frederick P., Jr.: "Physiological Measures of Presence in Stressful Virtual Environments", in Proceedings of the 29th annual conference on Computer graphics and interactive techniques, San Antonio, Texas, 2002, pp 645-652.
22. Recommendation ITU-R BS.1285, Pre-selection methods for the subjective assessment of small impairments in audio systems, International Telecommunication Union, Geneva 1997.
23. Recommendation ITU-R BT.500-11, Methodology for the subjective assessment of the quality of television pictures, International Telecommunication Union, Geneva 2002.
24. Recommendation ITU-T P.910, Subjective video quality assessment methods for multimedia applications. International Telecommunication Union, Geneva 1999.
25. Recommendation ITU-R BS.1286, Methods for the subjective assessment of audio systems with accompanying picture, International Telecommunication Union, Geneva 1997.
26. Bech, Soren; Hansen, Villy: "Interaction Between Audio-Visual Factors in a Home Theater System: Experimental Results", AES Audio Engineering Society 99th Convention, Preprint 4096, New York, USA, 1995.
27. Recommendation ITU-R BS.1534-1, Method for the subjective assessment of intermediate quality levels of coding systems, International Telecommunication Union, Geneva 2003.
28. Reiter, Ulrich: "An Input Device for Subjective Assessments of Bimodal Audio Visual Perception", submitted for publication in Proceedings of the 2005 IEEE 9th International Symposium on Consumer Electronics (ISCE 2005), Macau, SAR, June 14-16, 2005.
29. ISO/IEC 14496-1, Coding Of Audio-Visual Objects: Systems, Final Draft International Standard, ISO/IEC JTC1/SC29/WG11 N2501, October 1998.
30. ISO/IEC 14772-1, The Virtual Reality Modeling Language (VRML), 1997.