Movement sonification: Effects on perception and action

IEEE Multimedia

Volumn 12, Issue 2, 2005, Pages 53-59

  Effenberg, Alfred O ^a,b  

^a GERMAN SPORT UNIVERSITY COLOGNE   (Germany)

^b UNIVERSITY OF BONN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC WAVES; AUDITION; SENSORY PERCEPTION; VISION;

HUMAN PERCEPTUAL SYSTEM; INTERACTIVE SONIFICATION;

HUMAN COMPUTER INTERACTION;

EID: 20344384538     PISSN: 1070986X     EISSN: None     Source Type: Journal    
DOI: 10.1109/MMUL.2005.31     Document Type: Article

References (26)

1. A.O. Effenberg, "Multimodal Convergent Information Enhances Perception Accuracy of Human Movement Patterns," Proc. 6th Ann. Congress of the European College of Sports Science (ECSS), Sport und Buch Strauss, 2001, p. 122.
2. A.O. Effenberg and H. Mechling, "Multimodal Convergent Information Enhances Reproduction Accuracy of Sport Movements," Proc. 8th Ann. Congress of the European College of Sport Science (ECSS), ECSS, 2003, pp. 196-197.
3. T. Takeuchi, "Auditory Information in Playing Tennis," Perceptual and Motor Skills, vol. 76, no. 3, part 2, 1993, pp. 1324-1328.
4. G. Kramer, "An Introduction to Auditory Display," Auditory Display, G. Kramer, ed., Addison Wesley, 1994, pp. 1-77.
5. J.J. Gibson, The Senses Considered as Perceptual Systems, Houghton-Mifflin, 1966.
6. A.O. Effenberg and H. Mechling, "Zur Funktion Audiomotorischer Verhaltenskomponenten," Sportwissenschaft [Behavioral Functions of Audio-Motor Gateways], vol. 2, no. 2, 1999, pp. 200-215 (in German).
7. S. Runeson and G. Frykholm, "Kinematic Specification of Dynamics as an Informational Basis for Person-and-Action Perception: Expectation, Gender Recognition and Deceptive Intention," J. Experimental Psychology: General, vol. 112, 1983, pp. 585-615.
8. M.H. Thaut, B. Tian, and M. Azimi-Sadjadi, "Rhythmic Finger-Tapping to Cosine-Wave Modulated Metronome Sequences: Evidence of Subliminal Entrainment," Human Movement Science, vol. 17, 1998, pp. 839-863.
9. S.M. Williams, "Perceptual Principles in Sound Grouping," Proc. Siggraph, ACM Press, 1993, pp. 4.66-4.91.
10. T.A. Stoffregen and B.G. Bardy, "On Specification and the Senses," Behavioral Brain Sciences, vol. 24, no. 2, 2001, pp. 195-261.
11. M. Botvinick and J. Cohen, "Rubber Hands 'Feel' Touch That Eyes See," Nature, vol. 391, no. 6669, 1998, p. 756.
12. J. Vroomen and B. de Gelder, "Sound Enhances Visual Perception: Cross-Modal Effects of Auditory Organization on Vision," J. Experimental Psychology: Human Perception and Performance, vol. 26, no. 5, 2000, pp. 1583-1590.
13. B.E. Stein and M.A. Meredith, The Merging of the Senses, MIT Press, 1993.
14. G.A. Calvert, R. Campbell, and M.J. Brammer, "Evidence from Functional Magnetic Resonance Imaging of Crossmodal Binding in the Human Heteromodal Cortex," Current Biology, vol. 10, no. 11, 2000, pp. 649-657.
15. B.E. Stein, "Neural Mechanisms for Synthesizing Sensory Information and Producing Adaptive Behaviors," Experimental Brain Research, vol. 123, nos. 1-2, 1998, pp. 124-135.
16. D.A. Slutsky and G.H. Recanzone, "Temporal and Spatial Dependency of the Ventriloquism Effect," Neuroreport, vol. 12, no. 1, 2001, pp. 7-10.
17. G.A. Calvert, M.J. Brammer, and S.D. Iversen, "Crossmodal Identification," Trends in Cognitive Sciences, vol. 2, 1998, pp. 247-253.
18. D.W. Massaro, Perceiving Talking Faces: From Speech Perception to a Behavioral Principle, MIT Press, 1998.
19. M. Goodale and A.D. Milner, "Separate Visual Pathways for Perception and Action," Trends in Neurosciences, vol. 15, 1992, pp. 20-25.
20. O. Neumann and W. Klotz, "Motor Responses to Nonreportable, Masked Stimuli: Where is the Limit of Direct Parameter Specification?" Attention and Performance XV: Conscious and Nonconscious Information Processing, C. Umilta and M. Moscovitch, eds., MIT Press, 1994, pp. 123-150.
21. J.H. Kaas and T.A. Hackett, "What' and 'Where' Processing in Auditory Cortex," Nature Neuroscience, vol. 2, no. 12, 1999, pp. 1045-1046.
22. M.C. Morrone et al., "A Cortical Area That Responds Specifically to Optic Flow, Revealed by fMRI," Nature Neuroscience, vol. 3, no. 12, 2000, pp. 1322-1328.
23. E.D. Grossman and R. Blake, "Brain Areas Active During Visual Perception of Biological Motion," Neuron, vol. 35, no. 6, 2002, pp. 1167-1175.
24. A.O. Effenberg, "Unbewusste Wahrnehmungsfunktionen bei der Bewegungsregulation [Unconscious Perceptual Functions on Movement Regulation]," Handbuch Bewegungslehre [Handbook of Movement Science], H. Mechling and J. Munzert, eds., Hofmann, 2003, pp. 197-217 (in German).
25. R.A. Andersen, "Multimodal Integration for the Representation of Space in the Posterior Parietal Cortex," Philosophical Trans. Royal Soc. London: Biological Sciences, vol. 352, no. 1360, 1997, pp. 1421-1428.
26. W.P. Dunlap et al., "Meta-Analysis of Experiments with Matched Groups or Repeated Measures Designs," Psychological Methods, vol. 1, no. 2, 1996, pp. 170-177.