Seeing circles and drawing ellipses: When sound biases reproduction of visual motion

PLoS ONE

Volumn 11, Issue 4, 2016, Pages

  Thoret, Etienne ^a   Aramaki, Mitsuko ^a   Bringoux, Lionel ^b   Ystad, Sølvi ^a   Kronland Martinet, Richard ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

^b AIX MARSEILLE UNIVERSITÉ   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; DRAWING; FEMALE; FRICTION; HUMAN; HUMAN EXPERIMENT; KINEMATICS; MALE; MOTION; REPRODUCTION; SOUND; VELOCITY; BIOMECHANICS; HAND; HEARING; MOVEMENT PERCEPTION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; PSYCHOMOTOR PERFORMANCE; VISION; VISUAL SYSTEM FUNCTION; YOUNG ADULT;

ADULT; AUDITORY PERCEPTION; BIOMECHANICAL PHENOMENA; FEMALE; HAND; HUMANS; MALE; MOTION PERCEPTION; OCULAR PHYSIOLOGICAL PHENOMENA; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; VISUAL PERCEPTION; YOUNG ADULT;

EID: 85016105973     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0154475     Document Type: Article

References (39)

1. Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychologica 54: 115–130. doi: 10.1016/0001-6918(83)90027-6 PMID: 6666647
2. Viviani P, Campadelli P, Mounoud P (1987) Visuo-manual pursuit tracking of human two-dimensional movements. Journal of Experimental Psychology: Human Perception and Performance 13: 62–78. doi: 10.1037//0096-1523.13.1.62
3. Viviani P, Stucchi N (1989) The effect of movement velocity on form perception: Geometric illusions in dynamic displays. Perception & Psychophysics 46: 266–274. doi: 10.3758/bf03208089
4. Thoret E, Aramaki M, Bringoux L, Ystad S, Kronland-Martinet R (2016) When eyes drive hand: Influence of non-biological motion on visuo-motor coupling. Neuroscience Letters 612: 225–230. doi: 10. 1016/j.neulet.2015.12.022 PMID: 26708633
5. Viviani P, Baud-Bovy G, Redolfi M (1997) Perceiving and tracking kinesthetic stimuli: Further evidence of motor-perceptual interactions. Journal of Experimental Psychology: Human Perception and Performance 23: 1232–1252. doi: 10.1037/0096-1523.23.4.1232 PMID: 9269735
6. Kitagawa N, Ichihara S (2002) Hearing visual motion in depth. Nature 416: 172–174. doi: 10.1038/ 416172a PMID: 11894093
7. Sekuler R, Sekuler A, Lau R (1997) Sound alters visual motion perception. Nature 385: 308–308. doi: 10.1038/385308a0 PMID: 9002513
8. Soto-Faraco S, Kingstone A, Spence C (2003) Multisensory contributions to the perception of motion. Neuropsychologia 41: 1847–1862. doi: 10.1016/s0028-3932(03)00185-4 PMID: 14527547
9. Repp B, Penel A (2003) Rhythmic movement is attracted more strongly to auditory than to visual rhythms. Psychological Research 68. doi: 10.1007/s00426-003-0143-8
10. Repp B, Su Y (2013) Sensorimotor synchronization: A review of recent research (2006–2012). Psychonomic Bulletin & Review 20: 403–452. doi: 10.3758/s13423-012-0371-2
11. Brooks A, van der Zwan R, Billard A, Petreska B, Clarke S, Blanke O (2007) Auditory motion affects visual biological motion processing. Neuropsychologia 45: 523–530. doi: 10.1016/j.neuropsychologia. 2005.12.012 PMID: 16504220
12. Arrighi R, Marini F, Burr D (2009) Meaningful auditory information enhances perception of visual biological motion. Journal of Vision 9: 25–25. doi: 10.1167/9.4.25
13. Thoret E, Aramaki M, Kronland-Martinet R, Velay JL, Ystad S (2014) From sound to shape: Auditory perception of drawing movements. Journal of Experimental Psychology: Human Perception and Performance 40: 983–994. doi: 10.1037/a0035441 PMID: 24446717
14. Hollerbach J (1981) An oscillation theory of handwriting. Biol Cybern 39: 139–156. doi: 10.1007/ bf00336740
15. Dounskaia N, Van Gemmert A, Stelmach G (2000) Interjoint coordination during handwriting-like movements. Experimental Brain Research 135: 127–140. doi: 10.1007/s002210000495 PMID: 11104134
16. Gaver WW (1993) How Do We Hear in the World? Explorations in Ecological Acoustics. Ecological Psychology 5: 285–313. doi: 10.1207/s15326969eco0504_2
17. van den Doel K, Kry P, Pai D (2001) FoleyAutomatic: Physically-Based Sound Effects for Interactive Simulation and Animation. Proceedings of the 28th annual conference on Computer graphics and interactive techniques—SIGGRAPH '01. doi: 10.1145/383259.383322
18. Conan S, Thoret E, Aramaki M, Derrien O, Gondre C, Ystad S, et al. (2014) An Intuitive Synthesizer of Continuous-Interaction Sounds: Rubbing, Scratching, and Rolling. Computer Music Journal 38: 24–37. doi: 10.1162/comj_a_00266
19. Aramaki M, Besson M, Kronland-Martinet R, Ystad S (2011) Controlling the Perceived Material in an Impact Sound Synthesizer. IEEE Transactions on Audio, Speech, and Language Processing 19: 301–314. doi: 10.1109/tasl.2010.2047755
20. Chowning J (1977) The Simulation of Moving Sound Sources. Computer Music Journal 1: 48–52. doi: 10.2307/3679609
21. Kronland-Martinet R, Voinier T (2008) Real-Time Perceptual Simulation of Moving Sources: Application to the Leslie Cabinet and 3D Sound Immersion. EURASIP Journal on Audio, Speech, and Music Processing 2008: 849696. doi: 10.1186/1687-4722-2008-849696
22. Merer A, Aramaki M, Ystad S, Kronland-Martinet R (2013) Perceptual characterization of motion evoked by sounds for synthesis control purposes. ACM Transactions on Applied Perception 10: 1–24. doi: 10.1145/2422105.2422106
23. Savitzky A, Golay M (1964) Smoothing and Differentiation of Data by Simplified Least Squares Procedures. Analytical Chemistry 36: 1627–1639. doi: 10.1021/ac60214a047
24. Athènes S, Sallagoïty I, Zanone P, Albaret J (2004) Evaluating the coordination dynamics of handwriting. Human Movement Science 23: 621–641. doi: 10.1016/j.humov.2004.10.004 PMID: 15589625
25. Danna J, Athènes S, Zanone P (2011) Coordination dynamics of elliptic shape drawing: Effects of orientation and eccentricity. Human Movement Science 30: 698–710. doi: 10.1016/j.humov.2010.08.019 PMID: 21524807
26. Varlet M, Marin L, Issartel J, Schmidt R, Bardy B (2012) Continuity of Visual and Auditory Rhythms Influences Sensorimotor Coordination. PLoS One 7: e44082. doi: 10.1371/journal.pone.0044082 PMID: 23028488
27. McGarry L, Russo F, Schalles M, Pineda J (2012) Audio-visual facilitation of the mu rhythm. Exp Brain Res 218: 527–538. doi: 10.1007/s00221-012-3046-3 PMID: 22427133
28. Angelaki D, Gu Y, DeAngelis G (2009) Multisensory integration: psychophysics, neurophysiology, and computation. Current Opinion in Neurobiology 19: 452–458. doi: 10.1016/j.conb.2009.06.008 PMID: 19616425
29. Campos J, Byrne P, Sun H (2010) The brain weights body-based cues higher than vision when estimating walked distances. European Journal of Neuroscience 31: 1889–1898. doi: 10.1111/j.1460-9568. 2010.07212.x PMID: 20584194
30. Campos J, Butler J, Bülthoff H (2012) Multisensory integration in the estimation of walked distances. Exp Brain Res 218: 551–565. doi: 10.1007/s00221-012-3048-1 PMID: 22411581
31. Campos J, Butler J, Bülthoff H (2014) Contributions of visual and proprioceptive information to travelled distance estimation during changing sensory congruencies. Exp Brain Res 232: 3277–3289. doi: 10. 1007/s00221-014-4011-0 PMID: 24961739
32. Hommel B, Müsseler J, Aschersleben G, Prinz W (2001) The Theory of Event Coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences 24: 849–878. doi: 10.1017/ s0140525x01000103 PMID: 12239891
33. Danna J, Paz-Villagrán V, Gondre C, Aramaki M, Kronland-Martinet R, Ystad S, et al. (2015) “Let Me Hear Your Handwriting!‚” Evaluating the Movement Fluency from Its Sonification. PLoS One 10: e0128388. doi: 10.1371/journal.pone.0128388 PMID: 26083384
34. Young W, Rodger M, Craig C (2013) Perceiving and reenacting spatiotemporal characteristics of walking sounds. Journal of Experimental Psychology: Human Perception and Performance 39: 464–476. doi: 10.1037/a0029402 PMID: 22866760
35. Danna J, Fontaine M, Paz-Villagrán V, Gondre C, Thoret E, Aramaki M, et al. (2015) The effect of real-time auditory feedback on learning new characters. Human Movement Science 43: 216–228. doi: 10. 1016/j.humov.2014.12.002 PMID: 25533208
36. Rodger M, Young W, Craig C (2014) Synthesis of Walking Sounds for Alleviating Gait Disturbances in Parkinson's Disease. IEEE Trans Neural Syst Rehabil Eng 22: 543–548. doi: 10.1109/tnsre.2013. 2285410 PMID: 24235275
37. Young W, Rodger M, Craig C (2014) Auditory observation of stepping actions can cue both spatial and temporal components of gait in Parkinson’s disease patients. Neuropsychologia 57: 140–153. doi: 10. 1016/j.neuropsychologia.2014.03.009 PMID: 24680722
38. Craig C, Delay D, Grealy M, Lee D (2000). Guiding the swing in golf putting. Nature 405: 295–296. doi: 10.1038/35012690 PMID: 10830947
39. La Scaleia B, Zago M, Moscatelli A, Lacquaniti F, Viviani P (2014). Implied dynamics biases the visual perception of velocity. PloS One, 9(3), e93020. doi: 10.1371/journal.pone.0093020 PMID: 24667578