The effect of real-time auditory feedback on learning new characters

Human Movement Science

Volumn 43, Issue , 2015, Pages 216-228

  Danna, Jérémy ^a   Fontaine, Maureen ^a   Paz Villagrán, Vietminh ^a   Gondre, Charles ^a   Thoret, Etienne ^a   Aramaki, Mitsuko ^a   Kronland Martinet, Richard ^a   Ystad, Sølvi ^a   Velay, Jean Luc ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Handwriting; Motor learning; Movement; Sonification

Indexed keywords

ADULT; ARTICLE; AUDITORY FEEDBACK; FEMALE; HANDWRITING; HUMAN; HUMAN EXPERIMENT; KINEMATICS; LEARNING; MALE; MOVEMENT (PHYSIOLOGY); SPATIAL ANALYSIS; TASK PERFORMANCE; ULTRASOUND; VELOCITY; HEMISPHERIC DOMINANCE; MOTOR PERFORMANCE; SENSORY FEEDBACK; YOUNG ADULT;

ADULT; FEEDBACK, SENSORY; FEMALE; FUNCTIONAL LATERALITY; HANDWRITING; HUMANS; MALE; MOTOR SKILLS; TRANSFER (PSYCHOLOGY); YOUNG ADULT;

EID: 84941267633     PISSN: 01679457     EISSN: 18727646     Source Type: Journal    
DOI: 10.1016/j.humov.2014.12.002     Document Type: Article

References (55)

1. Aramaki M., Kronland-Martinet R. Analysis-synthesis of impact sounds by real-time dynamic filtering. IEEE Transactions on Audio Speech, and Language Processing 2006, 14(2):695-705.
2. Aramaki M., Besson M., Kronland-Martinet R., Ystad S. Controlling the perceived material in an impact sound synthesizer. IEEE Transactions on Audio Speech, and Language Processing 2011, 19(2):301-314.
3. Aramaki M., Gondre C., Kronland-Martinet R., Voinier T., Ystad S. Imagine the sounds: An intuitive control of an impact sound synthesizer. Auditory Display, Lecture Notes in Computer Science 2010, 5954:408-421.
4. Bangert M., Altenmüller E. Mapping perception to action in piano practice: A longitudinal DC-EEG study. BMC Neuroscience 2003, 4:26.
5. Bangert M., Häusler U., Altenmüller E. On practice: How the brain connects piano keys and piano sounds. Annals of the New York Academy of Sciences 2001, 930:425-428.
6. Bangert M., Peschel T., Schlaug G., Rotte M., Drescher D., Hinrichs H., et al. Shared networks for auditory and motor processing in professional pianists: Evidence from fMRI conjunction. Neuroimage 2006, 30(3):917-926.
7. Barrass S., Kramer G. Using sonificiation. Multimedia systems 1999, 7:23-31.
8. Baur B., Fürholzer W., Marquart C., Hermsdörfer J. Auditory grip force feedback in the treatment of Writer's Cramp. Journal of Hand Therapy 2009, 22(2):163-170.
9. Bengtsson S.L., Ullén F., Ehrsson H.H., Hashimoto T., Kito T., Naito E., et al. Listening to rhythms activates motor and premotor cortices. Cortex 2009, 45:62-71.
10. Bindman E., Tibbetts R.W. Writer's cramp - A rational approach to treatment?. The British Journal of Psychiatry 1977, 131:143-148.
11. Butler A.J., James T.W., James K.H. Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations. Journal of Cognitive Neuroscience 2011, 23(11):3515-3528.
12. Bluteau J., Coquillard S., Payan Y., Gentaz E. Haptic guidance improves the visuo-manual tracking of trajectories. PLoS One 2008, 3(3):e1775.
13. Castiello U., Giordano B.L., Begliomini C., Ansuini C., Grassi M. When ears drive hands: The influence of contact sound on reaching to grasp. PLoS One 2010, 5(8):e12240. 10.1371/journal.pone.0012240.
14. Chartrel E., Vinter A. The impact of spatio-temporal constraints on cursive letter handwriting in children. Learning and Instruction 2008, 18:537-547.
15. Chin J., Diehl V., Norman K. Development of an instrument measuring user satisfaction of the human-computer interface. Proceedings of ACM CHI '88 1988, ACM Press, New York, USA.
16. Conan S., Thoret E., Aramaki M., Derrien O., Gondre C., Kronland-Martinet R., et al. Navigating in a space of synthesized interactions-sounds: Rubbing, scratching and rolling. Proceedings of the 16th conference on digital audio effects (DAFx) 2013, Maynooth, Ireland.
17. Danna J., Paz-Villagrán V., Gondre C., Aramaki M., Kronland-Martinet R., Ystad S., et al. Handwriting sonification for the diagnosis of dysgraphia. Recent progress in graphonomics: Learn from the past - Proceedings of the 16th conference of the international graphonomics society 2013, 123-126. Tokyo University of Agriculture and Technology Press, Tokyo, Japan. M. Nakagawa, M. Liwicki, B. Zhu (Eds.).
18. Danna J., Paz-Villagrán V., Velay J.-L. Signal-to-Noise velocity peaks difference: A new method for evaluating the handwriting movement fluency in children with dysgraphia. Research in Developmental Disabilities 2013, 34(12):4375-4384.
19. Danna J., Paz-Villagrán V., Capel A., Petroz C., Gondre C., Pinto S., et al. Handwriting movement sonification for the diagnosis and the rehabilitation of graphomotor disorders. Sound, Music & Motion 2014, Springer, Berlin Heidelberg, [LNCS 8905]. M. Aramaki, O. Derrien, R. Kronland-Martinet, S. Ystad (Eds.).
20. Di Brina C., Niels R., Overvelde A., Levi G., Hulstijn W. Dynamic time warping: A new method in the study of poor handwriting. Human Movement Science 2008, 27(2):242-255.
21. Effenberg A.O., Mechling H. Movement-sonification: A new approach in motor control and learning. Journal of Sport & Exercise Psychology 2005, 27:58.
22. Effenberg A.O. Movement sonification: Effects on perception and action. IEEE Multimedia 2005, 12(2):53-59.
23. Engel A., Bangert M., Horbank D., Hijmans B.S., Wilkens K., Keller P.E., et al. Learning piano melodies in visuo-motor or audio-motor training conditions and the neural correlates of their cross-modal transfer. NeuroImage 2012, 63:966-978.
24. Fitch W.T., Kramer G. Sonifying the body electric: Superiority of an auditory over a visual display in a complex, multivariate system. Auditory display: Sonification, audification and auditory interfaces 1994, 307-325. Addison-Wesley, Reading MA. G. Kramer (Ed.).
25. Haueisen J., Knöshe T.R. Involuntary motor activity in pianists evoked by music perception. Journal of Cognitive Neuroscience 2001, 13:786-792.
26. Hepp-Reymond M.C., Charakov V., Schulte-Mönting J., Huethe F., Kristeva R. Role of proprioception and vision in handwriting. Brain Research Bulletin 2009, 79:365-370.
27. Hommel B., Müsseler J., Aschersleben G., Prinz W. The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences 2001, 24(5):849-878.
28. Höner O., Hunt A., Pauletto S., Röber N., Hermann T., Effenberg A.O. Aiding movement with sonification in "Exercice, Play and Sport". The sonification handbook 2011, 525-553. Logos Publishing House, Berlin, Germany. T. Hermann, A. Hunt, J.G. Neuhoff (Eds.).
29. Ince L.P., Leon M.S., Christidis D. EMG biofeedback for handwriting disabilities: A critical examination of the littérature. Journal of Behavioral Therapy and Experimental Psychiatry 1986, 17(2):95-100.
30. Konttinen N., Mononen K., Viitasalo J., Mets T. The effects of augmented auditory feedback on psychomotor skill learning in precision shooting. Journal of Sport & Exercise Psychology 2004, 26:306-316.
31. Le Bel R.M., Pineda J.A., Sharma A. Motor-auditory-visual integration: The role of the human mirror neuron system in communication and communication disorders. Journal of Communication Disorders 2009, 42:299-304.
32. McCabe K., Rangwalla A. Auditory display of computational fluid dynamics Data. Auditory display: Sonification, audification and auditory interfaces 1994, 327-340. Addison-Wesley, Reading MA. G. Kramer (Ed.).
33. Niels R., Vuurpijl L., Schomaker L. Automatic allograph matching in forensic writer identification. International Journal of Pattern Recognition and Artificial Intelligence 2007, 21(1):61-81.
34. Plamondon R., Yergeau P., Brault J.J. A multi-level signature verification system. From pixels to features III: Frontiers in handwriting recognition 1992, 363-370. Elsevier, Amsterdam. S. Impedovo, J.C. Simon (Eds.).
35. Plimmer B., Reid P., Blagojevic R., Crossan A., Brewster S. Signing on the tactile line: A multimodal system for teaching handwriting to blind children. ACM Transactions on Computer Human Interaction 2011, 18(3):1-29.
36. Portier S.J., van Galen G.P. Immediate vs. postponed visual feedback in practicing a handwriting task. Human Movement Science 1992, 11:563-592.
37. Prinz W. Perception and action planning. European Journal of Cognitive Psychology 1997, 9(2):129-154.
38. Reavley W. The use of biofeedback in the treatment of writer's cramp. Journal of Behavioral Therapy and Experimental Psychiatry 1975, 6:335-338.
39. Ronsse R., Puttemans V., Coxon J.P., Goble D.J., Wagemans J., Wenderoth N., et al. Motor learning with augmented feedback: Modality-dependent behavioral and neural consequences. Cerebral Cortex 2011, 21:1283-1294.
40. Schaffert N., Barrass K., Effenberg A.O. Exploring function and aesthetics in sonification for elite sports. Human communication science: A compendium 2009, 465-472. ARC Research Network in Human Communication Science, Sydney. R. Dale, D. Burnham, C.J. Stevens (Eds.).
41. Scheef L., Boecker H., Daamen M., Fehse U., Landsberg M.W., Granath D.O., et al. Multimodal motion processing in area V5/MT: Evidence from an artificial class of audio-visual events. Brain Research 2009, 1252:94-104.
42. Schmidt R.A., Young D.E., Swinnen S., Shapiro D.E. Summary knowledge of results for skill acquisition: Support for the guidance hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition 1989, 15:352-359.
43. Schmitz G., Mohammadi B., Hammer A., Heldmann M., Samii A., Münte T.F., et al. Observation of sonified movements engages a basal ganglia frontocortical network. BMC Neuroscience 2013, 14-32.
44. Sigrist R., Rauter G., Riener R., Wolf P. Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychonomics Bulletin & Review 2013, 20(1):21-53.
45. Smyth M.M., Silvers G. Functions of vision in the control of handwriting. Acta Psychologica 1987, 65:47-64.
46. Sullivan K.I., Kantak S.S., Burtner P.A. Motor learning in children: Feedback effects on skill acquisition. Physical Therapy 2008, 88(6):720-732.
47. Teo, C. L., Burdet, E., & Lim, H. P. (2002). A robotic teacher of chinese handwriting. In Proceedings of 10th haptic interfaces for virtual environment and teleoperator systems (pp. 335-341).
48. Thoret E., Aramaki M., Gondre C., Kronland-Martinet R., Ystad S. Controlling a non linear friction model for evocative sound synthesis applications. Proceedings of the 16th international conference on digital audio effects 2013, 1-7. Maynooth, Ireland.
49. Thoret E., Aramaki M., Kronland-Martinet R., Velay J.L., Ystad S. From sound to shape: Auditory perception of drawing movements. Journal of Experimental Psychology: Human Perception and Performance 2014, 40:983-994.
50. Van Emmerick R.E.A., Newell K.M. The relationship between pen-point and joint kinematics in handwriting and drawing. Computer Recognition and Human Production of Handwriting 1989, 231-248. World Scientific, Singapore. R. Plamondon, C.Y. Suen, M.L. Simner (Eds.).
51. Varni G., Dubus G., Oksanen S., Volpe G., Fabiani M., Bresin R., et al. Interactive sonification of synchronization of motoric behaviour in social active listening to music with mobile devices. Journal on Multimodal User Interfaces 2012, 5:157-173.
52. Vogt, K., Pirrò, D., Kobenz, I., Höldrich, R., & Eckel, G. (2009). PhysioSonic - Evaluated movement sonification as auditory feedback in physiotherapy. In Proceedings of the 6th international conference on auditory display (pp. 103-120).
53. Wulf G. Attentional focus and motor learning: A review of 15 years. International Review of Sport and Exercise Psychology 2013, 6(1):77-104.
54. Wulf G., Schmidt R.A. The learning o f generalized motor programs: Reducing the relative frequency of knowledge of results enhances memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 1989, 15:748-757.
55. Young W., Rodger M., Craig C.M. Perceiving and reenacting spatiotemporal characteristics of walking sounds. Journal of Experimental Psychology: Human Perception and Performance 2013, 39(2):464-476.