"Let me hear your handwriting!" Evaluating the movement fluency from its sonification

PLoS ONE

Volumn 10, Issue 6, 2015, Pages

  Danna, Jérémy ^a   Paz Villagrán, Vietminh ^a   Gondre, Charles ^a   Aramaki, Mitsuko ^a   Kronland Martinet, Richard ^a   Ystad, Sølvi ^a   Velay, Jean Luc ^a  

^a AIX MARSEILLE UNIVERSITY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; AUDITORY FEEDBACK; CHILD; CLINICAL ARTICLE; CONTROLLED STUDY; DECISION MAKING; DYSGRAPHIA; FEMALE; HANDWRITING; HEARING; HUMAN; MALE; MOVEMENT (PHYSIOLOGY); MOVEMENT DYSFLUENCY; PEN PRESSURE; PEN VELOCITY; PRESSURE; SCHOOL CHILD; TASK PERFORMANCE; ULTRASOUND; VELOCITY; VISION; VISUAL STIMULATION; ANALYSIS OF VARIANCE; BIOMECHANICS; CLUSTER ANALYSIS; PHYSIOLOGY; STATISTICAL MODEL;

ADULT; ANALYSIS OF VARIANCE; AUDITORY PERCEPTION; BIOMECHANICAL PHENOMENA; CHILD; CLUSTER ANALYSIS; FEMALE; HANDWRITING; HUMANS; LINEAR MODELS; MALE; VISUAL PERCEPTION;

EID: 84939235114     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0128388     Document Type: Article

References (50)

1. Hommel B (2004) Event files: feature binding in and across perception and action. Trends Cogn Sci, 8 (11): 494-500. PMID: 15491903
2. Hommel B, Müsseler J, Aschersleben G, Prinz W (2001) The theory of event coding (TEC): A framework for perception and action planning. Behav Brain Sci, 24(5): 849-878. PMID: 12239891
3. Prinz W (1997) Perception and action planning. Eur J Cogn Psychol, 9(2): 129-154.
4. Bangert M, Häusler U, Altenmüller E (2001) On practice: how the brain connects piano keys and piano sounds. Ann N Y Acad Sci, 930: 425-428. PMID: 11458857
5. Bengtsson SL, Ullén F, Ehrsson HH, Hashimoto T, Kito T, Naito E, et al. (2009) Listening to rhythms activates motor and premotor cortices. Cortex, 45: 62-71. doi: 10.1016/j.cortex.2008.07.002 PMID: 19041965
6. Zatorre RJ, Chen JL, Penhune VB (2007) When the brain plays music: auditory-motor interactions in music perception and production. Nat Rev Neurosci, 8(7): 547-558. PMID: 17585307
7. Haueisen J, Knöshe TR (2001) Involuntary motor activity in pianists evoked by music perception. J Cogn Neurosci, 13: 786-792. PMID: 11564322
8. Schmitz G, Mohammadi B, Hammer A, Heldmann M, Samii A, Münte TF, et al. (2013) Observation of sonified movements engages a basal ganglia frontocortical network. BMC Neurosci, 14: 32. doi: 10. 1186/1471-2202-14-32 PMID: 23496827
9. Graziano MSA, Reiss LAJ, Gross CG (1999) A neuronal representation of the location of nearby sounds. Nature, 397: 428-430. PMID: 9989407
10. Kohler E, Keysers C, Umiltà MA, Fogassi L, Gallese V, Rizzolatti G (2002) Hearing sounds, understanding actions: Action representation in mirror neurons. Science, 297(5582): 846-848. PMID: 12161656
11. Gazzola V, Aziz-Zadeh L, Keysers C (2006) Empathy and the somatotopic auditory mirror system in humans. Curr Biol, 16: 1824-1829. PMID: 16979560
12. Effenberg AO (2005) Movement sonification: Effects on perception and action. IEEE Multimedia, 12 (2): 53-59.
13. Baudry L, Leroy D, Thouvarecq R, Choller D (2006) Auditory concurrent feedback benefits on the circle performed in gymnastics. J Sports Sci, 24: 149-56. PMID: 16368624
14. Chollet D, Micallef JP, Rabischong P (1988) Biomechanical signals for external biofeedback to improve swimming techniques. In: Ungerechts BE, Reischle K, Wilke K, editors. Swimming Science V. Champaign, IL: Human Kinetics Books. pp. 389-396.
15. Konttinen N, Mononen K, Viitasalo J, Mets T (2004) The effects of augmented auditory feedback on psychomotor skill learning in precision shooting. J Sport Exerc Psychol, 26(2): 306-316.
16. Sigrist R, Schellenberg J, Rauter G, Broggi S, Riener R, Wolf P (2011) Visual and auditory augmented concurrent feedback in a complex motor task. Presence (Camb), 20(1): 15-32.
17. Sigrist R, Rauter G, Riener R, Wolf P (2013) Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review. Psychon Bull Rev, 20(1): 21-53. doi: 10.3758/s13423-012-0333-8 PMID: 23132605
18. Vogt K, Pirrò D, Kobenz I, Höldrich R, Eckel G (2010) PhysioSonic-Evaluated movement sonification as auditory feedback in physiotherapy. In: Ystad S, Aramaki M, Kronland-Martinet R, Jensen K, editors. Auditory Display CMMR/ICAD 2009, LNCS 5954. Berlin, Germany: Springer-Verlag Berlin Heidelberg. pp. 103-120.
19. Young W, Rodger M, Craig CM (2013) Perceiving and reenacting spatiotemporal characteristics of walking sounds. J Exp Psychol Hum Percept Perform, 39(2): 464-476. doi: 10.1037/a0029402 PMID: 22866760
20. Dubus G, Bresin R (2013) A systematic review of mapping strategies for the sonification of physical quantities. PLoS One 9(4): e96018. doi: 10.1371/journal.pone.0096018
21. Smits-Engelsman BCM, van Galen GP (1997) Dysgraphia in children: Lasting psychomotor deficiency or transient developmental delay? J Exp Child Psychol, 67: 164-184. PMID: 9388804
22. Danna J, Paz-Villagrán V, Capel A, Pétroz C, Gondre C, Pinto S, et al. (2014). Movement sonification for the diagnosis and the rehabilitation of graphomotor disorders. In: Aramaki M, Derrien O, Kronland- Martinet R, Ystad S, editors. Sound, Music, & Motion [LNCS 8905]. Springer Berlin Heidelberg.
23. Reavley W (1975) The use of biofeedback in the treatment of writer's cramp. J Behav Ther Exp Psychiatry, 6: 335-338.
24. Bindman E, Tibbetts RW (1977) Writer's cramp-a rational approach to treatment? Brit J Psychiatry, 131: 143-148. PMID: 912215
25. Ince LP, Leon MS, Christidis D (1986) EMG biofeedback for handwriting disabilities: A critical examination of the litterature. J Behav Ther Exp Psychiatry, 17(2): 95-100. PMID: 3722399
26. Baur B, Fürholzer W, Marquart C, Hermsdörfer J (2009) Auditory grip force feedback in the treatment of Writer's Cramp. J Hand Ther, 22(2): 163-170. doi: 10.1016/j.jht.2008.11.001 PMID: 19188043
27. Plimmer B, Reid P, Blagojevic R, Crossan A, Brewster S (2011) Signing on the tactile line: A multimodal system for teaching handwriting to blind children. ACM Trans Comput Hum Interact, 18(3): 1-29.
28. Danna J, Paz-Villagrán V, Velay JL (2013) Signal-to-Noise velocity peaks difference: A new method for evaluating the handwriting movement fluency in children with dysgraphia. Res Dev Disabil, 34(12): 4375-4384. doi: 10.1016/j.ridd.2013.09.012 PMID: 24139714
29. Rosenblum S, Paruch S, Weiss PL (2003) Computerized temporal handwriting characteristics of proficient and non-proficient hand-writers. Am J Occup Ther, 57(2): 129-138. PMID: 12674304
30. Paz-Villagrán V, Danna J, Velay JL (2014) Lifts and stops in proficient and dysgraphic handwriting. Hum Mov Sci, 33: 381-394. doi: 10.1016/j.humov.2013.11.005 PMID: 24321409
31. van Galen GP, Portier SJ, Smits-Engelsman BCM, Shomaker LRB (1993) Neuromotor noise and poor handwriting in children. Acta Psychol, 82: 161-178. PMID: 8475764
32. Rosenblum S, Samuel M, Zlotnik S, Erikh I, Schlesinger I (2013) Handwriting as an objective tool for Parkinson's disease diagnosis. J Neurol, 260(9): 2357-2361. doi: 10.1007/s00415-013-6996-x PMID: 23771509
33. Hermann T, Hunt A, Neuhoff JG (2011) The sonification handbook. Berlin, Logos Publishing House. 586p.
34. Castiello U, Giordano BL, Begliomini C, Ansuini C, Grassi M (2010) When ears drive hands: The influence of contact sound on reaching to grasp. PLoS One 5(8): e12240. doi: 10.1371/journal.pone.0012240 PMID: 20808929
35. Thoret E, Aramaki M, Kronland-Martinet R, Velay JL, Ystad S (2014) From Sound to Shape: Auditory Perception of Drawing Movements. J Exp Psychol Hum Percept Perform, 40: 983-994. doi: 10.1037/a0035441 PMID: 24446717
36. Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figural aspects of drawing movements. Acta Psychol, 54: 115-130. PMID: 6666647
37. Viviani P, Terzuolo C (1982) Trajectory determines movement dynamics. Neuroscience, 7(2): 431-437. PMID: 7078732
38. Hamstra-Bletz L, de Bie J, den Brinker B (1987). Concise evaluation scale for children's handwriting. Lisse: Swets 1 Zeitlinger. doi: 10.2466/10.15.PMS.120v15x5 PMID: 25650511
39. Charles M, Soppelsa R, Albaret JM (2003) BHK-Echelle d'évaluation rapide de l'écriture chez l'enfant. Paris: Editions et Applications Psychologiques.
40. Aramaki M, Besson M, Kronland-Martinet R, Ystad S (2011) Controlling the perceived material in an impact sound synthesizer. IEEE T Audio Speech, 19: 301-314.
41. Viviani P, Schneider R (1991) A developmental study of the relationship between geometry and kinematics in drawing movements. J Exp Psychol Hum Percept Perform, 17: 198-218. PMID: 1826312
42. Chartrel E, Vinter A (2008) The impact of spatio-temporal constraints on cursive letter handwriting in children. Learn Instr, 18: 537-547.
43. Meulenbroek RGJ, van Galen GP (1986) Movement analysis of repetitive writing behaviour of first, second and third grade primary school children. In: Kao HSR, van Galen GP, Hoosain R, editors. Graphonomics: Contemporary research in handwriting. Amsterdam: Elsevier. pp. 71-91.
44. Meulenbroek RGJ, van Galen GP (1988) The acquisition of skilled handwriting discontinuous trends in kinematic variables. In: Colley AM, Beech JR, editors. Cognition and action in skilled behavior. Amsterdam: Elsevier. pp. 273-281.
45. Rosenblum S, Weiss PL, Parush S (2003) Product and process evaluation of handwriting difficulties. Educ Psychol Rev, 15: 41-81.
46. Bluteau J, Coquillard S, Payan Y, Gentaz E (2008). Haptic guidance improves the visuo-manual tracking of trajectories. PloS One 3(3): e1775. doi: 10.1371/journal.pone.0001775 PMID: 18335049
47. Portier SJ, van Galen GP (1992) Immediate vs. postponed visual feedback in practicing a handwriting task. Hum Mov Sci, 11(5): 563-592.
48. Danna J, Paz-Villagrán V, Thoret E, Gondre C, Kronland-Martinet R., Capel C, et al. (2013) Sonifying handwriting movements as real-time auditory feedback for the rehabilitation of dysgraphia. In: Proceedings of the IXth International Conference on Progress in Motor Control. p. 118.
49. Danna J, Velay JL, Paz-Villagrán V, Capel A, Petroz C, Gondre C, et al. (2013). Handwriting movement sonification for the rehabilitation of dysgraphia. In: Derrien O, editor. Sound, Music & Motion: Proceedings of the 10th International Symposium on CMMR, France. pp. 200-208.
50. Danna J, Fontaine M, Paz-Villagrán V, Gondre C, Thoret E, Aramaki M, et al. (2014). The effect of realtime auditory feedback on learning new characters. Hum Mov Sci. Available: doi: 10.1016/j.humov.2014.12.002