Movement sonification for the diagnosis and the rehabilitation of graphomotor disorders

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8905, Issue , 2014, Pages 246-255

  Danna, Jérémy ^a,b   Paz Villagrán, Vietminh ^a   Capel, Annabelle ^b   Pétroz, Céline ^b   Gondre, Charles ^b   Pinto, Serge ^b   Thoret, Etienne ^b   Aramaki, Mitsuko ^b   Ystad, Sølvi ^b   Kronland Martinet, Richard ^b  

^a CNRS   (France)

^b AIX MARSEILLE UNIVERSITY   (France)

Author keywords

Auditory feedback; Dysgraphia; Kinematics; Motor control; Parkinson s disease

Indexed keywords

AUDITION; COMPUTER MUSIC; DISEASE CONTROL; FEEDBACK; KINEMATICS;

AUDITORY FEEDBACK; DEVELOPMENTAL DISABILITY; DYNAMIC FEATURES; DYSGRAPHIA; MOTOR CONTROL; MOVEMENT CHARACTERISTICS; SONIFICATIONS; SPATIOTEMPORAL CHARACTERISTICS;

DIAGNOSIS;

EID: 84918497350     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-319-12976-1_16     Document Type: Conference Paper

References (27)

1. Aramaki, M., Besson, M., Kronland-Martinet, R., Ystad, S.: Controlling the perceived material in an impact sound synthesizer. IEEE Trans. Audio Speech Lang. Process. 19(2), 301–314 (2011)
2. Bangert, M., Häusler, U., Altenmüller, E.: On Practice: how the brain connects piano keys and piano sounds. Ann. N.Y. Acad. Sci. 930, 425–428 (2001)
3. Baur, B., Fürholzer, W., Marquart, C., Hermsdörfer, J.: Auditory grip force feedback in the treatment of writer’s cramp. J. Hand Ther. 22, 163–171 (2009)
4. Charles, M., Soppelsa, R., Albaret, J.M.: BHK - Échelle d’Evaluation Rapide de l’Ecriture chez l’Enfant. Editions et Applications Psychologiques, Paris (2003)
5. Chen, J.L., Penhume, V.B., Zatorre, R.J.: Listening to musical rhythms recruits motor regions of the brain. Cereb. Cortex 18(12), 2844–2854 (2008)
6. Chin, J., Diehl, V., Norman, K.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of ACM CHI’88, ACM Press, New York (1988)
7. Danna, J., Eusebio, A., Azulay, J.P., Witjas, T., Pinto, S., Velay, J.L.: Computerized analysis of spiral drawing in Parkinson’s disease. Mov. Disord. 29(Suppl. 1), 313 (2014)
8. Danna, J., Fontaine, M., Paz-Villagrán, V., Gondre, C., Thoret, E., Aramaki, M., Kronland-Martinet, R., Ystad, S., Velay, J.L.: The effect of real-time auditory feedback on learning new characters. Hum. Mov. Sci. (in revision)
9. Danna, J., Paz-Villagrán, V., Gondre, C, Aramaki, M., Kronland-Martinet, R., Ystad, S., Velay, J.L.: Handwriting sonification for the diagnosis of dysgraphia. In: Nakagawa, M., Liwicki, M., Zhu, B. (eds.) Recent Progress in Graphonomics: Learn from the Past -Proceedings of the 16th Conference of the International Graphonomics Society, pp. 123-126. Tokyo University of Agriculture and Technology Press, Tokyo, Japan (2013)
10. Danna, J., Paz-Villagrán, V., Velay, J.L.: Signal-to-noise velocity peak difference: a new method for evaluating the handwriting movement fluency in children with dysgraphia. Res. Dev. Disabil. 34, 4384–4675 (2013)
11. Effenberg, A.O.: Movement sonification: effects on perception and action. IEEE Multim. 12, 53-59 (2005)
12. Hamstra-Bletz, L., DeBie, J., den Brinker, B.: Concise Evaluation Scale for Children’s Handwriting. Swets & Zeitlinger, Lisse (1987)
13. Hommel, B.: Event files: feature binding in and across perception and action. Trends Cogn. Sci. 8(11), 494-500 (2004)
14. Jankovic, J.: Parkinson’s disease: clinical features and diagnosis. J. Neurol. Neurosur. Psychiatry 79, 368-376 (2008)
15. McLennan, J.E., Nakano, K., Tyler, H.R., Schwab, R.S.: Micrographia in Parkinson’s disease. J. Neurol. Sci. 15(2), 141-152 (1972)
16. Parkinson, J.: An Essay on the Shaking Palsy. Whittingham and Rowland for Sherwood, Neely & Jones, London (1817)
17. Paz-Villagrán, V., Danna, J., Velay, J.L.: Lifts and stops in proficient and dysgraphic handwriting. Hum. Mov. Sci. 33, 381-394 (2014)
18. Plimmer, B., Reid, P., Blagojevic, R., Crossan, A., Brewster, S.: Signing on the tactile line: a multimodal system for teaching handwriting to blind children. ACM T. Comput.-Hum. Interact. 18(3), Article 17, 1-29 (2011)
19. Reavley, W.: The Use of biofeedback in the treatment of writer’s cramp. J. Behav. Ther. Exp. Psychiatry 6, 335-338 (1975)
20. Ronsse, R., Puttemans, V., Coxon, J.P., Goble, D.J., Wagemans, J., Wenderoth, N., Swinnen, S.P.: Motor learning with augmented feedback: modality dependent behavioral and neural consequences. Cereb. Cortex 21, 1283-1294 (2011)
21. Rosenblum, S., Samuel, M., Zlotnik, S., Erikh, I., Schlesinger, I.: Handwriting as an objective tool for Parkinson’s disease diagnosis. J. Neurol. 260(9), 2357-2361 (2013)
22. Sigrist, R., Rauter, G., Riener, R., Wolf, P.: Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review. Psychon. Bull. Rev. 20(1), 21-53 (2013)
23. Søvik, N., Arntzen, O.: A Comparative study of the writing/spelling performances of “normal”, dyslexic and dysgraphic children. Eur. J. Spec. Needs Educ. 1(2), 85-101 (1986)
24. Thoret, E., Aramaki, M., Gondre, C, Kronland-Martinet, R., Ystad, S.: Controlling a non linear friction model for evocative sound synthesis applications. In: Proceedings of 16th International Conference on Digital Audio Effects (DAFx), Maynooth, Ireland, pp. 1-7 (2013)
25. Thoret, E., Aramaki, M., Kronland-Martinet, R., Velay, J.L., Ystad, S.: From sound to shape: auditory perception of drawing movements. J. Exp. Psychol. Hum. Percept. Perform. 40, 983-994 (2014)
26. Van den Doel, K., Kry, P.G., Pai, D.K.: Foleyautomatic: physically-based sound effects for interactive simulation and animation. In: Proceedings of SIGGRAPH ‘01, pp. 537-544. ACM Press, New York (2001)
27. Young, W., Rodger, M., Craig, CM.: Perceiving and reenacting spatiotemporal characteristics of walking sounds. J. Exp. Psychol. Hum. 39(2), 464–476 (2013)