Camera-Based Motion Tracking and Performing Arts for Persons with Motor Disabilities and Autism

Disability Informatics and Web Accessibility for Motor Limitations

Volumn , Issue , 2013, Pages 294-322

  Kontogeorgakopoulos, Alexandros ^a   Wechsler, Robert ^b,c   Keay Bright, Wendy ^a  

^a CARDIFF METROPOLITAN UNIVERSITY   (United Kingdom)

^b MotionComposer ^*  (Germany)

^c BAUHAUS UNIVERSITY WEIMAR   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84944810453     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-4666-4442-7.ch009     Document Type: Chapter

References (93)

1. Acitores, A. P., & Wechsler, R. (2010). Danza interactiva con niños parálisis cerebral. In Proceedings of XXVII Congreso de la Asociación Española de Logopedia, Foniatría, y Audiología. UCM Press.
2. APA. (2011). DSM 5. Retrieved from http://www. dsm5.org/Pages/Default.aspx.
3. Berkeley, S., & Zittel, L. (1998). Teaching the child with autism in physical education. Achieving a Balance. In Proceedings of the 6th National Conference on Adapted Physical Activity. Macomb, IL: Western Illinois University.
4. Billerbeck, U. (2012). Bewegung und klang-Eine woche mit dem motioncomposer. Unterstützte kommunikation. In Proceedings of ISAAC. Karlsruhe, Germany: Literaturverlag.
5. Bodgashina, O. (2003). Sensory perceptual issues in autism and asperger syndrome. London: Jessica Kingsley Publishers.
6. Bracken, C., & Lombard, M. (2004). Social presence and children: Praise, intrinsic motivation, and learning with computers. The Journal of Communication, 54, 22-30. doi:10.1111/j.1460-2466.2004. tb02611.x.
7. Buchenau & Suri. (2000). Experience prototyping. In Proceedings of the Conference on Designing Interactive Systems, 424-433. New York: ACM Press.
8. Camurri, A., Mazzarino, B., & Volpe, G. (2004). Expressive gestural control of sound and visual output in multimodal interactive systems. In Proceedings of the International Conference of Sound and Music Computing. Paris: SMC Press.
9. Camurri, A., & Moeslund, T. B. (2009). Visual gesture recognition: From motion tracking to expressive gesture. In Leman, M., & Godoy, R. I. (Eds.), Musical Gestures: Sound, Movement, and Meaning. New York: Routledge.
10. Chadabe, J. (1997). Electric sound. Upper Saddle River, NJ: Prentice Hall.
11. Dietz, J. (2011). Der motioncomposer: bewegung in musik verwandeln. Checkpoint E-learning.de. Interview. Retrieved from http://www.checkpointelearning. de/article/10614.html.
12. Dietz, J. (2012). The motioncomposer home website. Retrieved from http://www.motioncomposer. com#events.
13. Dissanayake, E. (2000). Art and intimacy: How the arts began. Seattle, WA: University of Washington Press.
14. Dixon, S., & Smith, B. (2007). Digital performance: A history of new media in theater, dance, performance art, and installation. Cambridge, MA: MIT press.
15. Drummond, J. (2009). Understanding interactive systems. Organised Sound, 14(2), 124-133. doi:10.1017/S1355771809000235. Foster, S. L. (2005). Choreographing empathy. Topoi, 24(1), 81-91. doi:10.1007/s11245-004- 4163-9.
16. Gallese, V. (2005). Embodied simulation: From neurons to phenomenal experience. [Berlin: Springer.]. Phenomenology and the Cognitive Sciences, 4, 23-48. doi:10.1007/s11097-005-4737-z.
17. Gallese, V., & Goldman, A. (1998). Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences, 12, 493-501. doi:10.1016/ S1364-6613(98)01262-5 PMID:21227300.
18. Godøy, R. I. (2009). Musical gestures: Sound, movement, and meaning. New York: Routledge.
19. Grandin, T. (1995). The learning style of people with autism: An autobiography. In Quill, K. A. (Ed.), Teaching Children with Autism: Strategies to Enhance Communication and Socialisation. London: Delmar Publishers Inc.
20. Hunt, A., & Wanderley, M. M. (2002). Mapping performer parameters to synthesis engines. Organised Sound, 7(2), 97-108. doi:10.1017/ S1355771802002030.
21. Keay-Bright, W. (2006). Reactivities: Autism and play. Digital Creativity, 17(3), 149-156. doi:10.1080/14626260600882414.
22. Keay-Bright, W. (2007a). Can computers create relaxation? Designing reactickles software with children on the autistic spectrum. CoDesign, 3(2), 97-110. doi:10.1080/15710880601143443.
23. Keay-Bright, W. (2007b). The reactive colours project: Demonstrating participatory and collaborative design methods for the creation of software for autistic children. Design Principles and Practices: An International Journal, 1(2), 7-16.
24. Keay-Bright, W. (2007c). Designing playful sensory experiences with interactive whiteboard technology: The implications for children on the autistic spectrum. In Proceedings of 7th European Academy of Design Conference: Dancing with Disorder: Design, Discourse, and Disaster. Sheffield, UK, Sheffield Hallam University Press.
25. Keay-Bright, W. (2008). Tangible technologies as interactive play spaces for children with learning difficulties: The reactive colours project. The International Journal of Technology. Knowledge in Society, 4(1), 111-120.
26. Keay-Bright, W. (2009). ReacTickles: Playful interaction with information communication technologies. The International Journal of Art & Technology, 2(1-2), 133-151. doi:10.1504/ IJART.2009.024063.
27. Keay-Bright, W. (2013). Young people on the autism spectrum make interaction magical. Special: autism spectrum disorders. Nasen, 38-40
28. Keay-Bright, W., & Howarth, I. C. (2011). Is simplicity the key to engagement for children on the autism spectrum. Journal of Personal and Ubiquitous Computing, Theme Issue on Technology for Autism. Berlin: Springer.
29. Kern, L., Koegel, R. L., & Dunlap, G. (1984). The influence of vigorous versus mild exercise on autistic stereotyped behaviors. Journal of Autism and Developmental Disorders, 14, 57-67. doi:10.1007/BF02408555 PMID:6706897.
30. Kestenberg, J. S. (1975). Parents and children. Northvale, NJ: Jason Aronson.
31. Koch, S. C. (2006). Interdisciplinary embodiment approaches. Implications for creative arts therapies. In S. C. Koch & I. Brauninger (Eds.), Advances in Dance/Movement Therapy. Theoretical perspectives and empirical findings (17-28). Berlin: Logos.
32. Koch, S. C. (2011). Basic body rhythms and embodied intercorporality: From individual to interpersonal movement feedback. In W. Tschacher, & C. Bergomi (Eds.), The Implications of Embodiment: Cognition and Communication (151-171). Exeter, UK: Imprint Academic.
33. Koegel, R. L., Koegel, L. K., & McNerney, E. (2001). Pivotal areas in intervention for autism. Journal of Clinical Child and Adolescent Psychology, 30(1). doi:10.1207/S15374424JCCP3001_4.
34. Krueger, M. W. (1985). VIDEOPLACE: A Report from the Artificial Reality Laboratory. Leonardo, 18(3), 145-151. doi:10.2307/1578043.
35. Laban, R. V. (1960). The mastery of movement. London: MacDonald & Evans.
36. Laban, R. V., & Lawrence, F. C. (1974). Effort: Economy in body movement. Boston: Plays.
37. Leekam, S. R., Prior, M. R., & Uljarevic, M. (2011). Restricted and repetitive behaviors in autism spectrum disorders: A review of research in the last decade. Psychological Bulletin, 137(4), 562-593. doi:10.1037/a0023341 PMID:21574682.
38. Levin, G. (2006). Computer vision for artists and designers: Pedagogic tools and techniques for novice programmers. AI & Society, 20(4), 462-482. doi:10.1007/s00146-006-0049-2.
39. Levin, G. (2007). Vision. In Reas & Fry (Eds.), Processing: A Programming Handbook for Visual Designers and Artists. Cambridge, MA: MIT Press.
40. Miranda, E. R., & Wanderley, M. M. (2006). New digital musical instruments: Control and interaction beyond the keyboard, 21. Middleton, WI: AR Editions, Inc.
41. Muller, P., & Warwick, A. (1993). Autistic children and music therapy: The effect of maternal involvement in therapy. In Heal and Wigram (Eds), Music Therapy in Health and Education. London: Jessica Kingsley.
42. Murray, D. (1997). Powell & Jordan (Eds.), Autism and information technology: Therapy with computers. Autism and Learning: A Guide to Good Practice. London: David Fulton Publishers.
43. Murray, D., & Aspinall, A. (2006). Getting IT. London: Jessica Kingsley Publishers.
44. Murray, D., Lesser, M., & Lawson, W. (2005). Attention, monotropism, and the diagnostic criteria for autism. Autism, 9(2). doi:10.1177/- 1362361305051398 PMID:15857859.
45. Noble, J. (2009). Programming Interactivity: A Designer's Guide to Processing, Arduino, and Openframeworks. Sebastapol, CA: O'Reilly Media.
46. Ozonoff, S., Strayer, D. L., McMahon, W. M., & Filloux, F. (1994). Executive function abilities in autism and tourette syndrome: An informationprocessing approach. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 35, 1015-1032. doi:10.1111/j.1469-7610.1994. tb01807.x PMID:7995842.
47. Quill, K., Gurry, S., & Larkin, A. (1989). Daily life therapy: A Japanese model for educating children with autism. Journal of Autism and Developmental Disorders, 19(4), 625-635. doi:10.1007/ BF02212861 PMID:2606888.
48. Quill, K. A. (2000). Do-watch-listen-say: Social communication intervention for children with autism. Baltimore: Paul H. Brookes Publishing Co.
49. Reas, C., McWilliams, C., & Barendse, J. (2010). Form+ code in design, art, and architecture. Princeton, NJ: Princeton Architectural Press.
50. Report of the Secretary-General of the United Nations. (2010). Keeping the promise: Realizing the millennium development goals for persons with disabilities towards 2015 and beyond. Retrieved from http://www.un.org/disabilities/documents/ events/idpd10_philippines.pdf.
51. Rosenthal-Malek, A., & Mitchell, S. (1997). Brief report: The effects of exercise on the selfstimulating behaviors and positive responding of adolescents with autism. Journal of Autism and Developmental Disorders, 27(2), 193-202. doi:10.1023/A:1025848009248 PMID:9105970.
52. Rowe, R. (1992). Interactive music systems: Machine listening and composing. Cambridge, MA: MIT Press.
53. Secretariat for the Convention on the Rights of Persons with Disabilities. (2012). Department of economic and social affairs, united nations (2012). Retrieved from http://www.un.org/disabilities.
54. Siegel, W. (1999). Two compositions for interactive dance. In Proceedings of the International Computer Music Conference, 56-59. Cambridge, MA: MIT Press.
55. Siegel, W. (2009). Dancing the music: Interactive dance and music. In Dean, R. (Ed.), The Oxford Handbook of Computer Music (191-2013). Oxford, UK: Oxford University Press.
56. Siegel, W., & Jacobsen, J. (1998). The challenges of interactive dance: An overview and case study. Computer Music Journal, 29-43. doi:10.2307/3680892.
57. Steuer, J. (1992). Defining virtual reality: Dimensions determining telepresence. The Journal of Communication, 42(4), 73- 93. Retrieved from http://www.presenceresearch. org/papers/steuer92defining.pdf doi:10.1111/j.1460-2466.1992.tb00812.x.
58. Szeliski, R. (2010). Computer vision: Algorithms and applications. New York: Springer.
59. Van Rijn, H. (2012) Meaningful Encounters: Explorative Studies About Designers Learning from Children with Autism. (Doctoral thesis). Delft, Netherlands, Delft University of Tehcnology.
60. Watts, E. (1977). Towards dance and art. London: Lepus Books.
61. Wechsler, R. (2006). Artistic considerations in the use of motion tracking with live performers: A Practical Guide. Performance and Technology: Practices of Virtual Embodiment and Interactivity, 60-77. Hampshire, UK: Palgrave MacMillan.
62. Wechsler, R. (2012). Applications of motion tracking in making music for persons with disabilities. In Proceedings of the 4th Workshop on Innovative Computer Based Music Interfaces. IEEE Press.
63. Wimpory, D., Chadwick, P., & Nash, S. (1995). Musical interaction therapy for children with autism: An illustrative case study with two-year follow-up. Journal of Autism and Developmental Disorders, 25(5), 541-552. doi:10.1007/ BF02178299 PMID:8567598.
64. Winkler, T. (1995). Making motion musical: Gesture mapping strategies for interactive computer music. In ICMC Proceedings, 261-264. Ann Arbor, MI: University of Michigan Press.
65. Winkler, T. (1997). Creating interactive dance with the very nervous system. In Proceedings of Connecticut College Symposium on Arts and Technology. New London, CT: Connecticut College Press.
66. Winkler, T. (1998). Composing interactive music: Techniques and ideas using MAX. Cambridge, MA: MIT Press.
67. Bevilacqua, F., Naugle, L., & Valverde, I. (2001). Virtual dance and music environment using motion capture. In Proceedings of the IEEE-Multimedia Technology and Applications Conference. Irvine, CA: IEEE Press.
68. Bevilacqua, F., Schnell, N., & Alaoui, S. F. (2011). Gesture capture: Paradigms in interactive music/dance systems. Emerging Bodies: The Performance of Worldmaking in Dance and Choreography, 183-193. Bielefeld, Germany: Transcript-Verlag.
69. Bradski, G., & Kaehler, A. (2008). Learning OpenCV: Computer vision with the OpenCV library. Sebastapol, CA: O'Reilly Media, Inc.
70. Cadoz, C. & Wanderley, M. M. (2000). Gesturemusic. Trends in gestural control of music, 71-94.
71. Camurri, A., Hashimoto, S., Ricchetti, M., Ricci, A., Suzuki, K., Trocca, R., & Volpe, G. (2000). Eyesweb: Toward gesture and affect recognition in interactive dance and music systems. Computer Music Journal, 24(1), 57-69. doi:10.1162/014892600559182.
72. Camurri, A., Mazzarino, B., Volpe, G., Morasso, P., Priano, F., & Re, C. (2003). Application of multimedia techniques in the physical rehabilitation of parkinson's patients. Journal of Visualization and Computer Animation, 14(5), 269-278. doi:10.1002/vis.324.
73. Davis, W., Gfeller, K., & Thaut, M. (2000). Introducción a la musicoterapia: Teoría y práctica. Barcelona: Boileau.
74. Dodge, C., & Jerse, T. A. (1997). Computer Music: Synthesis, composition, and performance. Hampshire, UK: Macmillan Library Reference.
75. Kestenberg Amighi, J., Loman, S., Lewis, P., & Sossin, K. M. (1999). The meaning of movement clinical and developmental assessment with the kestenberg movement profile. New York: Brunner- Routledge Publishers.
76. Koch, S. C., Glawe, S., & Holt, D. (2011). Up and down, front and back: Movement and meaning in the vertical and sagittal axis. Social Psychology, 42(3). doi:10.1027/1864-9335/a000065.
77. Koch, S. C., Morlinghaus, K., & Fuchs, T. (2007). The joy dance. Effects of a single dance intervention on patients with depression. The Arts in Psychotherapy, 34, 340-349. doi:10.1016/j. aip.2007.07.001.
78. Laban, R. (1973). Foreward. Labanotation, or Kinetography Laban: The System of Analyzing and Recording Movement. New York: Theatre Arts Books.
79. Louppe, L. (1994). Traces of dance: Drawings and notations by choreographers. Paris: Editions Dis Voir.
80. Lye, L. (Director). (1929). Tusalava. (Motion Picture). UK: The Film Society. Malagón, J. (2007). Actualizaciones en neurología infantil. La parálisis cerebral. Medicina, 67(6), 1. PMID:17408014.
81. Mulder, S. (1994). Human movement tracking technology. Hand centered studies of human movement project. Technical Report 94-1. Burnaby, BC: Simon Fraser University.
82. Ng, K. (2002). Sensing and mapping for interactive performance. Organised Sound, 7(02), 191-200. doi:10.1017/S1355771802002091.
83. O'Sullivan, D., & Igoe, T. (2004). Physical computing: Sensing and controlling the physical world with computers. Independence, KY: Cengage Learning.
84. Paradiso, J. A., & Sparacino, F. (1997). Optical tracking for music and dance performance. In Proceedings of Fourth Conference on Optical 3D Measurement Techniques. Zurich, Switzerland: Elsevier.
85. Reas, C., & Fry, B. (2007). Processing: A programming handbook for visual designers and artists. Cambridge, MA: MIT Press.
86. Roads, C. (1996). The computer music tutorial. Cambridge, MA: MIT Press.
87. Schacher, J. C. (2010). Motion to gesture to sound: Mapping for interactive dance. In Proceedings of the 2010 International Conference on New Interfaces for Musical Expression. NIME Press.
88. Schneider, S., Schönle, P. W., Altenmüller, E., & Münte, T. F. (2006). Using musical instruments to improve motor skill recovery following a stroke. Journal of Neurology, 254(10). PMID:17260171.
89. Sparacino, F., Davenport, G., & Pentland, A. (2000). Media in performance: Interactive spaces for dance, theater, circus, and museum exhibits. IBM Systems Journal, 39(3-4), 479-510. doi:10.1147/sj.393.0479.
90. Tsuruta, S., Kawauchi, Y., Choi, W., & Hachimura, K. (2007). Real-time recognition of body motion for virtual dance collaboration system. In 17th International Conference on Artificial Reality and Telexistence, 23-30. IEEE Press.
91. Wanderley, M., & Battier, M. (Eds.). (2000). Trends in gestural control of music. Paris: IRCAM Press.
92. Wechsler, R., Weiß, F., & Dowling, P. (2004). EyeCon-A motion sensing tool for creating interactive dance, music, and video projections. In Proceedings of the SSAISB Convention. IEEE Press.
93. Winkler, T. (1997). Creating interactive dance with the very nervous system. In Proceedings of Connecticut College Symposium on Arts and Technology. New London, CT: Connecticut College Press.