Dance-the-Music: An educational platform for the modeling, recognition and audiovisual monitoring of dance steps using spatiotemporal motion templates

Eurasip Journal on Advances in Signal Processing

Volumn 2012, Issue 1, 2012, Pages

  Maes, Pieter Jan ^a   Amelynck, Denis ^a   Leman, Marc ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

Audiovisual dance performance database; Dance education; Dance modeling and recognition; Dance based music querying and retrieval; Multimodal monitoring; Spatiotemporal template

Indexed keywords

DANCE EDUCATION; DANCE MODELING AND RECOGNITION; DANCE-BASED MUSIC QUERYING AND RETRIEVAL; MULTI-MODAL; SPATIOTEMPORAL TEMPLATE;

EDUCATION COMPUTING; STUDENTS;

COMPUTER MUSIC;

EID: 84872898461     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1186/1687-6180-2012-35     Document Type: Article

References (39)

1. S Brown, M Martinez, L Parsons, The neural basis of human dance. Cerebral Cortex. 16(8), 1157-1167 (2006) (Pubitemid 44025385)
2. M Leman, Embodied Music Cognition and Mediation Technology, (MIT Press, Cambridge, MA, USA, 2007)
3. M Leman, L Naveda, Basic gestures as spatiotemporal reference frames for repetitive dance/music patterns in Samba and Charleston. Music Percept. 28, 71-91 (2010). doi:10.1525/mp. 2010.28.1.71
4. L Naveda, M Leman, The spatiotemporal representation of dance and music gestures using topological gesture analysis (TGA). Music Percept. 28, 93-111 (2010). doi:10.1525/mp. 2010.28.1.93
5. RI Godøy, M Leman, Musical Gestures: Sound, Movement, and Meaning, (Routledge, New York, NY, USA, 2010)
6. K Kahol, P Tripathi, S Panchanathan, Automated gesture segmentation from dance sequences, in Proc 6th IEEE International Conference on Automatic Face and Gesture Recognition (FG). volume = not speci-fied; pages = 883-888; publisher = IEEE Computer Society; location = Seoul, South Korea (2004)
7. A Ruiz, B Vachon, Three learning systems in the reconnaissance of basic movements in contemporary dance, in Proc 5th IEEE World Automation Congress (WAC), IEEE Computer society, Orlando, FL, USA, 13, 189-194 (2002)
8. F Chenevière, S Boukir, B Vachon, Compression and recognition of spatiotemporal sequences from contemporary ballet. Int J Pattern Recogn Artif Intell. 20(5), 727-745 (2006). doi:10.1142/S0218001406004880 (Pubitemid 44370610)
9. K Kahol, K Tripathi, S Panchanathan, Documenting motion sequences with a personalized annotation system. IEEE Multimedia. 13, 37-45 (2006). doi:10.1109/MMUL.2006.5 (Pubitemid 43174077)
10. F Bévilacqua, B Zamborlin, A Sypniewski, N Schnell, F Guédy, N Rasamimanana, Continuous realtime gesture following and recognition, in Gesture in Embodied Communication and Human-Computer Interaction, vol. 5394. Springer Verlag, Berlin, Heidelberg, Germany, pp. 73-84 (2010)
11. C Bishop, Pattern recognition and machine learning, (Springer Science +Business Media LLC, New York, USA, 2009)
12. A Bobick, J Davis, The representation and recognition of action using temporal templates. IEEE Trans Pattern Anal Mach Intell. 23(3), 257-267 (2001). doi:10.1109/34.910878 (Pubitemid 32286632)
13. F Lv, R Nevatia, M Lee, 3D human action recognition using spatio-temporal motion templates. Comput Vision Human-Comput Interact 120-130 (2005) (Pubitemid 43741575)
14. M Müller, T Röder, Motion templates for automatic classification and retrieval of motion capture data, in Proc ACM/Eurographics Symposium on Computer Animation (SCA), Eurographics Association, Vienna, Austria, 137-146 (2006)
15. J Zacks, K Swallow, Event segmentation. Curr Direct Psychol Sci. 16(2), 80-84 (2007). doi:10.1111/j.1467-8721.2007.00480.x
16. P Jackson, A Meltzoff, J Decety, Neural circuits involved in imitation and perspective-taking. Neuroimage. 31, 429-439 (2006). doi:10.1016/j. neuroimage.2005.11.026 (Pubitemid 43728993)
17. D Davcev, V Trajkovic, S Kalajdziski, S Celakoski, Augmented reality environment for dance learning, in Proc IEEE International Conference on Information Technology, Research and Education (ITRE), 189-193 (2003)
18. A Nakamura, S Tabata, T Ueda, S Kiyofuji, Y Kuno, Dance training system with active vibro-devices and a mobile image display, in Proc IEEE International Conference on Intelligent Robots and Systems (IROS), IEEE Computer Society, Alberta, Canada, 3075-3080 (2002)
19. J Chan, H Leung, J Tang, T Komura, A virtual reality dance training system using motion capture technology. IEEE Trans Learn Technol. 4(2), 187-195 (2010)
20. L Deng, H Leung, N Gu, Y Yang, Real-time mocap dance recognition for an interactive dancing game. Comput Animat Virt W. 22, 229-237 (2011). doi:10.1002/cav. 397
21. D Hoppe, M Sadakata, P Desain, Development of real-time visual feedback assistance in singing training: a review. J Comput Assist Learn. 22(4), 308-316 (2006). doi:10.1111/j.1365-2729.2006.00178.x (Pubitemid 44000889)
22. E Gibbons, Feedback in the Dance Studio. J Phys Edu Recreat Dance. 75(7), 1-6 (2004)
23. J Menickelli, The Effectiveness of Videotape Feedback in Sport: Examining Cognitions in a Self-Controlled Learning Environment, PhD thesis, (Western Carolina University, 2004)
24. S Hanrahan, R Mathews, Success in Salsa: students' evaluation of the use of self-reflection when learning to dance, in Proc of the Conference of Tertiary Dance Council of Australia (TDCA), Melbourne, Australia, pp. 1-12 (2005)
25. K Kahol, P Tripathi, S Panchanathan, T Rikakis, Gesture segmentation in complex motion sequences, in Proc IEEE International Conference on Image Processing (ICIP), IEEE Computer Society, Barcelona, Spain, 2, 105-108 (2003)
26. H Yang, A Park, S Lee, Gesture spotting and recognition for human-robot interaction. IEEE Trans Robot. 23(2), 256-270 (2007) (Pubitemid 46621552)
27. T Artieres, S Marukatat, P Gallinari, Online handwritten shape recognition using segmental hidden markov models. IEEE Trans Pattern Anal Mach Intell. 29(2), 20-217 (2007)
28. S Rajko, G Qian, T Ingalls, J James, Real-time gesture recognition with minimal training requirements and on-line learning, in Proc IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, Minneapolis, USA, 1-8 (2007)
29. S Rajko, G Qian, HMM parameter reduction for practical gesture recognition, in Proc 8th IEEE International Conference on Automatic Face and Gesture Recognition (FG), IEEE Computer Society. Amsterdam, The Netherlands, 1-6 (2008)
30. T Hastie, R Tibshirani, J Friedman, J Franklin, The elements of statistical learning: data mining, inference and prediction. Math Intelligencer. 27(2), 83-85 (2005)
31. PJ Maes, M Leman, M Lesaffre, A model-based sonification system for directional movement behavior, in Proc 3th Interactive Sonification Workshop (ISon), KTH, Stockholm, Sweden, 91-94, (2010)
32. F Lv, R Nevatia, Recognition and segmentation of 3-d human action using hmm and multiclass adaboost, in Proc 9th European Conference on Computer Vision (ECCV), vol. 3954. Springer Verlag, Graz Austria, pp. 359-372 (2006) (Pubitemid 44029643)
33. H Mori, S Ohta, J Hoshino, Automatic dance generation from music annotation, in Proc International Conference on Advances in Computer Entertainment Technology (ACE), ACM Singapore, 352-353 (2004)
34. T Shiratori, A Nakazawa, K Ikeuchi, Dancing-to-Music Character Animation. Comput Graph Forum. 25(3), 449-458 (2006). doi:10.1111/j.1467-8659.2006.00964.x (Pubitemid 44891380)
35. J Kim, H Fouad, J Sibert, J Hahn, Perceptually motivated automatic dance motion generation for music. Comput Animat Virt W. 20(2-3), 375-384 (2009). doi:10.1002/cav. 314
36. F Ofli, E Erzin, Y Yemez, A Tekalp, Multi-modal analysis of dance performances for music-driven choreography synthesis, in Proc IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), IEEE Computer Society, Dallas, TX, USA, 2466-2469 (2010)
37. G Qian, F Guo, T Ingalls, L Olson, J James, T Rikakis, A gesture-driven multimodal interactive dance system, Proc IEEE International Conference on Multimedia and Expo (ICME), IEEE Computer Society, Taipei, Taiwan, 3, 1579-1582 (2004) (Pubitemid 40063349)
38. G Castellano, R Bresin, A Camurri, G Volpe, User-centered control of audio and visual expressive feedback by full-body movements. Affect Comput Intell Interact. 4738, 501-510 (2007). doi:10.1007/978-3-540-74889-2-44
39. PJ Maes, M Leman, K Kochman, M Lesaffre, M Demey, The "One-Person Choir": a multidisciplinary approach to the development of an embodied human-computer interface. Comput Music J. 35(2), 1-15 (2011)