An approach to ballet dance training through MS kinect and visualization in a CAVE virtual reality environment

ACM Transactions on Intelligent Systems and Technology

Volumn 6, Issue 2, 2015, Pages

  Kyan, Matthew ^a   Sun, Guoyu ^b   Li, Haiyan ^b   Zhong, Ling ^c   Muneesawang, Paisarn ^d   Dong, Nan ^a   Elder, Bruce ^a   Guan, Ling ^a  

^a RYERSON UNIVERSITY   (Canada)

^b State Key Laboratory of Media Convergence Production Technology and Systems   (China)

^c GUANGDONG UNIVERSITY OF TECHNOLOGY   (China)

^d NARESUAN UNIVERSITY   (Thailand)

Author keywords

Ballet; Dance; Gesture recognition; Human computer interaction; Immersive training and simulation; MS Kinect; Self organizing maps, CAVE; Virtual reality

Indexed keywords

CAVES; CONFORMAL MAPPING; E-LEARNING; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; SELF ORGANIZING MAPS; STUDENTS; THREE DIMENSIONAL COMPUTER GRAPHICS; VISUALIZATION;

BALLET; DANCE; GESTURAL COMPONENTS; GESTURE TRAJECTORIES; MS-KINECT; TRAINING AND SIMULATIONS; VIRTUAL INSTRUCTORS; VIRTUAL-REALITY ENVIRONMENT;

VIRTUAL REALITY;

EID: 84927511803     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/2735951     Document Type: Article

References (54)

1. D. Alexiadis, P. Daras, P. Kelly, N. E. O'Connor, T. Boubekeur, and M. B. Moussa. 2011. Evaluating a dancer's performance using Kinect-based skeleton tracking. In ACM Multimedia. 659-662.
2. O. Arikan and E. Forsyth. 2002. Interactivemotion generation from examples. ACMTransactions onGraphics 21, 3 (2002), 483-490.
3. C.W. Armstrong and S. J. Hoffman. 1979. Effects of teaching experience, knowledge of performer competence, and knowledge of performance outcome on performance error identification. Research Quarterly 50, 3 (1979), 318-327.
4. J. Barbic, A. Safonova, J. Y. Pan, C. Faloutsos, J. K. Hodgins, and N. S. Pollard. 2004. Segmenting motion capture data into distinct behaviors. In Proceedings of Graphics Interface. 185-194.
5. M. A. Barnes, D. Krasnow, S. J. Tupling, and M. Thomas. 2000. Knee rotation in classical dancers during the grand plié. Medical Problems o f Performing Artists 15, 4 (2000), 140-147.
6. D. A. Becker and A. Pentland. 1996. Using a virtual environment to teach cancer patients T'ai Chi, relaxation, and self-imagery. In Proceedings of the Intern ational Conference on Automatic Face and Gesture Recognition.
7. M. Bertucco and P. Cesari. 2010. Does movement planning follow Fitts' law? Scaling anticipatory postural adjustments with movement speed and accuracy. Neuroscience 171, 1 (2010), 205-213.
8. A. F. Bobick and J. W. Davis. 2001. The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 3 (2001), 257-267.
9. D. Brennan and M. M. Van Hulle. 2007. Comparison of flat SOM with spherical SOM: A case study. In The Self-Organizing Maps and the Development-From Medicine and Biology to the Sociological Field. 31-41. Spr inger, Tokyo, Japan, (2007).
10. S. Bronner,S. Ojofeitimi 2006. Gender and limb differences in healthy elite dancers: Passé kinematics Journal of Motor Behavior 38 1 2006 71-79.
11. S. Bronner and S. Ojofeitimi. 2011. Pelvis and hip three-dimensional kinematics in grand battement movements. Journal of Dance Medicine and Science 15, 1 (2011), 23-30.
12. J. C. Chan, H. Leung, J. K. Tang , and T. Komura. 2011. A virtual reality dance training system using motion capture technology. IEEE Transactions on Learning Technologies 4, 2 (2011), 187-195.
13. P. T. Chua, R. Crivella, B. Daly, N. Hu, R. Schaaf, T. Ventura, J. Camill, J. Hodgins, and R. Pausch. 2003. Tai chi: Training for physical tasks in virtual environments. In Proceedings of IEEE Virtual Reality. 87-94.
14. A. Clay, N. Co uture, and L. Nigay. 2009. Towards an architecturemodel for emotion recognition in interactive systems: Application to a ballet dance show. In Proceedings of theWorld Conference on Innovative Virtual Reality. 19-24.
15. A. Couillandres, P. Lewton-Brain, and P. Portero. 2008. Exploring the effects of kinesiological awareness and mental imagery on movement intention in the performance of demi-plie. Journal of Dance Medicine and Science 12, 3 (2008), 91-98.
16. J. L. Deckert, S. M. Barry, and T. M. Welsh. 2007. Analysis of pelvic alignment in university ballet majors. Journal of Dance Medicine and Science 11, 4 (2007), 110-117.
17. L. Deng, H. Leung, N. Gu, and Y. Yang. 2011. Real time mocap dance recognition for an interactive dancing game. Computer Animation and Virtual Worlds 22 (2011), 229-237.
18. K. A. Ericsson, R. T. Krampe, and C. Tesch-Roemer. 1993. The role of deliberate practice in the acquisition of expert performance. Psychological Review 100, 3 (1993), 363-406.
19. N. Gamboian, S. J. Chatfield, and M. H. Woollacott. 2000. Further effects of somatic training on pelvic tilt and lumbar lordosis alignment during quiet stance and dynamic dance movement. Journal of Dance Medicine and Science 4, 3 (2000), 90-98.
20. E. Golomer, R. M. Gravenhorst, and Y. Toussaint. 2009. Influence of vision and motor imagery styles on equilibrium control during whole-body rotations. Somatosensory and Motor Research 26, 4 (2009), 105-110.
21. A. O. Gonsales and M. Kyan. 2012. Trajectory analysis on spherical self-organizing maps with application to gesture recognition. In Proceedings of the 9th International Workshop (WSOM'12). 125-134.
22. K. Hachimu ra, H. Kato, and H. Tamura. 2004. A prototype dance training support system with motion capture and mixed reality technologies. In Proceedings of the IEEE International Workshop on Robot and Human Interactive Communication. 217-222.
23. E. Ho, J. Chan, T. Komura, and H. Leung. 2013. Interactive partner control in close interactions for realtime applications. ACM Transactions on Multimedia Computing, Communications, and Applications 9, 3 (2013), 21.
24. K. M. Holt, T. M. Welsh, and J. Speights. 2011. A within-subject analysis of the effects of remote cueing on pelvic alignment in dancers. Journal of Dance Medicine and Science 15, 1 (2011), 15-22.
25. A. Imura, Y. Iino, and T.Kojima. 2008. Biomechanics of the continuity and speed change during one revolution of the fouette turn. Human Movement Science 27, 6 (2008), 903-913.
26. A. Imura, Y. Iino, and T. Kojima. 2010. Kinematic and kinetic analysis of the fouette turn in classical ballet. Journal of Applied Biomechanics 26, 4 (2010), 484-492.
27. G. Kassing and M. J. Danielle. 1998. Teaching Beginning Ballet Technique. Human Kinetics.
28. E. Kavakli, S. Bakogianni, A. Damianakis, M. Loumou, and D. Tsatsos. 2004. Traditional dance and elearning: The WEBDANCE learn ing environment. In Proceedings of the International Conference on Theory and Applications of Mathematics and Informatics. 272-281.
29. M. Kawashima, A. Shimada, and R.-I. Taniguchi. 2009. Early recognition of gesture patterns using sparse code of self-organising map. In Advances in Self-Organizing Maps. Springer, Berlin, 116-123.
30. E. Keogh. 2002. Exact indexing of dynamic time warping. In Proceedings of the International Conference on Very Large Data Bases. 406-417.
31. E. Keogh,T. Palpanas,V. B. Zordan,E. Gunopulos,M. Cardle 2004 Indexing large humanmotion databases In Proceedings of the International Conference on Very Large Data Bases 780-791.
32. T. Komura, B. Lam, R. W. H. Lau, and H. Leung. 2006. e-Learning martial arts. Lecture Notes in Computer Science 4181 (2006), 239-248.
33. D. H. Krasnow and S. J. Chatfield. 1997. Imagery and conditioning practices for dancers. Dance Research Journal 29, 1 (1997), 43-64.
34. K. Kulig, A. L. Fietzer, and J. M. Popovich. 2011. Ground reaction forces and knee mechanics in the weight acceptance phase of a dance leap take-off and landing. Journal of Sports Sciences 29, 2 (2011), 125-131.
35. C. F. Lin, F. C. Su, and H. W. Wu. 2005. Ankle biomechanics of ballet dancers in relevé en pointé dance. Research in Sports Medicine 13, 1 (2005), 23-35.
36. F. Lv, R. Nevatia, and M. W. Lee. 2005. 3D human action recognition using spatio-temporalmotion templates. In Computer Vision in Human-Computer Interaction. Springer, Berlin, 120-130.
37. N. Masso, A. Germain, F. Rey, L. Costa, D. Romero, and S. Guitart. 2004. Study of muscle activity during releve in first position and sixth positions. Journal of Dance Medicine and Science 8, 4 (2004), 101-107.
38. L. Mayers, S. Bronner, S. Agraharasamakulam, and S. Ojofeitimi. 2010. Lower extremity kinetics in tap dance. Journal of Dance Medicine and Science 14, 1 (2010), 3-10.
39. J. D. McAuley and M. R. Jones. 2003. Modeling effec ts of rhythmic context on perceived duration: A comparison of interval and entrainment approaches to short-interval timing. Journal of Experimental Psychology: Human Perception and Performance 29 (2003), 1102-1125.
40. M. Naemura and M. Suzuki. 2006. A method for estimating dance action based on motion analysis. In Computer Vision and Graphics. Springer Netherlands, 695-702.
41. J. G. Noverre. 1760. Letters on Dancing and Ballet, translated by Cyril W. Beaumont. London 1830, Reproduced, New York Dance Horizons.
42. M. Raptis, D. Kirovski, and H. Hoppe. 2011. Real-time classification of dance gestures from skeleton animation. In Proceedings of ACM SIGGRAPH/Eurographics Symposium on Computer Animation. 147-156.
43. A. P. Sangole and A. Leontitis. 2006. Spherical self-organizing feature map: An introductory review. International Journal of Bifurcation and Chaos 16, 11 (2006), 3195-3206.
44. C. Schuldt, I. Laptev, and B. Caputo. 2004. Recognizing human actions: A local SVM approach. In Proceedings of the IEEE International Conference on Pattern Recognition. 32-36.
45. G. Shan. 2005. Comparison of repetitive movements between ballet dan cers and martial artists: Risk assessment of muscle overuse injuries and prevention strategies. Research in Sports Medicine 13, 1 (2005), 63-76.
46. J. M. Shippen and B. May. 2010. Calculation of muscle loading and joint contact forces during the rock step in Irish dance. Journal of Dance Medicine and Science 14, 1 (2010), 11-18.
47. R. W. Simmons. 2005. Sensory organization determinants of postural stability in trained ballet dancers. International Journal of Neuroscience 115, 1 (2005), 87-97.
48. J. K. T. Tang, H. Leung, T. Komura, and H. P. H. Shum. 2008. Emulating human perception of motion similarity. Computer Animation and Virtual Worlds 19, 3-4 (2008), 211-221.
49. M. Uejou, H.-H. Huang, J.-H. Lee, and K. Kawagoe. 2011. Toward a conversational virtual instructor of ballroom dance. In Intelligent Virtual Agents. Springer, Berlin, 477-478.
50. R. E. Ward. 2012. Biomechanical Perspectives on Classical Ballet Technique and Implications for Teaching Practice. PhD Thesis, University of New South Wales.
51. M. Wilson, J.-H. Ryu, and Y.-H. Kwon. 2007. Contribution of the pelvis to gesture leg range of motion in a complex balletmovement grand rond de jambe en l'air en dehors. Journal of Dance Medicine and Science 11, 4 (2007), 118-123.
52. U. Yang and G. J. Kim. 2002. Implementation and evaluation of " just follow me" : An immersive, VRbased, motion-training system. Presence: Teleoperators and Virtual Environments 11, 3 (2002), 304-323.
53. Y. Yang, H. Leung, L. Yue, and L. Deng. 2012. Automatic dance lesson generation. IEEE Transactions on Learning Technologies 3, 5 (2012), 191-198.
54. Y. Yang, H. Leung, L. Yue, and L. Deng . 2013. Generating a two-phase lesson for guiding beginners to learn basic dance movements. Computers and Education 61, 1 (2013), 1-20.