Tale of a robot: Humanoid robot assisted sign language tutoring

IEEE-RAS International Conference on Humanoid Robots

Volumn , Issue , 2011, Pages 105-111

  Kose, Hatice ^a   Yorganci, Rabia ^a  

^a ISTANBUL TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Humanoid Robots; Interaction games; Non verbal communication; Sign Language

Indexed keywords

HAND MOVEMENT; HEARING IMPAIRED; HUMANOID ROBOT; INTERACTION GAMES; INTERACTIVE STORIES; KNOW-HOW; NON-VERBAL COMMUNICATION; NON-VERBAL COMMUNICATIONS; RELEVANT FEEDBACK; SIGN LANGUAGE; TURKISHS;

ANTHROPOMORPHIC ROBOTS; AUDITION; COMMUNICATION; TEACHING;

HANDICAPPED PERSONS;

EID: 84856345307     PISSN: 21640572     EISSN: 21640580     Source Type: Conference Proceeding    
DOI: 10.1109/Humanoids.2011.6100846     Document Type: Conference Paper

References (28)

1. Aran, O., Keskin, C., and L. .Akarun, Sign Language Tutoring Tool, European Signal Processing Conference, EUSIPCO'05, Antalya, Türkiye, 2005.
2. Gürel, T. C., Turkish Sign Language Animation With Articulated Body Model, MSc. Thesis, Boǧazici University, 2010.
3. Turkish Sign Language Dictionary v1.0. [Online]. Available: http://www.cmpe.boun.edu.tr/pilab/tidsozlugu
4. Jaffe, D., Evolution of mechanical fingerspelling hands, for people who are deaf-blind, Journal of Rehabilitation Research and Development, 31, 236-244, 1994 (Pubitemid 24275722)
5. Hersh, M. A., and M. A. Johnson, (Eds.), Assistive Technology for the Hearing-impaired, Deaf and Deafblind, 2003, XIX, 319 p. 168 illus., Hardcover, ISBN: 978-1-85233-382-9
6. Staner, A. T., and A. Pentland, "Real-Time American Sign Language Recognition from Video using Hidden Markov Models", ISCV '95 Proceedings of the International Symposium on Computer Vision IEEE Computer Society Washington, DC, USA, 1995
7. Kadous, W., "GRASP: Recognition of Australian Sign Language Using Instrumented Gloves," MSc. Thesis, University of New South Wales, 1995.
8. Kouichi, M., and H., Taguchi, "Gesture Recognition Using Recurrent Neural Networks," Proceedings of CHI'91 Human Factors in Computing Systems, 1991, pp. 237-242.
9. Aran, O., and L. Akarun, A Multi-class Classification Strategy for Fisher Scores: Application to Signer Independent Sign Language Recognition, Pattern Recognition, Vol. 43, no. 5, pp. 1717-1992, May 2010.
10. Keskin, C. and L. Akarun, Input-output HMM based 3D hand gesture recognition and spotting for generic applications, accepted for publication, Pattern Recognition Letters, vol. 30, no. 12, pp. 1086- 1095, September 2009.
11. Aran, O., M.S.T. Burger, A., Caplier, and L. Akarun, A Belief-Based Sequential Fusion Approach for Fusing Manual and Non-Manual Signs, Pattern Recognition, vol.42 no.5, pp. 812-822, May 2009.
12. Aran, O., I., Ari, A. Benoit, P. Campr, A. H. Carrillo, F. Fanard, L. Akarun, A. Caplier, M. Rombaut, and B. Sankur, Signtutor: An Interactive System for Sign Language Tutoring, IEEE Multimedia, Volume: 16, Issue: 1, Pages: 81-93, Jan-March 2009.
13. Aran, O., I., Ari, P. Campr, E. Dikici, M. Hruz, S. Parlak, L.Akarun, and M. Saraclar, Speech and Sliding Text Aided Sign Retrieval from Hearing Impaired Sign News Videos, Journal on Multimodal User Interfaces, vol. 2, no: 1, Springer, 2008.
14. Caplier, A, S. Stillittano, O. Aran, L. Akarun, G. Bailly, D. Beautemps, N. Aboutabit, and T. Burger, Image and video for hearing impaired people, EURASIP Journal on Image and Video Processing, Special Issue on Image and Video Processing for Disability, 2007.
15. Shen, Q., J. Saunders, H. Kose-Bagci, K. Dautenhahn, "The Impact of Participants' Beliefs on Motor Interference and Motor Coordination in Human-Humanoid Interaction", IEEE T. Autonomous Mental Development (IEEE TAMD), VOL. 3, NO. 1, pp. 6-16, March, 2011.
16. Kose-Bagci, H., K. Dautenhahn, C. L. Nehaniv, "Emergent Dynamics of Turn-Taking Interaction in Drumming Games with a Humanoid Robot", Proc. IEEE RO-MAN 2008, Technische Universitat Munchen, Munich, Germany, 1-3 August 2008.
17. Kose-Bagci, H., E. Ferrari, K. Dautenhahn, D. S. Syrdal, and C. L. Nehaniv, "Effects of Embodiment and Gestures on Social Interaction in Drumming Games with a Humanoid Robot", Special issue on Robot and Human Interactive Communication, Advanced Robotics vol.24, no.14, 2009.
18. Kose-Bagci, H, .K. Dautenhahn, D. S. Syrdal, and C. L. Nehaniv, "Effects of emodiment and gestures on social interaction in drumming games with a humanoid robot," Connection Science, vol. 22, no. 2, pp. 103- 134, 2010.
19. Dautenhahn, K., C. L. Nehaniv, M. L. Walters, B. Robins, H. Kose-Bagci, N. A. Mirza, M. Blow, KASPAR - A Minimally Expressive Humanoid Robot for Human-Robot Interaction Research. Special Issue on "Humanoid Robots", Applied Bionics and Biomechanics 6(3): 369-397, 2009
20. Adamo-Villani, N., A virtual learning environment for deaf children: Design and evaluation. IJASET - International Journal of Applied Science, Engineering, and Technology, 16, 18-23, 2006
21. Lee, S., V. Henderson, H. Hamilton, T. Starner, H. Brashear, and S. Hamilton, A Gesture-based American Sign Language (ASL) Tutor for Deaf Children, Proceedings of CHI (Computer-Human Interaction). Portland, OR. April 2005
22. Greenbacker, C., and K. McCoy, The ICICLE Project: An Overiew. First Annual Computer Science Research Day, Department of Computer & Information Sciences, University of Delaware, Feb 2008.
23. www.cmu.ac.th/images/uploadfile/engnewsfile-100715102721.doc, Last Accessed: September, 2011
24. Graf, C., Härtl, A., Röfer, T., and T. Laue, A robust closed-loop gait for the standard platform league humanoid, In Zhou, C., Pagello, E., Menegatti, E., Behnke, S., Röfer, T., eds.: Proceedings of the Fourth Workshop on Humanoid Soccer Robots in conjunction with the 2009 IEEE-RAS International Conference on Humanoid Robots, Paris, France, 2009, pp.30 - 37.
25. Aldebaran Robotics Choregraphe. [Online]. Available: http://www. aldebaran-robotics.com/en/programmable
26. Kose-Bagci, H., R. Yorganci, H. E. Algan, and D.S. Syrdal, Evaluation of the Robot Assisted Sign Language Tutoring using video-based studies, IEEE T. Autonomous Mental Development (IEEE TAMD) special issue on "Measuring Human-Robot Interaction", submitted.
27. th European Conference on Mobile Robots (ECMR11), 7-9 Sep. 2011, accepted
28. Kose-Bagci, H, R. Yorganci ve H. E. Algan, http://humanoids.ce.itu.edu. tr, Last Accessed: September 2011