Socially interactive robotic platforms as sign language tutors

International Journal of Humanoid Robotics

Volumn 11, Issue 1, 2014, Pages

  Kose, Hatice ^a   Akalin, Neziha ^a   Uluer, Pinar ^a  

^a ISTANBUL TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Humanoid robots; interaction games; nonverbal communication; sign language

Indexed keywords

ANTHROPOMORPHIC ROBOTS; HUMAN COMPUTER INTERACTION;

COMMUNICATION PROBLEMS; EXPLORATORY STUDIES; HUMANOID ROBOT; INTERACTION GAMES; INTERACTIVE ROBOTICS; MULTIMODAL COMMUNICATIONS; NON-VERBAL COMMUNICATIONS; SIGN LANGUAGE;

COMMUNICATION;

EID: 84898450132     PISSN: 02198436     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219843614500030     Document Type: Article

References (45)

1. A. Billard, B. Robins, K. Dautenhahn and J. Nadel, Building Robota, A mini-humanoid robot for the rehabilitation of children with autism, RESNA Assist. Technol. J. 19(1) (2007) 37-49.
2. M. A. Salichs, R. Barber, A. M. Khamis, M. Malfaz, J. F. Gorostiza, R. Pacheco, R. Rivas, A. Corrales, E. Delgado and D. Garcia, Maggie: A robotic platform for human-robot social interaction, IEEE Conf. Robotics, Automation and Mechatronics (Bangkok, Thailand, 2006), pp. 1-7.
3. N. G. Tsagarakis, M. Sinclair, F. Becchi, G. Metta, G. Sandini and D. G. Caldwell, Lower body design of the ̀iCub' a human-baby like crawling robot, IEEE-RAS Int. Conf. Humanoid Robots (Genova, Italy, 2006), pp. 450-455.
4. K. Nishiwaki, T. Sugihara, S. Kagami, F. Kanehiro, M. Inaba and H. Inoue, Design and development of research platform for perception-action integration in humanoid robot: H6, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS) (Takamatsu, Japan, 2000), Vol. 3, pp. 1559-1564.
5. K. Kaneko, F. Kanehiro, S. Kajita, K. Yokoyama, K. Akachi, T. Kawasaki, S. Ota and T. Isozumi, Design of prototype humanoid robotics platform for HRP, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (2002), Vol. 3, pp. 2431-2436.
6. M. Hackle, S. Schwope, J. Fritsch, B. Wrede and G. Sagerer, Humanoid robot platform suitable for studying embodied interaction, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS) (2005), pp. 2443-2448.
7. Y. Sakagami, R. Watanabe, C. Aoyama, S. Matsunaga, N. Higaki and K. Fujimura, The intelligent ASIMO: System overview and integration, IEEE/RSJ Int. Conf. Intelligent Robots and Systems (IROS) (2002), Vol. 3, pp. 2478-2483.
8. A. Bauer, D. Wollherr and M. Buss, Human-Robot collaboration: A survey, Int. J. H. R. 5(1) (2008) 47-66.
9. R. Yamazaki, S. Nishio, K. Ogawa, K. Matsumura, T. Minato, H. Ishiguro, T. Fujinami and M. Nishikawa, Promoting socialization of schoolchildren using a teleoperated android: An interaction study, Int. J. H. R. 10(1) (2013).
10. C. Liu, C. T. Ishi, H. Ishiguro, and N. Hagita, Generation of nodding, head tilting and gazing for human-robot speech interaction, Int. J. H. R. 10(1) (2013).
11. C. Pop, R. Simut, S. Pintea, J. Saldien, A. Rusu, D. David, J. Vanderfaeillie, D. Lefeber, and B. Vanderborght, Can the social robot probo help children with autism to identify situation-based emotions? A series of single case experiments, Int. J. H. R. 10(3) (2013).
12. S. L. Spitzer, Play in children with autism: Structure and experience, in Play in Occupational Therapy for Children, eds. L. D. Parham and L. S. Fazio, 2nd edn. (St. Louis, MO: Mosby Elsevier, 2008), pp. 351-374.
13. I. Iacono, H. Lehmann, P. Marti, B. Robins and K. Dautenhahn, Robots as social mediators for children with autism-a preliminary analysis comparing two different robotic platforms, in IEEE Int. Conf. Development and Learning (ICDL) (2011), Vol. 2, pp. 1-6.
14. S. Besio, Analysis of Critical Factors Involved in Using, Analysis of Critical Factors Involved in Using in Interactive Robots for Education and Therapy of Children with Disabilities (UNI Service, Trento, 2008).
15. WHO International Classification of Functioning Disability and Health (Geneva, World Health Organization, 2001).
16. L. Ding and A. M. Martinez, Modeling and recognition of the linguistic components in American sign language, Image Vis. Comput. 27(12) (2009) 1826-1844.
17. M. M. Zaki and S. I. Shaheen, Sign language recognition using a combination of new vision based features, Pattern Recognit. Lett. 32(4) (2011) 572-577.
18. H. Suk, B. Sin and S. Lee, Hand gesture recognition based on dynamic bayesian network framework, Pattern Recognit. 43(9) (2010) 3059-3072.
19. T. D. Nguyen and S. Ranganath, Facial expressions in american sign language: Tracking and recognition, Pattern Recognit. 45(5) (2012) 1877-1891.
20. M. P. Paulraj, S. Yaacob, M. S. Z. Azalan and R. Palaniappan, A phoneme based sign language recognition system using 2D moment invariant interleaving feature and neural network, in IEEE Student Conf. Research and Development (SCOReD) (2011), pp. 111-116.
21. J. Ohene-Djan and S. Naqvi, An adaptive WWW-based system to teach British sign language, IEEE Int. Conf. Advanced Learning Technologies (ICALT) (2005), pp. 127-129.
22. M. Jemni and O. Elghoul, Using ICT to teach sign language, IEEE Int. Conf. Advanced Learning Technologies (ICALT) (2008), pp. 995-996.
23. X. Xu, X. Wang, L. Yao, D. Zhang and H. Zhao, Avatars based Chinese sign language synthesis system, IEEE Int. Conf. Systems, Man and Cybernetics (2008), pp. 444-449.
24. N. Adamo-Villani, J. Doublestein and Z. Martin, The MathSigner: An interactive learning tool for American sign language, in Int. Conf. Information Visualisation (2004), pp. 713-716.
25. D. Jaffe, Evolution of mechanical fingerspelling hands for people who are deaf-blind, J. Rehabil. Res. Dev. 31 (1994) 236-244.
26. M. A. Hersh and M. A. Johnson, Assistive Technology for the Hearing-Impaired, Deaf and Deaf-Blind (Springer, 2003).
27. http://Spectrum.Ieee.Org/Automaton/Robotics/Humanoids/ Honda-Robotics-Unveils-Next-Generation-Asimo-Robot, Accessed on 2013.
28. www.cmu.ac.th/images/uploadfile/engnewsfile-100715102721.doc, Accessed on 19 July 2013.
29. T. Kanda, T. Hirano, D. Eaton and H. Ishiguro, Interactive robots as social partners and peer tutors for children: A field trial, J. Hum. Comput. Interact. 19(1-2) (2004) 61-84.
30. M. Nalin, I. Baroni, I. Kruijff-Korbayova, L. Canamero, M. Lewis, A. Beck, H. Cuayahuitl and A. Sanna, Children's adaptation in multi-session interaction with a humanoid robot, IEEE Int. Symp. Robot and Human Interactive Communication (RO-MAN) (2012), pp. 351-357.
31. H. S. Yoon and S. Y. Chi, Visual processing of rock, scissors, paper game for human robot interaction, Int. Joint Conf. SICE-ICASE (2006), pp. 326-329.
32. C. Chao, L. Jinhan, M. Begum and A. L. Thomaz, Simon plays Simon says: The timing of turn-taking in an imitation game, IEEE Int. Symp. Robot and Human Interactive Communication (RO-MAN) (2011), pp. 235-240.
33. C. Liu, K. Conn, N. Sarkar and W. Stone, Online affect detection and robot behavior adaptation for intervention of children with autism, IEEE Trans. Robot. 24(4) (2008) 883-896.
34. H. Kose, R. Yorganci, H. E. Algan and D. S. Syrdal, Evaluation of the robot assisted sign language tutoring using video-based studies, Int. J. Soc. Robot. 4(3) (2012) 273-283.
35. H. Kose and R. Yorganci, Tale of a robot: Humanoid robot assisted sign language tutoring, IEEE-RAS Int. Conf. Humanoid Robots (Bled, Slovenia, 2011), pp. 105-111.
36. N. Akalin, P. Uluer and H. Kose, iSpy-uSign: Humanoid assisted interactive sign language tutoring games, IEEE Int. Symp. Robot and Human Interactive Communication (RO-MAN) (Gyeongju, Korea, 2013), pp. 290-291.
37. N. Akalin and H. Kose, Humanoid robot and children companionship: An interactive sign language game, Advances in Robotics Research (ICARR) (Seoul, South Korea, 2013).
38. B. S. Ertugrul, H. Kivrak, E. Daglarli, A. Kulaglic, A. Tekelioglu, S. Kavak, A. Ozkul, R. Yorganci{dotless} and H. Kose, iSign: Interaction games for humanoid assisted sign language tutoring, Int. Workshop on Human-Agent Interaction (iHAI 2012) (Vilamoura, Algarve, Portugal, 2012).
39. B. S. Ertugrul, C. Gurpinar, H. Kivrak, A. Kulaglic and H. Kose, Gesture recognition for humanoid assisted interactive sign language tutoring, Int. Conf. Advances in Computer-Human Interactions (ACHI) (Nice, France, 2013).
40. B. S. Ertugrul, C. Gurpinar, H. Kivrak and H. Kose, Gesture recognition for humanoid assisted interactive sign language tutoring, Signal Processing and Communications Applications Conf. (SIU) (2013), pp. 1-4.
41. D. Gouaillier, V. Hugel, P. Blazevic, C. Kilner, J. Monceaux, P. Lafourcade, B. Marnier, J. Serre and B. Maisonnier, Mechatronic design of NAO humanoid, IEEE Int. Conf. Robotics and Automation (ICRA) (2009), pp. 769-774.
42. Aldebaran Robotics Choregraphe. [Online]. Available at http://www.aldebaran-robotics.com/en/programmable, Accessed on August 2013.
43. Vstone robotics [Online], http://www.vstone.co.jp/english/products.html.
44. Turkish Sign Language Dictionary v1.0. [Online]. Available at http://www.cmpe.boun.edu.tr/pilab/tidsozlugu.
45. N. Akalin, P. Uluer and H. Kose, Humanoid robots communicating with children using sign language: A nonverbal interaction game, IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO) (Tokyo, Japan, 2013).