Multimodal communication for human-friendly robot partners in informationally structured space

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 42, Issue 6, 2012, Pages 1142-1151

  Kubota, Naoyuki ^a   Toda, Yuichiro ^a  

^a TOKYO METROPOLITAN UNIVERSITY   (Japan)

Author keywords

Computational intelligence; human robot interaction; information services; intelligent robots; ubiquitous computing

Indexed keywords

COGNITIVE CAPABILITY; COLOR IMAGES; CONVERSATION SYSTEMS; DISTANCE INFORMATION; ENVIRONMENTAL SYSTEMS; HUMAN BEHAVIORS; HUMAN DETECTION; HUMAN HANDS; HUMAN-FRIENDLY; INTEGRATION METHOD; MEASUREMENT RANGE; MULTI-LAYERED; MULTIMODAL COMMUNICATIONS; SPIKING NEURAL NETWORKS; TOUCH INTERFACES;

ARTIFICIAL INTELLIGENCE; COGNITIVE SYSTEMS; HUMAN COMPUTER INTERACTION; INFORMATION SERVICES; INTELLIGENT ROBOTS; NEURAL NETWORKS; ROBOTS; UBIQUITOUS COMPUTING;

GESTURE RECOGNITION;

EID: 84871766484     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2012.2213810     Document Type: Article

References (34)

1. D. Sperber and D. Wilson, Relevance: Communication and Cognition: U.K.: Blackwell Publishing Ltd, 1995.
2. N. Kubota and A. Yorita, "Structured learning for partner robots based on natural communication," in Proc. IEEE Conf. Soft Comput. Ind. Appl., Jun. 2008, pp. 303-308.
3. H. Kimura, N. Kubota, and J. Cao, "Natural communication for robot partners based on computational intelligence for edutainment," in Proc. Mecatronics Congr., 2010, pp. 610-615.
4. N. Kubota and A. Yorita, "Topological environment reconstruction in informationally structured space for pocket robot partners," in Proc. IEEE Int. Symp. Comput. Intell. Rob. Autom., Dec. 2009, pp. 165-170.
5. T. Obo, N. Kubota, and B. H. Lee, "Localization of human in informa-tionally structured space based on sensor networks," in Proc. IEEE World Congr. Comput. Intell., 2010, pp. 2215-2221.
6. D. Preuveneers, J. V. Bergh, D. Wagelaar, A. Georges, P. Rigole, T. Clerckx, Y. Berbers, K. Coninx, V. Jonckers, and K. D. Bosschere, "Towards an extensible context ontology for Ambient Intelligence," in EUSAI 2004 (Lecture Notes in Computer Science vol 3295), P. Markopoulos, B. Eggen, E. Aarts, and J. L. Crowley, Eds. Heidelberg, Germany: Springer, 2004, pp. 148-159. (Pubitemid 39743848)
7. W. J. Kaiser, G. J. Pottie, M. Srivastava, G. S. Sukhatme, J. Villasenor, and D. Estrin, "Networked infomechanical systems (NIMS) for ambient intelligence," Center for Embedded Networked Sensing, UC, Los Angeles, Tech. Rep. CENS TR 0031, Dec. 2003.
8. A. Mainwaring, J. Polastre, R. Szewczyk, and D. Culler, "Wireless sensor networks for habitat monitoring," in Proc. 1st ACM Int. Workshop Wireless Sensor Netw. and Appl., 2002, pp. 88-97.
9. A. Cerpa, J. Elson, D. Estrin, L. Girod, M. Hamilton, and J. Zhao, "Habitat monitoring: Application driver for wireless communications technology," in Proc. ACM SIGCOMM Workshop on Data Commun. in Latin America and the Caribbean, 2001, pp. 20-41. (Pubitemid 32865521)
10. F. Ingelrest, G. Barrenetxea, G. Schaefer, M. Vetterli, O. Couach, and M. Parlange, "Sensorscope: Application-specific sensor network for environmental monitoring," ACM Trans. Sen. Netw., vol. 6, no. 2, pp. 1-32, 2010.
11. J. Zhou and J. Shi, "A comprehensive multi-factor analysis on RFID localization capability," Adv. Eng. Inf., vol. 25, pp. 32-40, 2011.
12. N. Li and B. Becerik-Gerber, "Performance-based evaluation of RFID-based indoor location sensing solutions for the built environment," Adv. Eng. Inf., vol. 25, pp. 535-546, 2011.
13. T. Jeng, "Toward a ubiquitous smart space design framework," J. Inf. Sci. Eng., vol. 25, pp. 675-686, 2009.
14. B. Johanson, A. Fox, and T. Winograd, "The interactive workspaces project: experiences with ubiquitous computing rooms," IEEE Pervasive Comput., vol. 1, no. 2, pp. 71-78, Apr. 2002.
15. K. Romer, T. Schoch, F. Mattern, and T. Dubendorfer, "Smart identification frameworks for ubiquitous computing applications," Wireless Netw., vol. 10, no. 6, pp. 689-700, Dec. 2004.
16. N. Kubota and K. Nishida, "Cooperative perceptual systems for partner robots based on sensor network," Int. J. Comput. Sci. Network Secur., vol. 6, no. 11, pp. 19-28, Nov. 2006.
17. J.-H. Kim, Y.-D. Kim, and K.-H. Lee, "The third generation of robotics: Ubiquitous robot," in Proc. 2nd Int. Conf. Autonom. Robots Agents, 2004, pp. 1-12.
18. N. Kubota, "Cognitive development of partner robots based on interaction with people," in Proc. Joint 4th Int. Conf. Soft Computing and Intelligent Systems and Int. Symp. Advanced Intell. Syst., 2008, pp. 820-825. [CD-ROM].
19. N. A. Mirza, C. L. Nehaniv, K. Dautenhahn, and R. te Boekhorst, "Using temporal information distance to locate sensorimotor experience in a metric space," in Proc. IEEE Congr. Evolutionary Comput., Sep. 2005, pp. 150-157. (Pubitemid 41495850)
20. TOYOTA Partner Robots, http://www.toyota.co.jp/jp/special/robot/, 2007.
21. M. Tomono and S. Yuta, "Object-based localization and mapping using loop constraints and geometric prior knowledge," in Proc. Int. Conf. Rob. Autom., Sep. 2003, pp. 862-867.
22. N. Kubota, D. Hisajima, F. Kojima, and T. Fukuda, "Fuzzy and neural computing for communication of a partner robot," J. Multiple-Valued Logic Soft Comput., vol. 9, no. 2, pp. 221-239, 2003.
23. N. Kubota, Y. Ito, M. Abe, and H. Kojima, "Computational intelligence for natural communication of partner robots," in Proc 5th Asian Symp. Applied Electromagnetics and Mechanics, Technical Section B-11, 2005.
24. N. Kubota, "Computational intelligence for structured learning of apartner robot based on imitation," Inf. Sci., vol. 171, pp. 403-429, 2005. (Pubitemid 40467143)
25. N. Kubota, Y. Nojima, F. Kojima, and T. Fukuda, "Multiple fuzzy state-value functions for human evaluation through interactive trajectory planning of a partner robot," Soft Comput., vol. 10, no. 10, pp. 891-901, 2006. (Pubitemid 43792835)
26. W. Gerstner, "Spiking neurons," in Pulsed Neural Networks, W. Maass and C. M. Bishop, Eds. Cambridge, MA: MIT Press, 1999, ch. 1, pp. 3-53.
27. W. Gerstner and W. M. Kistler, Spiking Neuron Models. Cambridge, U.K.: Cambridge Univ. Press, 2002.
28. T. Obo, N. Kubota, K. Taniguchi, and T. Sawaya, "Human localization based on spiking neural network in intelligent sensor networks," in Proc. IEEE Symp. Ser. Comput. Intell., Paris, France, Apr. 11-15, 2011, pp. 125-130.
29. Create System Development Co., Ltd., http://www.createsystem.co.jp/, 2005.
30. Nuance Mobile Developer Program, http://dragonmobile.nuancemobile- developer.com/public/index.php, 2012.
31. OpenCV, http://sourceforge.net/projects/opencvlibrary/, 2012.
32. OpenNI, http://www.openni.org/, 2012.
33. W. Maass and C. M. Bishop, Pulsed Neural Networks. Cambridge, MA: MIT Press, 1999.
34. D. Tang and N. Kubota, "Information support system based on sensor networks," in Proc. World Autom. Congr, 2010.