Towards improving social communication skills with multimodal sensory information

IEEE Transactions on Industrial Informatics

Volumn 10, Issue 1, 2014, Pages 323-330

  Chen, Jingying ^b   Chen, Dan ^a   Li, Xiaoli ^c   Zhang, Kun ^b  

^a CHINA UNIVERSITY OF GEOSCIENCES   (China)

^b CENTRAL CHINA NORMAL UNIVERSITY   (China)

^c BEIJING NORMAL UNIVERSITY   (China)

Author keywords

Behavior detection; intelligent systems; multimodal sensory information; social communication skills

Indexed keywords

COMMUNICATION; GESTURE RECOGNITION; INTELLIGENT SYSTEMS;

AFFECTIVE STATE DETECTION; BEHAVIOR DETECTION; FOCUS OF ATTENTION; GESTURE DETECTIONS; MULTI-CAMERA SURVEILLANCE; NATURAL INTERACTIONS; SENSORY INFORMATION; SOCIAL COMMUNICATIONS;

EDUCATION;

EID: 84898427098     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2013.2271914     Document Type: Article

References (21)

1. M. S. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, Fully automatic facial action recognition in spontaneous behavior in Proc. 7th Int. Conf. Automatic Face Gesture Recognit. (FGR), 2006, pp. 223-230. (Pubitemid 44711354)
2. S. Bardins, T. Poitschke, and S. Kohlbecher, Gaze-based interaction in various environments in Proc. 1st ACM Workshop Vis. Netw. Beh. Anal., Vancouver, B.C., Canada, Oct. 2008, pp. 47-54, 2008.
3. C.-C. Chang and C.-J. Lin, LIBSVM: A library for support vector machines ACM Trans. Intell. Syst. Technol., vol. 27, no. 2, pp. 1-27, 2011.
4. D. F. Dementhon and L. S. Davis, Model based object pose in 25 lines of code Int. J. Comput. Vis., vol. 15, no. 1-2, pp. 123-141, 1995.
5. M. A. Fischler and R. C. Bolles, Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography Comm. ACM, vol. 24, no. 6, pp. 381-395, Jun. 1981.
6. M. E. Foster, K. Avramides, S. Bernardini, J. Chen, C. Frauenberger, O. Lemon, and K. Porayska-Pomsta, Supporting children's social communication skills through interactive narratives with virtual characters in Proc. ACM Multimedia, Florence, Italy, Oct. 2010, pp. 1111-1114.
7. Q. Ji and Z. Zhu, Non-intrusive eye and gaze tracking for natural human computer interaction MMI-Interaktiv J., no. 6, 2003.
8. R. Jordan and G. Jones, Meeting the Needs of Children with Autistic Spectrum Disorder. London, U.K.: Fulton, 1999.
9. T. Kanade, J. Cohn, and Y. Tian, Comprehensive database for facial expression analysis in Proc. Int. Conf. Automatic Face Gesture Recognit., 2000, pp. 46-53.
10. I. Kotsia and I. Pitas, Facial expression recognition in image sequences using geometric deformation features and support vector machines IEEE Trans. Image Process., vol. 16, no. 1, pp. 172-187, Jan. 2007. (Pubitemid 46437480)
11. H. Liu, Exploring human hand capabilities into embedded multifingered object manipulation IEEE Trans. Ind. Inf., vol. 7, no. 3, pp. 389-398, Aug. 2011.
12. P.Lucey, J. Cohn,T.Kanade, J. Saragih, Z. Ambadar, and I.Matthews, The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression in Proc. 2010 IEEE Comput. Vis. Pattern Recognit. Workshops (CVPRW), 2010, pp. 94-101.
13. S. Milborrow and F. Nicolls, Locating facial features with an extended active shape model in Proc. 10th Eur. Conf. Comput. Vis.: Part IV, 2008, pp. 504-513, 2008.
14. D.Murray andW. Lawson,, R. Cigman, Ed., Inclusion Through Technology for Autistic Children, In Included or Excluded: The Challenge of Mainstream for Some SEN Children. London, U.K.: Routledge, 2006.
15. C. Peters, S. Asteriadis, and K. Karpouzis, Investigating shared attention with a virtual agent using a gaze-based interface J. Multimodal User Interfaces, vol. 3, no. 1-2, pp. 119-130, 2010.
16. R. Ruddarraju, A. Haro, and I. Essa, Fast multiple camera head pose tracking presented at the 16th Int. Conf. Vis. Interface, Halifax, Canada, Jun. 2003.
17. C. L. Sidner, C. D. Kidd, C. Lee, and N. Lesh, Where to look: A study of human-robot interaction in Proc. Int. Conf. Intell. User Interfaces, Funchal, Madeira, Portugal, Jan. 2004, pp. 78-84. (Pubitemid 40673705)
18. M. F. Valstar and M. Pantic, Fully automatic recognition of the temporal phases of facial actions. IEEE Trans. Sys., Man, Cybern., B: Cybern., vol. 42, no. 1, pp. 28-43, Feb. 2012.
19. P. Viola and M. Jones, Robust real time object detection in Proc. 2nd Int. Workshop Statist. Comput. Theories Vis.-Model., Learning, Comput. Sampling, Vancouver, Canada, Jul. 2001.
20. L. Vygotsky, Interaction between learning and development in Mind in Society, M. Cole, Ed. et al. Cambridge, MA, USA: Harvard Univ. Press, 1978.
21. Z. Zhang, A flexible new technique for camera calibration IEEE Trans. Pattern Anal.Mach. Intell., vol. 22, no. 11, pp. 1330-1334, Nov. 2000.