Capture, recognition, and visualization of human semantic interactions in meetings

2010 IEEE International Conference on Pervasive Computing and Communications, PerCom 2010

Volumn , Issue , 2010, Pages 107-115

  Yu, Zhiwen ^a   Yu, Zhiyong ^a   Aoyama, Hideki ^b   Ozeki, Motoyuki ^c   Nakamura, Yuichi ^b  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b KYOTO UNIVERSITY   (Japan)

^c KYOTO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Human interaction; Interaction capture; Interaction recognition; Smart meeting; Visualization

Indexed keywords

FLOW VISUALIZATION; GRAPHICAL USER INTERFACES; SEMANTICS; SUPPORT VECTOR MACHINES; UBIQUITOUS COMPUTING; VIDEO CAMERAS; VISUALIZATION;

COLLABORATIVE APPROACH; HUMAN INTERACTIONS; INTERACTION CAPTURE; INTERACTION RECOGNITION; MULTIPLE SENSORS; PHYSICAL INTERACTIONS; SEMANTIC INTERACTIONS; SMART MEETING;

SPEECH RECOGNITION;

EID: 77956424560     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/percom.2010.5466987     Document Type: Conference Paper

References (46)

1. Yu, Z. and Nakamura, Y. Smart Meeting Systems: A Survey of State-of-the-Art and Open Issues. ACM Computing Surveys, 42(2), 2010.
2. Dey, A K., Salber, D., Abowd, G. D., and Futakawa, M. The Conference Assistant: Combining Context-Awareness with Wearable Computing, In Proc. ISWC'99, 21-28.
3. Sumi, Y. and Mase, K. Digital Assistant for Supporting Conference Participants: An Attempt to Combine Mobile, Ubiquitous and Web Computing. In Proc. Ubicomp 2001, 156-175.
4. Chen, H., Finin, T., and Joshi, A. A Context Broker for Building Smart Meeting Rooms. In Proc. of the Knowledge Representation and Ontology for autonomous systems symposium (AAAI spring symposium), AAAI, 2004, 53-60.
5. Koike, H., Nagashima, S., Nakanishi, Y., and Sato, Y. EnhancedTable: Supporting a Small Meeting in Ubiquitous and Augmented Environment, In Proc. PCM 2004,97-104.
6. Chiu, P., Kapuskar, A., Reitmeier, S., and Wilcox, L., Room with a Rear View: Meeting Capture in a Multimedia Conference Room, IEEE Multimedia, 7(4), 2000, 48-54.
7. Richter, H., Abowd, G. D., Geyer W., Fuchs, L., Daijavad, S., and Poltrock, S. Integrating Meeting Capture within a Collaborative Team Environment. In Proc. Ubicomp 2001, 123-138.
8. Ark, W. S. and Selker, T. A look at human interaction with pervasive computers. IBM Systems Journal, 38(4), 1999, 504-507 (Pubitemid 30503263)
9. Vapnik, V. N. The Nature of Statistical Leaming Theory. Springer Verlag, Heidelberg, DE, 1995.
10. Ahmed, S., Sharmin, M., and Ahmed, S. I. A Smart Meeting Room with Pervasive Computing Technologies. In Proc. SNPD/SAWN'05, IEEE Computer Society Press (2005), 366-371.
11. Mikic, I., Huang, K., and Trivedi, M. Activity Monitoring and Summarization for an Intelligent Meeting Room. IEEE Workshop on Human Motion, 2000, 107-112.
12. Kim, N., Han, S., and Kim, J. W. Design of Software Architecture for Smart Meeting Space. In Proc. PerCom 2008, IEEE Press (2008), 543-547.
13. Stiefelhagen, R., Chen, X., and Yang, J., Capturing Interactions in Meetings with Omnidirectional Cameras. International Journal of Distance Education Technologies, 3(3), 2005, 34-47. (Pubitemid 40795443)
14. Nijholt, A., Rienks, R. J., Zwiers, J., and Reidsma, D. Online and Offline Visualization of Meeting Information and Meeting Support. The Visual Computer, 22(12), 2006, 965-976. (Pubitemid 44769433)
15. Kim, T., Chang, A., Holland, L., and Pentland, A. Meeting Mediator: Enhancing Group Collaboration using Sociometric Feedback. In Proc. CSCW 2008, 457-466.
16. Sumi, Y., et al. Collaborative capturing, interpreting, and sharing of experiences. Personal and Ubiquitous Computing, 11(4), 2007, 265-271. (Pubitemid 46523065)
17. DiMicco, J. M., et al.: The Impact of lncreased Awareness While Face-to-Face. Human-Computer Interaction, 22(1), 47-96 (2007)
18. Otsuka, K., Sawada, H., and Yamato, J. Automatic Inference of Cross-modal Nonverbal Interactions in Multiparty Conversations. In Proc. ICMI 2007, 255-262.
19. Dielmann, A. and Renals, S. Dynamic Bayesian Networks for Meeting Structuring. In Proc. ICASSP 2004, 629-632.
20. McCowan, I., Gatica-Perez, D., Bengio, S., Lathoud, G., Bamard, M., and Zhang, D. Automatic Analysis of Multimodal Group Actions in Meetings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3), 2005, 305-317. (Pubitemid 40377324)
21. Rybski, P. E. and Veloso, M. M. Using Sparse Visual Data to Model Human Activities in Meetings. In Proc. Of IJCAI Workshop on Modeling Other Agentsfrom Observations (MOO 2004).
22. Hillard, D., Ostendorf, M., and Shriberg, E. Detection of Agreement vs. Disagreement in Meetings: Training with Unlabeled Data. In Proc. HLTNAACL 2003, 34-36.
23. Tomobe, H. and Nagao, K. Discussion Ontology: Knowledge Discovery from Human Activities in Meetings. In Proc. JSAI2006, 33-41.
24. Garg, N. P., Favre, S., Salamin, H., Tur, D. H., and Vinciarelli, A. Role Recognition for Meeting Participants: an Approach Based on Lexical Information and Social Network Analysis. In Proc. ACM Multimedia 2008, 693-696.
25. Searle, J. Speech Acts, Cambridge University Press, 1969.
26. Waibel, A, Bett, M., and Finke, M. Meeting Browser: Tracking and Summarizing Meetings. Proc. of the Broadcast News Transcription and Understanding Workshop, Lansdowne, Virginia, February 1998, 281-286.
27. Colbath, S. and Kubala, F. Rough'n'Ready: A Meeting Recorder and Browser. In Proc. of the Perceptual User Interface Conference, San Francisco, CA, November 4-6, 1998, 220-223.
28. Wellner, P., Flynn, M., and Guillemot, M. Browsing Recorded Meetings with Ferret. Proc. of the First International Workshop on Machine Learning for Multimodal Interaction (MLMI'04), Martigny, Switzerland, June 21-23, 2004, 12-21.
29. Geyer W., Richter, H., and Abowd, G. D. Towards a Smarter Meeting Record - Capture and Access of Meetings Revisited. Multimedia Tools and Applications, 27(3), 2005, 393-410. (Pubitemid 43060851)
30. Jaimes, A., Omura, K., Nagamine, T., and Hirata, K. Memory Cues for Meeting Video Retrieval. The first ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE'04), New York, NY, USA, October 15, 2004, 74-85.
31. Junuzovic, S., Hegde, R., Zhang, Z., Chou, P. A., Liu, Z., and Zhang, C. Requirements and Recommendations for an Enhanced Meeting Viewing Experience. In Proc. of ACM Multimedia 2008, 539-548.
32. Araki, M., Itoh, T., Kumagai, T., and Ishizaki, M. Proposal of a standard utteranceunit tagging scheme. Journal of Japanese Society for artificial intelligence, 14(2), 1999, 251-260.
33. PhaseSpace IMPULSE system. http://www.phasespace.com/.
34. Julius speech recognition engine. http://julius.sourceforge.jp/en/.
35. Rabiner, L. A tutorial on Hidden Markov Models and selected applications in speech recognition. In Proc. IEEE, 77(2),1989, 257-286.
36. Kipp, M. Anvil - A Generic Annotation Tool for Multimodal Dialogue. In Proc. Eurospeech 2001, 1367-1370.
37. Hsu, C. W., Chang, C. C., and Lin, C. J. A practical guide to support vector classification. Technical Report, 2005.
38. Chang, C. C., and Lin, C. J. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
39. Hackman, J. R. Groups That Work (And Those That Don't). Jossey-Bass, San Francisco, 1990.
40. Pianesi, F., Zancanaro, M., Not, E., Leonardi, C., Falcon, V., and Lepri, B. Multimodal support to group dynamics. Personal and Ubiquitous Computing, 12(3), 2008, 181-195
41. Yu, H., Finke, M., and Waibel, A Progress in Automatic Meeting Transcription. Proc. of 6th European Coriference on Speech Communication and Technology (Eurospeech-99), September 5-9, 1999, Budapest, Hungary, Vol. 2, 695-698.
42. Gross, R., Yang, J., and Waibel, A. Face Recognition in a Meeting Room. In Proc. of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000, 294-299.
43. Jaimes, A. and Miyazaki, J. Building a Smart Meeting Room: From Infrastructure to the Video Gap (Research and Open Issues), the 21st International Conference on Data Engineering Workshops (ICDEW 05), Tokyo, Japan, April 5-8, 2005, 1173-1182.
44. Stajano, F. Security for Ubiquitous Computing, Wiley, 2002.
45. Moncrieff, S., Venkatesh, S., and West, G. Privacy and the access of information in a smart house environment. In Proc. of ACM Multimedia, 2007, 671-680.
46. Brown, R. Group Polarization in Social Psychology, 2nd ed., Free Press, 1986.