Enabling composition-based video-conferencing for the home

IEEE Transactions on Multimedia

Volumn 13, Issue 5, 2011, Pages 869-881

  Jansen, Jack ^a   Cesar, Pablo ^a   Bulterman, Dick C A ^a   Stevens, Tim ^b   Kegel, Ian ^b   Issing, Jochen ^c  

^a CWI   (Netherlands)

^b BT Group   (United Kingdom)

^c UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Compression and coding; consumer electronics and entertainment; presentation of content in multimedia sessions; standards and related issues; videoconferencing and collaboration environments

Indexed keywords

ARCHITECTURAL COMPONENTS; ARCHITECTURAL DECISION; AUDIO-VISUAL CONTENT; COMPOSITING; CONTROL INTERFACES; EFFICIENT ENCODING; END TO END DELAY; FUNCTIONAL REQUIREMENT; HIGH QUALITY; MULTIPLE PEOPLE; PERFORMANCE CONSTRAINTS; PRESENTATION OF CONTENT IN MULTIMEDIA SESSIONS;

ARCHITECTURE; CONSUMER ELECTRONICS; TELEVISION STANDARDS;

VIDEO CONFERENCING;

EID: 80052930504     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2159369     Document Type: Conference Paper

References (44)

1. S. E. Poltrock and J. Grudin, "Videoconferencing: Recent experiments and reassessment, " in Proc. Annu. Hawaii Int. Conf. System Sciences, 2005, vol. 04.
2. A. L. Batcheller, B. Hilligoss, K. Nam, E. Rader, M. Rey-Babarro, and X. Zhou, "Testing the technology: Playing games with video conferencing, " in Proc. ACM CHI, 2007, pp. 849-852. (Pubitemid 47581671)
3. M. G. Ames, J. Go, J. Kaye, and M. Spasojevic, "Making love in the network closet: The benefits and work of family videochat, " in Proc. ACM CSCW, 2010, pp. 145-154.
4. D. S. Kirk, A. Sellen, and X. Cao, "Home video communication: Mediating 'closeness', " in Proc. ACM CSCW, 2010, pp. 135-144.
5. D. Williams, M. F. Ursu, P. Cesar, K. Bergström, I. Kegel, and J. Meenowa, "An emergent role for TV in social communication, " in Proc. EuroITV, 2009, pp. 19-28.
6. M. Baldi and Y. Ofek, "End-to-end delay analysis of videoconferencing over packet-switched networks, " IEEE/ACM Trans. Netw., vol. 8, no. 4, pp. 479-492, 2000.
7. D. Roberts, T. Duckworth, C. Moore, R. Wolff, and J. O'Hare, "Comparing the end to end latency of an immersive collaborative environment and a video conference, " in Proc. EEE/ACM Int. Symp. Distributed Simulation and Real Time Applications, 2009, pp. 89-94.
8. D. Gatica-Perez, "Automatic nonverbal analysis of social interaction in small groups: A review, " Image Vision Comput., vol. 27, no. 12, pp. 1775-1787, 2009.
9. M. Frantzis, P. Torres, and M. Ursu, Interaction Modelling Language and Reasoners for Interaction Moderation and Content Capture, TA2 project, Jul. 28, 2010.
10. S. Duffner, P. Motlicek, and D. Korchagin, "The TA2 database-A multi-modal database from home entertainment, " in Proc. Int. Conf. Signal Acquisition and Processing, 2011.
11. R. Kaiser, P. Torres, and M. Hoffernig, "The interaction ontology: Lowlevel cue processing in real-time group conversations, " in Proc. ACM Int. Workshop Events in Multimedia, 2010, pp. 29-34.
12. H. H. Baker, N. Bhatti, D. Tanguay, I. Sobel, D. Gelb, M. E. Goss, W. B. Culbertson, and T. Malzbender, "Understanding performance in coliseum, an immersive videoconferencing system, " ACM TOMCAP, vol. 1, no. 2, pp. 190-210, 2005.
13. M. Chen, "Design of a virtual auditorium, " in Proc. ACM Int. Conf. Multimedia, 2001, pp. 19-28. (Pubitemid 32962451)
14. Z. Yang, W. Wu, K. Nahrstedt, G. Kurillo, and R. Bajcsy, "Enabling multi-party 3D tele-immersive environments with viewcast, " ACM Trans. Multimedia Comput., Commun., Appl., vol. 6, no. 2, article number 7, 2010.
15. D. E. Ott and K. Mayer-Patel, "Coordinated multi-streaming for 3D tele-immersion, " in Proc. ACM Int. Conf. Multimedia, 2004, pp. 596-603. (Pubitemid 40211834)
16. S. Yarosh, K. M. Inkpen, and A. J. B. Brush, "Video playdate: Toward free play across distance, " in Proc. ACM CHI, 2010, pp. 1251-1260.
17. W. Gaver, A. Sellen, C. Heath, and P. Luff, "One is not enough: Multiple views in a media space, " in Proc. ACM CHI, 1993, pp. 335-341.
18. A. Ranjan, J. Birnholtz, and R. Balakrishnan, "Improving meeting capture by applying television production principles with audio and motion detection, " in Proc. ACM CHI, 2008, pp. 227-236.
19. F. Lampi, S. Kopf, and W. Effelsberg, "Automatic lecture recording, " in Proc. ACM Int. Conf. Multimedia, 2008, pp. 1103-1104.
20. D. T. Nguyen and J. Canny, "More than face-to-face: Empathy effects of video framing, " in Proc. ACM CHI, 2009, pp. 423-432.
21. N. Yamashita, K. Hirata, S. Aoyagi, H. Kuzuoka, and Y. Harada, "Impact of seating positions on group video communication, " in Proc. ACM CSCW, 2008, pp. 177-186.
22. O. Boyaci, A. Forte, S. A. Baset, and H. Schulzrinne, "vDelay:Atool to measure capture-to-display latency and frame rate, " in Proc. IEE ISM, 2009, pp. 194-200.
23. I. Han, H. Park, Y. Choi, and K. Park, "Four-way video conference and its session control based on distributed mini-MCU in home server, " in Proc. IEEE Int. Conf. Consumer Electronics, 2008, pp. 233-234.
24. H. M. Pinson, S. Wolf, and G. Cermak, "HDTV subjective quality of H.264 vs. MPEG-2, with and without packet loss, " IEEE Trans. Broadcast., vol. 56, no. 1, pp. 86-91, 2010.
25. M. Schnell et al., "Enhanced MPEG-4 low delay AAC-Low bitrate high quality communication, " in Proc. 122th AES Conv., 2007.
26. H. Schulzrinne et al., RFC 3550-RTP: A Transport Protocol for Real- Time Application, 2003. [Online]. Available: http://www.ietf.org/rfc/rfc3550.txt.
27. J. Postel, User Datagram Protocol, 1980, IETF STD 0006. 1980.
28. J. Issing et al., "Adaptive playout for VoIP based on the enhanced low delay AAC audio codec, " in Proc. 124th AES Conv., 2008.
29. Multipoint Control Units for Audiovisual Systems Using Digital Channels up to 1920 kbit/s, 1997, ITU-T Recommendation H.231.
30. R. Schultz-Amling et al., "Planar microphone array processing for the analysis and reproduction of spatial audio using directional audio coding, " in Proc. 124th AES Conv., 2008.
31. M. Kallinger, "Analysis and adjustment of planar microphone arrays for application in directional audio coding, " in Proc. 124th AES Conv., 2008.
32. V. Pulkki, "Spatial sound reproduction with directional audio coding, " J. Audio Eng. Soc., vol. 55, no. 6, pp. 503-516, 2007. (Pubitemid 47039715)
33. F. Kuech et al., "Acoustic echo suppression based on separation of stationary and non-stationary echo components, " in Proc. Int. Workshop Acoustic Echo and Noise Control (IWAENC), 2008.
34. A. Favrot et al., "Acoustic echo control based on temporal fluctuation of short-time spectra, " in Proc. Int. Workshop Acoustic Echo and Noise Control (IWAENC), 2008.
35. Report on the Verification Test of MPEG-4 Enhanced Low Delay AAC, ISO/IEC JTC1/SC29/WG11, N10032, 2008.
36. Method for the Subjective Assessment of Intermediate Quality Levels of Coding Systems, ITU-R Recommendation BS.1534.
37. "Listening tests concerning reference codecs for EVS, " in Proc. Deutsche Telekom AG, TSG-SA4#59 Meeting, Prague, Czech Republic, Jun. 21-24, 2010. [Online]. Available: ftp://ftp.3gpp.org/tsg-sa/WG4-CODEC/TSGS4-59/ Docs/S4-100479.zip.
38. A. P. Markopoulou, F. A. Tobagi, and M. J. Karam, "Assessing the quality of voice communications over internet backbones, " IEEE/ACM Trans. Netw., vol. 11, no. 5, pp. 747-760, 2003.
39. The E-Model, A Computational Model for Use in Transmission Planning, 2000, ITU-T Recommendation.
40. One-Way Transmission Time, 2003, ITU-T Recommendation.
41. D. Bulterman et al., Synchronized Multimedia Integration Language (SMIL 3.0). W3C, 2008. [Online]. Available: http://www.w3.org/TR/SMIL/.
42. B. Rogge, J. Bekaert, and R. Van de Walle, "Timing issues in multimedia formats: Review of the principles and comparison of existing formats, " IEEE Trans. Multimedia, vol. 6, no. 6, pp. 910-924, Dec. 2004.
43. R. Kernchen et al., "Intelligent multimedia presentation in ubiquitous multidevice scenarios, " IEEE MultiMedia, vol. 17, no. 2, pp. 52-63, Apr.-Jun. 2010.
44. J. Jansen and D. C. Bulterman, "Enabling adaptive time-based web applications with SMIL state, " in Proc. ACMDocEng, 2008, pp. 18-27.