LIVE: An integrated production and feedback system for intelligent and interactive TV broadcasting

IEEE Transactions on Broadcasting

Volumn 57, Issue 3, 2011, Pages 646-661

  Jiang, Jianmin ^a   Köhler, Joachim ^b   Williams, Carmen Mac ^c   Zaletelj, Janez ^d   Güntner, Georg ^e   Horstmann, Heike ^b   Ren, Jinchang ^a   Löffler, Jobst ^b   Weng, Ying ^f  

^a UNIVERSITY OF BRADFORD   (United Kingdom)

^b FRAUNHOFER GESELLSCHAFT   (Germany)

^c Kunsthochschule fur Medien Koln   (Germany)

^d UNIVERSITY OF LJUBLJANA   (Slovenia)

^e Saltzburg Research   (Austria)

^f IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Intelligent TV; interactive TV; semantics based video processing

Indexed keywords

BEHAVIOR ANALYSIS; CONTENT ANALYSIS; CONTENT PRODUCTION; FEEDBACK SYSTEMS; FIELD TRIAL; FUNDAMENTAL CONCEPTS; INTEGRATED PRODUCTION; INTEGRATED PROJECT; INTELLIGENT TV; INTERACTIVE TV; OLYMPIC GAMES; REAL TIME INTERACTIONS; RESEARCH ACTIVITIES; TV BROADCASTING; TV PROGRAMS; VIDEO PROCESSING;

DIGITAL TELEVISION; SEMANTICS; USER INTERFACES;

TELEVISION BROADCASTING;

EID: 80052061069     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2011.2158252     Document Type: Article

References (64)

1. S. Grünvogel, C. MacWilliams, G. Trogemann, and R. Wages, "Video composer and live video conductor: Future professions for the interactive digital broadcasting industry", in Proc. 4th European Conference on Interactive Television (EuroITV), Athens, Greece, 2006, pp. 32-38.
2. R. Wages, S. Grünvogel, J. Zaletelj, C. Mac Williams, and G. Trogemann, "Future live iTV production: Challenges and opportunities", in Proc. 2nd Int. Conf. Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS), Leeds, UK, 2006, pp. 325-328. (Pubitemid 351308000)
3. M. Eltringham, "Citizen journalists challenge BBC", BBC NewsWatch, April 11, 2006 [Online]. Available: http://news.bbc.co.uk/newswatch/ ifs/hi/newsid-4900000/newsid-4900400/4900444.stm
4. "CNN" [Online]. Available: http://edition. cnn. com/2009/US/05/01/week.in. irpt/index.html
5. "NBC" [Online]. Available: http://www.nbcolympics.com/tv-and- online-listings/online.html
6. "Sky news HD [Online]. Available: http://news.sky.com/skynews/UKNews
7. D. Melendi, R. Garcia, X. G. Paneda, and V. Garcia, "Multivariate distributions for workload generation in video on demand systems", IEEE Commun. Lett., vol. 13, no. 5, pp. 348-350, 2009.
8. H. Shirazi, J. Cosmas, T. J. Owens, Y. H. Song, and A. Centonza, "A QoS monitoring system in a heterogeneous multi-domain DVB-H platform", IEEE Trans. Broadcast., vol. 15, no. 1, pp. 124-131, Mar. 2009.
9. M. Lopez-Nores and Y. Blanco-Fernandez et al., "Receiver-side semantic reasoning for digital TV personalization in the absence of return channels", Multimedia Tools Appl., vol. 41, no. 3, pp. 407-436, 2009.
10. R. Kaiser, M. Hausenblas, and M. Umgeher, "Metadata-driven interactive web video assembly", Multimedia Tools Appl., vol. 41, no. 3, pp. 237-467, 2009.
11. I. Mas, V. Berggren, R. Jana, J. Murray, and C. W. Rice, "IMS-TV: An IMS-based architecture for interactive, personalized IPTV", IEEE Communications Magazine, vol. 46, no. 11, pp. 156-163, Nov. 2008.
12. H. Jabbar, T. Jeong, J. Hwang, and G. Park, "Viewer identification and authentication in IPTV using RFID technique", IEEE Trans. Consumer Electronics, vol. 54, no. 1, pp. 105-109, Feb. 2008. (Pubitemid 351479611)
13. T. Yoshihisa, M. Tsukamoto, and S. Nishio, "A broadcasting scheme considering units to play continuous media data", IEEE Trans. Broadcast., vol. 53, no. 3, pp. 628-636, Sep. 2007.
14. Y. P. Huang, L. W. Hsu, and F. E. Sandnes, "An intelligent subtitle detection model for locating television commercials", IEEE Trans. Systems, Man and Cybernetics, Part B-Cybernetics, vol. 37, no. 2, pp. 485-492, April 2007.
15. S. J. Lee, S. Lee, K. W. Kim, and J. S. Seo, "Personal and mobile satellite DMB services in Korea", IEEE Trans. Broadcasting, vol. 53, no. 1, pp. 179-187, Mar. 2007, Part2. (Pubitemid 46380021)
16. J. Kim, H. Kim, and K. Park, "Towards optimal navigation through video content on interactive TV", Interacting With Computers, vol. 18, no. 4, pp. 723-746, Jul. 2006. (Pubitemid 43903143)
17. R. Goularte, M. D. G. C. Pimentel, and E. D. S. Moreira, "Contextaware support in structured documents for interactive-TV", Multimedia Syst., vol. 11, no. 4, pp. 367-382, Apr. 2006.
18. W. F. Poon, K. T. Lo, and J. Feng, "Provision of continuous VCR functions in interactive broadcast VoD systems", IEEE Trans. Broadcast., vol. 51, no. 4, pp. 460-472, Dec. 2005.
19. B. Nikolaus, J. Ott, C. Bormann, and U. Bormann, "Generalized greedy broadcasting for efficient media-on-demand transmissions", IEEE Trans. Broadcast., vol. 51, no. 3, pp. 354-359, Sep. 2005. (Pubitemid 41343358)
20. W. Behrendt, N. Arora, T. Bürger, and R. Westenthaler, "A management system for distributed knowledge and content objects", in Proc. 2nd Int. Conf. Automated Production of Cross Media Content for Multi-channel Distribution, Leeds, UK, December 12-15, 2006, 2006.
21. S. Boll and W. Klas, "ZYX-A semantic model for multimedia documents and presentations", in Proc. 8th IFIP Conf. Data Semantics (DS-8): 'Semantic Issues in Multimedia Systems', Rotorua, New Zealand, 1999 [Online]. Available: http://citeseer.ist.psu.edu/boll99semantic.html
22. T. Bürger and R. Westenthaler, "Mind the gap-requirements for the combination of content and knowledge", in Proc. 1st Int. Conf. Semantic and Digital Media Technol. (SAMT), Athens, Greece, 2006.
23. A. Gangemi and P. Mika, "Understanding the semantic Web through descriptions and situations", in In: On The Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE, 2003, pp. 689-706.
24. G. Güntner, T. Bürger, D. Glachs, and R. Westenthaler, "Bringing intelligence to iTV: The intelligent media framework", in Proc. 6th European Conf. EuroITV, Salzburg, Austria, 2008.
25. G. Güntner, D. Glachs, and R. Westenthaler, "Utilizing semantics in the production of iTV shows", in Proc. European Semantic Web Conf. (ESWC), Heraklion, Greece, 2009, pp. 841-845.
26. C. A. Macnee and W. Behrendt et al., "Presenting dynamically expandable hypermedia", Inf. Softw. Technol., vol. 37, no. 7, pp. 339-350, 1995.
27. C. Masolo et al., "The WonderWeb library of foundational ontologies preliminary report", (WonderWeb Deliverable D17) 2002 [Online]. Available: http://wonderweb.semanticweb.org/deliverables/documents/D17.pdf, Available online, (last visited: 31.05.2009)
28. L.-Y. Duan, M. Xu, Q. Tian, C.-S. Xu, and J. S. Jin, "A unified framework for semantic shot classification in sports video", IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1066-1083, 2005. (Pubitemid 41789119)
29. S.-F. Chang and A. Vetro, "Video adaptation: Concepts, technologies, and open issues", Proc. IEEE, vol. 93, no. 1, pp. 148-158, 2005. (Pubitemid 40851248)
30. A. Hanjalic and L.-Q. Xu, "Affective video content representation and modelling", IEEE Trans. Multimedia, vol. 7, no. 1, pp. 143-154, 2005. (Pubitemid 40178377)
31. N. Dimitrova, "Context and memory in multimedia content analysis", IEEE Multimedia, vol. 11, no. 3, pp. 7-11, 2004.
32. C. Cotsaces, N. Nikolaidis, and I. Pitas, "Video shot detection and condensed representation: A review", IEEE Signal Proc. Mag., vol. 23, no. 2, pp. 28-37, 2006.
33. Z. Rasheed and M. Shah, "Detection and representation of scenes in videos", IEEE Trans. Multimedia, vol. 7, no. 6, pp. 1097-1105, 2005. (Pubitemid 41789121)
34. C. Kim and J. N. Hwang, "Object-based video abstraction for video surveillance systems", IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1128-1138, 2002.
35. H. J. Zhang, S. Y. Low, and S. W. Smoliar, "Video parsing and browsing using compressed data", Multimedia Tools and Apps., vol. 1, no. 1, pp. 89-111, 1995.
36. V. Kobla, D. Doermann, and K.-I. Lin, "Archiving, indexing, and retrieval of video in the compressed domain", In: Proc. SPIE, vol. 2916, pp. 78-89, 1996.
37. J. Ren, J. Jiang, and J. Chen, "Shot boundary detection in MPEG videos using local and global indicators", IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 8, pp. 1234-1238, 2009.
38. H. Fang, J. Jiang, and Y. Feng, "A fuzzy logic approach for detection of video shot boundaries", Pattern Recognitions, vol. 39, no. 11, pp. 2092-2100, 2006. (Pubitemid 44175452)
39. Y. Weng and J. Jiang, "Real-time and automatic close up retrieval from compressed videos", Int. J. Autom. Comput., vol. 5, no. 2, pp. 198-201, 2008. (Pubitemid 351725928)
40. J. Jiang, Y. Weng, and P. Li, "Dominant colour extraction in DCT domain", Image Vis. Comput., vol. 24, pp. 1269-1277, 2006. (Pubitemid 44537529)
41. J. Jiang and G. Feng, "Robustness analysis of facial image description in DCT domain", Electron. Lett., vol. 43, no. 24, pp. 1354-1355, 2007.
42. J. Ren, J. Jiang, J. Chen, and S. S. Ipson, "Extracting objects and events from MPEG sequences for video highlights indexing and retrieval", J. Multimedia, Academy, vol. 5, no. 2, pp. 95-103, 2010.
43. Y. P. Tan, D. D. Saur, S. R. Kulkarni, and P. J. Ramadge, "Rapid estimation of camera motion from compressed video with application to video annotation", IEEE Trans. Circuits Syst. Video Technol., vol. 10, no. 1, pp. 133-146, 2000. (Pubitemid 30560010)
44. S. L. Phung, A. Bouzerdoum, and D. Chai, "Skin segmentation using colour pixel classification: analysis and comparison", IEEE Trans. Pattern Anal. Machine Intell., vol. 27, no. 1, pp. 148-154, 2005. (Pubitemid 40195906)
45. L. Sigal, S. Sclaroff, and V. Athitsos, "Skin colour-based video segmentation under time-varying illumination", IEEE Trans. Pattern Anal. Machine Intell., vol. 26, no. 7, pp. 862-877, 2004.
46. M. J. Jones and J. M. Rehg, "Statistical colour models with application to skin detection", Int. J. Comput. Vis. (IJCV), vol. 46, no. 1, pp. 81-96, 2002. (Pubitemid 34138494)
47. P. Kakumanu, S. Makrogiannis, and N. Bourbakis, "A survey of skincolour modelling and detection methods", Pattern Recognition, vol. 40, no. 3, pp. 1106-1122, 2007. (Pubitemid 44667749)
48. N. Habili, C. C. Lim, and A. Moini, "Segmentation of the face and hands in sign language video sequences using colour and motion cues", IEEE Trans. Circuits Syst. Video Technol., vol. 14, no. 8, pp. 1086-1097, 2004.
49. B. Leibe, K. Schindler, N. Cornelis, and L. Van Gool, "Coupled object detection and tracking from static cameras and moving vehicles", IEEE Trans. Pattern Anal. Machine Intell., vol. 30, no. 10, pp. 1683-1698, 2008.
50. P. Viola, M. J. Jones, and D. Snow, "Detecting pedestrians using patters of motion and appearance", Int. J. Comput. Vis. (IJCV), vol. 63, no. 2, pp. 153-161, 2005. (Pubitemid 40536820)
51. Y.-T. Chen and C.-S. Chen, "Fact human detection using a novel boosted cascading structure with meta stages", IEEE Trans. Image Proc., vol. 17, no. 8, pp. 1452-1464, 2008.
52. J. Jiang, K. Qiu, and G. Xiao, "An edge block content descriptor for MPEGcompressed videos", IEEE Trans. Circuits, Syst. Video Technol., vol. 18, no. 7, pp. 994-998, 2008.
53. J. Ren and J. Jiang, "Hierarchical modelling and adaptive clustering for real-time summarization of rush Videos", IEEE Trans. Multimedia, vol. 11, no. 5, pp. 906-917, 2009.
54. C. W. Ngo, Y. F. Ma, and H.-J. Zhang, "Video summarization and scene detection by graph modelling", IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 296-305, 2005.
55. X. Zhu, J. Fan, A. K. Elmagarmid, and X. Wu, "Hierarchical video content description and summarization using unified semantic and visual similarity", Multimedia Systems, vol. 9, no. 1, pp. 31-53, 2003.
56. Y. Weng and J. Jiang, "Fast camera motion estimation in MPEG compressed domain", IEEE Trans. Circuits Syst. Video Technol., 2009.
57. J. Ren and J. Jiang, "Extracting semantics and content adaptive summarisation for effective video retrieval", in Proc. EU NEM Summit Towards Future Media Internet, 2009.
58. J. Yuan, H. Wang, L. Xiao, W. Zheng, J. Li, F. Lin, and B. Zhang, "A formal study of shot boundary detection", IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 2, pp. 168-186, 2007. (Pubitemid 46379665)
59. G. Boccignone, A. Chianese, V. Moscato, and A. Picariello, "Foveated shot detection for video segmentation", IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 3, pp. 365-377, 2005. (Pubitemid 40384658)
60. J. Bescos, G. Cisneros, J. M. Martinez, J. M. Menendez, and J. Z. Cabrera, "A unified model for techniques on video-shot transition detection", IEEE Trans. Multimedia, vol. 7, no. 2, pp. 293-307, 2005. (Pubitemid 40454759)
61. F. Allamandri, S. Campion, A. Centonza, and A. Chernilov et al., "Service platform for converged interactive broadband broadcast and cellular wireless", IEEE Trans. Broadcast., vol. 53, no. 1, pp. 200-211, Mar. 2007.
62. H. C. Shih and C. L. Huang, "Content extraction and interpretation of superimposed captions for broadcasted sports videos", IEEE Trans. Broadcast., vol. 54, no. 3, pp. 333-346, Sep. 2008.
63. [Online]. Available: http://www.tv-anytime.org/The TV-Anytime Forum Accessed June, 2, 2010
64. B. S. Manjunath, P. Salembier, and T. Sikora, Eds., Introduction to MPEG-7: Multimedia Content Description Interface. Hoboken, NJ: Wiley & Sons, Apr. 2002.