On-line multi-view video summarization for wireless video sensor network

IEEE Journal on Selected Topics in Signal Processing

Volumn 9, Issue 1, 2015, Pages 165-179

  Ou, Shun Hsing ^a,b   Lee, Chia Han ^b,c   Somayazulu, V Srinivasa ^d   Chen, Yen Kuang ^b,d   Chien, Shao Yi ^a,b  

^a Graduate Institute of Electronics Engineering   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^c RESEARCH CENTER FOR INFORMATION TECHNOLOGY INNOVATION   (Taiwan)

^d INTEL CORPORATION   (United States)

Author keywords

Gaussian mixture model; Multi view video summarization; Video skimming; Wireless video sensor network

Indexed keywords

COMPLEX NETWORKS; ELECTRIC BATTERIES; ELECTRIC POWER SUPPLIES TO APPARATUS; SENSOR NETWORKS; SOCIAL NETWORKING (ONLINE); VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

BATTERY LIFETIME; GAUSSIAN MIXTURE MODEL; LOW-POWER DESIGN; MULTIVIEW VIDEO; REDUNDANT CONTENT; TRANSMISSION POWER; VIDEO SKIMMING; WIRELESS VIDEO SENSOR NETWORKS;

WIRELESS SENSOR NETWORKS;

EID: 84921709694     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2014.2331916     Document Type: Article

References (53)

1. W.-K. Chan, J.-Y. Chang, T.-W. Chen, Y.-H. Tseng, and S.-Y. Chien, "Efficient content analysis engine for visual surveillance network," IEEE Trans. Circuits Syst. Video Technol., vol. 19, no. 5, pp. 693-703, May 2009.
2. M. Valera and S. Velastin, "Intelligent distributed surveillance systems: A review," IEE Proc. Vis., Image Signal Process., vol. 152, no. 2, pp. 192-204, Apr. 2005.
3. M. Taj and A. Cavallaro, "Distributed and decentralized multicamera tracking," IEEE Signal Process. Mag., vol. 28, no. 3, pp. 46-58, May 2011.
4. "The Internet of Things ITU Internet Rep.," 2005 [Online]. Available: http://www.itu.int/internetofthings/
5. G. Lawton, "Machine-to-machine technology gears up for growth," IEEE Comput., vol. 37, no. 9, pp. 12-15, Sep. 2004.
6. A. Fallahi and E. Hossain, "QoS provisioning in wireless video sensor networks: A dynamic power management framework," IEEE Wireless Commun. Mag., vol. 14, no. 6, pp. 40-49, Dec. 2007.
7. Z. He and D. Wu, "Resource allocation and performance analysis of wireless video sensors," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 5, pp. 590-599, May 2006.
8. J. Ahmad, H. Khan, and S. Khayam, "Energy efficient video compression for wireless sensor networks," in Proc. 43rd Annu. Conf. Inf. Sci. Syst., Mar. 2009, pp. 629-634.
9. R. Puri, A. Majumdar, P. Ishwar, and K. Ramchandran, "Distributed video coding in wireless sensor networks," IEEE Signal Process. Mag., vol. 23, no. 4, pp. 94-106, Mar. 2006.
10. B. Girod, A. Aaron, S. Rane, and D. Rebollo-Monedero, "Distributed video coding," Proc. IEEE, vol. 93, no. 1, pp. 71-83, Jan. 2005.
11. C.-C. Chiu, H.-F. Wu, S.-Y. Chien, C.-H. Lee, V. Somayazulu, and Y.-K. Chen, "Hardware architecture design of hybrid distributed video coding with frame level coding mode selection," in Proc. Signal Inf. Process. Assoc. Annu. Summit Conf., Dec. 2012, pp. 1-4.
12. V. Valdés and J. M. Martínez, "Binary tree based on-line video summarization," in Proc. ACM TRECVid Video Summarizat. Workshop, Oct. 2008, pp. 134-138.
13. J. Almeida, N. J. Leite, and R. da S. Torres, "Online video summarization on compressed domain," J. Vis. Commun. Image Represent., vol. 24, no. 6, pp. 729-738, Aug. 2013.
14. Y. Fu, Y. Guo, Y. Zhu, F. Liu, C. Song, and Z.-H. Zhou, "Multi-view video summarization," IEEE Trans. Multimedia, vol. 12, no. 7, pp. 717-729, Nov. 2010.
15. B. T. Truong and S. Venkatesh, "Video abstraction: A systematic review and classification," ACM Trans. Multimedia Comput. Commun. Applicat., vol. 3, no. 1, Feb. 2007.
16. C. Sujatha and U. Mudenagudi, "A study on keyframe extraction methods for video summary," in Proc. Int. Conf. Comput. Intell. Commun. Netw., Oct. 2011, pp. 73-77.
17. A. G. Money and H. Agius, "Video summarisation: A conceptual framework and survey of the state of the art," J. Vis. Commun. Image Represent., vol. 19, no. 2, pp. 121-143, Feb. 2008.
18. P. Over, A. F. Smeaton, and G. Awad, "The TRECVid 2008 BBC rushes summarization evaluation," in Proc. ACMTRECVid Video Summarizat. Workshop, Oct. 2008, pp. 1-20.
19. P. Over, A. F. Smeaton, and P. Kelly, "The TRECVid 2007 BBC rushes summarization evaluation pilot," in Proc. Int. Workshop TRECVid Video Summarizat., Sep. 2007, pp. 1-15.
20. V. Valdes and J. M. Martinez, "Automatic evaluation of video summaries," ACM Trans. Multimedia Comput. Commun. Appl., vol. 8, no. 3, pp. 25:1-25:21, Aug. 2012.
21. E. Dumont and B. Merialdo, "Automatic evaluation method for rushes summary content," in Proc. IEEE Int. Conf. Multimedia Expo, Jun. 2009, pp. 666-669.
22. Y. Li and B. Merialdo, "VERT: Automatic evaluation of video summaries," in Proc. Int. Conf. Multimedia, 2010, pp. 851-854.
23. Y. Gong and X. Liu, "Video summarization using singular value decomposition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2000, vol. 2, pp. 174-180.
24. E. Asadi and N. Charkari, "Video summarization using fuzzy c-means clustering," in Proc. Iranian Conf. Elect. Eng., May 2012, pp. 690-694.
25. P. Li, Y. Guo, and H. Sun, "Multi-keyframe abstraction from videos," in Proc. IEEE Int. Conf. Image Process. (ICIP), Sep. 2011, pp. 2473-2476.
26. Z. Tian, J. Xue, X. Lan, C. Li, and N. Zheng, "Key object-based static video summarization," in Proc. ACM Int. Conf. Multimedia, 2011, pp. 1301-1304.
27. D. DeMenthon, V. Kobla, and D. Doermann, "Video summarization by curve simplification," in Proc. 6th ACM Int. Conf. Multimedia (ACMMM), Sep. 1998, pp. 211-218.
28. A. Khosla, R. Hamid, C.-J. Lin, and N. Sundaresan, "Large-scale video summarization using web-image priors," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn. (CVPR), Jun. 2013, pp. 2698-2705.
29. Y.-F. Ma, X.-S. Hua, L. Lu, and H.-J. Zhang, "A generic framework of user attention model and its application in video summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, Oct. 2005.
30. Y. Cong, J. Yuan, and J. Luo, "Towards scalable summarization of consumer videos via sparse dictionary selection," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 66-75, Feb. 2012.
31. W. Abd-Almageed, "Online, simultaneous shot boundary detection and key frame extraction for sports videos using rank tracing," in Proc. IEEE Inc. Conf. Image Process. (ICIP), Oct. 2008, pp. 3200-3203.
32. G. Guan, Z. Wang, K. Yu, S. Mei, M. He, and D. Feng, "Video summarization with global and local features," in Proc. IEEE Int. Conf. Multimedia Expo Workshop, 2012, pp. 570-575.
33. X. Zeng, X. Xie, and K. Wang, "Instant video summarization during shooting with mobile phone," in Proc. ACM Int. Conf. Multimedia Retrieval ( ICMR), Apr. 2011, pp. 40:1-40:8.
34. F. Wang and B. Merialdo, "Multi-document video summarization," in Proc. IEEE Int. Conf. Multimedia and Expo (ICME), Jun. 2009, pp. 1326-1329.
35. I. Yahiaoui, B. Merialdo, and B. Huet, "Generating summaries of multiepisode video," in Proc. IEEE Int. Conf. Multimedia Expo (ICME), Aug. 2001, pp. 611-614.
36. Y. Zhang, G. Wang, B. Seo, and R. Zimmermann, "Multi-video summary and skim generation of sensor-rich videos in geo-space," in Proc. 3rd Multimedia Syst. Conf., Feb. 2012, pp. 53-64.
37. Y. Li and B. Merialdo, "Multi-video summarization based on Video- MMR," in Proc. Int. Workshop Image Anal. for Multimedia Interactive Services, Apr. 2010, pp. 1-4.
38. J. Almeida, N. J. Leite, and R. da S. Torres, "VISON: VIdeo summarization for ONline applications," Pattern Recognition Lett., vol. 33, no. 4, pp. 397-409, Mar. 2012.
39. C.-W. Ngo, Y.-F. Ma, and H.-J. Zhang, "Video summarization and scene detection by graph modeling," IEEE Trans. Circuits Syst. Video Technol., vol. 15, no. 2, pp. 296-305, Feb. 2005.
40. C. De Leo and B. S. Manjunath, "Multicamera video summarization from optimal reconstruction," in Proc. Int. Conf. Comput. Vis., Nov. 2011, pp. 94-103.
41. F. Wang and C.-W. Ngo, "Summarizing rushes videos by motion, object, event understanding," IEEE Trans. Multimedia, vol. 14, no. 1, pp. 76-87, Feb. 2012.
42. S.-Y. Wu, R. Thawonmas, and K.-T. Chen, "Video summarization via crowdsourcing," in CHI'11 Extended Abstracts Human Factors Comput. Syst., 2011, pp. 1531-1536.
43. J. Kwon and K.-M. Lee, "A unified framework for event summarization and rare event detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn. (CVPR), Jun. 2012, pp. 1266-1273.
44. Y. J. Lee, J. Ghosh, and K. Grauman, "Discovering important people and objects for egocentric video summarization," in Proc. IEEE Conf. Comput. Vis. Pattern Recogn. (CVPR), Jun. 2012, pp. 1346-1353.
45. J. Jiang, X.-P. Zhang, and A. Loui, "A content-based video fast-forward playback method using video time density function and rate distortion theory," in Proc. IEEE Int. Conf. Multimedia Expo, 2011, pp. 1-6.
46. A. Rav-Acha, Y. Pritch, and S. Peleg, "Making a long video short: Dynamic video synopsis," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. (CVPR), Jun. 2006, vol. 1, pp. 435-441.
47. Y. Pritch, A. Rav-Acha, A. Gutman, and S. Peleg, "Webcam synopsis: Peeking around the world," in Proc. IEEE 11th Int. Conf. Comput. Vis., Jun. 2007, pp. 1-8.
48. E. Kasutani and A. Yamada, "The MPEG-7 color layout descriptor: A compact image feature description for high-speed image/video segment retrieval," in Proc. Int. Conf. Image Process. (ICIP), Oct. 2001, vol. 1, pp. 674-677.
49. C. Stauffer and W. E. L. Grimson, "Adaptive background mixture models for real-time tracking," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recogn. (CVPR), Jun. 1999, vol. 2, pp. 246-252.
50. F. Daniyal and A. Cavallaro, "Multi-camera scheduling for video production," in Proc. Conf. Visual Media Product. (CVMP), Nov. 2011, pp. 11-20.
51. S.-H. Ou, C.-H. Lee, V. S. Somayazulu, Y.-K. Chen, and S.-Y. Chien, Video repository of on-line multi-view video summarization for wireless video sensor network, [Online]. Available: http://media.ee.ntu.edu. tw/research/summarization
52. S.-Y. Chien, T.-Y. Cheng, S.-H. Ou, C.-C. Chiu, C.-H. Lee, V. Somayazulu, and Y.-K. Chen, "Power consumption analysis for distributed video sensors in machine-to-machine networks," IEEE J. Emerging Sel. Topics Circuits Syst., vol. 3, no. 1, pp. 55-64, Mar. 2013.
53. Y.-W. Huang, T.-C. Chen, C.-H. Tsai, C.-Y. Chen, T.-W. Chen, C.-S. Chen, C.-F. Shen, S.-Y. Ma, T.-C. Wang, B.-Y. Hsieh, H.-C. Fang, and L.-G. Chen, "A 1.3TOPS H.264/AVC single-chip encoder for HDTV applications," in Proc. IEEE Int. Solid-State Circuits Conf. (ISSCC), Feb. 2005, vol. 1, pp. 128-588.