Video colorization using parallel optimization in feature space

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 24, Issue 3, 2014, Pages 407-417

  Sheng, Bin ^a   Sun, Hanqiu ^b   Magnor, Marcus ^c   Li, Ping ^b  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c TECHNICAL UNIVERSITY OF BRAUNSCHWEIG   (Germany)

Author keywords

Gabor feature space; parallel optimization; user strokes; video colorization

Indexed keywords

OPTIMIZATION;

GABOR FEATURE SPACE; OPTICAL FLOW COMPUTATION; PARALLEL IMPLEMENTATIONS; PARALLEL OPTIMIZATION; REAL TIME PERFORMANCE; TEMPORAL COHERENCE; USER STROKES; VIDEO COLORIZATION;

VIDEO SIGNAL PROCESSING;

EID: 84896503947     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2013.2276702     Document Type: Article

References (35)

1. A. Levin, D. Lischinski, and Y. Weiss, "Colorization using optimization," ACM Trans. Graph., vol. 23, no. 3, pp. 689-694, 2004.
2. Q. Luan, F. Wen, D. Cohen-Or, L. Liang, Y.-Q. Xu, and H.-Y. Shum, "Natural image colorization," in Proc. 18th Eurograph. Conf. Rendering Tech., 2007, pp. 309-320.
3. L. Yatziv and G. Sapiro, "Fast image and video colorization using chrominance blending," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1120-1129, May 2006.
4. T. Welsh, M. Ashikhmin, and K. Mueller, "Transferring color to greyscale images," in Proc. SIGGRAPH, 2002, pp. 277-280.
5. Y.-W. Tai, J. Jia, and C.-K. Tang, "Local color transfer via probabilistic segmentation by expectation-maximization," in Proc. IEEE Comput. Soc. Conf. CVPR, vol. 1. 2005, pp. 747-754.
6. E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 34-41, Sep. 2001.
7. R. Ironi, D. Cohen-Or, and D. Lischinski, "Colorization by example," in Proc. Rendering Techniques. Eurographics, Konstanz, Germany, 2005, pp. 201-210.
8. X. Liu, L. Wan, Y. Qu, T.-T. Wong, S. Lin, C.-S. Leung, and P.-A. Heng, "Intrinsic colorization," ACM Trans. Graph., vol. 27, no. 5, pp. 152:1-152:9, 2008.
9. Y.-C. Huang, Y.-S. Tung, J.-C. Chen, S.-W. Wang, and J.-L. Wu, "An adaptive edge detection based colorization algorithm and its applications," in Proc. ACM Multimedia, 2005, pp. 351-354.
10. Y. Qu, T.-T. Wong, and P.-A. Heng, "Manga colorization," ACM Trans. Graph., vol. 25, no. 3, pp. 1214-1220, 2006.
11. V. Konushin and V. Vezhnevets, "Interactive image colorization and recoloring based on coupled map lattices," in Proc. Graphicon, vol. 4. 2006, pp. 231-234.
12. U. Lipowezky, "Grayscale aerial and space image colorization using texture classification," Pattern Recognit. Lett., vol. 27, no. 4, pp. 275-286, 2006.
13. B. Sheng, H. Sun, S. Chen, X. Liu, and E. Wu, "Colorization using the rotation-invariant feature space," IEEE Comput. Graph. Appl., vol. 31, no. 2, pp. 24-35, Mar. 2011.
14. M. Koleini, S. Monadjemi, and P. Moallem, "Film colorization using texture feature coding and artificial neural networks," J. Multimedia, vol. 4, no. 4, p. 240, 2009.
15. B. K. P. Horn and B. G. Schunck, "Determining optical flow," Artif. Intell., vol. 17, nos. 1-3, pp. 185-203, 1981.
16. B. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., vol. 81. 1981, pp. 674-679.
17. D. Heeger, "Optical flow using spatiotemporal filters," Int. J. Comput. Vision, vol. 1, no. 4, pp. 279-302, 1988.
18. R. March, "Computation of stereo disparity using regularization," Pattern recognit. Lett., vol. 8, no. 3, pp. 181-187, 1988.
19. M. Black and P. Anandan, "The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields," Comput. Vision Image Understanding, vol. 63, no. 1, pp. 75-104, 1996.
20. L. Alvarez, R. Deriche, J. Śanchez, and J. Weickert, "Dense disparity map estimation respecting image discontinuities: A PDE and scale-space based approach," J. Visual Commun. Image Representation, vol. 13, nos. 1-2, pp. 3-21, 2002.
21. T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High accuracy optical flow estimation based on a theory for warping," Lecture Notes Comput. Sci., vol. 3024, pp. 25-36, May 2004.
22. A. Bruhn, J. Weickert, and C. Schn̈orr, "Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods," Int. J. Comput. Vision, vol. 61, no. 3, pp. 211-231, 2005.
23. H. Nagel and W. Enkelmann, "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 8, no. 5, pp. 565-593, May 1986.
24. A. Mansouri, A. Mitiche, and J. Konrad, "Selective image diffusion: Application to disparity estimation," in Proc. IEEE Int. Conf. Image Process., vol. 3. 1998, pp. 284-288.
25. N. Grammalidis and M. Strintzis, "Disparity and occlusion estimation in multiocular systems and their coding for the communication of multiview image sequences," IEEE Trans. Circuits Syst. Video Technol., vol. 8, no. 3, pp. 328-344, Mar. 1998.
26. M. Proesmans, L. Van Gool, and A. Oosterlinck, "Determination of optical flow and its discontinuities using a nonlinear diffusion," in Proc. 3rd Eur. Conf. Comput. Vision ECCV, 1994, pp. 294-304.
27. L. Alvarez, R. Deriche, T. Papadopoulo, and J. Śanchez, "Symmetrical dense optical flow estimation with occlusions detection," Int. J. Comput. Vision, vol. 75, no. 3, pp. 371-385, 2007.
28. X. Bai, J. Wang, D. Simons, and G. Sapiro, "Video SnapCut: Robust video object cutout using localized classifiers," in Proc. ACM SIGGRAPH Papers, 2009, p. 70.
29. C. Liu, J. Yuen, A. Torralba, J. Sivic, and W. Freeman, "SIFT flow: Dense correspondence across different scenes," in Proc. ECCV, 2008, pp. 28-42.
30. B. S. Manjunath and W.-Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996.
31. A. Agarwala, "Efficient gradient-domain compositing using quadtrees," ACM Trans. Graph., vol. 26, no. 3, pp. 94:1-94:5, 2007.
32. K. Xu, Y. Li, T. Ju, S.-M. Hu, and T.-Q. Liu, "Efficient affinity-based edit propagation using k-d tree," ACM Trans. Graph., vol. 28, no. 5, pp. 118:1-118:6, 2009.
33. Y. Saad, Iterative Methods for Sparse Linear Systems, 2nd ed. Philadelphia, PA, USA: SIAM, 2003.
34. A. Granas and J. Dugundji, Fixed Point Theory. Berlin, Germany: Springer, 2003.
35. Y. Chuang, A. Agarwala, B. Curless, D. Salesin, and R. Szeliski, "Video matting of complex scenes," in Proc. 29th Annu. Conf. Comput. Graph. Interactive Tech., 2002, pp. 243-248.