Learning sparse high dimensional filters: Image filtering, dense CRFs and bilateral neural networks

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn 2016-December, Issue , 2016, Pages 4452-4461

  Jampani, Varun ^a   Kiefel, Martin ^a,b   Gehler, Peter V ^a,b  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

^b Bernstein Center for Computational Neuroscience   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BANDPASS FILTERS; COMPUTER VISION; IMAGE SEGMENTATION; NETWORK ARCHITECTURE;

BILATERAL FILTERS; CONDITIONAL RANDOM FIELD; DIVERSE APPLICATIONS; FILTER APPLICATIONS; FILTER PARAMETER; GAUSSIAN FILTERS; GRADIENT DESCENT ALGORITHMS; LATTICE CONSTRUCTION;

PATTERN RECOGNITION;

EID: 84986309374     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2016.482     Document Type: Conference Paper

References (49)

1. Google Images. https://images.google.com/. [Online; accessed 1-March-2015].
2. A. Adams, J. Baek, and M. A. Davis. Fast high-dimensional filtering using the permutohedral lattice. In Computer Graphics Forum, volume 29, pages 753-762. Wiley Online Library, 2010.
3. A. Adams, N. Gelfand, J. Dolson, and M. Levoy. Gaussian kd-trees for fast high-dimensional filtering. In ACM Transactions on Graphics (TOG), volume 28, page 21. ACM, 2009.
4. V. Aurich and J.Weule. Non-linear Gaussian filters performing edge preserving diffusion. In DAGM, pages 538-545. Springer, 1995.
5. S. P. Awate and R. T. Whitaker. Higher-order image statistics for unsupervised, information-theoretic, adaptive, image filtering. In Computer Vision and Pattern Recognition (CVPR), volume 2, pages 44-51, 2005.
6. K. Bache and M. Lichman. UCI machine learning repository, 2013.
7. D. Barash. Fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. Pattern Analysis and Machine Intelligence (T-PAMI), 24(6):844-847, 2002.
8. J. T. Barron, A. Adams, Y. Shih, and C. Hernández. Fast bilateral-space stereo for synthetic defocus. CVPR, 2015.
9. J. T. Barron and B. Poole. The Fast Bilateral Solver. ArXiv e-prints, Nov. 2015.
10. S. Bell, K. Bala, and N. Snavely. Intrinsic images in the wild. ACM Transactions on Graphics (TOG), 33(4):159, 2014.
11. S. Bell, P. Upchurch, N. Snavely, and K. Bala. Material recognition in the wild with the materials in context database. Computer Vision and Pattern Recognition (CVPR), 2015.
12. J. Bruna, W. Zaremba, A. Szlam, and Y. LeCun. Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203, 2013.
13. A. Buades, B. Coll, and J.-M. Morel. A non-local algorithm for image denoising. In Computer Vision and Pattern Recognition (CVPR), volume 2, pages 60-65, 2005.
14. N. D. Campbell, K. Subr, and J. Kautz. Fully-connected CRFs with non-parametric pairwise potential. In Computer Vision and Pattern Recognition (CVPR), pages 1658-1665, 2013.
15. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Semantic image segmentation with deep convolutional nets and fully connected CRFs. In International Conference on Learning Representations (ICLR), 2015.
16. D. Ciresan, U. Meier, and J. Schmidhuber. Multi-column deep neural networks for image classification. In Computer Vision and Pattern Recognition (CVPR), pages 3642-3649, 2012.
17. J. Domke. Learning graphical model parameters with approximate marginal inference. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 35(10):2454-2467, 2013.
18. D. Eigen, C. Puhrsch, and R. Fergus. Depth map prediction from a single image using a multi-scale deep network. In Neural Information Processing Systems (NIPS), pages 2366-2374, 2014.
19. M. Everingham, L. V. Gool, C. Williams, J. Winn, and A. Zisserman. The PASCAL VOC2012 challenge results. 2012.
20. D. Ferstl, M. Ruether, and H. Bischof. Variational depth superresolution using example-based edge representations. In International Conference on Computer Vision (ICCV), 2015.
21. E. S. Gastal and M. M. Oliveira. Adaptive manifolds for real-time high-dimensional filtering. ACM Transactions on Graphics (TOG), 31(4):33, 2012.
22. B. Graham. Spatially-sparse convolutional neural networks. arXiv preprint arXiv:1409.6070, 2014.
23. B. Graham. Sparse 3D convolutional neural networks. In British Machine Vision Conference (BMVC), 2015.
24. K. He, J. Sun, and X. Tang. Guided image filtering. Pattern Analysis and Machine Intelligence (T-PAMI), 35(6):1397-1409, 2013.
25. H. Hu and G. de Haan. Trained bilateral filters and applications to coding artifacts reduction. In Image Processing, 2007. IEEE International Conference on, volume 1, pages I-325.
26. C. Ionescu, O. Vantzos, and C. Sminchisescu. Matrix backpropagation for deep networks with structured layers. In International Conference on Computer Vision (ICCV), 2015.
27. M. Jaderberg, K. Simonyan, A. Zisserman, and K. Kavukcuoglu. Spatial transformer networks. In Neural Information Processing Systems (NIPS), 2015.
28. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the ACM International Conference on Multimedia, pages 675-678. ACM, 2014.
29. M. Kiefel and P. V. Gehler. Human pose estimation with fields of parts. In European Conference on Computer Vision (ECCV), pages 331-346. Springer, 2014.
30. J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele. Joint bilateral upsampling. ACM Transactions on Graphics (TOG), 26(3):96, 2007.
31. P. Krähenbühl and V. Koltun. Efficient inference in fully connected CRFs with Gaussian edge potentials. Neural Information and Processing Systems (NIPS), 2011.
32. P. Krähenbühl and V. Koltun. Parameter learning and convergent inference for dense random fields. In International Conference on Machine Learning (ICML), pages 513-521, 2013.
33. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradientbased learning applied to document recognition. Proceedings of the IEEE, 86(11):2278-2324, 1998.
34. Y. Li and R. Zemel. Mean-field networks. In ICML Workshop on Learning Tractable Probabilistic Models, 2014.
35. P. Milanfar. A tour of modern image filtering. IEEE Signal Processing Magazine, 2, 2011.
36. S. Paris and F. Durand. A fast approximation of the bilateral filter using a signal processing approach. In European Conference on Computer Vision (ECCV), pages 568-580. Springer, 2006.
37. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand. Bilateral filtering: Theory and applications. Now Publishers Inc, 2009.
38. J.-H. Rick Chang and Y.-C. Frank Wang. Propagated image filtering. In Computer Vision and Pattern Recognition (CVPR), pages 10-18, 2015.
39. A. G. Schwing and R. Urtasun. Fully connected deep structured networks. arXiv preprint arXiv:1503.02351, 2015.
40. N. Silberman, D. Hoiem, P. Kohli, and R. Fergus. Indoor segmentation and support inference from rgbd images. In European Conference on Computer Vision (ECCV), pages 746-760. Springer, 2012.
41. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, abs/1409.1556, 2014.
42. S. M. Smith and J. M. Brady. SUSAN - A new approach to low level image processing. Int. J. Comput. Vision, 23(1):45-78, May 1997.
43. D. Sun, J. Wulff, E. B. Sudderth, H. Pfister, and M. J. Black. A fully-connected layered model of foreground and background flow. In Computer Vision and Pattern Recognition (CVPR), pages 2451-2458, 2013.
44. H. Takeda, S. Farsiu, and P. Milanfar. Kernel regression for image processing and reconstruction. Image Processing, IEEE Transactions on, 16(2):349-366, 2007.
45. C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Computer Vision, 1998. Sixth International Conference on, pages 839-846. IEEE, 1998.
46. V. Vineet, G. Sheasby, J. Warrell, and P. H. Torr. Posefield: An efficient mean-field based method for joint estimation of human pose, segmentation and depth. In EMMCVPR, 2013.
47. V. Vineet, J. Warrell, and P. H. Torr. Filter-based mean-field inference for random fields with higher order terms and product label-spaces. In European Conference on Computer Vision (ECCV), 2012.
48. M. D. Zeiler, D. Krishnan, G. W. Taylor, and R. Fergus. Deconvolutional networks. In Computer Vision and Pattern Recognition (CVPR), pages 2528-2535, 2010.
49. S. Zheng, S. Jayasumana, B. Romera-Paredes, V. Vineet, Z. Su, D. Du, C. Huang, and P. H. Torr. Conditional random fields as recurrent neural networks. International Conference on Computer Vision (ICCV), 2015.