Hardware-efficient belief propagation

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 5, 2011, Pages 525-537

  Liang, Chia Kai ^a   Cheng, Chao Chung ^a   Lai, Yen Chieh ^a   Chen, Liang Gee ^a   Chen, Homer H ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Belief propagation; embedded systems; energy minimization; general purpose computation on GPU; Markov random field; VLSI circuit design

Indexed keywords

BELIEF PROPAGATION; ENERGY MINIMIZATION; GENERAL-PURPOSE COMPUTATION ON GPU; MARKOV RANDOM FIELD; VLSI CIRCUIT DESIGN;

ALGORITHMS; BANDWIDTH; COMPUTER GRAPHICS EQUIPMENT; DATA PROCESSING; EMBEDDED SYSTEMS; HARDWARE; INTEGRATED CIRCUIT MANUFACTURE; MESSAGE PASSING; OPTIMIZATION; PIPELINE PROCESSING SYSTEMS; PROGRAM PROCESSORS; VLSI CIRCUITS;

BACKPROPAGATION;

EID: 79955599978     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2125570     Document Type: Article

References (41)

1. A. Adams, N. Gelfand, and K. Pulli, "Viewfinder alignment," Comput. Graphics Forum, vol. 27, no. 2, pp. 597-606, 2008. (Pubitemid 351612873)
2. A. Agarwala, M. Dontcheva, M. Agrawala, S. Drucker, A. Colburn, B. Curless, D. Salesin, and M. Cohen, "Interactive digital photomontage," ACM Trans. Graph., vol. 23, no. 3, pp. 294-302, Aug. 2004.
3. J. Besag, "On the statistical analysis of dirty pictures (with discussion)," J. Royal Statistic. Soc., Series B, vol. 48, no. 3, pp. 259-302, 1986.
4. S. Birchfield and C. Tomasi, "A pixel dissimilarity measure that is insensitive to image sampling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 4, pp. 401-406, Apr. 1998. (Pubitemid 128741986)
5. M. J. Black and A. Rangarajan, "On the unification of line processes, outlier rejection, and robust statistics with applications in early vision," Int. J. Comput. Vision, vol. 19, no. 1, pp. 57-91, Jul. 1996. (Pubitemid 126713881)
6. M. Black, G. Sapiro, D. H. Marimont, and D. Heeger, "Robust anisotropic diffusion," IEEE Trans. Image Process., vol. 7, no. 3, pp. 412-432, Mar. 1998.
7. Y. Boykov, O. Veksler, and R. Zabih, "Fast approximate energy minimization via graph cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 11, pp. 1222-1239, Nov. 2001. (Pubitemid 33137959)
8. A. Brunton, C. Shu, and G. Roth, "Belief propagation on the GPU for stereo vision," in Proc. CRV, 2006, pp. 76-81.
9. T. C. Chen, S. Y. Chien, Y. W. Huang, C. H. Tsai, C. Y. Chen, T. W. Chen, and L. G. Chen, "Analysis and architecture design of an HDTV720p 30 frames/s H.264/AVC encoder," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 6, pp. 673-688, Jun. 2006.
10. A. Criminisi, A. Blake, and C. Rother, "Efficient dense stereo with occlusions for new view-synthesis by four-state dynamic programming," Int. J. Comput. Vision, vol. 71, no. 1, pp. 89-110, Jan. 2007. (Pubitemid 44343154)
11. J. Díaz, E. Ros, R. Carrillo, and A. Prieto, "Real-time system for high-image resolution disparity estimation," IEEE Trans. Image Process., vol. 16, no. 1, pp. 280-285, Jan. 2007. (Pubitemid 46437490)
12. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient belief propagation for early vision," Int. J. Comput. Vision, vol. 70, no. 1, pp. 41-54, Oct. 2006. (Pubitemid 43855866)
13. W. T. Freeman, E. C. Pasztor, and O. T. Carmichael, "Learning low-level vision," Int. J. Comput. Vision, vol. 40, no. 1, pp. 25-47, Oct. 2000. (Pubitemid 32083682)
14. B. J. Frey and D. MacKay, "A revolution: Belief propagation in graphs with cycles," in Proc. NIPS, 1998, pp. 479-485.
15. M. Gong, R. Yang, L. Wang, and M. Gong, "A performance study on different cost aggregation approaches used in real-time stereo matching," Int. J. Comput. Vision, vol. 75, no. 2, pp. 283-296, Nov. 2007. (Pubitemid 47293423)
16. M. Gong and Y.-H. Yang, "Near real-time reliable stereo matching using programming graphics hardware," in Proc. CVPR, vol. 1. 2005, pp. 924- 931.
17. H. Hirschmüller and D. Scharstein, "Evaluation of cost functions for stereo matching," in Proc. CVPR, Jun. 2007, pp. 1-8.
18. V. Kolmogorov, "Convergent tree-reweighted message passing for energy minimization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 10, pp. 1568-1583, Oct. 2006. (Pubitemid 46405078)
19. N. Komodakis and G. Tziritas, "Image completion using efficient belief propagation via priority scheduling and dynamic pruning," IEEE Trans. Image Process., vol. 16, no. 11, pp. 2649-2661, Nov. 2007. (Pubitemid 350141840)
20. M. P. Kumar and P. H. S. Torr, "Fast memory-efficient generalized belief propagation," in Proc. ECCV, 2006, pp. 451-463. (Pubitemid 44029650)
21. S. Li, Markov Random Field Modeling in Computer Vision. New York: Springer, 1995.
22. C. K. Liang, T. S. Lin, B. Y. Wong, C. Liu, and H. H. Chen, "Programmable aperture photography: Multiplexed light field acquisition," ACM Trans. Graph., vol. 27, no. 3, pp. 55:1-55:10, Aug. 2008.
23. C. K. Liang, C. C. Cheng, Y. C. Lai, L. G. Chen, and H. H. Chen, "Hardware-efficient belief propagation," in Proc. CVPR, 2009, pp. 80- 87.
24. Nvidia CUDA Compute Unified Device Architecture Programming Guide, version 2.0, Nvidia Corporation, Santa Clara, CA, Jun. 2008.
25. S. C. Park, C. Chen, and H. Jeong, "VLSI architecture for MRF based stereo matching," in Proc. Int. Symp. SAMOS, vol. 4599. 2007, pp. 55- 64.
26. C. Rother, V. Kolmogorov, and A. Blake, "'GrabCut': Interactive foreground extraction using iterated graph cuts," ACM Trans. Graph., vol. 23, no. 3, pp. 277-286, Aug. 2004.
27. D. Scharstein and R. Szeliski, "A taxonomy and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vision, vol. 47, nos. 1-3, pp. 7-42, Apr. 2002. (Pubitemid 34428419)
28. D. Scharstein and R. Szeliski, "High-accuracy stereo depth maps using structured light," in Proc. CVPR, vol. 1. 2003, pp. 195-202.
29. J. Sun, N. N. Zhang, and H. Y. Shum, "Stereo matching using belief propagation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 7, pp. 787-800, Jul. 2003.
30. R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. F. Tappen, and C. Rother, "A comparative study of energy minimization methods for Markov random fields," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 1068-1080, Jun. 2008. (Pubitemid 351650109)
31. M. F. Tappen and W. T. Freeman, "Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters," in Proc. ICCV, vol. 2. 2003, pp. 900-907.
32. Y. C. Tseng, N. Chang, and T. S. Chang, "Low memory cost block-based belief propagation for stereo correspondence," in Proc. ICME, 2007, pp. 1415-1418.
33. J. C. Tuan, T. S. Chang, and C. W. Jen, "On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture," IEEE Trans. Circuits Syst. Video Tech., vol. 2, no. 1, pp. 61-72, Jan. 2002.
34. V. Vineet and P. J. Narayanan, "CUDA cuts: Fast graph cuts on the GPU," in Proc. CVPR Workshop Vis. Comput. Vision GPUs, Jun. 2008, pp. 1-8.
35. L. Wang, H. Jin, and R. Yang, "Search space reduction for MRF stereo," in Proc. ECCV, 2008, pp. 576-588.
36. Q. Yang, L. Wang, R. Yang, H. Stewénius, and D. Nistér, "Stereo matching with color-weighted correlation, hierarchical belief propagation, and occlusion handling," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 492-504, Mar. 2009.
37. Q. Yang, L. Wang, R. Yang, S. Wang, M. Liao, and D. Nistér, "Realtime global stereo matching using hierarchical belief propagation," in Proc. BMVC, 2006, pp. 989-998.
38. J. S. Yedidia, W. T. Freeman, and Y. Weiss, "Generalized belief propagation," in Proc. NIPS, 1998, pp. 689-695.
39. K. J. Yoon and I. S. Kweon, "Locally adaptive support-weight approach for visual correspondence search," in Proc. CVPR, 2005, pp. 924-931.
40. T. Yu, R. S. Lin, B. Super, and B. Tang, "Efficient message representations for belief propagation," in Proc. ICCV, Oct. 2007, pp. 1-8.
41. Project Website [Online]. Available: http://mpac.ee.ntu.edu.tw/? chiakai/hebp