Efficient Robust Conditional Random Fields

IEEE Transactions on Image Processing

Volumn 24, Issue 10, 2015, Pages 3124-3136

  Song, Dongjin ^a   Liu, Wei ^b   Zhou, Tianyi ^c   Tao, Dacheng ^d   Meyer, David A ^e  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c University of Washington   (United States)

^d UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^e UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Conditional random fields; Image segmentation; Optimal gradient method; Robust conditional random fields

Indexed keywords

BIOINFORMATICS; COMPUTER VISION; GRADIENT METHODS; ITERATIVE METHODS; RANDOM PROCESSES;

CONDITIONAL RANDOM FIELD; CONDITIONAL RANDOM FIELDS(CRFS); CONVENTIONAL OPTIMIZATION; FIRST ORDER OPTIMIZATION METHOD; NUMBER OF ITERATIONS; OPTIMAL CONVERGENCE; OPTIMAL GRADIENT METHODS; PROBABILISTIC APPROACHES;

IMAGE SEGMENTATION;

EID: 84933052910     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2438553     Document Type: Article

References (59)

1. M. V. Afonso, J. M. Bioucas-Dias, and M. A. T. Figueiredo, "Fast image recovery using variable splitting and constrained optimization", IEEE Trans. Image Process., vol. 19, no. 9, pp. 2345-2356, Sep. 2010.
2. A. Beck and M. Teboulle, "A fast iterative shrinkage-thresholding algorithm for linear inverse problems", SIAM J. Image Sci., vol. 2, no. 1, pp. 183-202, 2009.
3. J. M. Bioucas-Dias and M. A. T. Figueiredo, "Multiplicative noise removal using variable splitting and constrained optimization", IEEE Trans. Image Process., vol. 19, no. 7, pp. 1720-1730, Jul. 2010.
4. A. L. Berger, V. J. D. Pietra, and S. A. D. Pietra, "A maximum entropy approach to natural language processing", Comput. Linguistics, vol. 22, no. 1, pp. 39-71, Mar. 1996.
5. C. Bhole, N. Morsillo, and C. Pal, "3D segmentation in CT imagery with conditional random fields and histograms of oriented gradients", in Proc. 2nd Int. Conf. Mach. Learn. Med. Imag., 2011, pp. 326-334.
6. E. Borenstein, E. Sharon, and S. Ullman, "Combining top-down and bottom-up segmentation", in Proc. Conf. Comput. Vis. Pattern Recognit. Workshop (CVPRW), Jun. 2004, p. 46.
7. J. Besag, "Statistical analysis of non-lattice data", J. Roy. Statist. Soc. D, vol. 24, no. 3, pp. 179-195, Sep. 1975.
8. P. D. Bertsekas, Nonlinear Programming, 2nd ed. Belmont, MA, USA: Athena Scientific, 1999.
9. S. Beigpour, C. Riess, J. Van De Weijer, and E. Angelopoulou, "Multiilluminant estimation with conditional random fields", IEEE Trans. Image Process., vol. 23, no. 1, pp. 83-96, Jan. 2014.
10. M. Collins, "Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms", in Proc. Empirical Methods Natural Lang. Process., vol. 10. 2002, pp. 1-8.
11. Y. Chen, R. Ranftl, and T. Pock, "Insights into analysis operator learning: From patch-based sparse models to higher order MRFs", IEEE Trans. Image Process., vol. 23, no. 3, pp. 1060-1072, Mar. 2014.
12. J. G. Daugman, "Two-dimensional spectral analysis of cortical receptive field profiles", Vis. Res., vol. 20, no. 10, pp. 847-856, 1980.
13. S. Della Pietra, V. Della Pietra, and J. Lafferty, "Inducing features of random fields", IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 4, pp. 380-393, Apr. 1997.
14. J. R. Finkel, T. Grenager, and C. Manning, "Incorporating non-local information into information extraction systems by Gibbs sampling", in Proc. 43rd Annu. Meeting Assoc. Comput. Linguistics (ACL), 2005, pp. 363-370.
15. M. A. T. Figueiredo and J. M. Bioucas-Dias, "Restoration of Poissonian images using alternating direction optimization", IEEE Trans. Image Process., vol. 19, no. 12, pp. 3133-3145, Dec. 2010.
16. Y. Fu, M. Liu, and T. S. Huang, "Conformal embedding analysis with local graph modeling on the unit hypersphere", in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-6.
17. G. E. Hinton, "Training products of experts by minimizing contrastive divergence", Neural Comput., vol. 14, no. 8, pp. 1771-1800, Aug. 2002.
18. J. M. Hammersley and P. Clifford, "Markov fields on finite graphs and lattices", unpublished.
19. X. He, R. S. Zemel, and M. A. Carreira-Perpindn, "Multiscale conditional random fields for image labeling", in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun./Jul. 2004, pp. II-695-II-702.
20. S. Kumar and M. Hebert, "Discriminative fields for modeling spatial dependencies in natural images", in Proc. Adv. Neural Inf. Process. Syst., vol. 16. 2004.
21. B. Leibe, A. Leonardis, and B. Schiele, "Combined object categorization and segmentation with an implicit shape model", in Proc. ECCV Workshop Statist. Learn. Comput. Vis., 2004, pp. 17-32.
22. D. G. Lowe, "Distinctive image features from scale-invariant keypoints", Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, Nov. 2004.
23. H. Lee, A. Battle, R. Raina, and A. Y. Ng, "Efficient sparse coding algorithms", in Proc. Adv. Neural Inf. Process. Syst., vol. 19. 2006, pp. 801-808.
24. J. D. Lafferty, A. McCallum, and F. C. N. Pereira, "Conditional random fields: Probabilistic models for segmenting and labeling sequence data", in Proc. 18th Int. Conf. Mach. Learn., 2001, pp. 282-289.
25. K. Li, J. Hu, and Y. Fu, "Modeling complex temporal composition of actionlets for activity prediction", in Proc. Eur. Conf. Comput. Vis., 2012, pp. 286-299.
26. L. Liu, M. Yu, and L. Shao, "Multiview alignment hashing for efficient image search", IEEE Trans. Image Process., vol. 24, no. 3, pp. 956-966, Mar. 2015.
27. R. J. Lipton and R. E. Tarjan, "A separator theorem for planar graphs", SIAM J. Appl. Math., vol. 36, no. 2, pp. 177-189, 1979.
28. S. Li and Y. Fu, "Low-rank coding with b-matching constraint for semisupervised classification", in Proc. 23rd Int. Joint Conf. Artif. Intell., 2013, pp. 1472-1478.
29. R. Malouf, "A comparison of algorithms for maximum entropy parameter estimation", in Proc. COLING, 2002, pp. 1-7.
30. T. P. Minka, "Algorithms for maximum-likelihood logistic regression", Dept. Statist., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. 758, 2001.
31. J. Nocedal and S. J. Wright, Numerical Optimization. New York, NY, USA: Springer-Verlag, 1999.
32. Y. Nesterov, "A method for solving a convex programming problem with convergence rate O (1/k2)", Soviet Math. Doklady, vol. 27, no. 2, pp. 372-376, 1983.
33. Y. Nesterov, "Smooth minimization of non-smooth functions", Math. Program., vol. 103, no. 1, pp. 127-152, May 2005.
34. F. Peng and A. McCallum, "Accurate information extraction from research papers using conditional random fields", in Proc. Human Lang. Technol. Conf. North Amer. Chapter Assoc. Comput. Linguistics, 2004, pp. 329-336.
35. P. Pletscher, C. S. Ong, and J. M. Buhmann, "Spanning tree approximations for conditional random fields", in Proc. 12th Int. Conf. Artif. Intell. Statist., 2006, pp. 408-415.
36. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding", Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
37. X. Qian, X. Jiang, Q. Zhang, X. Huang, and L. Wu, "Sparse higher order conditional random fields for improved sequence labeling", in Proc. 26th Annu. Int. Conf. Mach. Learn., 2009, pp. 849-856.
38. D. Song and D. Tao, "C1 units for scene classification", in Proc. 19th IEEE Int. Conf. Pattern Recognit., Tampa, FL, USA, Dec. 2008, pp. 1-4.
39. D. Song and D. Tao, "Biologically inspired feature manifold for scene classification", IEEE Trans. Image Process., vol. 19, no. 1, pp. 174-184, Jan. 2010.
40. D. Song, W. Liu, D. A. Meyer, R. Ji, and D. Tao, "Rank preserving hashing for rapid image search", in Proc. Data Compress. Conf., Snowbird, UT, USA, 2015, pp. 353-362.
41. F. Sha and F. Pereira, "Shallow parsing with conditional random fields", in Proc. Human Lang. Technol. Conf. North Amer. Chapter Assoc. Comput. Linguistics, 2003, pp. 134-141.
42. K. Sato and Y. Sakakibara, "RNA secondary structural alignment with conditional random fields", Bioinformatics, vol. 21, no. 2, pp. 237-242, 2005.
43. L. Shao, R. Yan, X. Li, and Y. Liu, "From heuristic optimization to dictionary learning: A review and comprehensive comparison of image denoising algorithms", IEEE Trans. Cybern., vol. 44, no. 7, pp. 1001-1013, Jul. 2014.
44. L. Shao, D. Wu, and X. Li, "Learning deep and wide: A spectral method for learning deep networks", IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 12, pp. 2303-2308, Dec. 2014.
45. N. Sokolovska, T. Lavergne, O. Cappé, and F. Yvon, "Efficient learning of sparse conditional random fields for supervised sequence labeling", IEEE J. Sel. Topics Signal Process., vol. 4, no. 6, pp. 953-964, Dec. 2010.
46. B. Taskar, D. Klein, M. Collins, D. Koller, and C. Manning, "Maxmargin parsing", in Proc. Empirical Methods Natural Lang. Process., 2004, pp. 1-8.
47. D. Tao, X. Lin, L. Jin, and X. Li, "Principal component 2-dimensional long short-term memory for font recognition on single Chinese characters", IEEE Trans. Cybern., to be published, doi: 10.1109/TCYB.2015.2414920.
48. G. Tsechpenakis and D. Metaxas, "CoCRF deformable model: A geometric model driven by collaborative conditional random fields", IEEE Trans. Image Process., vol. 18, no. 10, pp. 2316-2329, Oct. 2009.
49. S. V. N. Vishwanathan, N. N. Schraudolph, M. W. Schmidt, and K. P. Murphy, "Accelerated training of conditional random fields with stochastic gradient methods", in Proc. 23rd Int. Conf. Mach. Learn., 2006, pp. 969-976.
50. C. Wang, N. Komodakis, and N. Paragios, "Markov random field modeling, inference & learning in computer vision & image understanding: A survey", Comput. Vis. Image Understand., vol. 117, no. 11, pp. 1610-1627, Nov. 2013.
51. Y. Weiss, "Comparing the mean field method and belief propagation for approximate inference in MRFs", in Advanced Mean Field Methods, D. Saad and M. Opper, Eds. Cambridge, MA, USA: MIT Press, 2001.
52. M. Wytock and Z. Kolter, "Sparse Gaussian conditional random fields: Algorithms, theory, and application to energy forecasting", in Proc. 30th Int. Conf. Mach. Learn., 2013, pp. 1265-1273.
53. C. Xu, D. Tao, and C. Xu, "Large-margin multi-view information bottleneck", IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 8, pp. 1559-1572, Aug. 2014.
54. C. Xu, D. Tao, and C. Xu, "Multi-view intact space learning", IEEE Trans. Pattern Anal. Mach. Intell., to be published, doi: 10.1109/TPAMI.2015.2417578.
55. J. S. Yedidia, W. T. Freeman, and Y. Weiss, "Understanding belief propagation and its generalizations", in Exploring Artificial Intelligence in the New Millennium, D. Saad and M. Opper, Eds. 2003, ch. 8, pp. 239-269.
56. R. Yan, L. Shao, and Y. Liu, "Nonlocal hierarchical dictionary learning using wavelets for image denoising", IEEE Trans. Image Process., vol. 22, no. 12, pp. 4689-4698, Dec. 2013.
57. J. Zhu, Z. Nie, J.-R. Wen, B. Zhang, and W.-Y. Ma, "2D conditional random fields for Web information extraction", in Proc. 22nd Int. Conf. Mach. Learn., Bonn, Germany, 2005, pp. 1044-1051.
58. L. Zhang, X. Zhen, and L. Shao, "Learning object-to-class kernels for scene classification", IEEE Trans. Image Process., vol. 23, no. 8, pp. 3241-3253, Aug. 2014.
59. T. Zhou, D. Tao, and X. Wu, "NESVM: A fast gradient method for support vector machines", in Proc. IEEE 10th Int. Conf. Data Mining, Dec. 2010, pp. 679-688.