Human Parsing with Contextualized Convolutional Neural Network

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 39, Issue 1, 2017, Pages 115-127

  Liang, Xiaodan ^a   Xu, Chunyan ^b   Shen, Xiaohui ^c   Yang, Jianchao ^c   Tang, Jinhui ^d   Lin, Liang ^a   Yan, Shuicheng ^e  

^a SUN YAT SEN UNIVERSITY   (China)

^b HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^c ADOBE RESEARCH   (United States)

^d NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^e NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

context modeling; fully convolutional network; Human parsing; semantic labeling

Indexed keywords

CONVOLUTION; NEURAL NETWORKS; PIXELS; SEMANTICS;

COMPREHENSIVE EVALUATION; CONTEXT MODELING; CONVOLUTIONAL NETWORKS; CONVOLUTIONAL NEURAL NETWORK; HUMAN PARSING; SEMANTIC INFORMATION; SEMANTIC LABELING; STATE-OF-THE-ART ALGORITHMS;

IMAGE PROCESSING;

EID: 85005950673     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2016.2537339     Document Type: Article

References (35)

1. X. Liang, S. Liu, X. Shen, J. Yang, L. Liu, J. Dong, L. Lin, and S. Yan, "Deep human parsing with active template regression," IEEE Trans. Pattern Recog. Mach. Intell., vol. 37, no. 12, pp. 2402-2414, Dec. 2015.
2. S. Liu, X. Liang, L. Liu, X. Shen, J. Yang, C. Xu, L. Lin, X. Cao, and S. Yan, "Matching-CNN meets KNN: Quasi-parametric human parsing," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 1419-1427.
3. W. Di, C. Wah, A. Bhardwaj, R. Piramuthu, and N. Sundaresan, "Style finder: Fine-grained clothing style detection and retrieval," in Proc. Comput. Vis. Pattern Recog. Workshops, 2013, pp. 8-13.
4. K. Yamaguchi, M. Kiapour, and T. Berg, "Paper doll parsing: Retrieving similar styles to parse clothing items," in Proc. Int. Conf. Comput. Vis., 2013, pp. 3519-3526.
5. R. Zhao, W. Ouyang, and X. Wang, "Unsupervised salience learning for person re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3586-3593.
6. Y. Wang, D. Tran, Z. Liao, and D. Forsyth, "Discriminative hierarchical part-based models for human parsing and action recognition," J. Mach. Learning Res., vol. 13, no. 1, pp. 3075-3102, 2012.
7. Y. Kalantidis, L. Kennedy, and L.-J. Li, "Getting the look: Clothing recognition and segmentation for automatic product suggestions in everyday photos," in Proc. ACM Conf. Int. Conf. Multimedia Retrieval, 2013, pp. 105-112.
8. K. Yamaguchi, M. Kiapour, L. Ortiz, and T. Berg, "Parsing clothing in fashion photographs," in Proc. Comput. Vis. Pattern Recog., 2012, pp. 3570-3577.
9. J. Dong, Q. Chen, W. Xia, Z. Huang, and S. Yan, "A deformable mixture parsing model with parselets," in Proc. Int. Conf. Comput. Vis., 2013, pp. 3408-3415.
10. W. Yang, L. Lin, and P. Luo, "Clothing co-parsing by joint image segmentation and labeling," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2014, pp. 3182-3189.
11. M. Dantone, J. Gall, C. Leistner, and L. Van Gool, "Human pose estimation using body parts dependent joint regressors," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 3041-3048.
12. J. Carreira and C. Sminchisescu, "CPMC: Automatic object segmentation using constrained parametric min-cuts," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1312-1328, Jul. 2012.
13. J. Mairal, F. Bach, J. Ponce, and G. Sapiro, "Online learning for matrix factorization and sparse coding," J. Mach. Learning Res., vol. 11, pp. 19-60, 2010.
14. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2015, pp. 1-9.
15. R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," Comput. Vis. Pattern Recog., 2014.
16. X. Liang, S. Liu, Y. Wei, L. Liu, L. Lin, and S. Yan, "Towards computational baby learning: A weakly-supervised approach for object detection," in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 999-1007.
17. A. Toshev and C. Szegedy, "Deeppose: Human pose estimation via deep neural networks," in Proc. Int. Conf. Comput. Vis. Pattern Recog., 2014.
18. C. Farabet, C. Couprie, L. Najman, and Y. Le Cun, "Learning hierarchical features for scene labeling," IEEE Trans. Pattern Analyisi Mach. Intell., vol. 35, no. 8, pp. 1915-1929, Aug. 2013.
19. P. George, C. Liang-Chieh, M. Kevin, and A. L. Yuille, "Weaklyand semi-supervised learning of a DCNN for semantic image segmentation," in Proc. IEEE Int. Conf. Comput. Vis., 2015.
20. M. Mostajabi, P. Yadollahpour, and G. Shakhnarovich, "Feedforward semantic segmentation with zoom-out features," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3376-3385.
21. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik, "Hypercolumns for object segmentation and fine-grained localization," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recog., 2015, pp. 447-456.
22. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015.
23. G. Bertasius, J. Shi, and L. Torresani, "Deepedge: A multi-scale bifurcated deep network for top-down contour detection," Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015.
24. E. Simo-Serra, S. Fidler, F. Moreno-Noguer, and R. Urtasun, "A high performance CRF model for clothes parsing," in Proc. Asian Conf. Comput. Vis., 2014, pp. 64-81.
25. X. Liang, X. Shen, D. Xiang, J. Feng, L. Lin, and S. Yan, "Semantic object parsing with local-global long short-term memory," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016.
26. X. Liang, C. Xu, X. Shen, J. Yang, J. Tang, L. Lin, and S. Yan, "Human parsing with contextualized convolutional neural network," in Proc. IEEE Int. Conf. Comput. Vis., 2015.
27. S. Liu, X. Liang, L. Liu, K. Lu, L. Lin, X. Cao, and S. Yan, "Fashion parsing with video context," IEEE Trans. Multimedia., vol. 17, no. 8, pp. 1347-1358, Aug. 2015.
28. X. Liang, Y. Wei, X. Shen, J. Yang, L. Lin, and S. Yan, "Proposalfree network for instance-level object segmentation," arXiv:1509.02636, 2015.
29. X. Liang, Y. Wei, X. Shen, Z. Jie, J. Feng, L. Lin, and S. Yan, "Reversible recursive instance-level object segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2016.
30. B. Hariharan, P. Arbeláez, R. Girshick, and J. Malik, "Simultaneous detection and segmentation," in Proc. Eur. Conf. Comput. Vis., 2014, pp. 297-312.
31. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "Semantic image segmentation with deep convolutional nets and fully connected CRFs," ICLR, 2014.
32. W. Shen, X. Wang, Y. Wang, X. Bai, and Z. Zhang, "Deepcontour: A deep convolutional feature learned by positive-sharing loss for contour detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2015, pp. 3982-3991.
33. S. Xie and Z. Tu, "Holistically-nested edge detection," arXiv:1504.06375, 2015.
34. M.-Y. Liu, O. Tuzel, S. Ramalingam, and R. Chellappa, "Entropy rate superpixel segmentation," in Proc. Int. Conf. Comput. Vis. Pattern Recog., 2011, pp. 2097-2104.
35. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Int. Conf. Multimedia, 2014, pp. 675-678.