Food image segmentation for dietary assessment

MADiMa 2016 - Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management, co-located with ACM Multimedia 2016

Volumn , Issue , 2016, Pages 23-28

  Dehais, Joachim ^a   Anthimopoulos, Marios ^a,b   Mougiakakou, Stavroula ^a,b  

^a UNIVERSITY OF BERN   (Switzerland)

^b UNIVERSITY OF BERN   (Switzerland)

Author keywords

Computer vision; Diabetes; Diet assessment; Dish segmentation; Food recognition; Obesity; Smartphone

Indexed keywords

COMPUTER VISION; MEDICAL PROBLEMS; NUTRITION;

BORDER DETECTION; CHRONIC DISEASE; COMPUTER VISION SYSTEM; DIETARY ASSESSMENTS; NUTRITIONAL INFORMATION; OBESITY; PERSONAL INVOLVEMENT; SEGMENTATION METHODS;

IMAGE SEGMENTATION;

EID: 84995662770     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2986035.2986047     Document Type: Conference Paper

References (36)

1. Shroff G, Smailagic A., Siewiorek D. P. Wearable context-aware food recognition for calorie monitoring, In 12th IEEE International Symposium on Wearable Computers (Pittsburgh, USA, September 28-October 1, 2008), 119-120
2. He, Y., Khanna, N., Boushey, C.J., Delp, E.J. Image segmentation for image-based dietary assessment: A comparative study, in International Symposium on Signals, Circuits and Systems(Iasi, Romania, July 11-12, 2013), 1-4
3. Kass M., Witkin A., Terzopoulos D. Snakes: active contour models. In Int. J. Comput. Vis. 1(1998), 321-331
4. Shi J. and Malik J. Normalized cuts and image segmentation, in IEEE Tran. Pattern Anal. Mach. Intell. 22, 8(2000), 888-905
5. Felzenszwalb, P. F., Huttenlocher, D. P. Image segmentation using local variation. In: IEEE Conference on Computer Vision and Pattern Recognition(Santa Barbara, June 23-25, 1998), 98-104
6. Arbelaez P., Maire M., Fowlkes C., and Malik J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33, 5 (2011), 898-916
7. Bettadapura V., Thomaz E., Parnami A., Abowd G. D., Essa I. A.: Leveraging context to support automated food recognition in restaurants. In IEEE Workshop on the Applications of Computer Vision (Waikoloa Beach, USA, January 6-9, 2015), 580-587.
8. Anthimopoulos, M.; Dehais, J.; Diem, P.; Mougiakakou, S., Segmentation and recognition of multi-food meal images for carbohydrate counting, In IEEE 13th International Conference on Bioinformatics and Bioengineering (Chania, Greece, November 10-13, 2013)
9. Chen H.C. et al. Saliency-aware food image segmentation for personal dietary assessment using a wearable computer. In Meas Sci Technol. 26, 2(February 2015)
10. Zhu F., Bosch M., Khanna N., Boushey C.J., Delp E.J. Multiple hypotheses image segmentation and classification with application to dietary assessment. In IEEE J. Biomed. Health. Inform. 19, 1(2015), 377-88
11. Matsuda Y., Hoashi H., Yanai K.: Recognition of multiple-food images by detecting candidate regions, in IEEE International Conference on Multimedia and Expo (Melbourne, Australia, July 9-13, 2012), 25-30
12. Felzenszwalb P. F., Girshick R. B., McAllester D., Ramanan D.: Object detection with discriminatively trained part-based models. In IEEE Trans. Pattern Anal. Mach. Intell., 32, 9(2010), 1627-1645
13. Duda, R. O., Hart P. E.: Use of the Hough transformation to detect lines and curves in pictures. In Comm. ACM, 15 (1972), 11-15
14. Deng Y., Manjunath B. S., Unsupervised segmentation of color-texture regions in images and video. In IEEE Trans. Pattern Anal. Mach. Intell., 23, 8, 800-810
15. Zhang W, Yu Q, Siddiquie B, Divakaran A, Sawhney H. "Snap-n-Eat": Food recognition and nutrition estimation on a smartphone. In J. Diabetes Sci. Technol. 9, 3 (May 2015), 525-533
16. Puri M., Zhu Z., Yu Q., Divakaran A., Sawhney H.: Recognition and volume estimation of food intake using a mobile device. In IEEE Winter Conference on the Applications of Computer Vision (Snowbird, USA, December 7-8, 2009), 1-8.
17. Shimoda W., Yanai K. CNN-based food image segmentation without pixel-wise annotation. In Lecture Notes in Comp. Sci. 9281 (August 2015).
18. Bolaños, M. and Radeva, P. (2016). Simultaneous food localization and recognition". In arXiv:1604.07953
19. S. Xie and Z. Tu, "Holistically-Nested Edge Detection, " 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, 2015, pp. 1395-1403.
20. Wei Shen, Xinggang Wang, Yan Wang, Xiang Bai and Z. Zhang, "DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection, " 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015, pp. 3982-3991.
21. G. Bertasius, J. Shi and L. Torresani, "DeepEdge: A multi-scale bifurcated deep network for top-down contour detection, " 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015, pp. 4380-4389.
22. J. Dehais, M. Anthimopoulos, and S. G. Mougiakakou, "Dish Detection and Segmentation for Dietary Assessment on Smartphones, " in the 8th International Conference on Image Analysis and Processing (ICIAP2015), Genoa, Italy, September 7-8, 2015, vol. 9281, pp. 433-440.
23. Felzenszwalb, Pedro F. and Huttenlocher, Daniel P. Distance Transforms of Sampled Functions, TR2004-1963, TR2004-1963 (2004)
24. A. L. Maas, A. Y. Hannun, and A. Y. Ng, "Rectifier nonlinearities improve neural network acoustic models, " in ICML Workshop on Deep Learning for Audio, Speech, and Language Processing (WDLASL 2013), 2013, vol. 28.
25. Jin, X., Xu, C., Feng, J., Wei, Y., Xiong, J., Yan, S.: Deep learning with s-shaped rectified linear activation units. CoRR abs/1512.07030 (2015)
26. K. He, X. Zhang, S. Ren, and J. Sun. Deep residual learning for image recognition. arXiv:1512.03385, 2015.
27. D. P. Kingma and J. L. Ba, "Adam: A method for stochastic optimization, " in Int. Conf. Learn. Represent., 2015, pp. 1-13.
28. Adams, R., Bischof, L.: Seeded region growing. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(6), 641-647 (1994)
29. Nock, R., Nielsen, F.: Statistical region merging. IEEE Trans. Pattern Analysis and Machine Intelligence 26(11), 1452-1458 (2004)
30. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk, SLIC Superpixels Compared to State-of-the-art Superpixel Methods, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, num. 11, p. 2274-2282, May 2012.
31. Y. Rubner, C. Tomasi, and L. J. Guibas. A metric for distributions with applications to image databases. In IEEE International Conference on Computer Vision, pages 59-66, January 1998.
32. L. Bally, J. Dehais, M. Anthimopoulos, M. Lainer, D. Rhyner, G. Rosenberg, T. Zueger, , S. Mougiakakou, C. Stettler, Effects of an automated carbohydrate-assessment tool (GoCARB) on glycaemic profile in individuals with type 1 diabetes: a clinical pilot study, EASD virtual meeting 2016.
33. Huang, Q., Dom, B.: Quantitative methods of evaluating image segmentation. In: International Conference on Image Processing, Vol. 3, pp. 53-56 (1995)
34. F. Chollet, "Keras, " https://github.com/fchollet/keras, 2015.
35. Theano Development Team, "Theano: A Python framework for fast computation of mathematical expressions, " arXiv eprints, vol. abs/1605.02688, May 2016. [Online]. Available: http://arxiv.org/abs/1605.02688
36. Morikawa, C., Sugiyama, H., Aizawa, K.: Food region segmentation in meal images using touch points. In: ACM Workshop on Multimedia for Cooking And Eating Activities (2012)