Im2Calories: Towards an automated mobile vision food diary

Proceedings of the IEEE International Conference on Computer Vision

Volumn 2015 International Conference on Computer Vision, ICCV 2015, Issue , 2015, Pages 1233-1241

  Myers, Austin ^a   Johnston, Nick ^a   Rathod, Vivek ^a   Korattikara, Anoop ^a   Gorban, Alex ^a   Silberman, Nathan ^a   Guadarrama, Sergio ^a   Papandreou, George ^a   Huang, Jonathan ^a   Murphy, Kevin ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; IMAGE SEGMENTATION;

LOOKUPS; MOBILE VISION; MULTI-LABEL; OFFLINE; RUNTIMES; SINGLE IMAGES;

CLASSIFICATION (OF INFORMATION);

EID: 84973896949     PISSN: 15505499     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICCV.2015.146     Document Type: Conference Paper

References (39)

1. O. Beijbom, N. Joshi, D. Morris, S. Saponas, and S. Khullar. Menu-match: restaurant-specific food logging from images. In WACV, 2015.
2. V. Bettadapura, E. Thomaz, A. Parnami, G. D. Abowd, and I. Essa. Leveraging context to support automated food recognition in restaurants. In WACV, pages 580-587, 2015.
3. L. Bossard, M. Guillaumin, and L. Van Gool. Food-101: Mining discriminative components with random forests. In ECCV, 2014.
4. J. Chae, I. Woo, S. Kim, R. Maciejewski, F. Zhu, E. J. Delp, C. J. Boushey, and D. S. Ebert. Volume estimation using food specific shape templates in mobile image-based dietary assessment. In Proc. SPIE, 2011.
5. C. Champagne, G. Bray, A. Kurtz, J. Montiero, E. Tucker, J. Voaufova, and J. Delany. Energy intake and energy expenditure: A controlled study comparing dietitians and nondietitians. J. Am. Diet. Assoc., 2002.
6. L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. Semantic image segmentation with deep convolutional nets and fully connected CRFs. In ICLR, 2015.
7. M. Chen, K. Dhingra, W. Wu, L. Yang, R. Sukthankar, and J. Yang. PFID: Pittsburgh fast-food image dataset. In ICIP, pages 289-292, 2009.
8. F. Cordeiro, E. Bales, E. Cherry, and J. Fogarty. Rethinking the mobile food journal: Exploring opportunities for lightweight Photo-Based capture. In CHI, 2015.
9. F. Cordeiro, D. Epstein, E. Thomaz, E. Bales, A. K. Jagannathan, G. D. Abowd, and J. Fogarty. Barriers and negative nudges: Exploring challenges in food journaling. In CHI, 2015.
10. J. Dehais, S. Shevchik, P. Diem, and S. G. Mougiakakou. Food volume computation for self dietary assessment applications. In 13th IEEE Conf. on Bioinfo. And Bioeng., pages 1-4, Nov. 2013.
11. J. Deng, J. Krause, A. C. Berg, and L. Fei-Fei. Hedging your bets: Optimizing accuracy-specificity trade-offs in large scale visual recognition. In CVPR, pages 3450-3457, June 2012.
12. D. Eigen and R. Fergus. Predicting depth, surface normals and semantic labels with a common Multi-Scale convolutional architecture. Arxiv, 18 Nov. 2014.
13. M. Everingham, S. M. Ali Eslami, L. Van Gool, C. K. I. Williams, J. Winn, and A. Zisserman. The pascal visual object classes challenge: A retrospective. IJCV, 111(1):98-136, 25 June 2014.
14. G. M. Farinella, D. Allegra, and F. Stanco. A benchmark dataset to study the representation of food images. In ECCV Workshop Assistive CV, 2014.
15. FDA. www. fda. gov/Food/ IngredientsPackagingLabeling/ LabelingNutrition/ucm248732. htm.
16. USDA FNDDS. www. Ars. usda. gov/ba/bhnrc/fsrg.
17. B. Hariharan, P. Arbel, R. Girshick, and J. Malik. Simultaneous detection and segmentation. In ECCV, 2014.
18. H. He, F. Kong, and J. Tan. DietCam: Multiview Food Recognition Using a MultiKernel SVM. IEEE J. of Biomedical and Health Informatics, 2015.
19. Y. He, C. Xu, N. Khanna, C. J. Boushey, and E. J. Delp. Food image analysis: Segmentation, identification and weight estimation. In ICME, pages 1-6, July 2013.
20. A. Kar, S. Tulsiani, J. Carreira, and J. Malik. Amodal completion and size constancy in natural scenes. In Intl. Conf. on Computer Vision, 2015.
21. F. Kong and J. Tan. DietCam: Automatic dietary assessment with mobile camera phones. Pervasive Mob. Comput., 8(1):147-163, Feb. 2012.
22. R. Macmanus. How myfitnesspal became the king of diet trackers, 2015. readwrite. com/2015/02/23/trackersmyfitnesspal-excerpt.
23. C. K. Martin, H. Han, S. M. Coulon, H. R. Allen, C. M. Champagne, and S. D. Anton. A novel method to remotely measure food intake of free-living individuals in real time: The remote food photography method. British J. of Nutrition, 101(03):446-456, 2009.
24. Y. Matsuda, H. Hoashi, and K. Yanai. Recognition of Multiple-Food images by detecting candidate regions. In ICME, pages 25-30, July 2012.
25. Mealsnap app. Tracker. dailyburn. com/apps.
26. J. Noronha, E. Hysen, H. Zhang, and K. Z. Gajos. PlateMate: Crowdsourcing nutrition analysis from food photographs. In Proc. Symp. User interface software and tech., 2011.
27. Google places API. https://developers. google. com/places/.
28. M. Puri, Z. Zhu, Q. Yu, A. Divakaran, and H. Sawhney. Recognition and volume estimation of food intake using a mobile device. In WACV, pages 1-8, Dec. 2009.
29. Rise app. https://www. rise. us/.
30. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei. ImageNet Large Scale Visual Recognition Challenge. ArXiv:1409. 0575, 2014.
31. D. Schoeller, L. Bandini, and W. Dietz. Inaccuracies in selfreported intake identified by comparison with the doubly labelled water method. Can. J. Physiol. Pharm., 1990.
32. T. Stutz, R. Dinic, M. Domhardt, and S. Ginzinger. Can mobile augmented reality systems assist in portion estimation? a user study. In Intl. Symp. Mixed and Aug. Reality, pages 51-57, 2014.
33. K. Sudo, K. Murasaki, J. Shimamura, and Y. Taniguchi. Estimating nutritional value from food images based on semantic segmentation. In CEA workshop, pages 571-576, 13 Sept. 2014.
34. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In CVPR, 2015.
35. USDA National Nutrient Database for Standard Reference, Release 27 (revised). http://www. Ars. usda. gov/ba/bhnrc/ndl.
36. C. Xu, N. Khanna, C. B. Y. He, and A. Parra. Image-Based food volume estimation. In CAE workshop, 2013.
37. W. Zhang, Q. Yu, B. Siddiquie, A. Divakaran, and H. Sawhney. 'Snap-n-eat': Food recognition and nutrition estimation on a smartphone. J. Diabetes Science and Technology, 9(3):525-533, 2015.
38. F. Zhu, M. Bosch, N. Khanna, C. J. Boushey, and E. J. Delp. Multiple hypotheses image segmentation and classification with application to dietary assessment. IEEE J. of Biomedical and Health Informatics, 19(1):377-388, Jan. 2015.
39. F. Zhu, M. Bosch, I. Woo, S. Kim, C. J. Boushey, D. S. Ebert, and E. J. Delp. The use of mobile devices in aiding dietary assessment and evaluation. IEEE J. Sel. Top. Signal Process., 4(4):756-766, Aug. 2010.