Feasibility of identifying eating moments from first-person images leveraging human computation

ACM International Conference Proceeding Series

Volumn , Issue , 2013, Pages 26-33

  Thomaz, Edison ^a   Parnami, Aman ^a   Essa, Irfan ^a   Abowd, Gregory D ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Crowdsourcing; Diet; Egocentric photos; Health; Human computation; Lifestyle; Mechanical turk; Wearable

Indexed keywords

CROWDSOURCING; EGOCENTRIC PHOTOS; HUMAN COMPUTATION; LIFESTYLE; MECHANICAL TURKS; WEARABLE;

DISEASE CONTROL; HEALTH;

NUTRITION;

EID: 84890597080     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2526667.2526672     Document Type: Conference Paper

References (26)

1. Amft, O., Sẗager, M., Lukowicz, P. and Tr̈oster, G. Analysis of chewing sounds for dietary monitoring. In UbiComp'05: Proceedings of the 7th international conference on Ubiquitous Computing, Springer-Verlag (Sept. 2005).
2. Arab, L., Estrin, D., Kim, D. H., Burke, J., and Goldman, J. Feasibility testing of an automated image-capture method to aid dietary recall. European Journal of Clinical Nutrition 65, 10 (May 2011), 1156-1162.
3. Bai, Y., Li, C., Yue, Y., Jia, W., Li, J., Mao, Z.-H., and Sun, M. Designing a wearable computer for lifestyle evaluation. In Bioengineering Conference (NEBEC), 2012 38th Annual Northeast (2012), 93-94.
4. Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., and Panovich, K. Soylent: a word processor with a crowd inside. UIST (2010), 313-322.
5. Byrne, D., Doherty, A. R., Jones, G. J. F., Smeaton, A. F., Kumpulainen, S., and J̈arvelin, K. The SenseCam as a tool for task observation. In Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, British Computer Society (Sept. 2008).
6. Hara, K., Le, V., and Froehlich, J. Combining crowdsourcing and google street view to identify street-level accessibility problems. In CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM Request Permissions (Apr. 2013).
7. Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., and Wood, K. SenseCam: a retrospective memory aid. In UbiComp'06: Proceedings of the 8th international conference on Ubiquitous Computing, Springer-Verlag (Sept. 2006).
8. Jacobs, D. R. Challenges in research in nutritional epidemiology. Nutritional Health (2012), 29-42.
9. Kelly, P., Doherty, A., Berry, E., Hodges, S., Batterham, A. M., and Foster, C. Can we use digital life-log images to investigate active and sedentary travel behaviour? Results from a pilot study. International Journal of Behavioral Nutrition and Physical Activity 8, 1 (May 2011), 44.
10. Kelly, P., Marshall, S. J., Badland, H., Kerr, J., Oliver, M., Doherty, A. R., and Foster, C. An ethical framework for automated, wearable cameras in health behavior research. American journal of preventive medicine 44, 3 (Mar. 2013), 314-319.
11. Kittur, A., Chi, E. H., and Suh, B. Crowdsourcing user studies with Mechanical Turk. In CHI '08: Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, ACM Request Permissions (Apr. 2008).
12. Liu, J., Johns, E., Atallah, L., Pettitt, C., Lo, B. and Frost, G. An Intelligent Food-Intake Monitoring System Using Wearable Sensors.
13. Mankoff, J., Hsieh, G., Hung, H. C., Lee, S. and Nitao, E. Using Low-Cost Sensing to Support Nutritional Awareness. In UbiComp '02: Proceedings of the 4th international conference on Ubiquitous Computing, Springer-Verlag (Sept. 2002).
14. Mason, W., and Watts, D. J. Financial incentives and the "performance of crowds". In HCOMP '09: Proceedings of the ACM SIGKDD Workshop on Human Computation, ACM Request Permissions (June 2009).
15. Michels, K. B. Nutritional epidemiology-past, present, future. International journal of epidemiology 32, 4 (Aug. 2003), 486-488.
16. Noronha, J., Hysen, E., Zhang, H., and Gajos, K. Z. Platemate: crowdsourcing nutritional analysis from food photographs. Proceedings of the 24th annual ACM symposium on User interface software and technology (2011), 1-12.
17. Reddy, S., Parker, A., Hyman, J., Burke, J., Estrin, D. and Hansen, M. Image browsing, processing, and clustering for participatory sensing: lessons from a DietSense prototype. In EmNets '07: Proceedings of the 4th workshop on Embedded networked sensors, ACM Request Permissions (June 2007).
18. Ross, J., Irani, L., Silberman, M., Zaldivar, A., and Tomlinson, B. Who are the crowdworkers?: shifting demographics in mechanical turk. Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (2010), 2863-2872.
19. Russell, B. C., Torralba, A., Murphy, K. P., and Freeman, W. T. LabelMe: A Database and Web-Based Tool for Image Annotation. International Journal of Computer Vision 77, 1-3 (May 2008).
20. Song, Y. C., Lasecki, W. S., Bigham, J. P., and Kautz, H. Training Activity Recognition Systems Online Using Real-time Crowdsourcing. Ubicomp '12: Proceedings of the 14th ACM International Conference on Ubiquitous Computing (2012).
21. Sorokin, A., and Forsyth, D. Utility data annotation with Amazon Mechanical Turk. Audio, Transactions of the IRE Professional Group on (June 2008), 1-8.
22. Stellar, E., and Shrager, E. E. Chews and swallows and the microstructure of eating. The American journal of clinical nutrition 42, 5 (1985), 973-982.
23. Sun, M., Fernstrom, J. D., Jia, W., Hackworth, S. A., Yao, N., Li, Y., Li, C., Fernstrom, M. H. and Sclabassi, R. J. A wearable electronic system for objective dietary assessment. Journal of the American Dietetic Association 110, 1 (2010), 45.
24. von Ahn, L., and Dabbish, L. Labeling images with a computer game. In CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, ACM Request Permissions (Apr. 2004).
25. von Ahn, L., Liu, R., and Blum, M. Peekaboom: a game for locating objects in images. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM Request Permissions (Apr. 2006).
26. Zhang, H., Li, L., Jia, W., Fernstrom, J. D., Sclabassi, R. J. and Sun, M. Recognizing physical activity from ego-motion of a camera. Proceedings of IEEE EMBS 2010 (2010), 5569-5572.