Combining embedded accelerometers with computer vision for recognizing food preparation activities

UbiComp 2013 - Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Volumn , Issue , 2013, Pages 729-738

  Stein, Sebastian ^a   McKenna, Stephen J ^a  

^a UNIVERSITY OF DUNDEE   (United Kingdom)

Author keywords

Accelerometers; Activity recognition; Computer vision; Multi modal dataset; Sensor fusion

Indexed keywords

ACTIVITY RECOGNITION; BASELINE RESULTS; COMBINING CLASSIFIERS; COMPLEX ACTIVITY; EMPIRICAL EVALUATIONS; EVALUATION PROTOCOL; MULTI-MODAL DATASET; SENSOR FUSION;

COMPUTER VISION; FEATURE EXTRACTION; MOTION ESTIMATION; SENSORS; UBIQUITOUS COMPUTING;

ACCELEROMETERS;

EID: 84885201691     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2493432.2493482     Document Type: Conference Paper

References (29)

1. J. K. Aggarwal and M. S. Ryoo. Human activity analysis: A review. ACM Computing Surveys, 43(3):16:1 - 16:43, 2011.
2. L. Chen, C. D. Nugent, J. Biswas, and J. Hoey, editors. Activity Recognition in Pervasive Intelligent Environments. Springer/Atlantis Press, 2011.
3. A. Criminisi, J. Shotton, and E. Konukoglu. Decision forests: A unified framework for classification, regression, density estimation, manifold learning and semi-supervised learning. Foundations and Trends in Computer Graphics and Vision, 7(2-3):81-227, 2012.
4. F. de la Torre, J. Hodgins, J. Montano, S. Valcarcel, R. Forcada, and J. Macey. Guide to the Carnegie Mellon University multimodal activity (CMU-MMAC) database. 2009.
5. D. Figo, P. C. Diniz, and D. R. Ferreira. Preprocessing techniques for context recognition from accelerometer data. Personal and Ubiquitous Computing, 14(7):645 - 662, 2010.
6. G. Forman and M. Scholz. Apples-to-apples in cross-validation studies: Pitfalls in classifier performance measurement. ACM SIGKDD Explorations, 12(1):49-57, 2010.
7. J. Hoey, T. Ploetz, D. Jackson, A. Monk, C. Pham, and P. Oliver. Rapid specification and automated generation of prompting systems to assist people with dementia. Pervasive and Mobile Computing, 7(3):299-318, 2010.
8. J. Hoey, P. Poupart, A. v. Bertoldi, T. Craig, C. Boutilier, and A. Mihailidis. Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process. Computer Vision and Image Understanding, 114(5):503-519, 2010.
9. C.-H. Hsu and C.-H. Yu. An accelerometer based approach for indoor localization. In Proc. UIC-ATC, pages 223-227, 2009.
10. T. Huynh, M. Fritz, and B. Schiele. Discovery of activity patterns using topic models. In Proc. UbiComp, 2008.
11. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20:226-239, 1998.
12. R. Kohavi. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proc. IJCAI, 1995.
13. I. Laptev. On space-time interest points. International Journal of Computer Vision, 64(2/3):107-123, 2005.
14. J. Liu, J. Luo, and M. Shah. Recognizing realistic actions from videos "in the wild". In Proc. CVPR, 2009.
15. M. Marszałek, I. Laptev, and C. Schmid. Actions in context. In Proc. CVPR, 2009.
16. B. McFee and G. Lanckriet. Learning multi-modal similarity. Journal of Machine Learning Research, 12:491-523, 2011.
17. R. Messing, C. Pal, and H. Kautz. Activity recognition using the velocity histories of tracked keypoints. In Proc. ICCV, 2009.
18. C. Pham and P. Oliver. Slice&Dice: recognizing food preparation activities using embedded accelerometers. Ambient Intelligence, LNCS, 5859:34-43, 2009.
19. T. Pl̈otz, N. Y. Hammerla, and P. Olivier. Feature learning for activity recognition in ubiquitous computing. In Proc. IJCAI, pages 1729 - 1734, 2012.
20. M. E. Pollack. Intelligent technology for an aging population: The use of AI to assist elders with cognitive impairment. AI Magazine, 26(2), 2005.
21. D. Roggen, A. Calatroni, M. Rossi, T. Holleczek, K. F̈orster, G. Tr̈oster, P. Lukowicz, D. Bannach, G. Pirkl, A. Ferscha, J. Doppler, C. Holzmann, M. Kurz, G. Holl, R. Chavarriaga, M. Creatura, and J. del R. Milln. Collecting complex activity data sets in highly rich networked sensor environments. In Proc. INSS, 2010.
22. M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele. A database for fine grained activity detection of cooking activities. In Proc. CVPR, 2012.
23. C. Schuldt, I. Laptev, and B. Caputo. Recognizing human actions: A local SVM approach. In Proc. ICPR, 2004.
24. S. Stein and S. J. McKenna. Accelerometer localization in the view of a stationary camera. In Proc. CRV, pages 109 - 116, 2012.
25. M. Tenorth, J. Bandouch, and M. Beetz. The TUM Kitchen Data Set of Everyday Manipulation Activities for Motion Tracking and Action Recognition. In Proc. ICCV, 2009.
26. H. Wang, A. Klaser, C. Schmid, and C.-L. Liu. Action recognition by dense trajectories. In Proc CVPR, 2011.
27. J. P. Wherton and A. F. Monk. Problems people with dementia have with kitchen tasks: The challenge for pervasive computing. Interacting with Computers, 22(4):253-266, 2010.
28. J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, and J. M. Rehg. A scalable approach to activity recognition based on object use. In Proc. ICCV, pages 1-8, 2007.
29. P. Zappi, C. Lombriser, T. Stiefmeier, E. Farella, D. Roggen, L. Benini, and G. Tr̈oster. Activity recognition from on-body sensors: accuracy-power trade-off by dynamic sensor selection. In Proc. EWSN, 2008.