AutoDietary: A Wearable Acoustic Sensor System for Food Intake Recognition in Daily Life

IEEE Sensors Journal

Volumn 16, Issue 3, 2016, Pages 806-816

  Bi, Yin ^a   Lv, Mingsong ^a   Song, Chen ^b   Xu, Wenyao ^b   Guan, Nan ^a   Yi, Wang ^a  

^a NORTHEASTERN UNIVERSITY   (China)

^b State University of New York   (United States)

Author keywords

Acoustic Signal Processing; Embedded System; Food Intake Recognition; Wearable Sensor

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; ACOUSTIC WAVES; DATA MINING; DECISION TREES; EMBEDDED SYSTEMS; HEALTH RISKS; HIDDEN MARKOV MODELS; MARKOV PROCESSES; NUTRITION; SIGNAL ENCODING; SIGNAL PROCESSING; SMARTPHONES; SURVEYS; TREES (MATHEMATICS); WEARABLE TECHNOLOGY;

ACOUSTIC SENSORS; ACOUSTIC SIGNALS; DECISION-TREE BASED ALGORITHMS; EMBEDDED HARDWARE; FOOD INTAKE; NONLINEAR FEATURES; USER EXPERIENCE; WEARABLE SYSTEMS;

WEARABLE SENSORS;

EID: 84962132500     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2015.2469095     Document Type: Article

References (36)

1. Obesity and Overweight: What are Overweight and Obesity. Fact Sheet, World Health Organization, Geneva, Switzerland, 2006, (311).
2. E. S. Sazonov and S. Schuckers, "The energetics of obesity: A review: Monitoring energy intake and energy expenditure in humans," IEEE Eng. Med. Biol. Mag., vol. 29, no. 1, pp. 31-35, Jan./Feb. 2010.
3. L. E. Burke et al., "Self-monitoring dietary intake: Current and future practices," J. Renal Nutrition, vol. 15, no. 3, pp. 281-290, 2005.
4. J. Beh, D. K. Han, R. Durasiwami, and H. Ko, "Hidden Markov model on a unit hypersphere space for gesture trajectory recognition," Pattern Recognit. Lett., vol. 36, pp. 144-153, Jan. 2014.
5. S. R. M. S. Baki, Z. M. A. Mohd, I. M. Yassin, A. H. Hasliza, and A. Zabidi, "Non-destructive classification of watermelon ripeness using mel-frequency cepstrum coefficients and multilayer perceptrons," in Proc. IJCNN, Jul. 2010, pp. 1-6.
6. O. Amft and G. Troster, "On-body sensing solutions for automatic dietary monitoring," IEEE Pervasive Comput., vol. 8, no. 2, pp. 62-70, Apr./Jun. 2009.
7. E. Sazonov et al., "Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior," Physiol. Meas., vol. 29, no. 5, pp. 525-531, 2008.
8. O. Amft, "A wearable earpad sensor for chewing monitoring," IEEE Sensors, vol. 1, no. 4, pp. 222-227, Nov. 2010.
9. S. Päßler, M. Wolff, and W.-J. Fischer, "Food intake monitoring: An acoustical approach to automated food intake activity detection and classification of consumed food," Physiol. Meas., vol. 33, no. 6, pp. 1073-1093, 2012.
10. L. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
11. K.-H. Chang et al., "The diet-aware dining table: Observing dietary behaviors over a tabletop surface," in Pervasive Computing. Berlin, Germany: Springer-Verlag, 2006, pp. 366-382.
12. Y. Dong, J. Scisco, M. Wilson, E. Muth, and A. Hoover, "Detecting periods of eating during free-living by tracking wrist motion," IEEE J. Biomed. Health Inform., vol. 18, no. 4, pp. 1253-1260, Jul. 2013.
13. J. Lester, D. Tan, and S. Patel, "Automatic classification of daily fluid intake," in Proc. IEEE 4th Int. Conf. Pervas. Comput. Technol. Healthcare (PervasiveHealth), Mar. 2010, pp. 1-8.
14. K. Sato and T. Nakashima, "Human adult deglutition during sleep," Ann. Otol., Rhinol. Laryngol., vol. 115, no. 5, pp. 334-339, 2006.
15. J. Gao, A. G. Hauptmann, A. Bharucha, and H. D. Wactlar, "Dining activity analysis using a hidden Markov model," in Proc. 17th ICPR, vol. 2, 2004, pp. 915-918.
16. W. Wu and J. Yang, "Fast food recognition from videos of eating for calorie estimation," in Proc. IEEE ICME, Jun./Jul. 2009, pp. 1210-1213.
17. B. Zhou et al., "Smart table surface: A novel approach to pervasive dining monitoring," in Proc. IEEE Int. Conf. Pervasive Comput. Commun., Mar. 2015, pp. 155-162.
18. Texas Instruments. TI Homepage: LM358. [Online]. Available: http://www.ti.com/product/lm358, accessed Sep. 24, 2014.
19. Texas Instruments. TI Homepage: TLV25431. [Online]. Available: http://www.ti.com/product/tlv2541, accessed Sep. 24, 2014.
20. Texas Instruments. TI Homepage: MSP430. [Online]. Available: http://www.ti.com.cn/product/MSP430F169, accessed Sep. 30, 2014.
21. X. Zhou et al., "HMM-based acoustic event detection with adaBoost feature selection," in Multimodal Technologies for Perception of Humans. Berlin, Germany: Springer-Verlag, 2007.
22. C. Zieger, "An HMM based system for acoustic event detection," in Multimodal Technologies Perception Humans. Berlin, Germany: Springer-Verlag, 2008, pp. 338-344.
23. A. Temko, R. Malkin, C. Zieger, D. Macho, C. Nadeu, and M. Omologo, "Acoustic event detection and classification in smart-room environments: Evaluation of CHIL project systems," Cough, vol. 65, no. 48, p. 5, 2006.
24. L. Bao and S. S. Intille, "Activity recognition from userannotated acceleration data," in Pervasive Computing, Berlin, Germany: Springer-Verlag, 2004, pp. 1-17.
25. T. Huynh and B. Schiele, "Analyzing features for activity recognition," in Proc. Joint Conf. Smart Objects Ambient Intell., Innov. Context-Aware Services, 2005, pp. 159-163.
26. P. D. Welch, "The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms," IEEE Trans. Audio Electroacoust., vol. 15, no. 2, pp. 70-73, Jun. 1967.
27. A. Yadollahi and Z. Moussavi, "Feature selection for swallowing sounds classification," in Proc. 29th Annu. Int. Conf. IEEE EMBC, Aug. 2007, pp. 3172-3175.
28. E. S. Sazonov, O. Makeyev, S. Schuckers, P. Lopez-Meyer, E. L. Melanson, and M. R. Neuman, "Automatic detection of swallowing events by acoustical means for applications of monitoring of ingestive behavior," IEEE Trans. Biomed. Eng., vol. 57, no. 3, pp. 626-633, Mar. 2010.
29. A. Metin, Nonlinear Biomedical Signal Processing Volume II: Dynamic Analysis and Modeling. New York, NY, USA: Wiley, 2000, pp. 83-92.
30. M. E. Cohen, D. L. Hudson, and P. C. Deedwania, "Applying continuous chaotic modeling to cardiac signal analysis," IEEE Eng. Med. Biol. Mag., vol. 15, no. 5, pp. 97-102, Sep./Oct. 1996.
31. U. Kumar et al., "Mining land cover information using multiplayer perception and decision tree from MODIS data [J]" Indian Soc. Remote Sens., vol. 38, no. 4, pp. 592-602, Dec. 2010.
32. C. Chien and G. J. Pottie, "A universal hybrid decision tree classifier design for human activity classification," in Proc. 34th Annu. Int. Conf. IEEE EMBS, San Diego, CA, USA, Aug./Sep. 2012, pp. 1065-1068.
33. Y. Sakakibara, K. Misue, and T. Koshiba, "Text classification and keyword extraction by learning decision trees," in Proc. 9th Conf. Artif. Intell. Appl., Mar. 1993, p. 466.
34. L. Breiman, J. Friedman, C. J. Stone, and R. A. Olshen, Classification and Regression Tree. London, U.K.: Chapman & Hall, 1984.
35. M. M. Bundele and R. Banerjee, "ROC analysis of a fatigue classifier for vehicular drivers," in Proc. 5th IEEE Int. Conf. Intell. Syst., Jul. 2010, pp. 296-301.
36. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization," in Proc. 14th Int. Conf. Mach. Learn., 1997, pp. 412-420.