Naturalistic Recognition of Activities and Mood Using Wearable Electronics

IEEE Transactions on Affective Computing

Volumn 7, Issue 3, 2016, Pages 272-285

  Zhu, Zack ^a   Satizabal, Hector F ^b   Blanke, Ulf ^a   Perez Uribe, Andres ^b   Troster, Gerhard ^a  

^a ETH ZURICH   (Switzerland)

^b UNIVERSITY OF APPLIED SCIENCES WESTERN SWITZERLAND   (Switzerland)

Author keywords

activity recognition; Context recognition; mood inference; wearable computing

Indexed keywords

REGRESSION ANALYSIS;

ACTIVITY RECOGNITION; CONTEXT RECOGNITION; CONTROLLED LABORATORIES; EMERGING APPLICATIONS; MOOD INFERENCE; ROBUSTNESS AGAINST NOISE; STATISTICAL SIGNIFICANCE; WEARABLE COMPUTING;

WEARABLE TECHNOLOGY;

EID: 84986557067     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2015.2491927     Document Type: Article

References (44)

1. R. W. Picard, "Affective computing: Challenges," Int. J. Human-Comput. Stud., vol. 59, no. 1, pp. 55-64, 2003.
2. P. Ekkekakis, The Measurement of Affect, Mood, and Emotion. Cambridge, U. K.: Cambridge Univ. Press, 2013.
3. R. W. Picard, Affective Computing. Cambridge, MA, USA: MIT Press, 1997.
4. C. M. Lee and S. Narayanan, "Toward detecting emotions in spoken dialogs," IEEE Trans. Speech Audio Process., vol. 13, no. 2, pp. 293-303, Mar. 2005.
5. M. Pantic and M. Bartlett. (2007, Jul.). Machine analysis of facial expressions. Face Recognition, K. Delac and M. Grgic, Eds. Vienna, Austria: I-Tech Education and Publishing, pp. 377-416 [Online]. Available: http://doc. utwente. nl/64567/
6. A. Gluhak, M. Presser, L. Zhu, S. Esfandiyari, and S. Kupschick. (2007). Towards mood based mobile services and applications. Proc. 2nd Eur. Conf. Smart Sens. Context, pp. 159-174
7. [Online]. Available: http://dl. acm. org/citation. cfmid=1775377. 1775390
8. N. D. Lane, E. Miluzzo, H. Lu, D. Peebles, T. Choudhury, and A. T. Campbell, "A survey of mobile phone sensing," IEEE Commun. Mag., vol. 48, no. 9, pp. 140-150, Sep. 2010.
9. R. LiKamWa, Y. Liu, N. D. Lane, and L. Zhong, "Moodscope: Building a mood sensor from smartphone usage patterns," in Proc. 11th Annu. Int. Conf. Mobile Syst. Appl. Serv., 2013, pp. 389-402.
10. S. N. Patel, J. A. Kientz, G. R. Hayes, S. Bhat, and G. D. Abowd, "Farther than you may think: An empirical investigation of the proximity of users to their mobile phones," in Proc. 8th Int. Conf. Ubiquitous Comput., 2006, pp. 123-140.
11. Z. Zhu, U. Blanke, A. Calatroni, O. Brdiczka, and G. Troster, "Fusing on-body sensing with local and temporal cues for daily activity recognition," in Proc. 9th Int. Conf. Body Area Netw., Sep. 2014, pp. 83-89.
12. J. Posner, J. A. Russell, and B. S. Peterson, "The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology," Develop. Psychopathol., vol. 17, no. 3, pp. 715-734, 2005.
13. L. A. Clark and D. Watson, "Mood and the mundane: Relations between daily life events and self-reported mood," J. Personality Social Psychol., vol. 54, no. 2, pp. 296, 1988.
14. A. A. Stone, "Event content in a daily survey is differentially associated with concurrent mood," J. Personality Social Psychol., vol. 52, no. 1, p. 56, 1987.
15. G. E. J. Faulkner and A. H. Taylor, Exercise, Health, and Mental Health: Emerging Relationships. Evanston, IL, USA: Routledge, 2005.
16. M. A. M. Peluso and L. H. S. G. D. Andrade, "Physical activity and mental health: The association between exercise and mood," Clinics, vol. 60, no. 1, pp. 61-70, 2005.
17. S. M. Weinstein and R. Mermelstein, "Relations between daily activities and adolescent mood: The role of autonomy," J. Clinical Child Adolescent Psychol., vol. 36, no. 2, pp. 182-194, 2007.
18. T. H. Monk, D. J. Kupfer, E. Frank, and A. M. Ritenour. (1991). The social rhythm metric (SRM): Measuring daily social rhythms over 12 weeks. Psychiatry Res. [Online], 36, 2, 195-207
19. [Online]. Available: http://www. sciencedirect. com/science/article/pii/0165178191901318
20. T. H. Monk, E. Frank, J. M. Potts, and D. J. Kupfer, "A simple way to measure daily lifestyle regularity," J. Sleep Res., vol. 11, no. 3, pp. 183-190, 2002.
21. R. Bowen, L. Balbuena, M. Baetz, and L. Schwartz. (2013). Maintaining sleep and physical activity alleviate mood instability. Preventive Med. [Online], 57, 5, 461-465, Available: http://www. sciencedirect. com/science/article/pii/S009174351300217X
22. Y. S. Kim, Y. S. Park, J. P. Allegrante, R. Marks, H. Ok, K. O. Cho, and C. E. Garber. (2012). Relationship between physical activity and general mental health. Preventive Med. [Online], 55, 5, 458-463, Available: http://www.sciencedirect.com/science/article/pii/S0091743512003945
23. R. Mitchell. (2013). Is physical activity in natural environments better for mental health than physical activity in other environments Social Sci. Med. [Online]. 91, 130-134, Available:, http://www. sciencedirect. com/science/article/pii/S0277953612003565
24. R. Veasey, J. Gonzalez, D. Kennedy, C. Haskell, and E. Stevenson. (2013). Breakfast consumption and exercise interact to affect cognitive performance and mood later in the day. a randomized controlled trial. Appetite [Online]. 68, 38-44, Available:, http://www. sciencedirect. com/science/article/pii/S0195666313001487
25. S. H. Jones, D. J. Hare, and K. Evershed, "Actigraphic assessment of circadian activity and sleep patterns in bipolar disorder," Bipolar Disorders, vol. 7, no. 2, pp. 176-186, 2005.
26. E. M. Morris, Q. Kathawala, K. T. Leen, E. E. Gorenstein, F. Guilak, M. Labhard, and W. Deleeuw. (2010, Apr.). Mobile therapy: Case study evaluations of a cell phone application for emotional self-awareness. J. Med. Internet Res. [Online]. 12(2), p. e10, Available: http://www. jmir. org/2010/2/e10/
27. D. S. Kauer, C. S. Reid, D. A. H. Crooke, A. Khor, C. S. J. Hearps, F. A. Jorm, L. Sanci, and G. Patton. (2012, Jun.). Self-monitoring using mobile phones in the early stages of adolescent depression: Randomized controlled trial. J. Med. Internet Res. [Online]. 14(3), p. e67, Available:, http://www. jmir. org/2012/3/e67/
28. L. Liao, D. J. Patterson, D. Fox, and H. Kautz, "Learning and inferring transportation routines," Artif. Intell., vol. 171, no. 5, pp. 311-331, 2007.
29. E. Miluzzo, N. D. Lane, S. B. Eisenman, and A. T. Campbell. (2007). Cenceme: Injecting sensing presence into social networking applications. Proc. 2nd Eur. Conf. Smart Sens. Context, pp. 1-28[Online]. Available: http://dl. acm. org/citation. cfm id=1775377. 1775379
30. K. Partridge and P. Golle, "On using existing time-use study data for ubiquitous computing applications," in Proc. 10th Int. Conf. Ubiquitous Comput., 2008, pp. 144-153.
31. M. Borazio and K. Van Laerhoven, "Improving activity recognition without sensor data: A comparison study of time use surveys," in Proc. 4th Augmented Human Int. Conf., 2013, pp. 108-115.
32. M. Borazio and K. Van Laerhoven, "Using time use with mobile sensor data: A road to practical mobile activity recognition" in Proc. 12th Int. Conf. Mobile Ubiquitous Multimedia., 2013, p. 20.
33. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual and spontaneous expressions," in Proc. 9th Int. Conf. Multimodal Interfaces, 2007, pp. 126-133.
34. N. Lane, M. Lin, M. Mohammod, X. Yang, H. Lu, G. Cardone, S. Ali, A. Doryab, E. Berke, A. Campbell, and T. Choudhury, "Bewell: Sensing sleep, physical activities and social interactions to promote wellbeing," Mobile Netw. Appl., vol. 19, no. 3, pp. 345-359, 2014.
35. M. Berchtold, M. Budde, D. Gordon, H. R. Schmidtke, and M. Beigl, "Actiserv: Activity recognition service for mobile phones," in Proc. Int. Symp. Wearable Comput., 2010, pp. 1-8.
36. R. Rawassizadeh, B. A. Price, and M. Petre, "Wearables: Has the age of smartwatches finally arrived" Commun. ACM, vol. 58, no. 1, pp. 45-47, Dec. 2014.
37. F. Ichikawa, J. Chipchase, and R. Grignani, "Where's the phone A study of mobile phone location in public spaces," in Proc. 2nd Int. Conf. Mobile Technol. Appl. Syst., 2005, pp. 1-8.
38. K. J. Shelley, "Developing the American time use survey activity classification system," Monthly Lab. Rev., vol. 128, p. 3, 2005.
39. U. Blanke and B. Schiele, "Daily routine recognition through activity spotting," in Proc. 4th Int. Symp. Location Context Awareness, May 2009, pp. 192-206.
40. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay, "Scikit-learn: Machine learning in Python," J. Mach. Learn. Res., vol. 12, pp. 2825-2830, 2011.
41. K. Church, E. Hoggan, and N. Oliver, "A study of mobile mood awareness and communication through mobimood," in Proc. 6th Nordic Conf. Human-Comput. Interaction: Extending Boundaries, 2010, pp. 128-137.
42. J. A. Russell, "A circumplex model of affect," J. Personality Social Psychol., vol. 39, no. 6, p. 1161, 1980.
43. F. J. Massey, "The Kolmogorov-Smirnov test for goodness of fit," J. Am. Statist. Assoc., vol. 46, no. 253, pp. 68-78, 1951.
44. I. Guyon, J. Makhoul, R. Schwartz, and V. Vapnik, "What size test set gives good error rate estimates" IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 52-64, Jan. 1998.