Exploiting IoT technologies for enhancing Health Smart Homes through patient identification and emotion recognition

Computer Communications

Volumn 89-90, Issue , 2016, Pages 178-190

  Mano, Leandro Y ^a   Faiçal, Bruno S ^a   Nakamura, Luis H V ^a,b   Gomes, Pedro H ^e   Libralon, Giampaolo L ^c   Meneguete, Rodolfo I ^b   Filho, Geraldo P R ^a   Giancristofaro, Gabriel T ^a   Pessin, Gustavo ^d   Krishnamachari, Bhaskar ^e   Ueyama, Jó ^a,e  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b Department of Industry and Automation   (Brazil)

^c INSTITUTO FEDERAL DE EDUCAÇÃO   (Brazil)

^d INSTITUTO TECNOLÓGICO VALE   (Brazil)

^e UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

E health; Emotion detection; Face recognition; Internet of Things; Smart Home

Indexed keywords

AUTOMATION; CAMERAS; EHEALTH; FACE RECOGNITION; INTELLIGENT BUILDINGS; MHEALTH; NETWORK SECURITY; PATIENT MONITORING; PATIENT TREATMENT; UBIQUITOUS COMPUTING; WIRELESS TELECOMMUNICATION SYSTEMS;

EMBEDDED COMPUTING; EMOTION DETECTION; EMOTION RECOGNITION; INTERNET OF THING (IOT); MULTIPLE COMPUTING PLATFORMS; PATIENT IDENTIFICATION; SMART HOMES; WIRELESS COMMUNICATIONS;

INTERNET OF THINGS;

EID: 84979464283     PISSN: 01403664     EISSN: 1873703X     Source Type: Journal    
DOI: 10.1016/j.comcom.2016.03.010     Document Type: Article

References (42)

1. G.D. Abowd, A.F. Bobick, I.A. Essa, E.D. Mynatt, and W.A. Rogers The aware home: A living laboratory for technologies for successful aging Proceedings of the AAAI-02 Workshop "Automation as Caregiver 2002 1 7
2. J. Augusto, P. McCullagh, V. McClelland, and J. Walkden Enhanced healthcare provision through assisted decision-making in a smart home environment IEEE Second Workshop on Artificial Inteligence Techniques for Ambient Inteligence 2007 IEEE Computer Society
3. J.N. Bailenson, E.D. Pontikakis, I.B. Mauss, and et al. Real-time classification of evoked emotions using facial feature tracking and physiological responses Int. J. Hum. Comput. Stud. 66 5 2008 303 317
4. T. Banerjee, J.M. Keller, M. Popescu, and M. Skubic Recognizing complex instrumental activities of daily living using scene information and fuzzy logic Comput. Vis. Image Understand. 140 2015 68 82
5. P. Ekman Cross-cultural Studies of Facial Expression 1973 Academic New York
6. P. Ekman Darwin and Facial Expression: A Century of Research in Review 2006 Ishk
7. P. Ekman, W.V. Friesen, and J.C. Hager The Facial Action Coding System second ed. 2002 Research Nexus eBook Salt Lake City Weidenfeld and Nicolson London
8. G. Filho, J. Ueyama, B. Faical, D. Guidoni, and L. Villas Residi: an intelligent decision platform for residential infrastructure using wireless sensors and actuators 2015 XXXIII Brazilian Symposium on Computer Networks and Distributed Systems (SBRC) 2015 237 245 10.1109/SBRC.2015.36
9. G.P.R. Filho, J. Ueyama, L.A. Villas, A.R. Pinto, V.P. Goncalves, G. Pessin, R.W. Pazzi, and T. Braun Nodepm: a remote monitoring alert system for energy consumption using probabilistic techniques Sensors 14 1 2014 848 867 10.3390/s140100848
10. G.P.R. Filho, J. Ueyama, L.A. Villas, A.R. Pinto, V.P. Goncalves, and S. Seraphini An intelligent approach for improving energy efficiently in smart grids International Conference on Wireless Networks (ICWN) 12 2013 227 233
11. B.L. Fredrickson, and R.W. Levenson Positive emotions speed recovery from the cardiovascular sequelae of negative emotions Cognit. Emotion 12 2 1998 191 220
12. D. Freitas, T. Marcondes, L.H.V. Nakamura, J. Ueyama, P.H. Gomes, and R. Meneguette Combining cell phones and WSNs for preventing accidents in smart-homes with disabled people NTMS'2015 - New Technologies and ServicesTrack (NTMS'2015 New Technologies Track), Paris, France 2015
13. V.P. Goncalves, V.P. de Almeida Neris, S. Seraphini, T.C. Dias, G. Pessin, T. Johnson, and J. Ueyama Providing adaptive smartphone interfaces targeted at elderly people: an approach that takes into account diversity among the elderly Universal Access Inf. Soc. 2015 1 21 10.1007/s10209-015-0429-9
14. V.P. Gonçalves, V.P. de Almeida Néris, J. Ueyama, and S. Seraphini An analytic approach to evaluate flexible mobile user interfaces for the elderly. ICEIS (3) 2012 91 96
15. R.E. Gur, C.G. Kohler, J.D. Ragland, S.J. Siegel, K. Lesko, W.B. Bilker, and R.C. Gur Flat affect in schizophrenia: relation to emotion processing and neurocognitive measures Schizophr. Bull. 32 2 2006 279 287
16. S. Helal, W. Mann, J. King, Y. Kaddoura, E. Jansen, and et al. The gator tech smart house: a programmable pervasive space Computer 38 3 2005 50 60
17. Intel Corporation, Internet-of-Things (IoT) Advances Home Healthcare for Seniors, http://goo.gl/aFye65, 2015.
18. A. Ivanova Humor recognition in psychiatric patients and artificial intelligence 2012 AAAI Fall Symposium Series 2012
19. J.A. Kientz, S.N. Patel, B. Jones, E. Price, E.D. Mynatt, and G.D. Abowd The Georgia tech aware home CHI'08 Extended Abstracts on Human Factors in Computing Systems 2008 ACM 3675 3680
20. O. Lehmann, M. Bauer, C. Becker, and D. Nicklas From home to world-supporting context-aware applications through world models Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. PerCom 2004 2004 IEEE 297 306
21. G. Libralon, and R. Romero Mapping of facial elements for emotion analysis Proceedings of the Brazilian Conference on Intelligent Systems 2014
22. P. Lucey, J.F. Cohn, and et al. The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops 2010
23. S. Mahlke, and M. Minge Consideration of multiple components of emotions in human-technology interaction Affect and Emotion in HCI 2008 Springer
24. M.K. Mandal, R. Pandey, and A.B. Prasad Facial expressions of emotions and schizophrenia: a review Schizophr. Bull. 24 3 1998 399
25. A. Martinez, and S. Du A model of the perception of facial expressions of emotion by humans: research overview and perspectives J. Mach. Learn. Res. 13 2012 1589 1608
26. T. Mitchell Machine Learning 1997 McGraw Hill
27. G.V. Ostir, I.-M. Berges, M.E. Ottenbacher, A. Clow, and K.J. Ottenbacher Associations between positive emotion and recovery of functional status following stroke Psychosom. Med. 70 4 2008 404 409
28. V. Rialle, F. Duchene, N. Noury, L. Bajolle, and J. Demongeot Health "Smart" home: information technology for patients at home Telemed. J. e-Health 8 4 2002 395 409
29. G. Riva Ambient intelligence in health care Cyber Psycholo. Behav. 6 3 2003 295 300
30. E. Romero, A. Araujo, J.M. Moya, J.-M. de Goyeneche, J.C. Vallejo, P. Malagon, D. Villanueva, and D. Fraga Image processing based services for ambient assistant scenarios Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living. Lecture Notes in Computer Science 5518 2009 Springer Berlin, Heidelberg 800 807
31. L. Russek, Alarm for Patient Monitor and Life Support Equipment System, 1994, US Patent 5,319,355.
32. J. Russell A circumplex model of affect J. Personality Soc. Psychol. 39 1980 1161 1178
33. J.E. Salem, A.M. Kring, and S.L. Kerr More evidence for generalized poor performance in facial emotion perception in schizophrenia J. Abnorm. Psychol. 105 3 1996 480
34. J.M. Saragih, S. Lucey, and et al. Deformable model fitting by regularized landmark mean-shift Int. J. Comput. Vis. 91 2 2011 200 215
35. K.R. Scherer What are emotions? and how can they be measured? Soc. Sci. Inf. 44 4 2005 695 729
36. B. Schuller, S. Reiter, R. Muller, and et al. Speaker independent speech emotion recognition by ensemble classification IEEE International Conference on Multimedia and Expo, 2005. ICME 2005 2005
37. J.A. Stankovic, Q. Cao, T. Doan, L. Fang, Z. He, R. Kiran, S. Lin, S. Son, R. Stoleru, and A. Wood Wireless sensor networks for in-home healthcare: potential and challenges High Confidence Medical Device Software and Systems Workshop (HCMDSS) 2005
38. Y. Sui, C. Ahn, and C. Ahn A new smart fall-down detector for senior healthcare system using inertial microsensors Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE 2014 590 593 10.1109/EMBC.2014.6943660
39. Y.L. Tian, T. Kanade, and C.J. F. Handbook of Face Recognition 2005 Springer
40. J. Ueyama, V.P. Pinto, E.R. Madeira, P. Grace, T.M. Jonhson, and R.Y. Camargo Exploiting a generic approach for constructing mobile device applications Proceedings of the Fourth International ICST Conference on COMmunication System softWAre and MiddlewaRE 2009
41. WowWee, Rovio - Mobile Webcam, http://goo.gl/TmKu5v, 2015.
42. N. Yang, I. Demirkol, and W. Heinzelman Motion sensor and camera placement design for in-home wireless video monitoring systems 2011 IEEE Global Telecommunications Conference (GLOBECOM 2011) 2011 1 5 10.1109/GLOCOM.2011.6133718