Increasing trend of wearables and multimodal interface for human activity monitoring: A review

Biosensors and Bioelectronics

Volumn 90, Issue , 2017, Pages 298-307

  Kumari, Preeti ^a   Mathew, Lini ^a   Syal, Poonal ^a  

^a NATIONAL INSTITUTE OF TECHNICAL TEACHERS TRAINING AND RESEARCH   (India)

Author keywords

Biomedical; Human activity monitoring; Human Computer Interface; Multimodal interface; Shared control architecture; Smart sensors; Wearable sensors

Indexed keywords

DIAGNOSIS; ELECTROCARDIOGRAPHY; ELECTROENCEPHALOGRAPHY; HUMAN COMPUTER INTERACTION; INTERACTIVE COMPUTER SYSTEMS; SMART SENSORS; WEARABLE TECHNOLOGY;

BIOMEDICAL; HUMAN ACTIVITY MONITORING; HUMAN COMPUTER INTERFACES; MULTI-MODAL INTERFACES; SHARED CONTROL;

WEARABLE SENSORS;

CLINICAL EFFECTIVENESS; DAILY LIFE ACTIVITY; DEVICE SAFETY; DOCTOR PATIENT RELATION; DROWSINESS; ELECTROCARDIOGRAM; ELECTROCARDIOGRAPH; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPH; ELECTROMYOGRAM; ELECTROMYOGRAPH; ELECTROOCULOGRAM; HUMAN; HUMAN ACTIVITY MONITORING; MONITORING; REVIEW; RING SENSOR; SENSOR; SLEEP DISORDER; WEARABLE SENSOR; WEARABLE SMART SHIRT; WIRELESS COMMUNICATION; AGED; DEVICES; ELECTROCARDIOGRAPHY; GENETIC PROCEDURES; HUMAN ACTIVITIES; PHYSIOLOGIC MONITORING; TELEMEDICINE;

AGED; BIOSENSING TECHNIQUES; ELECTROCARDIOGRAPHY; HUMAN ACTIVITIES; HUMANS; MONITORING, PHYSIOLOGIC; TELEMEDICINE;

EID: 85002542035     PISSN: 09565663     EISSN: 18734235     Source Type: Journal    
DOI: 10.1016/j.bios.2016.12.001     Document Type: Review

References (85)

1. Aggarwal, Y., Singh, N., Ghosh, S., Sinha, R.K., Eye gaze-induced mental stress alters the heart rate variability analysis. J. Clin. Eng. 39 (2014), 79–89, 10.1097/JCE.0000000000000023.
2. Alert Devices for the Elderly [WWW Document], 2016. Med. Alert Syst. Rev. Site. URL (http://medicalalertsystemshq.com/blog/medical?alert?devices?for?the?elderly.html).
3. Bagade, P., Banerjee, A., Gupta, S.K.S., 2014. Optimal design for symbiotic wearable wireless sensors. In: Proceedings of the 2014 11th International Conference on Wearable and Implantable Body Sensor Networks, IEEE Computer Society. pp. 132–137.
4. Bleicher, A., Beyond words: Wearable computers will let us share thoughts and sensations. IEEE Spectr., 2014, 66–71.
5. Bobade, J.R., Khirwadkar, M.D., Design and implementation of electrooculogram based alarm system for disabled. Int. J. Adv. Res. Comput. Eng. Technol. 5 (2016), 872–874.
6. Bonato, P., Wearable sensors and systems. IEEE Eng. Med. Biol. Mag., 2010, 25–36, 10.1109/MEMB.2010.936554.
7. Boyle, J.A., 2014. Brain Sentry Licenses Breakthrough Wearable Sensor Technology from Johns Hopkins University.
8. Bulling, A., Ward, J., Gellersen, H., Troster, G., Eye movement analysis for activity recognition using electrooculography. IEEE Trans. Pattern Anal. Mach. Intell. 33 (2011), 741–753.
9. Bulling, A., Ward, J.A., Gellersen, H., Multimodal recognition of reading activity in transit using body-worn sensors. ACM Trans. Appl. Percept. 9 (2012), 2:1–2:21, 10.1145/2134203.2134205.
10. Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S.C., Shekelle, paul G., Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann. Intern. Med. 144 (2006), 742–752.
11. Chen, B., Patel, S., Buckley, T., Rednic, R., Mcclure, D.J., Shih, L., Tarsy, D., Welsh, M., Bonato, P., A web-based system for home monitoring of patients with Parkinson’ s disease using wearable sensors. IEEE Trans. Biomed. Eng. 58 (2011), 831–836.
12. Chimeno, M.F., Pallàs-areny, R., A comprehensive model for power line interference in biopotential measurements. IEEE Trans. Instrum. Meas. 49 (2000), 535–540.
13. Choujaa, D., Dulay, N., 2008. TRAcME: temporal activity recognition using mobile phone data. In: Proceedings of the IEEE/IFIP International Conference on Embedded Ubiquitous Computing. pp. 119–126. (http://dx.doi.org/10.1109/EUC.2008.33).
14. Cloudy Forecast : Predictions for Big Data in Large and Small Medical Practices [WWW Document], 2013. Cern. Ambul.
15. Cook, B.S., Le, T., Palacios, S., Traille, A., Tentzeris, M.M., Only skin deep. IEEE Macrow. Mag., 2013, 103–114.
16. Cunningham, P., Delany, S.J., 2007. k-Nearest Neighbour Classifiers. Dublin.
17. Englebienne, T.L.M.V.K.G., Krose, B.J.A., An activity monitoring system for elderly care using generative and discriminative models. J. Pers. Ubiquitous Comput. 14 (2010), 489–498, 10.1007/s00779-009-0277-9.
18. Ermes, M., Parkka, J., Mantyjarvi, J., Korhonen, I., Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions. IEEE Trans. Inf. Technol. Biomed. 12 (2008), 20–26.
19. Fang, Y.-M., Chang, C.-C., Users' psychological perception and perceived readability of wearable devices for elderly people. Behav. Inf. Technol., 2016, 1–8, 10.1080/0144929X.2015.1114145.
20. Fernandez, A., 2015. “Mind­ful” wearables [WWW Document]. Sharp Brains. URL (http://sharpbrains.com/blog/2015/11/10/10-neurotechnologies-about-to-transform-brain-enhancement-and-brain-health/).
21. Flemons, W.W., Douglas, N.J., Kuna, S.T., Rodenstein, D.O., Wheatley, J., Access to diagnosis and treatment of patients with suspected sleep apnea. Am. J. Respir. Crit. Care Med. 169 (2004), 668–672, 10.1164/rccm.200308-1124PP.
22. Fontana, J.M., Farooq, M., Sazonov, E., Automatic ingestion monitor: a novel wearable device for monitoring of ingestive behavior. IEEE Trans. Biomed. Eng. 61 (2014), 1772–1779.
23. Gandhi, T., Trikha, M., Santhosh, J., Anand, S., Development of an expert multitask gadget controlled by voluntary eye movements. Expert Syst. Appl. 37 (2010), 4204–4211, 10.1016/j.eswa.2009.11.082.
24. Goverdovsky, V., Looney, D., Kidmose, P., Mandic, D.P., In-ear EEG from viscoelastic generic earpieces: robust and unobtrusive 24/7 monitoring. IEEE Sens. J. 16 (2016), 271–277.
25. Gunn, S.R., 1998. Support Vector Machines for Classification and Regression.
26. Guo, X., Pei, W., Wang, Y., Chen, Y., Zhang, H., Wu, X., Yang, X., Chen, H., Liu, Y., Liu, R., A human-machine interface based on single channel EOG and patchable sensor. Biomed. Signal Process. Control 30 (2016), 98–105, 10.1016/j.bspc.2016.06.018.
27. Hayward, J., Chansin, D.G., 2016. Wearable Sensors 2016-–2026: Market Forecasts, Technologies, Players [WWW Document]. URL (http://www.idtechex.com/research/reports/wearable-sensors-2016-2026-market-forecasts-technologies-players-000470.asp).
28. Hayward, J., Das, R., Holland, G., 2015. Wearable Technology 2015–2025 : Technologies, Markets, Forecasts [WWW Document]. URL (http://www.idtechex.com/research/reports/wearable?technology?2015?2025?technologies?markets?forecasts?000427.asp).
29. Hopfield, J.J., Artificial neural networks. IEEE Circuits Devices Mag., 1988, 3–10.
30. Huo, X., Zheng, W., Lu, B., 2016. Driving fatigue detection with fusion of EEG and forehead EOG. In: Proceeding of International Joint Conference on Neural Networks (IJCNN-16).
31. Iáñez, E., Úbeda, A., Azorín, J.M., Perez-vidal, C., Assistive robot application based on an RFID control architecture and a wireless EOG interface. Rob. Auton. Syst. 60 (2012), 1069–1077, 10.1016/j.robot.2012.05.006.
32. Iglesias, J., Cano, J., Bernardos, A.M., Casar, J.R., A ubiquitous activity-monitor to prevent sedentariness. IEEE Conf. Pervasive Comput. Commun., 2011, 319–321.
33. Jatobá, L.C., Großmann, U., Kunze, C., Ottenbacher, J., Stork, W., System, A.M., Context-aware mobile health monitoring: evaluation of different pattern recognition methods for classification of physical activity. Annu. Int. IEEE EMBS Conf., 2008, 5250–5253.
34. Juha, P., Ermes, M., Korpipaa, P., Mantyjarvi, J., Peltola, J., Activity classification using realistic data From Wearable sensors. IEEE Trans. Inf. Technol. Biomed. 10 (2006), 119–128.
35. Kamen, G., Electromyographic kinesiology. Robertson, L.D., Tocco, A.N., (eds.) Research Methods in Biomechanics, 2004, Human Kinetics Publication, Champaign, IL, 171–181.
36. Knight, J.F., Baber, C., A tool to assess the comfort of wearable computers. Hum. Factors Ergon. Soc. 47 (2005), 77–91, 10.1518/0018720053653875.
37. Lane, N.D., Xu, Y., Campbell, A.T., Choudhury, T., Eisenman, S.B., Exploiting social networks for large-scale human behavior modeling. IEEE Pervasive Comput. 10 (2011), 45–53.
38. Lara, D., Labrador, M.A., A survey on human activity recognition using wearable sensors. IEEE Commun. Surv. Tutor. 15 (2013), 1192–1209.
39. Lee, B.W., Shin, H., Feasibility study of sitting posture monitoring based on piezoresistive conductive film-based flexible force sensor. IEEE Sens. J. 16 (2016), 15–16.
40. Lin, C., Yang, Y.C., Wang, J., Yang, Y., A wearable sensor module with a neural-network- based activity classification algorithm for daily energy expenditure estimation. IEEE Trans. Inf. Technol. Biomed. 16 (2012), 991–998.
41. Lin, Y., 2009. Decision Making in assistive environments using multimodal observations. In: Proceedings of the Petra '09 ACM. pp. 1–8.
42. Liu, G., Huang, B., Wang, L., A wearable respiratory biofeedback system based on generalized body sensor network. Telemed. J. E. Health, 2011, 348–357, 10.1089/tmj.2010.0182.
43. Loos, J.R., Davidson, E.J., 2016. Wearable health monitors and physician-patient communication: the physician's perspective. In: Proceeding of the 2016 49th Hawaii International Conference on System Sciences (HICSS)HICSS '16. pp. 3389–3399. (http://dx.doi.org/ 10.1109/HICSS.2016.422).
44. Mala, S., Latha, K., Feature selection in classification of eye movements using electrooculography for activity recognition. Comput. Math. Methods Med. 2014 (2014), 1–9, 10.1155/2014/713818.
45. Malhi, K., Wireless Sensors Network Based Physiological Parameters Monitoring System. 2010, Massey University, New Zealand.
46. Mao, M., Chuo, Y., Kaminska, B., Multi-functional wearable device for heart health and position assessment. NSTI Nanotech. 2 (2008), 615–618.
47. Mariani, B., Jimenez, M.C., Vingerhoets, F.J.G., Aminian, K., On-shoe wearable sensors for gait and turning assessment of patients With Parkinson's disease. IEEE Trans. Biomed. Eng. 60 (2013), 155–158.
48. Marquardt, D., an algorithm for least-squares estimation of nonlinear paramenters. J. Soc. Ind. Appl. Math. 11 (1963), 431–441.
49. Mobile phones to come with panic button from 2017, 2016. Econ. Times Bur. pp. 2–5.
50. Mortazavi, B., Nyamathi, S., Lee, S.I., Wilkerson, T., Ghasemzadeh, H., Sarrafzadeh, M., Near-realistic mobile exergames with wireless wearable sensors. IEEE J. Biomed. Heal. Inform. 18 (2014), 449–456.
51. Mukhopadhyay, S.C., Wearable sensors for human activity monitoring: a review. IEEE Sens. J. 15 (2015), 1321–1330.
52. Nam, Y., Koo, B., Cichocki, A., Choi, S., GOM-face: GKP, EOG, and EMG-based multimodal interface with application to humanoid robot control. IEEE Trans. Biomed. Eng. 61 (2014), 453–462, 10.1109/TBME.2013.2280900.
53. Nanjundappa, R., Franklin, R., Dharmapurikar, V.A., Singh, S., 2016. Oral health Monitoring Method and apparatus and Electronic Device Using the Same.
54. Nemati, E., Deen, M.J., Mondal, T., A wireless wearable ECG sensor for long-term applications. IEEE Commun. Mag., 2012, 36–43.
55. Niksch, A.L., Rothman, B.S., Davidson, S.J., The value of remote patient monitoring (RPM) physicians' perspectives. Healthc. Inf. Manag. Syst. Soc., 2014, 1–5.
56. Oh, S., Kumar, P.S., Kwon, H., Varadan, V.K., 2012. Wireless brain-machine interface using EEG and EOG: Brain wave classification and robot control. In: SPIE Proceedings on Nanosensors, Biosensors, and Info-Tech Sensors and Systems. pp. 1–8. (http://dx.doi.org/10.1117/12.918159).
57. Patel, S., Lorincz, K., Hughes, R., Huggins, N., Growdon, J., Standaert, D., Akay, M., Dy, J., Welsh, M., Bonato, P., Member, S., Monitoring motor fluctuations in patients with Parkinson’ s disease using wearable sensors. IEEE Trans. Inf. Technol. Biomed. 13 (2009), 864–873.
58. Patel, S., Park, H., Bonato, P., Chan, L., Rodgers, M., A review of wearable sensors and systems with application in rehabilitation. J. Neuroeng. Rehabil., 9, 2012, 21, 10.1186/1743-0003-9-21.
59. Peixoto, P., Batista, J., Araujo, H.J., Real-time human activity monitoring exploring multiple vision sensors. Rob. Auton. Syst. 35 (2001), 221–228, 10.1016/S0921-8890(01)00117-8.
60. Quazi, M.T., Human Emotion Recognition Using Smart Sensors. 2012, Massey university, New Zealand.
61. Ramasamy, V., Gowda, C., Noopuran, S., 2014. The basics of designing wearable electronics with microcontrollers [WWW Document]. Cypress Semicond. URL (http://www.embedded.com/print/4431259).
62. Ranney, T.A., Garrott, W.R., Goodman, M.J., n.d. NHTSA Driver Distraction Research: Past, Present and Future. 2001 pp. 1–8, (http://www-nrd.nhtsa.dot.gov/pdf/esv/esv17/proceed/00177.pdf).
63. Rodgers, M.M., Pai, V.M., Conroy, R.S., Recent advances in wearable sensors for health monitoring. IEEE Sens. J. 15 (2015), 3119–3126.
64. Salvo, P., Francesco, F., Di, Costanzo, D., Ferrari, C., Trivella, M.G., Rossi, D. De, A wearable sensor for measuring sweat rate. IEEE Sens. J. 10 (2010), 1557–1558.
65. Sarkar, J., Vinh, L.T., Lee, V.Y., GPARS: a general-purpose activity recognition system. Appl. Intell. 35 (2011), 242–259, 10.1007/s10489-010-0217-4.
66. Sasaki, M., SAuhaimi, M.S.B.A., Matsushita, K., Ito, S., Rusydi, M.I., Robot control system based on electrooculography and electromyogram. J. Comput. Commun. 3 (2015), 113–120.
67. Seoane, F., Mohino-herranz, I., Ferreira, J., Alvarez, L., Llerena, C., Gil-pita, R., Wearable biomedical measurement systems for assessment of mental stress of combatants in real time. Sensors 40 (2014), 7120–7141, 10.3390/s140407120.
68. Shen, J., Barbera, J., Shapiro, C.M., Distinguishing sleepiness and fatigue: focus on definition and measurement. Sleep Med. Rev. 10 (2006), 63–76, 10.1016/j.smrv.2005.05.004.
69. Shi, X., Zhou, F., Tao, M., Zhang, Z., Human movements separation based on principle component analysis. IEEE Sens. J. 16 (2016), 2017–2027.
70. Siddiqi, M.H., Ali, R., Khan, A.M., Park, Y., Lee, S., Human facial expression recognition using stepwise linear discriminant analysis and hidden conditional random fields. IEEE Trans. Image Process. 24 (2015), 1386–1398.
71. Strohrmann, C., Harms, H., Kappeler-setz, C., Tr, G., Monitoring kinematic changes with fatigue in running using body-worn sensors. IEEE Trans. Inf. Technol. Biomed. 16 (2012), 983–990.
72. The Role of Driver Fatigue in Commercial Road Transport Crashes, 2001.
73. Toh, W.Y., Tan, Y.K., Koh, W.S., Siek, L., Autonomous wearable sensor nodes with flexible energy harvesting. IEEE Sens. J. 14 (2014), 2299–2306.
74. Tolstikov, A., Hong, X., Biswas, J., Nugent, C., Chen, L., Parente, G., Comparison of fusion methods based on DST and DBN in human activity recognition. J. Control Theory Appl. 9 (2011), 18–27, 10.1007/s11768-011-0260-7.
75. Tomasini, M., Benatti, S., Milosevic, B., Farella, E., Benini, L., power line interference removal for high-quality continuous biosignal monitoring with low-power wearable devices. IEEE Sens. J. 16 (2016), 3887–3895.
76. Ugulino, W., Cardador, D., Vega, K., Velloso, E., Milidiu, R., Fuks, H., Wearable computing: accelerometers' data classification of body postures and movements. Adv. Artif. Intell. 7589 (2012), 52–61, 10.1007/978-3-642-34459-6.
77. Usakli, A.B., Gurkan, S., Design of a novel efficient human – computer interface: an electrooculagram based virtual keyboard. IEEE Trans. Instrum. Meas. 59 (2010), 2099–2108.
78. Uslu, G., Dursunoglu, H.I., Altun, O., Baydere, S., Human activity monitoring with wearable sensors and hybrid classifiers. Int. J. Comput. Inf. Syst. Ind. 5 (2013), 345–353.
79. Varadan, V.K., Rai, P., Oh, S.C., Kumar, P.S., Wearable technology and mobile platform for human health monitoring. Forum Electromagn. Res. Methods Appl. Technol. 16 (2016), 1–38.
80. Velloso, E., Bulling, A., Gellersen, H., Ugulino, W., 2013. Qualitative activity recognition of weight lifting exercises. In: Proceeding of the International Conference in Cooperation with SIGCHI (Augmented Human’13).
81. Versel, N., 2012. Panic buttons for seniors must go [WWW Document]. MobiHealthNews. URL (http://mobihealthnews.com/19397/panic?Buttons?For?Seniors?Must?Go).
82. Wang, L., Zheng, W., Ma, H., Lu, B., 2016. Measuring sleep quality from EEG with machine learning approaches. In: Proceedings of the International Joint Conference on Neural Networks (IJCNN-16).
83. Wang, X., Qin, H., Implementation of fall detection system based on data fusion technology. Int. J. u- e- Serv. Sci. Technol. 9 (2016), 1–8, 10.14257/ijunesst.2016.9.4.01.
84. Yang, J., Lee, J., Choi, J., Activity recognition based on RFID object usage for smart mobile devices. J. Comput. Sci. Technol. 26 (2011), 239–246, 10.1007/s11390-011-1126-7.
85. Zhang, Y., Gao, X., Zhu, J., Zheng, W., Lu, B., 2015. A Novel Approach to Driving Fatigue Detection Using Forehead EOG. In: Proceedings of the International IEEE/EMBS Conference on Neural Engineering. pp. 707–710.