A natural contact sensor paradigm for nonintrusive and real-time sensing of biosignals in human-machine interactions

IEEE Sensors Journal

Volumn 11, Issue 3, 2011, Pages 522-529

  Lin, Yingzi ^a  

^a Northeastern University   (United States)

Author keywords

Biosensor; human machine interaction; natural contact; nonintrusive; physiological signals

Indexed keywords

BIOSIGNALS; COMPREHENSIVE EVALUATION; HUMAN-MACHINE INTERACTION; HUMAN-MACHINE SYSTEMS; NATURAL-CONTACT; NON-CONTACT SENSORS; NON-INTRUSIVE; PHYSICAL STATE; PHYSIOLOGICAL SIGNALS; REAL TIME SENSING; TECHNICAL CHALLENGES; WEARABLE SENSORS;

COGNITIVE SYSTEMS; MAN MACHINE SYSTEMS; PHYSIOLOGY;

BIOSENSORS;

EID: 79251602915     PISSN: 1530437X     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSEN.2010.2041773     Document Type: Article

References (50)

1. S.-C. Liu, M. Tomizuka, and G. Ulsoy, "Strategic issues in sensors and smart structures," Structural Control and Health Monitoring, vol. 13, pp. 946-957, 2006.
2. C. L. Lisetti and F. Nasoz, "Using noninvasive wearable computers to recognize human emotions from physiological signals," EURASIP J. Appl. Signal Process., vol. 11, pp. 1672-1687, 2004.
3. J. N. Bailenson, E. D. Pontikakis, I. B. Mauss, J. J. Gross, M. E. Jabon, C. A. C. Hutcherson, C. Nass, and O. John, "Real-time classification of evoked emotions using facial feature tracking and physiological responses," Int. J. Human Computer Studies, vol. 66, no. 5, pp. 303-317, 2008.
4. X. Huang and Y. Lin, "A vision-based hybrid method for facial expression recognition," in Proc. Int. Conf. Ambient Media and Syst., Quebec City, Canada, Feb. 11-14, 2008, CD-ROM.
5. R. W. Picard, Affective Computing. Cambridge, MA: MIT Press, 1997.
6. G. Yang, Y. Lin, and P. Bhattacharya, "Multi-modality inferring of human cognitive states based on the integration of neuro-fuzzy network and information fusion techniques," EURASIP J. Advances in Signal Process. 2008. [Online]. Available: http://www.hindawi.com/getarticle. aspx?doi=10.1155/2008/371621, Article ID 371621, 14 pages, doi:10.1155/2008/ 371621. (Pubitemid 350243196)
7. G. Yang, Y. Lin, and P. Bhattacharya, "A driver fatigue recognition model based on information fusion and dynamic Bayesian network," Information Sciences, vol. 180, pp. 1942-1954, 2010. [Online]. Available: http://dx.doi.org/10.1016/j.ins.2010.01.011
8. H. Leng, "Design and application of a novel driver condition monitoring device-Smart Wheel," M.Sc. thesis, Concordia University, Montreal, Canada, 2005.
9. Y. Lin, H. Leng, G. Yang, and H. Cai, "An intelligent noninvasive sensor for driver pulse wave measurement," IEEE Sensors J., Special Issue on Intelligent Sensors, vol. 7, no. 5, pp. 790-799, Jul. 2007.
10. J. Zhai and A. Barreto, "Stress detection in computer users through non-invasive monitoring of physiological signals," Biomed. Sci. Instrumentation, vol. 42, pp. 495-500, Apr. 2006.
11. K. H. Kim, S. W. Bang, and S. R. Kim, "Emotion recognition system using short-term monitoring of physiological signals," Med. Bio. Eng. Comput., vol. 42, no. 3, pp. 419-427, May 2004.
12. I. C. Christie and B. H. Friedman, "Autonomic specificity of discrete emotion and dimensions of affective space: A multivariate approach," Int. J. Psychophysiology, vol. 51, pp. 143-153, 2004.
13. N. Sinha, J. Ma, and J. T. W. Yeow, "Carbon nanotube based sensors," J. Nanosci. Nanotechnol., vol. 6, no. 3, pp. 573-590, 2006.
14. F. Rahman and N. Shabana, "Wireless sensor network based personal health monitoring system," WSEAS Trans. Systems, vol. 5, no. 5, pp. 966-972, May 2006.
15. W. H. Wu, A. A. T. Bui, M. A. Batalin, D. Liu, and W. J. Kaiser, "Incremental diagnosis method for intelligent wearable sensor systems," IEEE Trans. Inf. Technol. Biomed., vol. 11, no. 5, pp. 553-562, Sep. 2007.
16. M. Ermes, J. Parkka, J. Mantyjarvi, and I. Korhonen, "Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions," IEEE Trans. Inf. Technol. Biomed., vol. 12, no. 1, pp. 20-26, Jan. 2008.
17. M. Strauss, C. Reynolds, S. Hughes, K. Park, G. McDarby, and R. W. Picard, "The handwave bluetooth skin conductance sensor. Affective computing and intelligent interaction," in Proc. Int. Conf., Oct. 22, 2005, vol. 3784, pp. 699-706.
18. R. W. Picard and J. Scheirer, "The galvactivator: A glove that senses and communicates skin conductivity," in Proc. 9th Int. Conf. Human- Computer Interaction, New Orleans, LA, Aug. 2001, pp. 1538-1542.
19. M. P. Bolton, K. McGuinness, J. Cooley, L. Hayes, and A. Howell, "Technical note: A compact data logger for ambulatory skin temperature measurement," J. Med. Eng. Technol., vol. 25, no. 6, pp. 264-268, 2001.
20. F. H.Wilhelm, M. C. Pfaltz, and P. Grossman, "Continuous electronic data capture of physiology, behavior and experience in real life: Towards ecological momentary assessment of emotion," Interacting With Computers, vol. 18, no. 2, pp. 171-186, Mar. 2006.
21. J. Healey, "Wearable and automotive systems for affect recognition from physiology," Ph.D. dissertation, Massachusetts Inst. Technol., Dept. Elect. Eng. Comput. Sci., Cambridge, MA, 2000.
22. T. Shinoda and M. Kato, "A pupil diameter measurement system for accident prevention," in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2007, pp. 1699-1703.
23. S. Choi and Z. Jiang, "A novel wearable sensor device with conductive fabric and PVDF film for monitoring cardiorespiratory signals," Sens. Actuators, A: Phys., vol. 128, no. 2, pp. 317-326, Apr. 19, 2006.
24. D. C. Mack, S. W. Kell, M. Alwan, B. Turner, and R. A. Felder, "Noninvasive analysis of physiological signals (NAPS): A vibration sensor that passively detects heart and respiration rates as part of a sensor suite for medical monitoring," in Proc. Summer Bioeng. Conf., Sonesta Beach Resort, Key Biscayne, FL, Jun. 25-29, 2003.
25. L. Stead, P. Goulev, C. Evans, and E. Mamdani, "The emotional wardrobe," Personal and Ubiquitous Computing, vol. 8, no. 3-4, pp. 282-90, 2004.
26. S. A. Mascaro and H. H. Asada, "Photoplethysmograph fingernail sensors for measuring finger forces without haptic obstruction," IEEE Trans. Robot. Autom., vol. 17, no. 5, pp. 698-708, Oct. 2001.
27. M. V. Scanlon, "Acoustic sensor pad for physiological monitoring," in Proc. IEEE 19th Int. Conf., EMBS, Chicago, IL, Oct. 30-Nov. 2 1997.
28. HIT/HRSA, Innovations in Telehealth: HIT Workshop for HRSA Grantees Region I, II, III, MGH Institute of Health Professions Center for Connected Health and Partners HomeCare. Cambridge, MA, Dec. 2-3, 2009.
29. A. Barreto, J. Zhai, N. Rishe, and Y. Gao, "Measurement of pupil diameter variations as a physiological indicator of the affective state in a computer user," in Proc. 44th Int. ISA Biomed. Sci. Instrumentation Symp., v 43, Tech. Papers, 2007, pp. 146-151.
30. Y. Lin, W. J. Zhang, and L. G.Watson, "Using eye movement parameters for evaluating human-machine interface frameworks under normal control operation and fault detection situations," Int. J. Human Computer Studies, vol. 59, no. 6, pp. 837-873, Dec. 2003.
31. P. Buddharaju, I. T. Pavlidis, P. Tsiamyrtzis, and M. Bazakos, "Physiology- based face recognition in the thermal infrared spectrum," IEEE Trans. Pattern Analy. Mach. Intell., Special Issue on Biometrics: Progress and Directions, vol. 29, no. 4, pp. 613-626, Apr. 2007.
32. H. Y. Hsieh, S. F. Liang, L. W. Ko, M. Lin, and C. T. Lin, "Development of a real-time wireless embedded brain signal acquisition/ processing system and its application on driver's drowsiness estimation," in Proc. IEEE Int. Conf. Syst., Man, Cybern., 2006, vol. 5, pp. 4374-4379.
33. C. Berka, D. J. Levendowski, M. M. Cvetinovic, M. M. Petrovic, G. Davis, M. N. Lumicao, V. T. Zivkovic, M. V. Popovic, and R. Olmstead, "Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset," Int. J. Human-Computer Interaction, vol. 17, no. 2, pp. 151-170, 2004.
34. C. Reynolds and R. Picard, "Designing for affective interactions," in Proc. 9th Int. Conf. Human-Computer Interaction, New Orleans, LA, Aug. 5-10, 2001.
35. Y. Qi, C. Reynolds, and R. W. Picard, "The Bayes point machine for computer-user frustration detection via pressure mouse," in Proc. Workshop on Perceptive Interfaces, Nov. 2001, MIT Media Lab. TR 545.
36. Q. Ji, A prototype emotional mouse for non-intrusive acquisition of physiological and behavioral data 2007. [Online]. Available: http://www.ecse.rpi.edu/homepages/qji/HCI/mouse.html
37. T. Ishikawa, K. Watanabe, T. Nakamura, and T. Okada, "Unconstrained and noninvasive measurement of heartbeat by a pneumatic method for drivers," in Proc. SICE Ann. Conf. , Sapporo, Japan, Aug. 4-6, 2004.
38. Q. Meng and M. H. Lee, "Design issues for assistive robotics for the elderly," Advanced En. Informat., vol. 20, pp. 171-186, 2005.
39. H. Cai and Y. Lin, "An experiment to non-intrusively collect driver physiological parameters towards cognitive/emotional state recognition," in Proc. SAE 2007World Congr., Cobo Center, Detroit, MI, Apr. 16-19, 2007, SAE Paper No. 2007-01-0401.
40. K. K. Kim, J. S. Kim, B. H. Choi, G. S. Chung, H. B. Lee, Y. G. Lim, and K. S. Park, "Comparison of HRV spectral analysis methods for unconstrainedly measured ECG," in Proc. 5th IASTED Int. Conf. Biomed. Eng., 2007, pp. 365-369.
41. H. A. M. Daanen, E. Van De Vliert, and X. Huang, "Driving performance in cold, warm, and thermoneutral environments," Appl. Ergonomics, vol. 34, no. 6, pp. 597-602, Nov. 2003.
42. S. Bhansali, S. B. Hoath, and H. T. Henderson, "Probing human skin as an information-rich smart biological interface using MEMS sensors," Microelectron. J., vol. 33, pp. 121-127, 2002.
43. P. W. Barth, S. L. Bernard, and J. B. Angell, "Flexible circuit and sensor arrays fabricated by monolithic silicon technology," IEEE Trans. Electron. Devices, vol. ED-32, no. 7, pp. 1202-1205, 1985.
44. H. Leng and Y. Lin, "A flexible NEMS sensor for measuring human skin temperature," Smart Structures and Systems, 2010, (under review).
45. H. Leng and Y. Lin, "A SWNT-based sensor for detecting human blood alcohol concentration," in Proc. 3rd Int. Conf. Nano-Networks, Boston, MA, Sep. 15-17, 2008.
46. H. Leng and Y. Lin, "Design and experimental study of the CNT based sensor toward measuring blood alcohol concentration (BAC) with short response delay," IEEE Sensors J., vol. 10, no. 6, pp. 1091-1097, Jun. 2010.
47. H. Leng and Y. Lin, "Development of an innovative deformation-based tissue softness sensor," IEEE Sensors J., vol. 9, no. 5, pp. 548-554, May 2009.
48. W. J. Zhang, Q. Li, and S. L. Guo, "Integrated design of mechanical structure and control algorithm for a programmable four-bar linkage," IEEE/ASME Trans. Mechatron., vol. 4, no. 4, pp. 354-362, 1999.
49. G. Taguchi, Taguchi Methods, Research and Development. Dearborn, MI: American Suppliers Institute Pressure, 1991a, vol. 1.
50. G. Taguchi, Taguchi Methods, Signal-to-Noise Ratio for Quality Evaluation. Dearborn, MI: American Suppliers Institute Pressure, 1991b, vol. 3.