The physiological microphone (PMIC): A competitive alternative for speaker assessment in stress detection and speaker verification

Speech Communication

Volumn 52, Issue 4, 2010, Pages 327-340

  Patil, Sanjay A ^a   Hansen, John H L ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

Non acoustic sensor; Physiological sensor; PMIC; Speaker verification; Stress detection

Indexed keywords

DEEP SEA; EXPERIMENTAL ASSESSMENT; NON-ACOUSTIC SENSORS; PHYSIOLOGICAL SENSORS; RESCUE OPERATIONS; SPEAKER VARIABILITY; SPEAKER VERIFICATION; SPEECH INTERFACE; SPEECH PRODUCTION; SPEECH SYSTEMS; STRESS CONDITION; STRESS DETECTION; TEST CONDITION;

ACOUSTIC DEVICES; ACOUSTICS; FEATURE EXTRACTION; MICROPHONES; SENSORS; STRESSES;

SPEECH RECOGNITION;

EID: 76849101651     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.11.006     Document Type: Article

References (56)

1. Akargun U.C., and Erzin E. Estimation of acoustic microphone vocal tract parameters from throat microphone recordings. IEEE Signal Process. Comm. Appl. (2007) 1-4
2. Baber C., Mellor B., Graham R., Noyes J.M., and Tunley C. Workload and the use of automatic speech recognition: The effects of time and resource demands. Speech Comm. 20 1-2 (1996) 37-53
3. Benzeghiba M., Mori R.D., Deroo O., Dupont S., Erbes T., Jouvet D., Fissore L., Laface P., Mertins A., Ris C., Rose R., Tyagi V., and Wellekens C. Automatic speech recognition and speech variability: A review. Speech Comm. 49 10-11 (2007) 763-786
4. Bimbot F., Bonastre J., Fredouille C., et al. A tutorial on text-independent speaker verification. EURASIP J. Appl. Signal Process. 2004 4 (2004) 430-451
5. Bosch L. Emotions, speech and the ASR framework. Speech Comm. 40 1-2 (2003) 213-225
6. Bou-Ghazale, S., 1996. Analysis, modeling and perturbation of speech under stress with applications to speech synthesis and recognition. Ph.D. thesis, Duke University, NC.
7. Bou-Ghazale, S.E., Hansen, J.H.L., 1995. A source generator based modeling framework for synthesis of speech under stress. In: IEEE Conf. on Acoust., Speech, Signal Process. (ICASSP '95) 1, pp. 664-667.
8. Bou-Ghazale S.E., and Hansen J.H.L. A comparative study of traditional and newly proposed features for recognition of speech under stress. IEEE Trans. Speech Audio Process. 8 4 (2000) 429-442
9. Brady, K., Quatieri, T., Campbell, J., Campbell, W., Brandstein, M., Weinstein, C.J., 2004. Multisensor MELPe using parameter substitution. In: IEEE Internat. Conf. on Acoust., Speech, Signal Process. (ICASSP '04) 1, pp. I-477-480.
10. Brouha L., Smith P., Lanne R., and Maxfield M. Physiological reactions of men and women during muscular activity and recovery in various environments. J. Appl. Physiol. 16 1 (1961) 133-140
11. Brouha L., Maxfield M., Smith P., and Stopps G. Discrepancy between heart rate and oxygen consumption during work in the warmth. J. Appl. Physiol. 18 6 (1963) 1095-1098
12. Brown D., Keenaghan K., and Desimini S. Measuring glottal activity during voiced speech using a tuned electromagnetic resonating collar sensor. Measure. Sci. Technol. 16 (2005) 2381-2390
13. Burnett, G., 1999. The physiological basis of glottal electromagnetic micropower sensors (GEMS) and their use in defining an excitation function for the human vocal tract. Ph.D. thesis, University of California, Davis.
14. Chan, C., 2003. Multi-expert automatic speech recognition system using myoelectric signals. Ph.D. thesis, University of New Brunswick, Canada.
15. Corrigan, G., 1996. Speaker understandability as a function of prosodic parameters. Ph.D. thesis, Northwest University, WA.
16. Cosmides L. Invariances in the acoustic expression of emotion during speech. J. Exp. Psychol.: Human Percept. Perform. 9 6 (1983) 864-881
17. Courteville A., Gharbi T., and Cornu J.Y. MMG measurement: A high-sensitivity microphone-based sensor for clinical use. IEEE Trans. Biomed. Eng. 45 2 (1998) 145-150
18. Denes P., and Pinson E. The Speech Chain: The Physics and Biology of Spoken Language (1993), W.H. Freeman and Company, New York, USA
19. de-Paula M.H., Vinha C.A., and Badini R.G. High-sensitivity optical microphone for photoacoustics. Rev. Sci. Instrum. 63 (1992) 3487-3491
20. Freund Y., and Schapire R. A short introduction to boosting. J. Jpn. Soc. Artif. Intell. 14 5 (1999) 771-780
21. Gable, T., 2000. Speaker verification using acoustic and glottal electromagnetic micropower sensor (GEMS) data. Ph.D. thesis, University of California, Davis.
22. Goodie J., Larkin K., and Schuass S. Validation of the polar heart rate monitor for assessing heart rate during physical and mental stress. J. Psychophysiol. 14 3 (2000) 159-164
23. Graciarena M., Franco H., Sonmez K., and Bratt H. Combining standard and throat microphones for robust speech recognition. IEEE Signal Process. Lett. 10 3 (2003) 72-74
24. Hansen, J.H.L., 1993. Adaptive source generator compensation and enhancement for speech recognition in noisy stressful environments. In: IEEE Internat. Conf. on Acoust., Speech, Signal Process. (ICASSP-93) 2, pp. 95-98.
25. Hansen J.H.L. Morphological constrained feature enhancement with adaptive cepstral compensation (MCE-ACC) for speech recognition in noise and Lombard effect. IEEE Trans. Speech Audio Process. 2 4 (1994) 598-614
26. Hansen J.H.L. Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech Comm. 20 1-2 (1996) 151-173
27. Heuber, T., Chollet, G., Denby, B., Stone, M., 2007. Continuous-speech phone recognition from ultrasound and optical images of the tongue and lips. INTERSPEECH 2007, pp. 658-661.
28. Holzrichter, J.F., Ng, L.C., 2002. Speech coding using EM sensor and acoustic signals. In: IEEE 10th Digital Signal Process. Workshop, pp. 35-36.
29. Huang R., Hansen J., and Angkititrakul P. Dialect/accent classification using unrestricted audio. IEEE Trans. Audio, Speech, Lang. Process. 15 2 (2007) 453-464
30. Ikeno, A., Varadarajan, V., Patil, S., Hansen, J.H.L., 2007. UT-Scope: Speech under Lombard effect and cognitive stress. In: IEEE Aerospace Conference, pp. 1-7.
31. Ingalls R. Throat microphone. J. Acoust. Soc. Am. 81 (1987) 809
32. Jou, S., Schultz, T., Waibel, A., 2007. Multi-stream articulatory feature classifiers for surface electromyographic continuous speech recognition. In: IEEE Internat. Conf. on Acoust., Speech, Signal Process. (ICASSP-2007).
33. Junqua J. The influence of acoustics on speech production: A noise-induced stress phenomenon known as the Lombard reflex. Speech Comm. 20 1-2 (1996) 13-22
34. Klabunde R. Cardiovascular Physiology Concepts (2005), Lippincott Williams and Wilkins
35. Knudsen, S., Yurek, A., Tveten, A., Dandridge, A., 1994. High-sensitivity fiber optic planar ultrasonic microphone. In: Tenth SPIE Internat. Conf. on Optical Fibre Sensors 2360, pp. 396-399.
36. Mainardi, E., Davalli, A., 2007. Controlling a prosthetic arm with a throat microphone. In: Annual Internat. Conf. of the IEEE Engineering in Medicine and Biology Society (EMBS 2007), pp. 3035-3039.
37. Maxfield M., and Brouha L. Validity of heart rate as an indicator of cardiac strain. J. Appl. Physiol. 18 6 (1963) 1099-1104
38. Mohamad, N., Iovenitti, P., Vinay, T., 2007. High sensitivity capacitive MEMS microphone with spring supported diaphragm. In: Proc. of the SPIE 6800, p. 40.
39. Mulder G., and Mulder L. Information processing and cardiovascular control. Psychophysiology 18 4 (1981) 392-402
40. Murray I.R., Baber C., and South A. Towards a definition and working model of stress and its effects on speech. Speech Comm. 20 1-2 (1996) 3-12
41. Noma, H., Kogure, K., Nakajima, Y., Shimonomura, H., Ohsuga, M., 2005. Wearable data acquisition for heartbeat and respiratory information using NAM (non-audible murmur) microphone. In: Ninth IEEE Internat. Symp. on Wearable Computers, pp. 210-211.
42. Otani K., and Hasegawa T. The image input microphone - a new nonacoustic speech communication system by media conversion from oral motion images to speech. IEEE J. Select. Areas Comm. 13 1 (1995) 42-48
43. Peters, R.D., 1995. Remote respiratory monitor. In: The Eighth IEEE Symp. on Computer-Based Medical Systems, pp. 204-211.
44. Quatieri T.F., Brady K., Messing D., Campbell J.P., Campbell W.M., Brandstein M.S., Weinstein C.J., Tardelli J.D., and Gatewood P.D. Exploiting nonacoustic sensors for speech encoding. IEEE Trans. Audio, Speech, Lang. Process. 14 2 (2006) 533-544
45. Reynolds D. Speaker identification and verification using gaussian mixture speaker models. Speech Comm. 17 1-2 (1995) 91-108
46. Roucos, S., Viswanathan, V., Henry, C., Schwartz, R., 1986. Word recognition using multisensor speech input in high ambient noise. In: IEEE Internat. Conf. on Acoust., Speech, Signal Process. (ICASSP '86) 11, pp. 737-740.
47. Scanlon, M., Fisher, F., Chen, S., 2002. Physiological sensors for speech recognition. In: Multimodal Speech Recognition Workshop, pp. 1-5.
48. Shahina, A., Yegnanarayana, B., 2005. Language identification in noisy environments using throat microphone signals. In: Internat. Conf. on Intelligent Sensing and Information Process, pp. 400-403.
49. Titze I.R., Story B.H., Burnett G., Holzrichter J., Ng L., and Lea W. Comparison between electroglottography and electromagnetic glottography. J. Acoust. Soc. Am. 107 1 (2000) 581
50. Tran, V., Bailey, G., Loevenbruck, H., Jutten, C., 2008. Improvement to a NAM captured whisper-to-speech system. In: INTERSPEECH 2008, pp. 1465-1568.
51. Viswanathan, V., Karnofsky, K., Stevens, K., Alakel, M., 1984. Multisensor speech input for enhanced immunity to acoustic background noise. In: IEEE Internat. Conf. Acoust., Speech, Signal Process. (ICASSP '84) 9, pp. 57-60.
52. Wand, M., Jou, S., Schultz, T., 2007. Wavelet- based front-end for electromyographic speech recognition. In: INTERSPEECH 2007.
53. Wang, H., Wang, L.Y., 2003. Multi-sensor adaptive heart and lung sound extraction. In: Proc. of IEEE Sensors 2, pp. 1096-1099.
54. Womack B.D., and Hansen J.H.L. Classification of speech under stress using target driven features. Speech Comm. 20 1-2 (1996) 131-150
55. Womack, B.D., Hansen, J.H.L., 1996b. Improved speech recognition via speaker stress directed classification. In: IEEE Internat. Conf. Acoust., Speech, Signal Process. (ICASSP-96) 1, pp. 53-56.
56. Zhou G., Hansen J.H.L., and Kaiser J.F. Nonlinear feature based classification of speech under stress. IEEE Trans. Speech Audio Process. 9 3 (2001) 201-216