Physical task stress and speaker variability in voice quality

Eurasip Journal on Audio, Speech, and Music Processing

Volumn 2015, Issue 1, 2015, Pages

  Godin, Keith W ^a   Hansen, John H L ^a  

^a The University of Texas at Dallas   (United States)

Author keywords

Glottal waveform analysis; Physical task stress; Speaker variability; Speech variability

Indexed keywords

NATURAL FREQUENCIES; SIGNAL PROCESSING; SPEECH;

ACOUSTIC CORRELATES; EXCITATION STRUCTURES; FUNDAMENTAL FREQUENCIES; SPEAKER RECOGNITION; SPEAKER VARIABILITY; SPEECH TECHNOLOGY; SYSTEMATIC CHANGES; TASK STRESS;

SPEECH RECOGNITION;

EID: 84943595385     PISSN: 16874714     EISSN: 16874722     Source Type: Journal    
DOI: 10.1186/s13636-015-0072-7     Document Type: Article

References (70)

1. J Deller, JHL Hansen, J Proakis, Discrete-Time Processing of Speech Signals, 2nd edn. (IEEE Press, New York, 2000)
2. AT Welford, Stress and Performance. Ergonomics, 2007, pp. 567–580
3. E Baker, J Hipp, H Alessio, Ventilation and speech characteristics during submaximal aerobic exercise. J. Speech. Lang. Hear. Res 51, 1203–1214 (2008)
4. JH Doust, JM Patrick, The limitation of exercise ventilation during speech. Respir. Physiol. 46, 137–147 (1981)
5. Y Meckel, A Rotstein, O Inbar, The effects of speech production on physologic responses during submaximal exercise. Med. Sci. Sports Exerc. 34(8), 1337–43 (2002)
6. EF Bailey, JD Hoit, Speaking and breathing in high respiratory drive. J. Speech Lang. Hear. Res. 45, 89–99 (2002)
7. JD Hoit, RW Lansing, KE Perona, Speaking-related dyspnea in healthy adults. J. Speech Lang. Hear. Res. 50, 361–374 (2007)
8. JE Luketic, The Effect of Inspiratory Muscle Strength Training on Ventilation and Dyspnea During Simultaneous Exercise and Speech (Master’s thesis, Miami University, Oxford, 2007)
9. SA Patil, Alternate Sensor Based Speech Systems for Speaker Assessment and Robust Human Communication. PhD thesis, CRSS: Center for Robust Speech Systems (The University of Texas at Dallas, Richardson, 2009)
10. JG Mohler, Quantification of dyspnea confirmed by voice pitch analysis. Bull. Eur. Physiopathol. Respir. 18, 837–50 (1982)
11. JA Rodriguez-Marroyo, G Villa, J Garcia-Lopez, C Foster, Relationship between the talk test and ventilatory thresholds in well trained cyclists. J. Strength Cond. Res. 27(7), 1942–1949 (2013)
12. A Rotstein, Y Meckel, O Inbar, Perceived speech difficulty during exercise and its relation to exercise intensity and physiological responses. Eur. J. Appl. Physiol. 92, 431–436 (2004)
13. JA Rodriguez-Marroyo, J Garcia-Lopez, C-E Juneau, JG Villa, Workload demands in professional multi-stage cycling races of varying duration. Br. J. Sports Med. 43, 180–185 (2007)
14. KW Godin, JHL Hansen, Analysis and Perception of Speech Under Physical Task Stress. ISCA INTERSPEECH-2008, 2008, pp. 1674–1677. Brisbane, Australia
15. HM Koblick, Effects of Simultaneous Exercise and Speech Tasks on the Perception of Effort and Vocal Measures in Aerobic Instructors (Master’s thesis, Univ. of Central Florida, Orlando, 2004)
16. B Johannes, P Wittels, R Enne, G Eisinger, CA Castro, JL Thomas, AB Adler, R Gerzer, Non-linear function model of voice pitch dependency on physical and mental load. Eur. J. Appl. Physiol. 101, 267–276 (2007)
17. RF Orliko, Voice production during a weightlifting and support task. Folia Phoniatr. Logop. 60, 188–194 (2008)
18. RF Orliko, RJ Baken, The effect of the heartbeat on vocal fundamental frequency perturbation. J. Speech Hear. Res. 32, 576–582 (1989)
19. KW Godin, JHL Hansen, Vowel context and speaker interactions influencing glottal open quotient and formant frequency shifts in physical task stress. ISCA INTERSPEECH-2011, 2011, pp. 2945–2948
20. KW Godin, JHL Hansen, Analysis of the effects of physical task stress on the speech signal. J. Acoust. Soc. Am. 130, 3992–3998 (2011)
21. LG Olson, KP Strohl, The response of the nasal airway to exercise. Am. Rev. Respir. Dis. 135(2), 356–359 (1987)
22. KW Godin, T Hasan, JHL Hansen, Glottal Waveform Analysis of Physical Task Stress Speech. ISCA INTERSPEECH-2012, Wed-SS6-15, 2012, pp. 1–4. Portland, OR
23. MHL Hecker, KN Stevens, G von Bismark, CE Williams, Manifestations of task-induced stress in the acoustic speech signal. J. Acoust. Soc. Am. 44(4), 993–1001 (1968)
24. JHL Hansen, S Patil, Speech Under Stress: Analysis, Modeling and Recognition. Speaker Classification I: Fundamentals, Features, and Methods, (Springer Publishing, 2007), pp. 108–137
25. CT Ishi, A New Acoustic Measure for Aspiration Noise Detection. ISCA INTERSPEECH-2004, 2004. Jeju Island, Korea
26. C Gobl, AN Chasaide, Acoustic characteristics of voice quality. Speech Comm. 11, 481–490 (1992)
27. N Campbell, Changes in Voice Quality Due to Social Conditions. Proc. Inter. Congress on Phonetic Science, 2007, pp. 2093–2096
28. N Campbell, P Mohktari, Voice Quality: The 4th Prosodic Dimension. Proc. Inter. Congress on Phonetic Science, 2003, pp. 2417–2430
29. JHL Hansen, Analysis and Compensation of Stressed and Noisy Speech with Application to Robust Automatic Recognition (PhD thesis, School of Electrical Engineering, Georgia Institute of Technology, Atlanta, 1988)
30. C Zhang, JHL Hansen, Analysis and Classification of Speech Mode: Whispered Through Shouted. ISCA Interspeech-2007, 2007, pp. 2289–2292
31. C Gobl, AN Chasaide, The role of voice quality in communicating emotion, mood, and attitude. Speech Comm. 40, 182–212 (2003)
32. CE Williams, KN Stevens, Emotions and speech: some acoustical correlates. J. Acoust. Soc. Am. 52(4B), 1238–1250 (1972)
33. L Gavidia-Ceballos, JHL Hansen, Direct speech feature estimation using an iterative EM algorithm for vocal cancer detection. IEEE Trans. Biomed. Eng. 43(4), 373–383 (1996)
34. KE Cummings, MA Clements, Analysis of glottal excitation of emotionally styled and stressed speech. J. Acoust. Soc. Am. 98, 88–98 (1995)
35. JHL Hansen, MA Clemments, Evaluation of speech under stress and emotional conditions. J. Acoust. Soc. Am. 82, S17 (1987)
36. DG Childers, CK Lee, Vocal quality factors: analysis, synthesis, and perception. J. Acoust. Soc. Am. 90(5), 2394–2410 (1991)
37. P Alku, E Vilkman, A comparison of glottal voice source quantification parameters in breathy, normal and pressed phonation of female and male speakers. Folia Phoniatr. Logop. 48, 250–254 (1994)
38. EB Holmberg, RE Hillman, JS Perkell, Glottal airflow and transglottal air pressure measurements for male and female speaker in soft, normal, and loud voice. J. Acoust. Soc. Am. 84, 511–529 (1988)
39. G de Krom, Some spectral correlates of pathological breathy and rough voice quality for different types of vowel fragments. J. Speech Hear. Res. 38, 794–811 (1995)
40. T Drugman, B Bozkurtb, T Dutoit, Causal-anticausal decomposition of speech using complex cepstrum for glottal source estimation. Speech Comm. 53, 855–866 (2011)
41. CT Ishi, K-I Sakakibara, H Ishiguro, N Hagita, A method for automatic detection of vocal fry. IEEE Trans. Audio Speech Lang. Process. 16(1), 47–56 (2008)
42. E Moore, J Torres, A performance assessment of objective measures for evaluating the quality of glottal waveform estimates. Speech Comm. 50, 56–66 (2008)
43. M Artkoski, J Tommila, A-M Laukkanen, Changes in voice during a day in normal voices without vocal loading. Logoped. Phoniatr. Vocol. 27, 118–123 (2002)
44. AL Bouhuys, HK Schutte, DGM Beersma, GLJ Nieboer, Relations between depressed mood and vocal parameters before, during and after sleep deprivation: a circadian rhythm study. J. Affect. Disord. 19, 249–258 (1990)
45. KE Cummings, MA Clements, Analysis of Glottal Waveforms Across Stress Styles. IEEE ICASSP-90: Inter. Conf. Acoustics, Speech, and Signal Processing, 1990
46. TF Yap, J Epps, EHC Choi, E Ambikairajah, TX Dallas, Glottal Features for Speech-Based Cognitive Load Classification. IEEE ICASSP-2010: Inter. Conf. Acoustics, Speech, and Signal Processing, 2010, pp. 5234–5237
47. M Lugger, B Yang, Cascaded Emotion Classification via Psychological Emotion Dimensions Using a Large Set of Voice Quality Parameters. IEEE ICASSP-2008: Inter. Conf. Acoustics, Speech, and Signal Processing, 2008
48. R Sun, E Moore, Affective Computing and Intelligent Interaction, vol. 6975 of Lecture Notes in Computer Science, chapter Investigating Glottal Parameters and Teager Energy Operators in Emotion Recognition, (Springer, 2011), pp. 425–434
49. SE Linville, J Rens, Vocal tract resonance analysis of aging voice using long-term average spectra. J. Voice 15, 323–330 (2001)
50. J Gudnason, M Brookes, Voice Source Cepstrum Coefficients for Speaker Identification. IEEE ICASSP-2008: Inter. Conf. Acoustics, Speech, and Signal Processing, 2008
51. MD Plumpe, TF Quatieri, DA Reynolds, Modeling of the glottal flow derivative waveform with application to speaker identification. IEEE. Trans. Speech. Audio. Process. 7(5), 569–86 (1999)
52. JHL Hansen, Evaluation of Acoustic Correlates of Speech Under Stress for Robust Speech Recognition, 1989, pp. 31–32. Boston, Mass
53. JHL Hansen, C Swail, AJ South, RK Moore, H Steeneken, EJ Cupples, T Anderson, CRA Vloeberghs, I Trancoso, P Verlinde, The Impact of Speech Under ‘Stress’ on Military Speech Technology, published by NATO Research & Technology Organization RTO-TR-10, AC/323(IST)TP/5 IST/TG-01, 2000
54. JHL Hansen, SE Bou-Ghazale, G Zhou, R Sarikaya, Speech Processing in Noise, Stress, and Lombard Effect, Research Monograph published by DoD, AFRL-IF-RS-TR-1999-208, 1999
55. SE Bou-Ghazale, JHL Hansen, A comparative study of traditional and newly proposed features for recognition of speech under stress. IEEE. Trans. Speech. Audio. Process. 8(4), 429–442 (2000)
56. JHL Hansen, D Cairns, ICARUS: a source generator based real-time system for speech recognition in noise, stress, and Lombard effect. Speech Comm. 16(4), 391–422 (1995)
57. JHL Hansen, M Clements, Source generator equalization and enhancement of spectral properties for robust speech recognition in noise and stress. IEEE. Trans. Speech. Audio. Process. 3(5), 407–415 (1995)
58. JHL Hansen, Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech Comm.Speech Under Stress. 20(2), 151–170 (1996)
59. D Cairns, JHL Hansen, Nonlinear snalysis and detection of speech under stressed conditions. J. Acoust. Soc. Am. 96(6), 3392–3400 (1994)
60. G Zhou, JHL Hansen, JF Kaiser, Nonlinear feature based classification of speech under stress. IEEE. Trans. Speech. Audio. Process. 9(2), 201–216 (2001)
61. JHL Hansen, W Kim, M Rahurkar, E Ruzanski, J Meyerhoff, Robust emotional stressed speech detection using weighted frequency subbands. EURASIP J. Adv. Signal Process. Article ID 906789, 10 (2011)
62. JHL Hansen, E Ruzanski, H Boril, J Meyerhoff, TEO-based speaker stress assessment using hybrid classification and tracking schemes. Int. J. Speech Technol. 15(3), 295–311 (2012)
63. T Drugman, M Thomas, J Gudnason, P Naylor, T Dutoit, Detection of glottal closure instants from speech signals: a quantitative review. IEEE Trans. Audio Speech Lang. Process. 20, 994–1006 (2012)
64. T Drugman, A Alwan, Joint Robust Voicing Detection and Pitch Estimation Based on Residual Harmonics. ISCA INTERSPEECH-2011, 2011, pp. 1973–1976
65. J Kane, C Gobl, Evaluation of glottal closure instant detection in a range of voice qualities. Speech Comm. 55, 295–314 (2013)
66. P Alku, T Backstrom, E Vilkman, Normalized amplitude quotient for parametrization of the glottal flow. J. Acoust. Soc. America. 112, 701–710 (2002)
67. A Ikeno, V Varadarajan, S Patil, JHL Hansen, UT-Scope: Speech Under Lombard Effect and Cognitive Stress. IEEE Aerospace Conf.-2007, 2007, pp. 1–7. Big Sky, Montana
68. AL Webster, S Aznar-Lain, Intensity of physical activity and the “talk test”. ACSM's Health. Fitness J. 12, 13–17 (2008)
69. JA Davis, VA Convertino, A comparison of heart rate methods for predicting endurance training intensity. Med. Sci. Sports. 7, 295–298 (1975)
70. H Tanaka, KD Monahan, DR Seals, Age-predicted maximal heart rate revisited. J. Am. Coll. Cardiol. 37, 153–156 (2001)