Acoustic correlates of speech when under stress: Research, methods and future directions

International Journal of Speech, Language and the Law

Volumn 18, Issue 1, 2011, Pages 75-98

  Kirchhübel, Christin ^a   Howard, David M ^b   Stedmon, Alex W ^b  

^a UNIVERSITY OF YORK   (United Kingdom)

^b NONE

Author keywords

Acoustic analysis; Acoustic and; Psychological stress

Indexed keywords

EID: 80053197531     PISSN: 17488885     EISSN: 17488893     Source Type: Journal    
DOI: 10.1558/ijsll.v18i1.75     Document Type: Article

References (71)

1. Anolli, L. and Ciceri, R. (1997) The voice of deception: vocal strategies of naïve and able liars. Journal of Nonverbal Behavior 21: 259-284.
2. Asterita, M.F. (1985) The Physiology of Stress, with Special Reference to the Neuroendocrine System. New York: Human Sciences Press, Inc.
3. Baber, C., Mellor, B., Graham, R., Noyes, J.M. and Turnley, C. (1996) Workload and the use of automatic speech recognition: the effects of time and resource demands. Speech Communication 16: 37-53.
4. Bartlett, D. (1998) Stress. Perspectives and Processes. Buckingham: Open University Press.
5. Benson, P. (1995) Analysis of the acoustic correlates of stress from an operational aviation emergency. In I. Trancoso and R. Moore (eds) Proceedings ESCA-NATO Tutorial and Research Workshop on Speech under Stress 61-64. 9-11 September. Lisbon.
6. Benus, S., Enos, F., Hirschberg, J. and Shriberg, E. (2006) Pauses in deceptive speech. Proceedings ISCA 3rd International Conference on Speech Prosody. Dresden, Germany.
7. Bhatt, S. and Brandon, S.E. (2008) Review of Voice Stress Based Technologies for the Detection of Deception. Accessed 12 April 2010 from http://www.polygraph.org/section/ review-voice-stress-based-technologies-detection-deception
8. Bond, Z.S., Moore, T.J. and Gable, B. (1989) Acoustic- phonetic characteristics of speech produced in noise and while wearing an oxygen mask. Journal of the Acoustical Society of America 85(2): 907-912.
9. Brenner, M., Shipp, T., Doherty, E.T. and Morrissey, P. (1983) Voice measures of psychological stress- laboratory and field data. In I.R. Titze and R.C. Scherer (eds) Vocal Fold Physiology: biomechanics, acoustics and phonatory control 239-248. Denver: Denver Center for Performing Arts.
10. Cannon, W. B. (1915) Bodily Changes in Pain, Hunger, Fear and Rage: an account of recent researches into the function of emotional excitement. New York: Appleton.
11. Cody, M.J., Marston, P.J. and Foster, M. (1984) Deception: paralinguistic and verbal leakage. In R.N. Bostrom and B.H. Westley (eds) Communication Yearbook 8 464-490. Beverly Hills CA: Sage.
12. Collins English dictionary. Accessed 12 April 2010 from http://www.collinslanguage.com/
13. Cox, T. (1978) Stress. London: The Macmillan Press Ltd.
14. Damphousse, K.R., Pointon, L., Upchurch, D. and Moore, R.K. (2007) Assessing the Validity of Voice Stress Analysis Tools in a Jail Setting. Report submitted to the U.S. Department of Justice.
15. Ekman, P., Friesen, W.V. and Scherer, K.R. (1976) Body movement and voice pitch in deceptive interaction. Semiotica 16: 23-27.
16. Eriksson, A. and Lacerda, F. (2007) Charlatanry in forensic speech science: a problem to be taken seriously. International Journal of Speech, Language and the Law 14(2): 169-193.
17. Fernandez, R. and Picard, R.W. (2003) Modelling drivers' speech under stress. Speech communication 40: 145-159.
18. Finch, M.I. and Stedmon, A.W. (1998) The complexities of stress in the operational military environment. In M. Hanson (ed.) Contemporary Ergonomics 388-392. London: Taylor & Francis Ltd.
19. Fuller, B.F., Horii, Y. and Conner, D.A. (1992) Validity and reliability of nonverbal voice measures as indicators of stressor-provoked anxiety. Research in Nursing & Health 15: 379-389.
20. Hansen, J.H.L. and Bou-Ghazale, S. (1997) Getting started with SUSAS: a speech under simulated and actual stress database. Proceedings Eurospeech. International Conference on Speech Communication and Technology. September. Rhodes, Greece.
21. Hausner, M. (1987) Sprechgeschwindigkeit als eine Funktion von Stress: Eine Fallstudie. Language and Style 20: 285-311.
22. Hecker, M.H.L., Stevens, K.N., von Bismarck, G. and Williams, C.E. (1968) Manifestations of task-induced stress in the acoustic speech signal. Journal of the Acoustical Society of America 44: 993-1001.
23. Hicks, J.W. Jr. (1979) An acoustical/temporal analysis of emotional stress in speech. Ph.D. Dissertation, University of Florida.
24. Hollien, H. (1990) The Acoustics of Crime. The New Science of Forensic Phonetics. New York: Plenum Press.
25. Hollien, H., Saletto J.A. and Miller, S.K. (1993) Psychological Stress in Voice: a new Approach. Studia Phonetica Posnaniensia 4: 5-17.
26. Hollien, H and Harnsberger, J.D. (2006) Voice Stress Analyzer Instrumentation Evaluation. Final report. Gainesville, FL: CIFA, 2006. Contract: FA-4814-04-0011.
27. Howard, D.M., Hirson, A., Brookes, T. and Tyrrell, A.M. (1995) Spectrography of disputed speech samples by peripheral human hearing modelling. Forensic Linguistics 2(1): 28-38.
28. Howard, D.M., Abberton, E. and Fourcin, A. (2011) Disordered voice measurement and auditory analysis. Speech Communication DOI:10.1016/j.specom.2011.03.008.
29. Jessen, M. (2006) Einfluss von Stress auf Sprache und Stimme. Unter besonderer Berücksichtigung polizeidienstlicher Anforderungen. Idstein: Schulz-Kirchner Verlag GmbH.
30. Johannes, B., Salnitski, V.P., Gunga, H-C. and Kirsch, K. (2000) Voice stress monitoring in space. Possibilities and limits. Aviation, Space, and Environmental Medicine 71: 58-64.
31. Junqua, J-C. (1993) The Lombard reflex and its role on human listeners and automatic speech recognizers. The Journal of the Acoustical Society of America 93: 510-524.
32. Karlsson, I., Banziger, T., Dankovicová, J., Johnstone, T., Lindberg, J., Melin, H., Nolan, F. and Scherer, K. (2000) Speaker verification with elicited speaking styles in the VeriVox project. Speech Communication 31: 121-129.
33. Kienast, M. and Glitza, F. (2003) Respiratory Sounds as an Idiosyncratic Feature in Speaker Recognition. Proceedings of 15th ICPhS 1607-1610. Barcelona, Spain.
34. Kirschbaum, C., Pirke, K-M. and Hellhammer, D.H. (1993) The 'Trier Social Stress Test'- a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology 28: 76-81.
35. Künzel, H.J., Braun, A. and Eysholdt, U. (1992) Einfluss von Alkohol auf Sprache und Stimme. Heidelberg: Kriminalistik Verlag.
36. Kuroda, I., Fujiwara, O., Okamura, N. and Utsuki, N. (1976) Method for determining pilot stress through analysis of voice communication. Aviation, Space and Environmental Medicine 47: 528-533.
37. Labov, W. (1972) Sociolinguistic Patterns. Oxford: Blackwell.
38. Laver, J. (1991) The Gift of Speech: papers in the analysis of speech and voice. Edinburgh: Edinburgh University Press.
39. Laver, J. (1980) The Phonetic Description of Voice Quality. Cambridge: Cambridge University Press.
40. Linville, S.E. (2001) Vocal Aging. San Diego: Singular.
41. Lively, S. E., Pisoni, D. B., Van Summers, W. and Bernacki, R.H. (1993) Effects of cognitive workload on speech production: acoustic analysis and perceptual consequences. Journal of the Acoustical Society of America 93: 2962-2973.
42. Meinerz, C. (2010) Effekte von Stress auf Stimme und Sprechen: Eine phonetische Untersuchung auf der Grundlage ausgewählter akustischer und sprecherdynamischer Parameter unter Berücksichtigung verschiedener Stressklassen. Norderstedt: Books on Demand GmbH.
43. Mendoza, E. and Carballo, G. (1998) Acoustic analysis of induced vocal stress by means of cognitive workload tasks. Journal of Voice 12: 263-273.
44. Murray, I.R., Baber, C. and South, A. (1996) Towards a definition and working model of stress and its effects on speech. Speech Communication 20: 3-12.
45. Papp, V. (2008) The Effects of Heroin on Speech and Voice. Unpublished MSc dissertation, University of York.
46. Protopapas, A. and Lieberman, P. (1997) Fundamental frequency of phonation and perceived emotional stress. Journal of the Acoustical Society of America 101: 2267-2277.
47. Ruiz, R., Absil, E., Harmegnies, B., Legros, C. and Poch, D. (1996) Time- and spectrumrelated variabilities in stressed speech under laboratory and real conditions. Speech Communication 20: 111-129.
48. Sapolsky, R.M. (1998) Why Zebras Don't Get Ulcers. An Updated Guide to Stress, Stress- Related Diseases, and Coping. New York: Freeman.
49. Scherer, K.R. (1979) Nonlinguistic vocal indicators of emotion and psychopathology. In C.E. Izard (ed.) Emotions in Personality and Psychopathology 495-529. New York: Plenum Press.
50. Scherer, K.R. (1981) Vocal indicators of stress. In J.K. Darby (ed.) Speech Evaluation in Psychiatry 171-187. New York: Grune and Stratton.
51. Scherer, K.R. (1986) Vocal affect expression: a review and a model for future research. Psychological Bulletin 99(2): 143-165.
52. Scherer, K.R., Johnstone, T., Klasmeyer, G. and Bänziger, T. Can automatic speaker verification be improved by training the algorithms on emotional speech? Proceedings, ICSLP 2000. Beijing, China.
53. Scherer, K.R., Grandjean, D., Johnstone, T., Klasmeyer, G. and Bänziger, T. (2002) Acoustic correlates of task load and stress. Proceedings, ICSLP 2017-2020. Denver, USA.
54. Selye, H. (1951) The general-adaptation-syndrome. Annual Review of Medicine 2: 327-342.
55. Siegman, A.W. (1993) Paraverbal correlates of stress: implications for stress identification and management. In L. Goldberger and S. Breznitz (eds) Handbook of Stress. Theoretical and Clinical Aspects 274-299. (Second edition.) New York: The Free Press.
56. Sigmund, M. (2006) Introducing the database examstress for speech under stress. Proceedings of the 7th Nordic Signal Processing Symposium 290-293. Rejkjavik.
57. Streeter, L.A., Krauss, R.M., Geller, V., Olson, C. and Apple, W. (1977) Pitch changes during attempted deception. Journal of Personality and Social Psychology 35: 345-350.
58. Streeter, L.A., Macdonald, N.H., Apple, W., Krauss, R.M. and Galati, K.M. (1983) Acoustic and perceptual indicators of emotional stress. Journal of the Acoustical Society of America 73: 1354-1360.
59. Sulc, J. (1977) To the problem of emotional changes in the human voice. Activitas Nervosa Superior 19: 215-216.
60. Tolkmitt, F.J. and Scherer, K.R. (1986) Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology 12(3): 302-313.
61. Trancoso, I. and Moore, R. (1995) Proceedings ESCA-NATO Tutorial and Research Workshop on Speech under Stress. 9-11 September. Lisbon.
62. Van Lierde, K., Heule van, S., De Ley, S., Mertens, E. and Claeys, S. (2009) Effect of psychological stress on female vocal quality - a multiparameter approach. Folia Phoniatrica et Logopaedica 61: 105-111.
63. Van Summers, W., Pisoni, D.B., Bernacki, R.H., Pedlow, R.I. and Stokes, M.A. (1988) Effects of noise on speech production: acoustic and perceptual analyses. Journal of the Acoustical Society of America 84(3): 917-928.
64. Vilkman, E. and Manninen, O. (1986) Changes in prosodic features of speech due to environmental factors. Speech Communication 5: 331-345.
65. Vilkman, E., Manninen, O., Lauri, E-R. and Pukkila, T. (1987) Vocal Jitter as an indicator of changes in psychophysiological arousal. Proceedings 11th International Congress of Phonetic Sciences, Tallin 188-191. In M. Jessen (2006) Einfluss von Stress auf Sprache und Stimme. Unter besonderer Berücksichtigung polizeidienstlicher Anforderungen. Idstein: Schulz- Kirchner Verlag GmbH.
66. Vogel, A.P., Fletcher, J. and Maruff, P. (2010) Acoustic analysis of the effects of sustained wakefulness on speech. Journal of the Acoustical Society of America 128(6): 3747-3756.
67. Vrij, A. and Mann, S. (2001) Telling and detecting lies in a high-stake situation: the case of a convicted murderer. Applied Cognitive Psychology 15: 187-203.
68. Waters, J., Nunn, S., Gillcrist, B. and Von Colln, E. (1995) The effect of stress on the glottal pulse. In I. Trancoso and R. Moore (eds) Proceedings ESCA-NATO Tutorial and Research Workshop on Speech under Stress. 9-11 September. Lisbon.
69. Williams, C.E. and Stevens, K.N. (1969) On determining the emotional state of pilots during flight: an exploratory study. Aerospace Medicine 40: 1369-1372.
70. Williams, C.E. and Stevens, K.N. (1972) Emotions and speech: some acoustical correlates. Journal of the Acoustical Society of America 52: 1238-1250.
71. Womack, B.D. and Hansen, J.H.L. (1996) Classification of speech under stress using target driven features. Speech Communication 20: 131-150.