Speech warnings: A review

Theoretical Issues in Ergonomics Science

Volumn 7, Issue 6, 2006, Pages 551-571

  Noyes, J M ^a   Hellier, E ^b   Edworthy, J ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Ergonomics; Human factors; Human speech; Machine speech; Warnings

Indexed keywords

EID: 85007879042     PISSN: 1463922X     EISSN: 1464536X     Source Type: Journal    
DOI: 10.1080/14639220600731123     Document Type: Article

References (86)

1. Aldrich, F.K. and Parkin, A.J., 1989, Listening at speed. British Journal of Visual Impairment and Blindness, 7, pp. 16-18.
2. Asakawa, C., Takagi, H., Ino, S. and Ifukube, T., 2003, Maximum listening speeds for the blind. In Proceedings of 2003 International Conference on Auditory Display (Boston, MA: International Community for Auditory Display), pp. 276-279.
3. Baber, C., 1991, Speech Technology in Control Room Systems - A Human Factors Perspective (Chichester: Ellis Horwood).
4. Baber, C. and Noyes, J.M., 1993, Interactive Speech Technology: Human Factors Issues in the Application of Speech Input/Output to Computers (London: Taylor & Francis).
5. Bacharowski, J., 1999, Vocal expression and perception of emotion. Current Directions in Psychological Science, 8, pp. 53-57.
6. Banse, R. and Scherer, K.R., 1996, Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, pp. 614-636.
7. BARZEGAR, R.S. and WOGALTER, M.S., 1998, Effects of auditorily-presented warning signal words on intended carefulness. In Contemporary Ergonomics 1998, M.A. Hanson (Ed.), pp. 311-315 (London: Taylor & Francis).
8. BARZEGAR, R.S. and WOGALTER, M.S., 2000, Intended carefulness ratings for voiced warning statements. In Proceedings of the IEA 2000/HFES 2000 Congress, Vol. 3 (Santa Monica, CA: Human Factors and Ergonomics Society), pp. 686-689.
9. BENOIT, C., GRICE, M. and HAZAN, V., 1996, The SUS test: a method for the assessment of text-to-speech synthesis intelligibility using semantically unpredictable sentences. Speech Communication, 18, pp. 381-392.
10. BERTONE, C.M., 1982, Human factors considerations in the development of a voice warning system for helicopters. In Proceedings of Symposium on Behavioral Objectives in Aviation Automated Systems, No. P-114 (Warrendale, PA: Society of Automotive Engineers), pp. 133-142.
11. BLISS, J.P., GILSON, R.D. and DEATON, J.E., 1995, Human probability matching behaviour in response to alarms of varying reliability. Ergonomics, 38, pp. 2300-2312.
12. BLY, S., 1982, Sound and computer information presentation. PhD thesis, University of California, Davis.
13. BRAUN, C.C. and SILVER, N.S., 1995, Interaction of signal word and color on warning labels: differences in perceived hazard and behavioral compliance. Ergonomics, 38, pp. 2207-2220.
14. BRISTOW, G., 1986, Electronic Speech Recognition (London: Collins).
15. BROWN, J.E., BERTONE, C.M. and OBERMEYER, R.W., 1968, Army aircraft voice warning system study. US Army Technical Memorandum 6-68, AMCMS Code 5122.12.43500, Bunker- Ramo Corporation for Aberdeen Proving Ground, MD.
16. BRUNGART, D.S., ERICSON, M.A. and SIMPSON, B.D., 2002, Design considerations for improving the effectiveness of multitalker speech displays. In Proceedings of the 2002 International Conference on Auditory Display (Kyoto, Japan: International Community for Auditory Display).
17. CHATEAU, N., MAFFIOLO, V., EHRETTE, T. and D'ALESSANDRO, C., 2002, Modelling the emotional quality of speech in a telecommunications context. In Proceedings of the 2002 International Conference on Auditory Display (Kyoto, Japan: International Community for Auditory Display).
18. CHERRY, E.C., 1953, Some experiments in the recognition of speech, with one and two ears. Journal of the Acoustical Society of America, 25, pp. 975-979.
19. COHEN, M., 2002, A survey of emerging and exotic auditory interfaces. In Proceedings of the 2002 International Conference on Auditory Display (Kyoto, Japan: International Community for Auditory Display).
20. CONZOLA, C.V. and WOGALTER, M.S., 1999, Using voice and print directives and warnings to supplement product manual instructions. International Journal of Industrial Ergonomics, 23, pp. 549-556.
21. DAVIDSON, J., COLES, D., NOYES, P. and TERRELL, C.D., 1991, Using computer-delivered natural speech to assist in the teaching of reading. British Journal of Educational Technology, 22, pp. 110-118.
22. DUFFY, S.A. and PISONI, D.B., 1992, Comprehension of synthetic speech produced by rule: a review and theoretical interpretation. Language and Speech, 35, pp. 351-389.
23. EDMAN, T.R., 1982, Human factors guidelines for the use of synthetic speech devices. In Proceedings of the 26th Annual Meeting of the Human Factors Society (Santa Monica, CA: Human Factors Society), pp. 212-216.
24. EDWORTHY, J., 1994, The design and implementation of non-verbal auditory warnings. Applied Ergonomics, 25, pp. 202-210.
25. EDWORTHY, J. and ADAMS, A., 1996, Warning Design: A Research Prospective (London: Taylor & Francis).
26. EDWORTHY, J. and HARDS, R.A.J., 1999, Learning auditory warnings: the effects of sound type, verbal labelling and imagery on the identification of alarm sounds. International Journal of Industrial Ergonomics, 24, pp. 603-618.
27. EDWORTHY, J., CLIFT-MATTHEWS, W. and CROWTHER, M., 1998, Listeners’ understanding of warning signal words. In Contemporary Ergonomics 1998, M.A. Hanson (Ed.), pp. 316-320 (London: Taylor & Francis).
28. EDWORTHY, J., HELLIER, E. and RIVERS, J., 2003a, The use of male or female voices in warning systems: a question of acoustics. Noise & Health, 6, pp. 39-50.
29. EDWORTHY, J., HELLIER, E., WALTERS, K., CLIFT-MATTHEWS, W. and CROWTHER, M., 2003b, Acoustic, semantic and phonetic influences in spoken warning signal words. Applied Cognitive Psychology, 17, pp. 915-930.
30. GOWER, D.W. and CASALI, J.G., 1994, Speech intelligibility and protective effectiveness of selected active noise-reduction and conventional communication headsets. Human Factors, 36, pp. 350-367.
31. GRAHAM, R., 1999, Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application. Ergonomics, 42, pp. 1233-1248.
32. HAKKINEN, M.T. and WILLIGES, B.H., 1982, Synthesized voice warning messages: effects of alerting cues and message environment. In Proceedings of 26th Annual Meeting of the Human Factors Society, p. 204 (Santa Monica, CA: Human Factors Society).
33. HAKKINEN, M.T. and WILLIGES, B.H., 1984, Synthesized warning messages: effects of an alerting cue in single- and multi-function voice synthesis systems. Human Factors, 26, pp. 185-195.
34. HELLIER, E., EDWORTHY, J., WEEDON, B., WALTERS, K. and ADAMS, A., 2002, The perceived urgency of speech warnings 1: semantics versus acoustics. Human Factors, 44, pp. 1-17.
35. HIRSH, I.J., REYNOLDS, E.G. and JOSEPH, M., 1954, Intelligibility of different speech materials. Journal of the Acoustical Society of America, 26, pp. 530-538.
36. HOLLINGUM, J. and CASSFORD, G., 1988, Speech Technology at Work (Bedford, England: IFS Publications).
37. IIDA, A., CAMPBELL, N., HIGUCHI, F. and YASUMURA, M., 2003, A corpus-based speech synthesis system with emotion. Speech Communication, 40, pp. 161-187.
38. KLATT, D., 1987, Review of text-to-speech conversion for English. Journal of the Acoustical Society of America, 82, pp. 737-793.
39. LEE, C.M. and NARAYANAN, S.S., 2005, Toward detecting emotions in spoken dialogs. IEEE Transactions on Speech and Audio Processing, 13, pp. 293-303.
40. LEINONEN, L., HILTUNEN, T., LINNANKOSKI, I. and LAAKSO, M., 1997, Expression of emotional- motivational connotations within a one word utterance. Journal of the Acoustical Society of America, 102, pp. 1853-1863.
41. LEPLATRE, G. and MCGREGOR, I., 2004, How to tackle auditory interface aesthetics? Discussion and case study. In Proceedings of the 2004 International Conference on Auditory Display (Sydney, Australia: International Community for Auditory Display).
42. LEUNG, Y.K., SMITH, S., PARKER, S. and MARTIN, R., 1997, Learning and retention of auditory warnings. In Proceedings of ICAD 97, 4th International Conference on Auditory Display (Palo Alto, CA: International Community for Auditory Display).
43. LICKLIDER, J.C.R., 1961, Audio warning signals for Air Force weapon systems. Technical Report WADD TR 60-814, Wright-Patterson Air Force Base, OH.
44. LIENARD, J.-S., 1980, An over-view of speech synthesis. In Spoken language Generation and Understanding, J.C. Simon (Ed.), pp. 397-412 (Dordrecht: D. Reidel).
45. LUCE, P.A., FEUSTEL, T.C. and PISONI, D.B., 1983, Capacity demands in short-term memory for synthetic and natural speech. Human Factors, 25, pp. 17-32.
46. MACDONALD, J.A., BALAKRISHNAN, J.D., OROSZ, M.D. and KARPLUS, W.J., 2002, Intelligibility of speech in a virtual 3-D environment. Human Factors, 44, pp. 272-286.
47. MEREDITH, C. and EDWORTHY, J., 1995, Are there too many alarms in the intensive-care unit - an overview of the problems. Journal of Advanced Nursing, 21, pp. 15-20.
48. MESGARANI, N., SHAMMA, S., GRANT, K.W. and DURAISWAMI, R., 2003, Augmented intelligibility in simultaneous multi-talker environments. In Proceedings of 2003 International Conference on Auditory Display (Boston, MA: International Community for Auditory Display), pp. 71-74.
49. MOMTAHAN, K.L., TANSLEY, B.W. and HETU, R., 1993, Audibility and identification of auditory alarms in the operating room and intensive care unit. Ergonomics, 36, pp. 1159-1176.
50. MOORE, T.J., 1981, Voice communication jamming research. In AGARD Conference Proceedings 331: Aural Communication in Aviation, Neuilly-Sur-Seine, France, pp. 2:1-2:6.
51. NIXON, C., ANDERSON, T., MORRIS, L., MCCAVITT, A., MCKINLEY, R., YEAGER, D. and MCDANIEL, M., 1998, Female voice communications in high level aircraft cockpit noises. Part II: vocoder and automatic speech recognition systems. Aviation, Space and Environmental Medicine, 69, pp. 1087-1194.
52. NOYES, J.M. and STARR, A.F., 2000, Civil aircraft warning systems: future directions in information management and presentation. International Journal of Aviation Psychology, 10, pp. 169-188.
53. O'SHAUGHNESSY, D., 2003, Interacting with computers by voice: automatic speech recognition and synthesis. Proceedings of the IEEE, 91, pp. 1272-1305.
54. OVING, A.B., VELTMAN, J.A. and BRONKHORST, A.W., 2004, Effectiveness of 3-D audio for warnings in the cockpit. International Journal of Aviation Psychology, 14, pp. 257-276.
55. PATTERSON, R.D. and MILROY, R., 1980, Auditory warnings on civil aircraft: the learning and retention of warnings. Civil Aviation Authority Contract 7D/S/0142, MRC Applied Psychology Unit, Cambridge, England.
56. PISONI, D.B., 1987, Some measures of intelligibility and comprehension. In From Text to Speech: The MITalk System, J. Allen, M.S. Hunnicutt and D. Klatt (Eds), pp. 151-171 (Cambridge: Cambridge University Press).
57. PRATT, R., 1986, On the intelligibility of synthetic speech. Proceedings of the Institute of Acoustics, 8, pp. 183-192.
58. RIVENEZ, M., DARWIN, C. and GUILLAUME, A., 2004, Perception of unattended speech. In Proceedings of the 2004 International Conference on Auditory Display (Sydney, Australia: International Community for Auditory Display).
59. ROSEGRANT, T.J., 1986, The importance of speech technology as a learning tool for acquiring beginning reading and writing. In Proceedings of Speech Tech’86, Voice I/O Applications Show and Conference (New York: Media Dimensions), pp. 297-298.
60. RUBIN, B.U., 1998, Audible information design in the New York City Subway System: a case study. In Proceedings of ICAD 98, 5th International Conference on Auditory Display (Glasgow, Scotland: International Community for Auditory Display).
61. SAINZ SALCES, F.J., ENGLAND, D. and VICKERS, P., 2003, Household appliances control device for the elderly. In Proceedings of the 2003 International Conference on Auditory Display, pp. 224-227 (Boston, MA: International Community for Auditory Display).
62. SALZA, P.L., FOTI, E., NEBBIA, L. and OREGLIA, M., 1996, MOS and pair comparison combined methods for quality evaluation of text to speech systems. Acta Acustica, 82, pp. 650-656.
63. SCHALK, T.B., FRANTZ, G.A. and WOODSON, L., 1982, Voice synthesis and recognition. Mini-Micro Systems, 15, pp. 147-160.
64. SCHERER, K., BANSE, R. and WALLBOTT, H., 2001, Emotion inferences from vocal expression correlate across languages and cultures. Journal of Cross Cultural Psychology, 32, pp. 76-92.
65. SCLATER, N., 1982, Introduction to Electronic Speech Synthesis (Indianapolis, IN: Howard W. Sams & Co. Inc.).
66. SIMPSON, C.A., 1975, Occupational experience with a specific phraseology: group differences in intelligibility for synthesized and human speech. In Proceedings of the 90th Meeting of the Acoustical Society of America, San Francisco, CA.
67. SIMPSON, C.A. and MARCHIOND-AFROST, K., 1984, Synthesised speech rate and pitch effects on intelligibility of warning messages for pilots. Human Factors, 26, pp. 509-518.
68. SIMPSON, C.A. and NAVARRO, T.N., 1984, Intelligibility of computer generated speech as a function of multiple factors. In Proceedings of the National Aerospace and Electronics Conference, 84 CH 1984-7 NAECON (New York: IEEE).
69. SIMPSON, C.A. and WILLIAMS, D.H., 1980, Response time effects of alerting tone and semantic context for synthesized voice cockpit warnings. Human Factors, 22, pp. 319-330.
70. SIMPSON, C.A., COLER, C.R. and HUFF, E.M., 1982, Human factors of voice I/O for aircraft cockpit controls and displays. In Proceedings of the Workshop on Standardization for Speech I/O Technology, National Bureau of Standards, Gaithersburg, MD.
71. SOBIN, C. and ALPERT, M., 1999, Emotion in speech: the acoustic attributes of fear, anger, sadness and joy. Journal of Psycholinguistic Research, 28, pp. 347-365.
72. SORIN, C., 1991, Text-to-speech research: technological goals and integration issues. In Natural Language and Speech, E. Klein and F. Veltman (Eds), pp. 182-183 (Berlin: Springer-Verlag).
73. TEPPO, A. and VUORIMAA, P., 2001, Speech interface implementation for XML browser. In Proceedings of the 2001 International Conference on Auditory Display, pp. 272-275 (Espoo, Finland: International Community for Auditory Display).
74. ULFVENGREN, P., 2003, Design of natural warning sounds in human-machine systems. PhD thesis, Stockholm Institute of Technology, Sweden.
75. VAN COILE, B., RUHL, H.W., VOGTEN, L., THOONE, M., GOB, S., DELAEY, D., MOONS, E., TERKEN, J.M.B., DE PIJPER, J.R., KUGLER, M., KAUFHOLZ, P., KRUGER, R., LEYS, S. and WILLEMS, S., 1997, Speech synthesis for the new Pan-European traffic message control system RDS-TMC. Speech Communication, 23, pp. 307-317.
76. VISWANATHAN, M. and VISWANATHAN, M., 2005, Measuring speech quality for text-to-speech systems: development and assessment of a modified mean opinion score (MoS) scale. Computer Speech and Language, 19, pp. 55-83.
77. WAKE, S. and ASAHI, T., 1998, Sound retrieval with intuitive verbal expressions. In Proceedings of ICAD 98, 5th International Conference on Auditory Display (Glasgow, Scotland: International Community for Auditory Display).
78. WATERWORTH, J.A. and THOMAS, C.M., 1985, Why is synthetic speech harder to remember than natural speech? In Proceedings of Human Factors in Computing Systems, Computer-Human Interaction, San Francisco, CA.
79. WERNER, S., EICHNER, M., WOLFF, M. and HOFFMANN, R., 2004, Toward spontaneous speech synthesis-utilizing language model information in TTS. IEEE Transactions on Speech and Audio Processing, 12, pp. 436-445.
80. WHIPPLE, T.W. and MCMANAMON, M.K., 2002, Implications of using male and female voices in commercials: an exploratory study. Journal of Advertising, 31, pp. 79-91.
81. WOGALTER, M.S. and SILVER, N.C., 1990, Arousal strength of signal words. Forensic Reports, 3, pp. 407-420.
82. WOGALTER, M.S. and SILVER, N.C., 1995, Warning signal words: connoted strength and understandability by children, elders and non-native English speakers. Ergonomics, 38, pp. 2188-2206.
83. WOGALTER, M.S. and YOUNG, S.L., 1991, Behavioral compliance to voice and print warnings. Ergonomics, 34, pp. 78-89.
84. WOGALTER, M.S., KALSHER, M.J., FREDERICK, L.J., MAGURNO, A.B. and BREWSTER, B.M., 1998, Hazard level perceptions of warning components and configurations. International Journal of Cognitive Ergonomics, 2, pp. 123-143.
85. ZAJICEK, M. and HALL, S., 2000, Solutions for elderly visually impaired people using the Internet. In Proceedings of HCI 2000, People and Computers XIV 'Usability or Else!’, S. McDonald, Y. Waern and G. Cockton (Eds), pp. 299-307 (London: British Computer Society).
86. ZAJICEK, M. and MORRISSEY, W., 2001, Speech output for older visually impaired adults. In Joint Proceedings of HCI 2001 and IHM 2001 'Interaction without frontiers’, A. Blandford, L. Vanderdonckt and P. Grat (Eds), pp. 503-513 (London: Springer).