Auditory displays in human-machine interfaces

Proceedings of the IEEE

Volumn 92, Issue 4, 2004, Pages 742-758

  Johannsen, Gunnar ^a  

^a UNIVERSITY OF KASSEL   (Germany)

Author keywords

Auditory display; Earcon; Human machine interface (HMI); Mobile robot; Music; Sound design; User centered development; Wavelet

Indexed keywords

AUTOMATION; COMPUTER MUSIC; COMPUTER SOFTWARE; MAN MACHINE SYSTEMS; MANIPULATORS; MOBILE ROBOTS; SPEECH PROCESSING; VISUALIZATION; WAVELET TRANSFORMS;

AUDITORY DISPLAYS; EARCON; HUMAN-MACHINE INTERFACES; SOUND DESIGNS; USER-CENTERED DEVELOPMENT;

HUMAN COMPUTER INTERACTION;

EID: 21244479427     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2004.825905     Document Type: Conference Paper

References (50)

1. T. B. Sheridan, Telerobotics, Automation, and Human Supervisory Control. Cambridge, MA: The MIT Press, 1992.
2. G. Johannsen, Mensch-Maschine-Systeme (Human-Machine Systems) (in German). Berlin, Germany: Springer-Verlag, 1993.
3. T. B. Sheridan, Humans and Automation: System Design and Research Issues. New York: Wiley, 2002.
4. G. Johannsen, "Human supervision and control in engineering and music - foundations and transdisciplinary views," J. New Music Res. (Special Issue on Human Supervision and Control in Engineering and Music), vol. 31, no. 3, pp. 179-190, 2002.
5. _, "Cooperative human-machine interfaces for plant-wide control and communication," in Annual Reviews in Control, J. J. Gertler, Ed. Oxford, U.K.: Pergamon/Elsevier. 1997, vol. 21, pp. 159-170.
6. N. A. Stanton and J. Edworthy, Eds., Human Factors in Auditory Warnings. Aldershot. U.K.: Ashgate, 1999.
7. G. Kramer, Ed., Auditory Display - Sonification, Audificalion, and Auditory Interfaces. Reading, MA: Addison-Wesley, 1994.
8. G. Johannsen, "Toward a new quality of automation in complex man-machine systems," Automatica, vol. 28, pp. 355-373, 1992.
9. J. L. Alty and G. Johannsen. "Knowledge-based dialogue for dynamic systems," Automatica, vol. 25, pp. 829-840, 1989.
10. B.-B. Borys and G. Johannsen, "An experimental multi-media process control room," in Proc. Anna. Conf. 1997 Human Factors and Ergonomics Soc. Eur. Chapter, Advances in Multimedia and Simulation, pp. 276-289.
11. L. Fejes, G. Johannsen, and G. Strätz, "A graphical editor and process visualization system for man-machine interfaces of dynamic systems," Vis. Comput., vol. 10, no. 1, pp. 1-18, 1993.
12. G. Johannsen, S. Ali. and R. van Paassen, "Intelligent human-machine systems," in Methods and Applications of Intelligent Control, S. G. Tzafestas, Ed. Dordrecht, The Netherlands: Kluwer, 1997, pp. 329-356.
13. J. A. Ballas, "The interpretation of natural sound in the cockpit," in Human Factors in Auditory Warnings, N. A. Stanton and J. Edworthy, Eds. Aldershot, U.K.: Ashgate, 1999, pp. 91-112.
14. P. Ulfvengren, L. Mårtensson. and G. Singer. "Auditory and visual warnings in aircraft," in Proc. 8th IFAC/IFIP/IFORS/IEA Symp.: Analysis, Design, and Evaluation of Human-Machine Systems 2001, G. Johannsen, Ed., pp. 53-57.
15. J. Welch, "Auditory alarms in intensive care." in Human Factors in Auditory Warnings. N. A. Stanton and J. Edworthy, Eds. Aldershot, U.K.: Ashgate, 1999, pp. 319-342.
16. D. Sonnenschein. Sound Design - The Expressive Power of Music, Voice, and Sound Effects in Cinema. Studio City, CA: Wiese. 2001.
17. B.-B. Borys, "Evaluation of auditory displays supporting aircraft approach and landing," in Proc. 8th IFAC Symp.: Automated Systems Based on Human Skill and Knowledge. J. Stahre and L. Mårtensson. Eds., 2003, pp. 141-146.
18. D. D. Woods, "Visual momentum: a concept to improve the cognitive coupling of person and computer." Int. J. Man-Mach. Stud., vol. 21, pp. 229-244, 1984.
19. K. L. Norman, L. J. Weldon, and B. Shneiderman, "Cognitive layouts of windows and multiple screens for user interfaces," Int. J. Man-Mach. Stud., vol. 25, pp. 229-248, 1986.
20. E. D. Mynatt, "Transforming graphical interfaces into auditory interfaces for blind users," Human-Comput. Interact., vol. 12, pp. 7-45, 1997.
21. J. L. Alty and D. I. Rigas, "Communicating graphical information to blind users using music - the role of context," in Proc. Computer-Human Interaction Conf. (CHI 98), vol. 1, C. M. Karat, A. Lund, J. Coutaz, and J. Karat, Eds., pp. 574-581.
22. J. T. Reason. Human Error. Cambridge, U.K.: Cambridge Univ. Press, 1991.
23. J. Pressing, "Some perspectives on performed sound and music in virtual environments," Presence, vol. 6, no. 4, pp. 482-503, 1997.
24. D. O'Shaughnessy, "Interacting with computers by voice: automatic speech recognition and synthesis." Proc. IEEE (Special Issue on Human-Computer Multimodal Interface), vol. 91, pp. 1272-1305, Sept. 2003.
25. W. W. Gaver, "The SonicFinder: an interface that uses auditory icons." Human-Comput. Interact., vol. 4, pp. 67-94, 1989.
26. _, "Using and creating auditory icons," in Auditory Display-Sonification, Audification, and Auditory Interfaces, G. Kramer, Ed. Reading, MA: Addison-Wesley, 1994, pp. 417-446.
27. M. M. Blattner, D. A. Sumikawa, and R. M. Greenberg, "Earcons and icons: their structure and common design principles," Human-Comput. Interact., vol. 4, pp. 11-44, 1989.
28. S. A. Brewster, P. C. Wright, and A. D. N. Edwards, "Experimentally derived guidelines for the creation of earcons," in Adjunct Proc. HCI'95, pp. 155-159.
29. D. McGookin and S. A. Brewster, "An investigation into the identification of concurrently presented earcons," in Proc. 2003 Int. Conf. Auditory Display (ICAD03), 2003, pp. 42-46.
30. P. Vickers and J. L. Alty, "Using music to communicate computing information." Interact. With Comput., vol. 14, no. 5, pp. 434-455, 2002.
31. _, "Musical program auralization: a structured approach to motif design," Interact. With Comput., vol. 14, no. 5, pp. 456-484, 2002.
32. M. Cohen and L. F. Ludwig, "Multidimensional audio window management," Int. J. Man-Mach. Stud., vol. 34, no. 3, pp. 319-336, 1991.
33. J. Herder and M. Cohen, "The helical keyboard: perspectives for spatial auditory displays and visual music," J. New Music Res. (Special Issue on Human Supervision and Control in Engineering and Music), vol. 31, no. 3, pp. 269-281, 2002.
34. R. N. Mumford and J. L. Alty, "3-D algorithm auralization using the SIMBA toolbox," in Proc. 18th Eur. Annu. Conf. Human Decision Making and Manual Control, J. L. Alty, Ed., 2000, pp. 214-225.
35. G. Johannsen, J. Heuer, and M. Tiemann, "Participative user interface design for industrial processes," in Proc. Silicon Valley Ergonomics Conf. (ErgoCon'97), 1997, pp. 21-28.
36. D. A. Norman, "Cognitive artifacts," in Designing Interaction: Psychology of the Human-Computer Interface, J. M. Caroll, Ed. Cambridge, U.K.: Cambridge Univ. Press, 1991.
37. E. Hollnagel, Ed., Handbook of Cognitive Task Design. Mahwah, NJ: Lawrence Erlbaum, 2003.
38. J. Rasmussen, A. M. Pejtersen, and L. P. Goodstein, Cognitive Systems Engineering. New York: Wiley, 1994.
39. D. Redmond-Pyle and A. Moore, Graphical User Interface Design and Evaluation (GUIDE). London, U.K.: Prentice-Hall, 1995.
40. G. Johannsen, "Cognitive systems analysis, design, and experimental investigation of auditory displays for human-machine interfaces," in Proc. Int. Conf. Cognitive Systems Engineering in Process Control (CSEPC 2000), 2000, pp. 150-155.
41. S. Ronkainen, "Earcons in motion - Defining language for an intelligent mobile device," in Proc. 2001 Int. Conf. Auditory Display (ICAD01), 2001, pp. 126-131.
42. G. Johannsen. "Sound-Design für Anmutung und Systemin-formationen bei Fahrzeugen und Geräten," in Tagungsband USEWARE 2002: Mensch-Maschine-Kommunikation/Design, Fachtagung der VDI/VDE-Gesellschaft Mess- und Automatisierungstechnik. Düsseldorf, Germany: VDI-Verlag, 2002, pp. 285-292.
43. G. Kronreif, R. Probst, and P. Kopacek, "Modular service robots - state of the art and future trends." in Proc. 8th Int. Conf. Advanced Robotics (ICAR'97), 1997, pp. 51-56.
44. G. Johannsen, "Analysis of audio symbols based on musical and robot-movement sounds using time-frequency methods," in Proc. Diderot Forum Mathematics and Music - Conf. Computational and Mathematical Methods in Music, H. G. Feichtinger and M. Dörfler, Eds., 1999, pp. 215-226.
45. _, "Auditory displays in human-machine interfaces of mobile robots for nonspeech communication with humans," J. Intell. Robot. Syst., vol. 32, pp. 161-169, 2001.
46. _, "Auditory display of directions and states for mobile systems," in Proc. 8th Int. Conf. Auditory Display (ICAD 2002), 2002, pp. 98-103.
47. A. Camurri, P. Coletta, M. Ricchetti, and G. Volpe, "Expressiveness and physicality in interaction," J. New Music Res. (Special Issue on Music and Motion), vol. 29, no. 3, pp. 187-198, 2000.
48. S. A. Brewster. P. C. Wright, and A. D. N. Edwards, "A detailed investigation into the effectiveness of earcons," in Auditory Display - Sonification, Audification, and Auditory Interfaces, G. Kramer, Ed. Reading, MA: Addison-Wesley, 1994, pp. 471-498.
49. S. Mallat, A Wavelet Tour of Signal Processing, San Diego, CA; Academic, 1998.
50. L. Bainbridge, "Ironies of automation," Automatica (Special Issue on Control Frontiers in Knowledge-Based and Man-Machine Systems), vol. 19, pp. 775-779, 1983.