An overview of auditory display to assist comprehension of molecular information

Interacting with Computers

Volumn 18, Issue 4, 2006, Pages 853-868

  Garcia Ruiz, Miguel Angel ^a   Gutierrez Pulido, Jorge Rafael ^a  

^a UNIVERSIDAD DE COLIMA   (Mexico)

Author keywords

Auditory display; Bonding; Molecular structure; Multimodality; Non speech sounds; Virtual reality

Indexed keywords

ACOUSTIC WAVES; BEHAVIORAL RESEARCH; DNA SEQUENCES; GENES; HUMAN COMPUTER INTERACTION; MOLECULAR DYNAMICS; VIRTUAL REALITY;

AUDITORY DISPLAY; MOLECULAR INFORMATION; MULTIMODALITY; NON SPEECH SOUNDS;

INFORMATION DISSEMINATION;

EID: 33745121923     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2005.12.001     Document Type: Article

References (57)

1. Alcock N.W. Bonding and Structure (1990), Ellis Horwood, New York
2. Aldrich F., Rogers Y., and Scaife M. Getting to grips with 'interactivity': helping teachers assess the educational value of CD-ROMs. British Journal of Educational Technology 29 4 (1998) 321-332
3. Baggi D.L. Computer-generated music. IEEE Computer 24 7 (1991) 6-9
4. Berenato G., and Maynard D.F. Audio conductivity device. Journal of Chemical Education 74 4 (1997) 415
5. Birk J.P., and Kurtz M.J. Effect of experience on retention and elimination of misconceptions about molecular structure and bonding. Journal of Chemical Education 76 1 (1999) 128
6. Blattner M.M., Sumikawa D.A., and Greenberg R.M. Earcons and icons: their structure and common design principles. Human Computer Interaction 4 1 (1989) 11-44
7. Blattner, M.M., Greenberg, R.M., Kamegai, M., 1992. Listening to turbulence: an example of scientific audialization. In: Multimedia Interface Design. ACM Press/Addison-Wesley, New York/Reading, MA, pp. 87-102.
8. Bly, S.A., 1982a. Presenting information in sound. In: Proceedings of the First Major Conference on Human factors in Computers Systems. National Bureau of Standards, Gaithersburg, MD.
9. Bly, S.A., 1982b. Sound and Computer Information Presentation. PhD thesis, University of California, Davis, also Available as Technical Report UCRL-53282, Lawrence Livermore National Laboratory.
10. Bonebright T.L., Nees M.A., Connerley T.T., and McCain G.R. Testing the effectiveness of sonified graphs for education: a programmatic research project. In: Hiipakka J., Zacharov N., and Takala T. (Eds). Proceedings of the 2001 International Conference on Auditory Display (2001), Helsinki University of Technology, Espoo, Finland 62-66
11. Brewster, S.A., 1996. A sonically enhanced interface toolkit. In: Proceedings of ICAD'96, Xerox PARC. Addison-Wesley, pp. 47-50.
12. Brewster, S.A., 1998a. Using earcons to improve the usability of a graphics package. In: Proceedings of BCS HCI'98. Springer, London, UK, pp. 287-302.
13. Brewster, S.A., 1998b. Using earcons to improve the usability of tool palettes. In: Summary Proceedings of ACM CHI'98. ACM Press, Los Angeles, CA, pp. 297-298.
14. Brewster, S.A., Pengelly, H. 1998. Visual impairment, virtual reality and visualisation. In: Proceedings of the First International Workshop on Usability Evaluation for Virtual Environments. British Computer Society, Leicester, UK, pp. 24-28.
15. Brewster S.A., Wright P.C., and Edwards A.D.N. The design and evaluation of an auditory-enhanced scrollbar. In: Adelson B., Dumais S., and Olson J. (Eds). Proceedings of CHI'94 (1994), ACM Press/Addison-Wesley, Boston, MA 173-179
16. Brewster, S.A., Wright, P.C., Edwards, A.D.N., 1995. Experimentally derived guidelines for the creation of earcons. In: Adjunct Proceedings of HCI'95. Springer, Huddersfield, UK.
17. Brooks F.P., Ouh-Young M., Battert J.J., and Kilpatrick P.J. Project GROPE-Haptic displays for scientific visualization. Computer Graphics 24 4 (1990) 177-185
18. Burgess, D.A., 1992. Techniques for low cost spatial audio. In: Proceedings of the Fifth Annual ACM Symposium on User Interface Software and Technology. ACM Press, Monterey, CA, pp. 53-59.
19. Buxton W. Introduction to this special issue on nonspeech audio. Human-Computer Interaction 1 4 (1989) 1-9
20. Byrne, C.M., 1996. Water on tap: the use of virtual reality as an educational tool. PhD Thesis, Department of Industrial Engineering, University of Washington.
21. Carlson, C., Comer, R., Fontes, R., et al., 1994. The human genome: science and the social consequences. In: DOE Human Genome Program Contractor-Grantee Workshop IV, US Department of Energy.
22. Chandler P., and Sweller J. Cognitive load theory and the format of instruction. Cognition and Instruction 8 (1991) 293-332
23. Crossan, A., Brewster, S., Reid, S., Mellor, D., 2000. Multimodal feedback cues to aid veterinary training simulations. In: Proceedings of the First Workshop on Haptic Human-Computer Interaction, pp. 45-49.
24. Forrester, M.A., 2000. Auditory perception and sound as event: theorising sound imagery in psychology, electronic publication. Sound Journal, www.kent.ac.uk/sdfva/sound-journal/forrester001.html
25. Garcia-Ruiz, M.A., 2001. Using non-speech sounds to convey molecular properties in a virtual environment. In: Proceeedings of the International Conference of New Technologies in Science Education (CINTEC). University of Aveiro, Aveiro, Portugal.
26. Garcia-Ruiz, M.A., 2002. Binding virtual molecules sounds good!: exploring a novel way to convey molecular bonding to students. In: Proceedings of E-Learn 2002. Association for the Advancement of Computing in Education, Montreal, Canada.
27. Garcia-Ruiz, M.A., Bustos-Mendoza, C., de la O, L.G., Andrade-Arechiga, M., Santos-Virgen, M., Acosta-Diaz, R., 2004. Exploring multimodal virtual environments for learning biochemistry concepts. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications. AACE, Lugano, Switzerland, pp. 2143-2147.
28. Gaver W.W. Auditory icons: using sound in computer interfaces. Human-computer Interaction 2 (1986) 167-177
29. Gaver W.W. The SonicFinder: an interface that uses auditory icons. Human-computer Interaction 4 1 (1989) 67-94
30. Gaver W.W., Smith R.B., and O'Shea T. Effective sound in complex systems: the ARKola simulation. In: Robertson S., Olson G., and Olson J. (Eds). Human Factors in Computing Systems CHI'91 Conference Proceedings (1991), Addison-Wesley, Reading, MA 85-90
31. Hansen, M.D., Charp, E., Lodha, S., Meads, D., Pang, A., 1999. PROMUSE: a system for multi-media data presentation of protein structural alignments. In: Proceedings of the Pacific Symposium on Biocomputing.
32. Hart H., Craine L.E., and Hart D.H. Organic Chemistry. A Short Course. 10th ed. (1999), Houghton Mifflin, Boston, MA
33. Hayashi K., and Munakata N. Basically musical. Nature 310 (1984) 96
34. Hofstadter D.R. Godel, Escher, Bach: an Eternal Golden Braid (1980), Vintage Books, New York
35. Kaper H.G., Tipei S., and Wiebel E. Data sonification and sound visualization. Computing in Science and Engineering 1 4 (1999) 48-58
36. King R.D., and Angus C.G. PM-protein music. Computer Applications in Biosciences 12 3 (1996) 251-252
37. Kozma R.B. Learning with media. Review of Educational Research 61 2 (1991) 179-211
38. Kramer G. An introduction to auditory display. In: Kramer G. (Ed). Auditory Display. Proceedings of the International Conference of Auditory Display'92 (1994), Addison-Wesley, Reading, MA 1-77
39. Loftin, R.B., Pettitt, B.M., Su, S., 1998. PaulingWorld: an immersive environment for collaborative exploration of molecular structures and interactions. In: Proceedings of the 17th Nordic Internet Conference Nordunet'98, University of Tromso, Norway.
40. Lunney D. Development of a data acquisition and data analysis system for visually impaired chemistry students. Journal of Chemical Education 71 (1994) 308
41. Lunney D., and Morrison R.C. High technology laboratory aids for visually handicapped chemistry students. Journal of Chemical Education 58 3 (1981) 228-231
42. Lunney, D., Morrison, R.C., 1990. Auditory presentation of experimental data. In: Proceedings of the SPIE Extracting Meaning from Complex Data: Processing, Display, Interaction, vol. 1259, pp. 140-146.
43. Miner C., and Della Villa P. DNA music. The Science Teacher 64 5 (1997) 19-21
44. Mousavi S., Low R., and Sweller J. Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology 87 2 (1995) 319-334
45. Musical mutants, 2002. The Exploratorium, 3601 Lyon Street, San Francisco, California, 94123, Available at: www.exploratorium.edu/genepool/exhibits.html
46. Ohno S., and Ohno M. The all pervasive principle of repetitious recurrence governs not only coding sequence construction but also human endeavor in musical composition. Immunogenetics 24 (1986) 71-78
47. Petersen Q.R. Some reflections on the use and abuse of molecular models. Journal of Chemical Education 47 1 (1970) 24-29
48. Ranck J.P. Visualization for chemists. In: Swift M.L., and Zielinski T.J. (Eds). Using Computers in Chemistry and Chemical Education (1997), American Chemical Society, Washington, DC 227-240 (Chapter 13)
49. Rees A.R., and Sterenberg M.J. From cells to atoms. An Illustrated Introduction to Molecular Biology (1984), Blackwell, Oxford, UK
50. Roussos M., Johnson A., Moher T., Leigh J., Vasilakis C., and Barnes C. Learning and building together in an immersive virtual world. Presence 8 (1999) 3
51. Rzepa, H., Whitaker, B., 1995. Chemists surf to active sights. Times Higher Education Supplement 13.
52. Salzman, M., Dede, C., Loftin, B., 1996. Science space: virtual realities for learning complex and abstract scientific concepts. In: Proceedings of IEEE Virtual Reality Annual International Symposium. IEEE Press, New York, pp. 246-253.
53. Schomaker, L., Munch, S., Hartung, K., 1995. A taxonomy of multimodal interaction in the human information processing system. A Report of ESPRIT Project 8579 MIAMI, Technical Report, Nijmegen Institute of Cognition and Information, The Netherlands.
54. Shneiderman B. Designing the user interface. Strategies for Effective Human-Computer Interaction. third ed. (1998), Addison-Wesley, Reading, MA
55. Su S., and Loftin R.B. A shared virtual environment for exploring and designing molecules. Communications of ACM 44 12 (2001) 57-58
56. Upson R. Sonifications as mathematics teaching tools. In: Hiipakka J., Zacharov N., and Takala T. (Eds). Proceedings of the 2001 International Community of Auditory Display (2001), Helsinki University of Technology, Espoo, Finland 217-221
57. Yeung E.S. Pattern recognition by audio representation of multivariate analytical data. Analytical Chemistry 52 (1980) 1120-1123