Adding speech recognition support to UML tools

Journal of Visual Languages and Computing

Volumn 16, Issue 1-2 SPEC. ISS., 2005, Pages 85-118

  Lahtinen, Samuel ^a   Peltonen, Jari ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

CASE tool; Multimodal interaction; Speech recognition; UML modeling; Visual language

Indexed keywords

EID: 13844315160     PISSN: 1045926X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jvlc.2004.08.001     Document Type: Article

References (60)

1. Object Management Group, http://www.omg.org/uml/, 2004
2. M. Albizuri-Romero A Retrospective View of CASE Tools Adoption ACM SIGSOFT. Software Engineering Notes, 25 2 2000 46-51
3. D. Lending, N. Chervany, CASE Tools: Understanding the Reasons for Non-Use, Computer Personnel, April 1998, pp. 13-26
4. IBM Rational, Rational Rose, http://www.rational.com, 2001
5. B. Myers, Challenges of HCI Design and Implementation. Interactions, January 1994, pp. 73-83
6. J. Airaksinen, K. Koskimies, J. Koskinen, J. Peltonen, P. Selonen, M. Siikarla, T. Systä, xUMLi: Towards a tool-independent UML processing platform, In: Proceedings of NWPER, 2002
7. A.B. Jaczone, Waypointer, http://www.jaczone.com/, (7.7.2004)
8. S. Lahtinen, J. Peltonen, Enhancing usability of UML case-tools with speech recognition, In: Proceedings of IEEE Symposium on Human Centric Computing Languages and Environments, 28-31 October 2003, pp. 227-235
9. J. Preece A Guide to Usability: Human Factors in Computing 1993 Addison Wesley Reading, MA
10. R. Peacocke D. Graf An Introduction to Speech and Speaker Recognition IEEE Computer 23 8 1990 26-33
11. R. Baecker J. Grudin W. Buxton S. Greenberg Readings in Human-Computer Interaction: Towards the Year 2000 Second Edition 1995 Morgan Kaufmann Publishers Inc Los Altos, CA
12. H. Aust M. Oerder F. Side V. Steinbiss The Philips Automatic Train Timetable Information System Speech Communication 17 1995 249-262
13. V. Zue S. Seneff J.R. Glass J. Polifroni C. Pao T.J. Hazen L. Hetherington JUPlTER: A telephone-based conversational interface for weather information IEEE Transactions on Speech and Audio Processing 8 1 2000 85-96
14. M. Marx, C. Schmandt, MailCall: Message presentation and navigation in a nonvisual environment, In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Common Ground, April 1996, pp. 165-172
15. M. Turunen, J. Hakulinen, Mailman - a multilingual speech-only e-mail client based on an adaptive speech application framework, In: Proceedings of the Workshop on Multi-Lingual Speech Communication (MSC 2000), 2000, pp. 7-12
16. P. Martin F. Crabbe S. Adams E. Baatz N. Yankelovich SpeechActs: A spoken language framework In IEEE Computer 29 1996 33-40
17. A. Elmaghraby, Voice recognition applications for programming environments, In: Proceedings of IEEE, Southeastcon, 1989, pp. 655-659
18. J. Leopold, L. Ambler, Keyboardless Visual Programming Using Voice, Handwriting and Gesture, IEEE, 1997, pp. 28-35
19. M. Billinghurst, Put That Where? Voice and Gesture at the Graphics Interface, Computer Graphics, 1998, pp. 60-63
20. P. Cohen D. McGee S. Oviatt L. Wu J. Clow R. King S. Julier L. Rosenblum Multimodal interaction for 2D and 3D environments Computer Graphics and Applications, IEEE 19 4 1999 10-13
21. D.M. Krum, O. Omoteso, W. Ribarsky, T. Starner, L.F. Hodges, Case studies: Information visualization and user interaction: Speech and gesture multimodal control of a whole Earth 3D visualization environment, In: Proceedings of the Symposium on Data Visualisation 2002, May 2002, pp. 195-200
22. T. Nishimoto, N. Shida, T. Kobyashi, K. Shirai, Improving human interface in drawing tool using speech, mouse and keyboard, In: Proceedings of IEEE International Workshop on Robot and Human Communication, IEEE, 1995, pp. 107-112
23. M. Salisbury, J. Hendrickson, T. Lammers, C. Fu, S. Moody, Talk and Draw Budling Speech and Graphics, IEEE Computer, August 1990, pp. 59-65
24. R. Sharma M. Zeller V.I. Pavlovic T.S. Huang Z. Lo S. Chu Y. Zhao J.C. Phillips K. Schulten Speech/gesture interface to a visual-computing environment Computer Graphics and Applications, IEEE 20 2 2000 29-37
25. L.A. Smith, E.F. Chiu, B.L. Scott, A speech interface for building musical score collections, In: Proceedings of the Fifth ACM Conference on Digital Libraries San Antonio, TX, USA, 2000, pp. 165-173
26. D. Weimer, A Synthetic visual environment with hand gesturing and voice input, In: Proceedings of CHI'89, ACM, 1989, pp. 235-240
27. R. Bolt, Put-That-There: Voice and Gesture at the Graphics Interface, ACM, 1980, pp. 262-270
28. P.R. Cohen, M. Johnston, D. McGee, S. Oviatt, J. Pittman, I. Smith, L. Chen, J. Clow, QuickSet: Multimodal interaction for distributed applications, In: Proceedings of the Fifth ACM International Conference on Multimedia, November 1997, pp. 31-40
29. G. Martin The utility of speech input in user computing interfaces International Journal of Man-Machine Studies 30 1989 355-375
30. A. Hauptmann, Speech and gestures for graphic image manipulation, In: Proceedings of CHI'89, ACM, 1989, pp. 241-245
31. B. Myers, R. Malkin, M. Bett, A. Waibel, B. Bostwick, R.C. Miller, J. Yang, M. Denecke, E. Seemann, J. Zhu, P.C. Hong, D. Kong, J. Nichols, B. Scherlis, Flexi-modal and multi-machine user interfaces, In: Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces, 14-16 October 2002, pp. 343-348
32. P. Cohen, D. McGee, J. Clow, The efficiency of multimodal interaction for a map-based task, In: Proceedings of the Sixth Conference on Applied Natural Language Processing, April 2000, pp. 331-338
33. S. Oviatt, Multimodal interfaces for dynamic interactive maps, In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: Common Ground, April 1996, pp. 95-102
34. E.V. Zudilova, P.M.A. Sloot, R.G. Belleman, A multi-modal interface for an interactive simulated vascular reconstruction system, In: Proceedings of the Fourth IEEE International Conference on Multimodal Interfaces (ICMI'02) Pittsburgh, Pennsylvania, October 14-16, 2002, pp. 313-318
35. M. Zeller, J.C. Phillips, A. Dalke, W. Humphrey, K. Schulten, R. Sharma, T.S. Huang, V.I. Pavlovic, Y. Zhao, Z. Lo, S. Chu, A visual computing environment for very large scale biomolecular modeling, In: Proceedings of IEEE International Conference on Application-Specific Systems, Architectures and Processors, 14-16 July 1997, pp. 3-12
36. C.-C.P. Chu, T.H. Dani, R. Gadh, Multimodal interface for a virtual reality based computer aided design system, IEEE International Conference on Robotics and Automation Albuquerque, New Mexico, April 1997, pp. 1329-1334
37. D.M. Krum, O. Omoteso, W. Ribarsky, T. Starner, L.F. Hodges, Evaluation of a multimodal interface for 3D terrain visualization, Visualization, VIS 2002, IEEE, 27 October-1 November 2002, pp. 411-418
38. Object Management Group, OMG Unified Modeling Language Specification, Version 1.4, September 2001
39. R. Rosenfeld D. Olsen A. Rudnicky Universal speech interfaces Interactions VIII 6 2001 34-44
40. S. Shriver, R. Rosenfeld, X. Zhu, A. Toth, A. Rudnicky, M. Flueckiger, Universalizing Speech: Notes from the USI Project, In: Proceedings of the Eurospeech, Bonn: ISCA, vol. 1, 2001, pp. 1563-1566
41. K. Sugiyama S. Tagawa M. Toda Methods for visual understanding of hierarchical system structures IEEE Transactions on Systems, Man, and Cybernetics SMC-11 2 1981 109-125
42. S. Lahtinen, J. Peltonen, K. Koskimies, Deriving speech interface for manipulating model instances: A UML case study, In: Proceedings of the Workshop on Bridging the Gaps II (SEHCI 2004), Edinburgh, May 2004, pp. 67-74
43. J. Peltonen, S. Lahtinen, K. Koskimies, A specification technique for model based derivation of speech interfaces, In: Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing Rome, Italy, 26-29 September 2004, pp. 251-253
44. A.R. Toth, T.K Harris, J. Sanders, S. Shriver, R. Rosenfeld, Towards every-citizen's speech interface: An application generator for speech interfaces to databases, In: Proceedings of ICSLP 2002, vol. 3, 2002, pp. 1497-1500
45. Wang Ye-Yi, A. Acero, Grammar learning for spoken language understanding, IEEE Workshop on Automatic Speech Recognition and Understanding, 9-13 December 2001, pp. 292-295
46. C. Janssen, A Weisbecker, J. Ziegler, Generating user interfaces from data models and dialogue net specifications, In: Proceedings of the SIGCHI Conference on Human factors in Computing Systems, Amsterdam, The Netherlands, 24-29 April, 1993, pp. 418-423
47. G. Nordstrom, J. Sztipanovits, G. Karsai, A. Ledeczi, Metamodeling-rapid design and evolution of domain-specific modeling environments, In: Proceedings of IEEE Conference and Workshop on Engineering of Computer-Based Systems, ECBS '99, 7-12 March 1999, pp. 68-74
48. H. Vangheluwe, J. Lara, Computer automated multi-paradigm modelling: meta-modelling and graph transformation, In: Proceedings of the 2003 Winter Simulation Conference, Vol. 1, December 2003, pp. 595-603
49. Microsoft Speech SDK (SAPI 5.1)- http://www.microsoft.com/speech/SDK/51/sapi.chm
50. M. Turunen, J. Hakulinen, Jaspis-a framework for multilingual adaptive speech applications, In: Proceedings of the Sixth International Conference of Spoken Language Processing ICSLP, vol. 2, 2000, pp. 719-722
51. S. Srinivasan, J. Vergo, Object oriented reuse: Experience in developing a framework for speech recognition applications, In: Proceedings of the 20th International Conference on Software Engineering, Kyoto, Japan, April 19-25 1998, pp. 322-330
52. N. Yankelovich How do users know what to say? Interactions 3 6 1996 32-43
53. Q. Chen, J. Grundy, J. Hosking, An e-whiteboard application to support early design-stage sketching of UML diagrams, In: Proceedings of IEEE Symposium on Human Centric Computing Languages and Environments, 28-31 October 2003, pp. 219-226
54. C.H. Damm, K.M. Hansen, M. Thomsen, Tool support for cooperative object-oriented design: Gesture based modelling on an electronic whiteboard, In: Procedings of the SIGCHI Conference on Human Factors in Computing Systems, April 2000, pp. 518-525
55. E. Lank, J.S. Thorley, S. Jy-Shyang Chen, An interactive system for recognizing hand drawn UML diagrams, In: Proceedings of the 2000 Conference of the Centre for Advanced Studies on Collaborative research, November 2000, p. 7
56. Z.X. Sun, B. Zhang, Q.H. Qiu, L.S. Zhang, A freehand sketchy graphic input system: SketchGIS, Machine Learning and Cybernetics, 2003 International Conference, vol. 5, 2-5 November 2003, pp. 3232-3237
57. P. Selonen, Set operations for Unified Modeling Language, In: Proceedings of the Eight Symposium on Programming Languages and Tools, SPLST'2003, Kuopio, Finland, June 2003, pp. 70-81
58. P. Selonen K. Koskimies M. Sakkinen Transformations Between UML Diagrams Journal of Database Management 14 3 2003 37-55
59. W3C, Speech Recognition Grammar Specification Version 1.0, W3C Proposed Recommendation 18 December 2003, http://www.w3.org/TR/speech-grammar/
60. J. Peltonen, P. Selonen, Processing UML Models with Visual Scripts. In: Proceedings of HCC'01, 2001, pp. 264-271