ISIS: An adaptive, trilingual conversational system with interleaving interaction and delegation dialogs

ACM Transactions on Computer-Human Interaction

Volumn 11, Issue 3, 2004, Pages 268-299

  Meng, Helen ^a   Ching, P C ^a   Chan, Shuk Fong ^a   Wong, Yee Fong ^a   Chan, Cheong Chat ^a  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Human computer spoken language interface; Interaction and delegation dialogs

Indexed keywords

DELEGATION DIALOGS; HUMAN COMPUTER SPOKEN LANGUAGE INTERFACES; SPEAKER AUTHENTICATION;

HUMAN COMPUTER INTERACTION; INFORMATION RETRIEVAL; REAL TIME SYSTEMS; SPEECH ANALYSIS; SPEECH PROCESSING; SPEECH RECOGNITION;

USER INTERFACES;

EID: 5444223018     PISSN: 10730516     EISSN: None     Source Type: Journal    
DOI: 10.1145/1017494.1017497     Document Type: Article

References (51)

1. AUST, H., OERDER, M., SEIDE, F., AND STEINBISS, V. 1995. The Phillips Automatic Train Timetable Information System. Speech Comm. 17, 249-262.
2. BAZZI, J. AND GLASS, J. 2000. Modeling out-of-vocabulary words for robust speech recognition. In Proceedings of the International Conference on Spoken Language Technologies (ICSLP-00). Beijing, ISCA-Archive, volume 1, 401-404.
3. BAYER S., DORAN C., AND GEORGE, B. 2001. Exploring speech-enabled dialog with the GALAXY communicator infrastructure. In Proceedings of the Human Language Technologies Conference (HLT-01). San Diego. Morgan Kaufman, 79-81.
4. BRILL, E. 1995. Transformation-based error-driven learning and natural language processing: A case study in part-of-speech tagging. Computational Linguistics. 21(4), 543-566.
5. CHOI, W. N., WONG, Y. W., LEE, T., AND CHING, P. C. 2000. Lexical tree decoding with class-based language models for Chinese speech recognition. In Proceedings of the International Conference on Spoken Language Technologies (ICSLP-00). Beijing. ISCA-Archive, volume 1, 174-177.
6. CHUNG, G., SENEFF, S., AND WANG, C. 2003. Automatic acquisition of names using speak and spell mode in spoken dialogue systems. In Proceedings of the Human Language Technologies Conference (HLT-03). Edmonton. Morgan Kaufman, 197-200.
7. COHEN, P. R., CHEYER, J., WANG, M., AND BAEG, S. C. 1994. An open agent architecture. In the AAAI Spring Symposium Technical Report. Palo Alto. AAAI Press, 1-8.
8. CUTRELL, E., CZERWINSKI, M., AND HORVITZ, E. 2001. Notification, Disruption and memory: Effects of messaging on memory and performance. In Proceedings of Human-Computer Interaction (Interact-01). Tokyo. IOS Press, 263-269.
9. CZERWINSKI, M., CUTRELL, E., AND HORVITZ, E. 2000. Instant messaging and interruption: Influence of task type on performance. In OZCHI Conference Proceedings 2000. 356-361.
10. DECADT, B., DUCHATEAU, J., DAELEMANS, W., AND WAMBACQ, P. 2002. Transcription of out-of-vocabulary words in large vocabulary speech recognition based on Phoneme-to-Grapheme conversion. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP-02). Orlando. IEEE, Volume 1, 861-864.
11. FININ, T. AND FRIITZSON, R. 1994. KQML - A Language and Protocol for Knowledge and Information Exchange. Tech. Rep. CS-94-02, University of Maryland, UMBC, 〈http://www.mmt.bme.hu/research/ai/lib/kbkshtml/kbks.html〉.
12. FUNG T. Y. AND MENG, H. 2000. Concatenating syllables for response generation in domain-specific applications. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-00). Istanbul. IEEE, Volume 2, 933-936.
13. GODDEAU, D., MENG, H., POLIFRONI, J., SENEFF, S., AND BUSAYAPONGCHAI, S. 1996. A form-based dialog manager for spoken language applications. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-96). Philadephia. IEEE, Volume 2, 701-704.
14. GROSZ, B. AND SIDNER, C. 1985. Discourse structure and the proper treatment of interruptions. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-85). Los Angeles. Morgan Kaufman, 832-839.
15. HAZEN, T. AND BAZZI, I. 2001. A comparison and combination of methods for OOV word detection and word conference scoring. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-01). Salt Lake City. IEEE, Volume 1, 397-400.
16. HORVITZ, E. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI-99). Pittsburgh. ACM Press, 159-166.
17. HORVITZ, E. AND BARRY, M. 1995. Display of information for time-critical decision making. In Proceedings of Uncertainty in Artificial Intelligence (UAI-95). Montreal. Morgan Kaufman, 296-305.
18. HORVITZ, E., KADIE, C., PAEK, T., AND HOVEL, D. 2003. Models of attention in computing and communication: From principles to applications. Comm. ACM 46, 3, 52-59.
19. ISHII, H. AND ULLMER, B. 1997. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI-97). Atlanta. ACM Press, 234-241.
20. ISSAR, S. 1996. Estimation of language models for new spoken language applications. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-96). Philadephia. ISCA-archive, 869-872.
21. LAU, R. AND SENEFF, S. 1998. A unified system for sublexical and linguistic modeling using ANGIE and TINA, In Proceedings of the International Conference on Spoken Language Processing (ICSLP-98). Sydney. 2443-2446.
22. LESH, N., RICH, C., AND SIDNER, C. 2001. Collaborating with focused and unfocused users under imperfect communication. In Proceedings of the International Conference on User Modeling. Sonthofen. Springer, 63-74.
23. LEVIN, E., NARAYANAN, S., PIERACCINI, R., BIATOV, K., BOCCHIERI, E., DI FABBRIZIO, G., ECKERT, W., LEE, S., POKROVSKY, A., RAHIM, N., RUSCITTI, P., AND WALKER, M. 2000. The AT&T DARPA communicator mixed-initiative spoken dialog system. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-00), Beijing, ISCA-Archive, Volume 2, 122-125.
24. LIM R. W. AND WOGALTER, M. S. 2000. The position of static and on-off banners in WWW displays on subsequent recognition. In Proceedings of the Joint Meeting of the Human Factors and Ergonomics Society and the International Ergonomics Association (IEA2000/HFES2000). San Diego. 420-423.
25. MAGLIO, P. AND CAMPBELL, C. 2000. Tradeoffs in displaying peripheral information. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI-00). The Hague. ACM Press, 241-248.
26. MANOS, A. AND ZUE, V. 1997. A segment-based spotter using phonetic filler models. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-97). Munich. IEEE, Volume 2, 899-902.
27. MCFARLANE, D. 1999. Coordinating the interruption of people. In. Human-Computer Interaction, Proceedings of Human-Computer Interaction - INTERACT99, IOS Press, Inc., The Netherlands, 295-303.
28. MCTEAR, M. 2002. Spoken dialog technology: Enabling the conversational user interface. ACM Computing Surveys (CSUR). 34, 1, 90-169, ACM Press.
29. MENG, H., LEE, S., AND WAI, C. 2000a. CU FOREX: A bilingual spoken dialog system for foreign exchange enquires. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP-00). Istanbul IEEE, Volume 2, 229-232.
30. MENG, H., CHING, P. C., WONG, Y. F., AND CHAN, C. C. 2002b. A multi-modal, trilingual, distributed spoken dialog system developed with CORBA, JAVA, XML and EQML. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-02), Denver. 2561-2564.
31. MENG, H., CHAN, S. F., WONG, Y. F, CHAN, C. C., WONG, Y. W., FUNG, T. Y., TSUI, W. C., CHEN, K., WANG, L., WU, T. Y., LI, X. L., LEE, T., CHOI. W. N., CHING, P. C., AND CHI, H. S. 2001. ISIS: A learning system with combined interaction and delegation dialogs. In Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech-01). Scandinavia. Volume 3, 1551-1554.
32. MENG H., CHAN, S. F., WONG, Y. F., FUNG, T. Y., TSUI, W. C., LO, T. H., CHAN, C. C., CHEN, K., WANG, L., WU, T. Y., LI, X., LEE, T., CHOI. W. N., WONG, Y. W., CHING, P. C., AND CHI, H. 2000b. ISIS: A multilingual spoken dialog system developed with CORBA and KQML agents. 2000. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-00). Beijing. ISCA-Archive, Volume 2, 150-153.
33. MENG, H. AND TSUI, W. C. 2000. Comprehension across application domains and languages. In Proceedings of the International Symposium on Chinese Spoken Language Processing (ISCSLP-00), Beijing. CD-ROM proceedings.
34. MENG H., LAM, W., AND WAI, C. 1999. To believe is to understand. In Proceedings of 6th European Conference on Speech Communication and Technology (Eurospeech-99). Budapest. ISCA-archive, 2015-2018.
35. MENG H., BUSAYAPONGCHAI, S., GLASS, J., GODDEAU, D., HETHERINGTON, L., HURLEY, E., PAO, C., POLIFRONI, J., SENEFF, S., AND ZUE, V. 1996. WHEELS: A conversational system on electronic automobile classifieds. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-96). Philadelphia. IEEE, Volume 1, 542-545.
36. MENG, H., KEUNG, C. K., SIU, K. C., FUNG, T. Y., AND CHING, P. C. 2002b. CU Vocal: Corpus-based syllable concatenation for Chinese speech synthesis across domains and dialects. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-02), Denver. 2373-2376.
37. MENG, H., LO, T. H., KEUNG, C. K., HO, M. C., HO, M. C., AND LO, W. K. 2003. CU VOCAL Web Service: A Text-to-speech synthesis Web service for voice-enabled Web-mediated applications. In Proceedings of the 12th International World Wide Web Conference (WWW-03), Budapest. www2003.org/cdrom/ papers/poster/p056/p56-meng.html.
38. OVIATT, S., DEANGELI, A., AND KUHN, K. 1997. Integration and synchronization of input modes during multimodal human-computer interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI-97). Atlanta. ACM Press, 415-422.
39. OVIATT, S. AND COHEN, P. 2000. Multimodal interfaces that process what comes naturally. Comm. ACM 43, 3, 45-53.
40. PAPINENI K. A., ROUKOS S., AND WARD R. T. 1998. Free-flow dialog management using forms. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-98). Sydney. 1411-1414.
41. RAO, A. S. AND GEORGEFF, M. P. 1995. BDI Agents: From Theory to Practice. Tech. Rep. #56, Australian Artificial Intelligence Institute, Melbourne, Australia.
42. REYNOLDS, D. A. 1992. A Gaussian mixture modeling approach to text-independent speaker identification. Ph.D. thesis, Georgia Institute of Technology.
43. ROSSET, S., BENNACEF, S., AND LAMEL, L. 1999. Design strategies for spoken language dialog systems. In Proceedings of 6th European Conference on Speech Communication and Technology (Eurospeech-99). Budapest. ISCA-archive, 1535-1538.
44. RUDNICKY, A., THAYER, E., CONSTANTINIDES, P., TCHOU, C., SHERN, R.,LENZO, K.,XU, W., AND OH, A. 1999. Creating natural dialogs in the Carnegie Mellon communicator system. In Proceedings of 6th European Conference on Speech Communication and Technology (Eurospeech-99). Budapest. ISCA-archive, 1531-1534.
45. SADEK, M. D. AND MORI, R. 1997. Dialog systems. In Spoken Dialog with Computers. R. de Mori, Ed. Academic Press, 523-561.
46. SCHILLO, C., FINK, G. A., AND KUMMERT, F. 2000. Grapheme-based speech recognition for large vocabularies. In Proceedings of the International Conference on Spoken Language Technologies (ICSLP-00). Beijing. ISCA-archive, Volume 4, 584-587. Beijing, 2000.
47. SENEFF, S., LAU, R., AND POLIFRONI, J. 1999. Organization, communication and control in the Galaxy-II conversational system. In Proceedings of 6th European Conference on Speech Communication and Technology (Eurospeech-99). Budapest. ISCA-archive, 1271-1274.
48. SENEFF, S., CHUU, C., AND CYPHERS, D. S. 2000. Orion: From On-line Interaction to Off-line Delegation. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-00). Beijing. ISCA-archive, Volume 2, 142-145.
49. SENEFF, S., LAU, R., AND MENG, H. 1996. ANGIE: A new framework for speech analysis based on morpho-phonological modeling. In Proceedings of the International Conference on Spoken Language Processing (ICSLP-96). Philadelphia, IEEE, Volume 1, 110-113.
50. TAYLOR, P., BLACK, A., AND CALEY, R. 1998. The architecture of the festival speech synthesis system. In Proceedings of the 3rd ESCA/COCOSDA Workshop on Speech Synthesis. Jenolan Caves, Australia. 147-151.
51. VAN DANTZICH, M., ROBBINS, D., HORVITZ, E., AND CZERWINSKI, M. 2002. Scope: providing awareness of multiple notifications at a Glance. In Proceedings of the ACM International Working Conference on Advanced Visual Interfaces (AVI-02). Trento, ACM Press, research.microsoft.com/~horvitz/scope.htm.