Spoken language interaction with model uncertainty: An adaptive human-robot interaction system

Connection Science

Volumn 20, Issue 4, 2008, Pages 299-318

  Doshi, Finale ^a   Roy, Nicholas ^b  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Adaptive systems; Dialogue management; Human computer interface; Online learning; Partially observable Markov decision processes

Indexed keywords

ADAPTIVE HUMAN-ROBOT INTERACTION SYSTEMS; DIALOGUE MANAGEMENT; HUMAN COMPUTER INTERFACES; NATURAL LANGUAGE INTERACTION; NOISY SPEECH RECOGNITION; ONLINE LEARNING; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; PROBABILISTIC MODELS;

ADAPTIVE SYSTEMS; COMMUNICATION; HUMAN ROBOT INTERACTION; MAN MACHINE SYSTEMS; SPEECH PROCESSING; SPEECH RECOGNITION; UNCERTAINTY ANALYSIS;

BEHAVIORAL RESEARCH;

EID: 56749163138     PISSN: 09540091     EISSN: 13600494     Source Type: Journal    
DOI: 10.1080/09540090802413145     Document Type: Article

References (25)

1. Bellman, R. (1957), Dynamic Programming, Princeton, NJ: Princeton University Press.
2. th Conference for Uncertainty in Artificial Intelligence, pp. 150-159.
3. th International Joint Conference on Artificial Intelligence, pp. 690-695.
4. th International Joint Conference on Artificial Intelligence, pp. 1879-1884.
5. Gordon, G.J. (1995), 'Stable Function Approximation in Dynamic Programming,' in Proceedings of the Twelfth. International Conference on Machine Learning, San Francisco, CA: Morgan Kaufmann.
6. Hoey, J., Poupart, P., Boutilier, C., andMihailidis, A. (2005), 'POMDP Models for Assistive Technology,'IATSL Technical Report.
7. James, M.R., Singh, S., and Littman, M. (2004), 'Planning with Predictive State Representations,' in International Conference on Machine Learning and Applications.
8. Jaulmes, R., Pineau, J., and Precup, D. (2005), 'Learning in Non-stationary Partially Observable Markov Decision Processes,' ECML Workshop.
9. Litman, D., Singh, S., Kearns, M., and Walker, M. (2000), 'NJFun: A Reinforcement Learning Spoken Dialogue System,' in Proceedings of the ANLP/NAACL 2000 Workshop on Conversational Systems, Seattle, pp. 17-20.
10. Litman, D.J., and Pan, S. (2002), 'Designing and Evaluating an Adaptive Spoken Dialogue System,' User Modeling and User-Adapted Interaction, 12, 111-137.
11. Littman, M.L., Cassandra, A.R., and Kaelbling, L.P. (1995), 'Learning Policies for Partially Observable Environments: Scaling up,' in Proceedings of the Twelfth International Conference on Machine Learning, eds. A. Prieditis and S. Russell, San Francisco, CA: Morgan Kaufmann; San Mateo, CA, pp. 362-370.
12. Lopes, L.S., and Chauhan, A. (2007), 'How Many Words can my Robot Learn? An Approach and Experiments with One-class Learning,' Interaction Studies, 8(1), 53-81.
13. Lopes, L.S., and Teixeira, A. (2000), 'Human-Robot Interaction through Spoken Language Dialogue,' Proceedings of the International Conference on Intelligent Robots and Systems, pp. 528-534.
14. th Advances in Neural Information Processing Systems.
15. Paek, T., and Horvitz, E. (2004), 'Optimizing Automated Call Routing by Integrating Spoken Dialog Models with Queuing Models,' in Human language Technology Conference, North American Chapter of the Associationfor Computational Linguistics, pp. 41-48.
16. th International Joint Conference on Artificial Intelligence, pp. 1025-1032.
17. Pineau, J., Roy, N., and Thrun, S. (2001), 'A Hierarchical Approach to POMDP Planning and Execution,' in Workshop on Hierarchy and Memory in Reinforcement Learning (ICML), June.
18. Porta, J.M., Vlassis, N., Spaan, M., and Poupart, P. (2006), 'An Point-based Value Iteration for Continuous POMDP,' Journal of Machine Learning Research, 1, 2329-2367.
19. Poupart, P., Vlassis, N., Hoey, J., and Regan, K. (2006), 'An Analytic Solution to Discrete Bayesian. Reinforcement Learning,' in International Conference on Machine Learning, Pittsburgh, PA, New York, NY: ACM Press, pp. 697-704.
20. Rabiner, L.R. (1989), 'A Tutorial on Hidden Markov Models and Selecteds Applications in Speech Recognition,' Proceedings of the IEEE, 11, 257-286.
21. Reeves, B., and Nass, C. (1996), The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places, Chicago: University of Chicago Press.
22. Roy, N., Pineau, J., and Thrun, S. (2000), 'Spoken Dialogue Management Using Probabilistic Reasoning,' in Proceedings of the 38th Annual Meeting of the ACL, Hong Kong, pp. 93-100.
23. Seneff, S., and Polifroni, J. (2000), 'Dialogue Management in the Mercury Flight Reservation System,' in ANLP/NAACL 2000 Workshop on Conversational Systems, Seattle, Washington, Morristown, NJ: Association for Computational Linguistics, pp. 11-16.
24. Williams, J., and Young, S. (2005), 'Scaling Up POMDPs for Dialogue Management: The 'Summary POMDP' Method,' in Proceedings of the IEEE ASRU Workshop, pp. 250-255.
25. Xu, H., and Mannor, S. (2007), 'The Robustness-Performance Tradeoff in Markov Decision Processes,' in Advances in Neural Information Processing Systems 19, eds. B. Schölkopf, J. Platt and T. Hoffman, Cambridge, MA: MIT Press.