Distributed control of situated assistance in large domains with many tasks

ICAPS 2011 - Proceedings of the 21st International Conference on Automated Planning and Scheduling

Volumn , Issue , 2011, Pages 90-97

  Hoey, Jesse ^a   Grześ, Marek ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AFFORDANCES; ASSISTANCE SYSTEM; AUTOMATED ASSISTANCE; AUTOMATED SYSTEMS; COGNITIVE DISABILITY; DISTRIBUTED CONTROL; FULL MODEL; HIERARCHICAL CONTROLLERS; LARGE DOMAIN; MULTIPLE TASKS; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; SENSOR NOISE; SIMULATED DOMAINS;

AUTOMATION; COGNITIVE SYSTEMS; COMPUTER SIMULATION; DISTRIBUTED PARAMETER CONTROL SYSTEMS; MARKOV PROCESSES;

BEHAVIORAL RESEARCH;

EID: 80054840616     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Boutilier, C. 1999. Sequential optimality and coordination in multiagent systems. In Proc. IJCAI, 478-485.
2. Brdiczka, O.; Crowley, J. L.; and Reignier, P. 2009. Learning situation models in a smart home. IEEE Trans. on Systems, Man and Cybernetics - Part B: Cybernetics 39(1).
3. Dietterich, T. G. 2000. Hierarchical reinforcement learning with the MAXQ value function decomposition. JAIR 13:227-303. (Pubitemid 33682087)
4. Dolgov, D. A., and Durfee, E. H. 2006. Resource allocation among agents with MDP-induced preferences. JAIR 27:505-549.
5. Duke, D.; Barnard, P.; Duce, D.; and May, J. 1998. Syndetic modelling. Human-Computer Interaction 13(4):337.
6. Fern, A.; Natarajan, S.; Judah, K.; and Tadepalli, P. 2007. A decision-theoretic model of assistance. In Proc. IJCAI.
7. Geib, C. W. 2002. Problems with intent recognition for elder care. In Proc. of AAAI Wrkshp. on Automation as Caregiver.
8. Guestrin, C., and Gordon, G. 2002. Distributed planning in hierarchical factored MDPs. In Proc. UAI, 197-206.
9. Hoey, J.; Plötz, T.; Jackson, D.; Monk, A.; Pham, C.; and Olivier, P. 2010a. Rapid specification and automated generation of prompting systems to assist people with dementia. to appear in Pervasive and Mobile Computing. doi:10.1016/j.pmcj.2010.11.007.
10. Hoey, J.; Poupart, P.; von Bertoldi, A.; Craig, T.; Boutilier, C.; and Mihailidis, A. 2010b. Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. CVIU 114(5):503-519.
11. Meuleau, N.; Hauskrecht, M.; Kim, K.-E.; Peshkin, L.; Kaelbling, L. P.; Dean, T.; and Boutilier, C. 1998. Solving very large weakly coupled Markov decision processes. In Proc. AAAI, 165-172.
12. Nair, R.; Tambe, M.; Yokoo, M.; Pynadath, D.; and Marsella, S. 2003. Taming decentralized POMDPs: Towards efficient policy computation for multiagent settings. In Proc. IJCAI.
13. Pineau, J.; Roy, N.; and Thrun, S. 2001. A hierarchical approach to POMDP planning and execution. In ICML Workshop on Hierarchy and Memory in Reinforcement Learning.
14. Ryu, H., and Monk, A. F. 2009. Interaction unit analysis: A new interaction design framework. Human-Computer Interaction 24(4):367-407.
15. Seuken, S., and Zilberstein, S. 2007. Improved memory-bounded dynamic programming for decentralized POMDPs. In Proc. UAI.
16. Singla, G.; Cook, D. J.; and Schmitter-Edgecombe, M. 2008. Incorporating temporal reasoning into activity recognition for smart home residents. In AAAI Wrkshp. Spatial and Temporal Reasoning.
17. Spaan, M. T. J., and Vlassis, N. 2005. Perseus: Randomized point-based value iteration for POMDPs. JAIR 24:195-220. (Pubitemid 43130936)
18. Sutton, R.; Precup, D.; and Singh, S. 1999. Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112:181-211. (Pubitemid 32079890)
19. Theocharous, G.; Murphy, K.; and Kaelbling, L. 2004. Representing hierarchical POMDPs as DBNs for multi-scale robot localization. In Proc. Intl. Conf. on Robotics and Automation.
20. Varakantham, P.; young Kwak, J.; Taylor, M.; Marecki, J.; Scerri, P.; and Tambe, M. 2009. Exploiting coordination locales in distributed POMDPs via social model shaping. In Proc. ICAPS.
21. Zhang, S.; McClean, S.; Scotney, B.; and Nugent, C. 2008. Learning under uncertainty in smart home environments. In Proc. IEEE EMBS Conference.