Hierarchical preference learning for light control from user feedback

2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops, CVPRW 2010

Volumn , Issue , 2010, Pages 56-62

  Khalili, Amir Hossein ^a   Wu, Chen ^a   Aghajan, Hamid ^a  

^a STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CAMERA NETWORK; ENERGY COST; HIERARCHICAL REINFORCEMENT; INTERACTIVE LEARNING; LIGHT CONTROL; LIGHT INTENSITY; PREFERENCE LEARNING; SMART HOMES; STATE ABSTRACTION; USER FEEDBACK; USER MODELS; USER SATISFACTION; USER'S ACTIVITIES;

COMPUTER VISION; ENERGY EFFICIENCY; OPTIMIZATION;

TECHNICAL PRESENTATIONS;

EID: 77956537697     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2010.5543265     Document Type: Conference Paper

References (20)

1. G. Abowd, E. Mynatt, and T. Rodden. The human experience [of ubiquitous computing]. Pervasive Computing, IEEE, 1(1):48-57, 2002. 1
2. A. Aztiria, A. Izaguirre, R. Basagoiti, and J. C. Augusto. Learning preferences and common behaviours of the user in intelligent environments. In Behaviour Monitoring and Interpretation: Smart Environments, pages 289-315, 2009. 3
3. D. Cook, M. Schmitter-Edgecombe, A. Crandall, C. Sanders, and B. Thomas. Collecting and disseminating smart home sensor data in the casas project. In CHI Workshop on Developing Shared Home Behavior Datasets to Advance HCI and Ubiquitous Computing Research, 2009. 3
4. R. Crites and A. Barto. Improving elevator performance using reinforcement learning. In In Advances in Neural Information Processing Systems, 1995. 3
5. B. de Ruyter, E. van Loenen, and V. Teeven. User centered research in experiencelab. In Ambient Intelligence, volume 4794/2007, pages 305-313, 2007. 1
6. T. G. Dietterich. State abstraction in maxq hierarchical reinforcement learning. In Advanced in Neural Information Processing System 12, pages 994-1000. MIT Press, 2000. 4
7. A. Helal, M. Mokhtari, and B. Abdulrazak. Engineering Handbook on Smart Technology for Aging Disability and Independence. JohnWiley & Sons. Computer Engineering Series, 2008.
8. S. Intille, K. Larson, E. Tapia, J. Beaudin, P. Kaushik, J. Nawyn, and R. Rockinson. Using a live-in laboratory for ubiquitous computing research. In Pervasive Computing, pages 349-365, 2006. 1
9. B. Logan, J. Healey, M. Philipose, E. M. Tapia, and S. Intille. A long-term evaluation of sensing modalities for activity recognition. In Proc. of Ubicomp, 2007. 2
10. T. Moeslund, A. Hilton, and V. Kruger. A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding, 103(2-3):90-126, November 2006. 2
11. M. Mozer and D. Miller. Parsing the stream of time: The value of event-based segmentation in a complex real-world control problem. Springer Verlag., 1998. 3
12. M. C. Mozer. Lessons from an adaptive home. In Smart environments: Technologies, protocols, and applications, pages 271-294. John Wiley & Sons., 2004. 1
13. J. C. Niebles, H. Wang, and L. Fei-Fei. Unsupervised learning of human action categories using spatial-temporal words. International Journal of Computer Vision, 2008. 2, 3
14. M. Philipose, K. P. Fishkin, M. Perkowitz, D. J. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. IEEE Pervasive Computing, 3(4):50-57, 2004. 2
15. P. Rashidi and D. J. Cook. Keeping the resident in the loop: Adapting the smart home to the user. 39(5):949-959, 2009. 3
16. R. Sutton and A. Barto. Reinforcement Learning: An introduction. MIT Press, Cambridge, MA, USA, 1998. 4
17. E. M. Tapia, S. S. Intille, and K. Larson. Activity recognition in the home using simple and ubiquitous sensors. In Pervasive Computing, pages 158-175, 2004. 2
18. C. Wu and H. Aghajan. User-centric environment discovery in smart home with camera networks. In to appear. 5
19. G. N. Yannakakis, M. Maragoudakis, and J. Hallam. Preference learning for cognitive modeling: a case study on entertainment preferences. IEEE Systems, Man and Cybernetics:Part A, pages 1165-1175, 2009. 3
20. S. Zaidenberg, P. Reignier, and J. Crowley. Reinforcement learning of context models for a ubiquitous personal assistant. In The 3rd Symposium of Ubiquitous Computing and Ambient Intelligence, volume 51, pages 254-264, 2008. 3