Context-aware resource management in multi-inhabitant smart homes: A framework based on Nash H-learning

Pervasive and Mobile Computing

Volumn 2, Issue 4, 2006, Pages 372-404

  Das, Sajal K ^a   Roy, Nirmalya ^a   Roy, Abhishek ^a  

^a The University of Texas at Arlington   (United States)

Author keywords

Context aware computing; Information theory; Location activity prediction; Multi inhabitant smart homes; Nash equilibrium; Q learning; Stochastic game theory

Indexed keywords

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMATION; INFORMATION THEORY; OPTIMAL SYSTEMS; RESOURCE ALLOCATION; VIRTUAL REALITY;

CONTEXT-AWARE COMPUTING; LOCATION/ACTIVITY PREDICTION; MULTI-INHABITANT SMART HOMES; NASH EQUILIBRIUM; Q-LEARNING; STOCHASTIC GAME THEORY;

LEARNING SYSTEMS;

EID: 33749677833     PISSN: 15741192     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.pmcj.2006.08.003     Document Type: Article

References (33)

1. Bahl P., and Padmanabhan V. RADAR: An in-building RF-based user location and tracking system. Proc. IEEE Infocom (2000), IEEE CS Press, Los Alamitos, CA 775-784
2. Bhattacharya A., and Das S.K. LeZi-update: An information-theoretic approach for personal mobility tracking in PCS networks. ACM/Kluwer Wireless Networks 8 2 (2002) 121-137
3. Cook D.J., and Das S.K. Smart Environments: Technology, Protocols and Applications (2004), John Wiley & Sons
4. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), John Wiley
5. Das S.K., Cook D.J., Bhattacharya A., Hierman E., and Lin T.Y. The role of prediction algorithms in the MavHome smart home architecture. Smart Homes. IEEE Wireless Communications (2002) (special issue)
6. Estop T.D. Applied Thermodynamics for Engineering Technologists: S.I. Units (1978), Longman Publishers
7. Garey M.R., and Johnson D.S. Computers and Intractability: A Guide to the Theory of NP-Completeness (1979), W. H. Freeman Publishers
8. Gopalratnam K., and Cook D.J. Active LeZi: An incremental parsing algorithm for sequential prediction. International Journal of Artificial Intelligence Tools 14 1-2 (2004) 917-930
9. Grimmet G.R., and Stirzaker D.R. Probability and Random Processes. second ed. (1992), Oxford University Press
10. Harter A., and Hopper A. A distributed location system for the active office. IEEE Network 8 1 (1994) 62-70
11. A. Harter, A. Hopper, P. Steggles, A. Ward, P. Webster, The anatomy of a context-aware application, in: Proc. 5th Annual Int'l Conference on Mobile Computing and Networking, August 1999, pp. 59-68
12. X10 web resources available at http://www.x10.com
13. A. Hopper, Sentient computing, The Royal Society Clifford Patterson Lecture, 1999
14. House_n Living Laboratory Introduction, Web resource available at http://architecture.mit.edu/house_n/web/publications
15. Hu J., and Wellman M.P. Nash Q-learning for general-sum stochastic games. Journal of Machine Learning 4 (2003) 1039-1069
16. E. Koutsoupias, C. Papadimitriou, Worst-case equilibria, in: 16th Annual Symposium on Theoretical Aspects of Computer Science, 1999, pp. 404-413
17. Krumm J., Harris S., Meyers B., Brumitt B., Hale M., and Shafer S. Multi-camera multi-person tracking for easy living. Proceedings of 3rd IEEE International Workshop on Visual Surveillance (2000), IEEE Press, Piscataway, NJ 3-10
18. V. Lesser, et al., The intelligent home testbed, in: Proc. of Autonomy Control Software Workshop, January 1999
19. M.C. Mozer, The Neural Network House: An Environment that Adapts to its Inhabitants, in: Proc. of the American Association for Artificial Intelligence Spring Symposium on Intelligent Environments, 1998, pp. 110-114
20. Nash J.F. Non-cooperative games. Annals of Mathematics 54 (1951) 286-295
21. Orr R.J., and Abowd G.D. The smart floor: A mechanism for natural user identification and tracking. Proceedings of Conference on Human Factors in Computing Systems. CHI 2000 (2000), ACM Press, NY
22. Owen G. Game Theory. second ed. (1982), Academic Press
23. N. Priyantha, A. Chakraborty, H. Balakrishnan, The cricket location support system, in: Proc. 6th Ann. Int'l Conference on Mobile Computing and Networking, August 2000, pp. 32-43
24. A. Roy, S.K. Das Bhaumik, A. Bhattacharya, K. Basu, D.J. Cook, S.K. Das, Location aware resource management in smart homes, in: Proc. of IEEE Int'l Conf. on Pervasive Computing and Communications PerCom, March 2003, pp. 481-488
25. N. Roy, S.K. Das, K. Basu, M. Kumar, Enhancing availability of grid computational services to ubiquitous computing application, in: IEEE International Conference on Parallel and Distributed Processing Symposium, IPDPS'2005, Denver, Colorado, USA, April 2005
26. N. Roy, A. Roy, S.K. Das, K. Basu, A reinforcement learning framework for location-aware resource management in multi-inhabitant smart homes, in: Proc. of 3rd International Conference on Smart Homes and Health Telematic, ICOST, July 2005, pp. 180-187
27. N. Roy, A. Roy, K. Basu, S.K. Das, A cooperative learning framework for mobility-aware resource management in multi-inhabitant smart homes, in: Proc. of IEEE International Conference on Mobile and Ubiquitous Systems: Networking and Services, MobiQuitous, July 2005, pp. 393-403
28. N. Roy, A. Roy, S.K. Das, Context-aware resource management in multi-inhabitant smart homes: A Nash H-learning based approach, in: Proc. of IEEE Int'l Conf. on Pervasive Computing and Communications, PerCom, March 2006
29. Shelton C.R. Balancing multiple sources of reward in reinforcement learning. Advances in Neural Information Processing Systems (2000) 1082-1088
30. Weiser M. The computer for the 21st century. Scientific American 265 3 (1991) 94-104
31. M. Youngblood, D.J. Cook, L.B. Holder, Managing adaptive versatile environments, in: Proc. of IEEE Int'l Conf. on Pervasive Computing and Communications, PerCom, March 2005, pp. 351-360
32. M. Youngblood, MavPad inhabitant 2 Trial 2 data set, in: The MavHome Project. Computer Science and Engineering Department, The University of Texas, Arlington, 2005. http://mavhome.uta.edu
33. Ziv J., and Lempel A. Compression of individual sequences via variable-rate coding. IEEE Transactions on Information Theory 24 5 (1978) 530-536