Combined Fuzzy State Q-learning algorithm to predict context aware user activity under uncertainty in assistive environment

Proc. 9th ACIS Int. Conf. Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing, SNPD 2008 and 2nd Int. Workshop on Advanced Internet Technology and Applications

Volumn , Issue , 2008, Pages 57-62

  Ali, Feki Mohamed ^a   Lee, Sang Wan ^b   Bien, Zenn ^b   Mokhtari, Mounir ^c  

^a INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

^b Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^c TELECOM SUDPARIS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; FORECASTING; INTERNET; LEARNING SYSTEMS; SOFTWARE ENGINEERING; TECHNICAL PRESENTATIONS;

CHALLENGING TASKS; COMBINED ALGORITHMS; CONTEXT-AWARE; FUZZY STATES; ON TIMES; PRE-REQUISITES; PROBABILISTIC METHODS; REAL DATUMS; STATE OF THE ARTS; UNCERTAINTY DATUMS; USER ACTIVITIES;

LEARNING ALGORITHMS;

EID: 57749173895     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SNPD.2008.13     Document Type: Conference Paper

References (22)

1. Mounir M and Feki M.A, «User needs and usage analysis in a smart environment for people requiring assistance », Topics in Geriatric rehabilitation Journal, January/March 2007, Volume 23, Number 1, p. 52-59..
2. R. J. Orr and G. D. Abowd, "The Smart Floor: A Mechanism for Natural User Identification and Tracking", Proceedings of 2000 Conference on Human Factors in Computing Systems (CHI 2000), ACM Press, NY, 2000.
3. M. C. Mozer, "The Neural Network House: An Environment that Adapts to its Inhavitants", Proc. of the American Association for Artificial Intelligence Spring Symposium on Intelligent Environments, pp. 110-114, 1998.
4. Lesser, et al., "The Intelligent Home Testbed", Proc. of Autonomy Control Software Workshop, Jan 1999.
5. Kwang-Hyun Park, Hyong-Euk Lee, and Z. Zenn Bien, Learning Capability of a Steward Robot for Proactive Services in Smart House Environment Proceedings of International Workshop on IT-based Assistive Devices and Service Robots in Smart House Environment, Daejeon, Korea, pp. 74-80, July 27-28, 2006
6. Z. Zenn Bien, Kwang-Hyun Park, Dae-Jin Kim, and Jin-Woo Jung, Welfare-Oriented Service Robotic Systems: Intelligent Sweet Home & KARES II Advances in Rehabilitation Robotics: Human-friendly Technologies on Movement Assistance and Restoration for People with Disabilities, Lecture Notes in Control and Information Sciences, vol. 306, pp. 57-94, September 2004
7. S. K. Das, D. J. Cook, A. Bhattacharya, E. Hierman, T. Y. Lin, "The Role of Prediction Algorithms in the MAVHome Smart Home Architecture", IEEE Wireless Communications, Special Issue Smart Homes, Vol. 9, No. 6, pp. 77-84, Dec. 2002.
8. Ehrhard Behrends. Introduction to Marcov Chains. Vieweg, 1999.
9. Finn V. Jensen. An Introduction to Bayesian Networks. UCL Press, 1996.
10. Kevin Gurney. An Introduction to Neural Networks. Routledge, 2002.
11. R. Mayrhofer. An Architecture for Context Prediction. PhD thesis, Johannes Kepler University of Linz, Austria, October 2004.
12. Feki M.A, Sang Wang Lee, Zenn bien and Mounir Mokhtari, «Context Aware Life Pattern Prediction using Fuzzy-State Q-Learning », LNCS Proceeding of ICOST 2007, fifth International Conference On Smart homes and health Telematics, Japan, June 2007
13. Feki M.A and Mokhtari M «context aware and ontology specification for assistive environment » HWRS-ERS Journal, Vol. 4, No2, P29-32. December 2005
14. R. Mayrhofer, "Context prediction based on context histories: Expected benefits, issues and current state-ofthe-art", in Proc. ECHISE 2005: 1st International Workshop on Exploiting Context Histories in Smart Environments (T. Prante, B. Meyers, G. Fitzpatrick, and L. D. Harvel, eds.), May 2005. Part of the Third International Conference on Pervasive Computing (PERVASIVE 2005).
15. Yoichiro M.: Modified Q-Learning Method with Fuzzy State Division and Adaptive Rewards. Proc. of IEEE International Conference on Fuzzy Systems, (2002) 1556-1561
16. Christopher J.C.H.W., Peter D.: Q-Learning. Machine Learning, 8(1992)279-292.
17. J. C. Bezdek.: Fuzziness vs. Probability - Again. IEEE Trans. Fuzzy Systems, vol 2(1) (1994) 1-3.
18. B. Kosko.: The probability Mopnopoly. IEEE Transactions on Fuzzy Systems. vol. 2., No. 1, (1994)
19. Harnid R. B.: Fuzzy Q-learning: A New Approach for Fuzzy Dynamic Programming. IEEE World Congress on Computational Intelligence (1994) 486-491.
20. Suh, I. H., Kim, J.-H., Frank Rhee, C.-H.: Fuzzy Q- learning for Autonomous Robot Systems. Proc. of IEEE International Conference on Neural Network, (1997) 1738-1743.
21. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm", Journal of the Royal Statistical Society, Vol. 39(1), pp. 1-38, 1977.
22. H.-E. Lee, K.-H. Park and Z. Z. Bien, "Iterative Fuzzy Clustering Algorithm with Supervision to Construct Probabilistic Fuzzy Rule Base from Numerical Data", IEEE Trans. Fuzzy Systems, Vol. 16, No. 1. Feb. 2008.