Learning Human Behavior Patterns for Proactive Service System: Agglomerative Fuzzy Clustering-based Fuzzy-state Q-learning

2008 International Conference on Computational Intelligence for Modelling Control and Automation, CIMCA 2008

Volumn , Issue , 2008, Pages 362-367

  Lee, Sang Wan ^b   Kim, Yong Soo ^a   Bien, Zeungnam ^b  

^a Daejeon University   (South Korea)

^b Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

AGGLOMERATIVE CLUSTERING; BAYESIAN; HUMAN ACTIONS; HUMAN BEHAVIORS; LEARNING METHODS; Q-LEARNING; Q-LEARNING ALGORITHMS; REAL-WORLD DATABASE; SEQUENCE OF ACTIONS; SERVICE SYSTEMS;

ARTIFICIAL INTELLIGENCE; BEHAVIORAL RESEARCH; EDUCATION; FUZZY SYSTEMS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; PATTERN RECOGNITION SYSTEMS;

FUZZY CLUSTERING;

EID: 70449570693     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIMCA.2008.79     Document Type: Conference Paper

References (18)

1. Z. Z. Bien, "Learning system techniques for humanfriendly man-machine interaction", Keynote Speech in the 2nd International Conference on Artificial Intelligence in Engineering and Technology (iCAiET 2004), Malaysia, August 3-5, 2004.
2. S. W. Lee, D.-J. Kim, Y. S. Kim, and Z. Bien, "Adaptive Gabor wavelet neural network for facial expression recognition - training of feature extractor by novel feature separability criterion, " Proc. of the 11th World Congress of International Fuzzy Systems Association (IFSA 2005), Beijing, China, July 28-31, 2005, pp. 1309-1315.
3. H. Jang, J.-H. Do, J.-W. Jung, and Z. Z. Bien, "Twostaged hand-posture recognition method for softremocon system", Proc. of IEEE International Conference on Systems, Man, and Cybernetics, USA, October 10-12, 2005.
4. J.-H. Do, H. Jang, S. H. Jung, J. Jung, and Z. Bien, "Soft remote control system in the intelligent sweet home", Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2005), Edmonton, Canada, August 2-6, 2005, pp. 2193-2198.
5. Z. Z. Bien, H.-E. Lee, Y.-M. Kim, Y.-H. Kim, J.-W. Jung, and K.-H. Park, "Steward robot for human-friendly assistive home environment", Promoting Independence for Older Persons with Disabilities, ser. Assistive Technology Research Series, The Netherlands: IOS Press, January 2006, vol. 18, pp. 75-84.
6. P. K. Simpson, "Fuzzy min-max neural networks - part I: Classification", IEEE Trans. on Neural Networks, vol. 3, no. 5, pp. 776-786, 1992.
7. Hyong-Euk Lee, Kwang-Hyun Park and Z. Zenn Bien, "Iterative Fuzzy Clustering Algorithm with Supervision to Construct Probabilistic Fuzzy Rule Base from Numerical Data", IEEE Trans. on Fuzzy Systems, 2008.
8. Christopher J.C.H.W., Peter D., "Q-Learning", Machine Learning, vol. 8, pp. 279-292, 1992.
9. Yoichiro M, "Modified Q-Learning Method with Fuzzy State Division and Adaptive Rewards", Proc. of IEEE Int. Conference on Fuzzy Systems, 2002, pp.1556-1561.
10. Hamid R. B., "Fuzzy Q-learning: A New Approach for Fuzzy Dynamic Programming", IEEE World Congress on Computational Intelligence, 1994, pp. 486-491.
11. Suh, I. H., Kim, J.-H., Frank Rhee, C.-H., "Fuzzy Q-learning for Autonomous Robot Systems", Proc. of IEEE International Conference on Neural Network, 1997, pp.1738-1743.
12. Sang Wan Lee, Yong Soo Kim, and Zeungnam Bien, "Agglomerative Fuzzy Clustering based on Bayesian Interpretation", Proc. of IEEE International Conference on Information Reuse and Integration, Las Vegas, USA, 2007.
13. A. V. Petrovsky, et al. Psychology, 1986, Prosveshenye.
14. W. Lee, Decision Theory and Human Behavior, John Wiley & Sons, INC, 1971.
15. Yoichiro M, "Modified Q-Learning Method with Fuzzy State Division and Adaptive Rewards", Proc. of IEEE Int. Conference on Fuzzy Systems, pp.1556-1561, 2002.
16. J.C.H.W. Christopher, D. Peter, "Q-Learning", Machine Learning, vol. 8, pp. 279-292, 1992.
17. K. Murphy, "Hidden Markov Model (HMM) Toolbox for Matlab, " http://www.cs.ubc.ca/~murphyk/Software/HMM/hmm.html 2005.
18. M. A. Feki, S. W. Lee, M. Mokhtari, Z. Bien, "Context Aware Life Pattern Prediction using Fuzzy-State Q-Learning", Proc. 5th International Conference on Smart home and Telecommunication, Nara, Japan, June, 2007.