Data mining for hierarchical model creation

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 37, Issue 4, 2007, Pages 561-572

  Youngblood, G Michael ^a   Cook, Diane J ^b  

^a University of North Carolina at Charlotte   (United States)

^b Washington State University   (United States)

Author keywords

Data mining; Hierarchical Markov models; Prediction; Smart homes; User modeling

Indexed keywords

DECISION-LEARNING ALGORITHM; HIERARCHICAL MARKOV MODEL; SMART ENVIRONMENT;

AUTOMATION; COMPUTER SIMULATION; DECISION SUPPORT SYSTEMS; HIERARCHICAL SYSTEMS; INTELLIGENT BUILDINGS; MARKOV PROCESSES; SENSORS;

DATA MINING;

EID: 34447295107     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2007.897341     Document Type: Article

References (36)

1. J. Boger, P. Poupart, J. Hoey, C. Boutilier, G. Fernie, and A. Mihailadis, "A planning system based on Markov decision processes to guide people with dementia through activities of daily living," IEEE Trans. Inf. Technol. Biomed., vol. 10, no. 2, pp. 323-333, Apr. 2006.
2. K. Pulasinghe, K. Watanabe, K. Izumi, and K. Kiguchi, "Modular fuzzyneuro controller driven by spoken language commands," IEEE Trans. Syst., Man, Cybern. B, vol. 34, no. 1, pp. 293-302, Feb. 2004.
3. L. Rabiner and B. Juang, "An introduction to hidden Markov models," IEEE ASSP Mag., vol. 3, no. 1, pp. 4-16, Jan. 1986.
4. M. Skounakis, M. Craven, and S. Ray, "Hierarchical hiddenMarkov models for information extraction," in Proc. Int. Joint Conf. Artif. Intell., 2003, pp. 427-433.
5. J. Bockhorst and M. Craven, "Markov networks for detecting overlapping elements in sequence data," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2005, pp. 193-200.
6. G. Theocharous and S. Mahadevan, "Approximate planning with hierarchical partially observable Markov decision process models for robot navigation," in Proc. IEEE Int. Conf. Robot. Autom.,May 2002, pp. 1347-1352.
7. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, "Planning and acting in partially observable stochastic domains," Artif. Intell. vol. 101, pp. 99-134, 1998.
8. S. Fine, Y. Singer, and N. Tishby, "The hierarchical hidden Markov model: Analysis and applications," Mach. Learn., vol. 32, no. 1, pp. 41-62, 1998.
9. A.G. Barto and S. Mahadevan, "Recent advances in hierarchical reinforcement learning," in Discrete Event Systems. Norwell, MA: Kluwer, 2003, pp. 343-379.
10. M. Hauskrecht, N. Meuleau, L. P. Kaelbling, T. Dean, and C. Boutilier, "Hierarchical solution of Markov decision processes using macroactions," in Proc. Conf. Uncertainty Artif. Intell., 1998, pp. 220-229.
11. S. Singh, "Reinforcement learning with a hierarchy of abstract models," in Proc. Nat. Conf. Artif. Intell., 1992, pp. 202-207.
12. Y.-H. Chang and L. P. Kaelbling, "Hedged learning: Regret-minimization with learning experts," presented at the Int. Conf. Mach. Learn., Bonn, Germany, 2005.
13. C. Demonceaux and D. Kachi-Akkouche, "Motion detection usingwavelet analysis and hierarchical Markov models," in Proc. Workshop Spec. Coherence Vis. Motion Anal., 2004, pp. 64-75.
14. T. Mori, Y. Segawa, M. Shimosaka, and T. Sato, "Hierarchical recognition of daily human actions based on continuous hidden Markov models," in Proc. IEEE Int. Conf. Autom. Face Gesture Recog., 2004, pp. 779-784.
15. R. Sun and C. Sessions, "Self-segmentation of sequences," in Proc. IEEE Int. Joint Conf. Neural Netw., 1999, pp. 2253-2258.
16. J. Pineau, N. Roy, and S. Thrun, "A hierarchical approach to POMDP planning and execution," presented at the Workshop Hierarchy Memory Reinforcement Learn. (ICML), Williams College, MA, 2001.
17. L. Xie, S.-F. Chang, A. Divakaran, and H. Sun, "Unsupervised mining of statistical temporal structures in video," in Video Mining, A. Rosenfeld, D. Doermann, and and D. Dementhon, Eds. Norwell, MA: Kluwer, 2003.
18. Bureau of Labor Statistics. (2006). [Online]. Available: www.bls.gov/oco/
19. AIRE Group. (2004, Jan.). MIT project AIRE - About us. [Online]. Available: http://www.ai.mit.edu/projects/aire
20. A. Fox, B. Johanson, P. Hanrahan, and T. Winograd, "Integrating information appliances into an interactive space," IEEE Comput. Graph. Appl., vol. 20, no. 3, pp. 54-65, May/Jun. 2000.
21. M. Roman, C. K. Hess, R. Cerqueira, A. Ranganathan, R. H. Campbell, and K. Nahrstedt, "Gaia: A middleware infrastructure to enable active spaces," IEEE Pervasive Comput., vol. 1, no. 4, pp. 74-83, Oct.-Dec. 2002.
22. N. A. Streitz, J. Geiler, T. Holmer, S. Konomi, C. Mller-Tomfelde, W. Reischl, P. Rexroth, P. Seitz, and R. Steinmetz, "i-LAND: An interactive landscape for creativity and innovation," in Proc. CHI 1999, pp. 120-127.
23. G. D. Abowd and E. D. Mynatt, "Designing for the human experience in smart environments," in Smart Environments: Technology, Protocols, and Applications, D. J. Cook and S. K. Das, Eds. New York: Wiley, 2005, pp. 153-174.
24. A. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kaddoura, and E. Jansen, "The Gator Tech smart house: A programmable pervasive space," IEEE Comput., vol. 38, no. 3, pp. 50-60, Mar. 2005.
25. NIST. (2006). Smart space NIST laboratory, [Online]. Available: http://www.nist.gov/smartspace/
26. M. C. Mozer, "Lessons from an adaptive home," in Smart Environments: Technology, Protocols, and Applications, D. J. Cook and S. K. Das, Eds. New York: Wiley, 2005, pp. 273-298.
27. H. Hagras, V. Callaghan, M. Colley, G. Clarke, A. Pounds-Cornish, and H. Duman, "Creating an ambient-intelligence environment using embedded agents," IEEE Intell. Syst., vol. 19, no. 6, pp. 12-20, Nov./Dec. 2004.
28. G. M. Youngblood, D. J. Cook, and L. B. Holder, "Managing adaptive versatile environments," J. Pervasive Mobile Comput., vol. 1, no. 4, pp. 373-403, 2005.
29. R. Srikant and R. Agrawal, "Mining sequential patterns: Generalizations and performance improvements," in Proc. 5th Int. Conf. Extending Database Technol., 1996, pp. 3-17.
30. J. Rissanen, Stochastic Complexity in Statistical inquiry. Singapore: World Scientific, 1989.
31. G. J. Chaitin, "Randomness and mathematical proof," Sci. Amer., vol. 232, no. 5, pp. 47-52, 1975.
32. S. Rubin and L. Trajkovic, "On the role of randomization in software engineering," presented at the Int. Conf. Comput. Ind. Eng., Cocoa Beach, FL, 2001.
33. K. Gopalratnam and D. J. Cook, "Online sequential prediction via incremental parsing: The Active LeZi algorithm," IEEE Intell. Syst. vol. 22, no. 1, pp. 52-58, Jan./Feb. 2007.
34. T. C. Bell, J. G. Cleary, and I.H. Witten, Text Compression. Englewood Cliffs, NJ: Prentice-Hall, 1990.
35. R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction Cambridge, MA: MIT Press, 1998.
36. E. Batschelet, Circular Statistics in Biology. New York: Academic, 1981.