Computational state space models for activity and intention recognition. A feasibility study

PLoS ONE

Volumn 9, Issue 11, 2014, Pages

  Krüger, Frank ^a   Nyolt, Martin ^a   Yordanova, Kristina ^a   Hein, Albert ^a   Kirste, Thomas ^a  

^a UNIVERSITY OF ROSTOCK   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ANALYSIS OF VARIANCE; ARTICLE; BEHAVIOR; COMPUTATIONAL STATE SPACE MODEL; CONTROLLED STUDY; FEASIBILITY STUDY; FILTRATION; HIDDEN MARKOV MODEL; HUMAN; HUMAN EXPERIMENT; MARGINAL FILTER; MATHEMATICAL MODEL; MONTE CARLO METHOD; PARTICLE FILTER; WILCOXON SIGNED RANKS TEST; COMPUTER SIMULATION; DAILY LIFE ACTIVITY; PSYCHOLOGICAL MODEL; RECOGNITION;

ACTIVITIES OF DAILY LIVING; COMPUTER SIMULATION; FEASIBILITY STUDIES; HUMANS; INTENTION; MODELS, PSYCHOLOGICAL; RECOGNITION (PSYCHOLOGY);

EID: 84910620885     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0109381     Document Type: Article

References (68)

1. Baker CL, Saxe R, Tenenbaum J.B. (2009) Action understanding as inverse planning. Cognition 113: 329-349.
2. Hiatt L, Harrison A, Trafton G. (2011) Accommodating human variability in human-robot teams through theory of mind. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI). Barcelona, Spain, pp. 2077-2071.
3. Krüger F., Yordanova K, Hein A., Kirste T. (2013) Plan synthesis for probabilistic activity recognition. In: Proceedings of the fifth International Conference on Agents and Artificial Intelligence (ICAART). Barcelona, Spain, pp. 283-288.
4. Ramírez M., Geffner H. (2010) Probabilistic plan recognition using off-the-shelf classical planners. In: Proceedings of the 24th National Conference of Artificial Intelligence (AAAI). Atlanta, Georgia, USA, pp. 1211-1217.
5. Ramírez M., Geffner H. (2011) Goal recognition over POMDPs: Inferring the intention of a POMDP agent. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI). Barcelona, Spain, pp. 2009-2014.
6. Bui HH, Phung DQ, Venkatesh S. (2004) Hierarchical hidden markov models with general state hierarchy. In: Proceedings of the 19th national conference on Artificial Intelligence (AAAI). San Jose, CA, USA, pp. 324-329.
7. Kiefer P, Stein K. (2008) A framework for mobile intention recognition in spatially structured environments. In: Gottfried B, Aghajan HK, editors, Proceedings of the second Workshop on Behaviour Monitoring and Interpretation (BMI). Kaiserslautern, Germany, pp. 28-41.
8. Shi Y, Huang Y, Minnen D., Bobick A, Essa I. (2004) Propagation networks for recognition of partially ordered sequential action. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Washington DC, USA, pp. 862-869.
9. Cook DJ, Das S.K. (2007) How smart are our environments? an updated look at the state of the art. Pervasive and mobile computing 3: 53-73.
10. Yu Z, Nakamura Y. (2010) Smart meeting systems: A survey of state-of-the-art and open issues. ACM Computing Surveys 42: 8:1-8:20.
11. Gong S, Loy C, Xiang T. (2011) Security and surveillance. In: Moeslund TB, Hilton A, Krüger V, Sigal L, editors, Visual Analysis of Humans, Springer London. pp. 455-472.
12. Hoey J, Plötz T, Jackson D., Monk A, Pham C, et al (2011) Rapid specification and automated generation of prompting systems to assist people with dementia. Pervasive and Mobile Computing 7: 299-318.
13. Patterson DJ, Liao L, Gajos K., Collier M, Livic N, et al (2004) Opportunity knocks: A system to provide cognitive assistance with transportation services. In: Davies N, Mynatt E, Siio I, editors, Proceedings of the sixth International Conference on Ubiquitous Computing (Ubicomp), Nottingham, UK: Springer, Volume 3205 of Lecture Notes in Computer Science. pp. 433-450.
14. Krüger F., Yordanova K, Burghardt C., Kirste T. (2012) Towards creating assistive software by employing human behavior models. Journal of Ambient Intelligence and Smart Environments 4: 209-226.
15. Hastie T, Tibshirani R, Friedman J. (2009) The Elements of Statistical Learning - Data Mining, Inference, and Prediction. Springer, second edition.
16. Koller D, Friedman N. (2009) Probabilistic Graphical Models. Cambridge, MA: MIT Press.
17. Anderson JR, Bothell D, Byrne M.D., Douglass S., Lebiere C, et al. (2004) An integrated theory of the mind. Psychological Review 111: 1036-1060.
18. Aggarwal JK, Ryoo M.S. (2011) Human activity analysis: A review. ACM Computing Surveys 43: 16:1-16:43.
19. Chen L, Hoey J, Nugent C., Cook D, Yu Z. (2012) Sensor-based activity recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 42: 790-808.
20. Han TA, Pereira L.M. (2013) State-of-the-art of intention recognition and its use in decision making. AI Communications 26: 237-246.
21. Dai P, Di H, Dong L., Tao L, Xu G. (2008) Group interaction analysis in dynamic context. Trans Sys Man Cyber Part B 38: 275-282.
22. Association AOT (2002) Occupational therapy practice framework: Domain and process. The American Journal of Occupational Therapy 56: 609-639.
23. Baum C, Edwards D.F. (1993) Cognitive performance in senile dementia of the Alzheimer's type: The Kitchen Task Assessment. The American Journal of Occupational Therapy 47: 431-436.
24. Serna A, Pigot H, Rialle V. (2007) Modeling the progression of Alzheimer's disease for cognitive assistance in smart homes. User Modeling and User-Adapted Interaction 17: 415-438.
25. Rohrbach M, Amin S, Andriluka M., Schiele B. (2012) A database for fine grained activity detection of cooking activities. In: Proceedings of the 25th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Rhode Island, USA.
26. Nielsen J, Landauer T.K. (1993) A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems. Amsterdam, The Netherlands: ACM, pp. 206-213.
27. Jones M, Chiang J, Stephens A., J P. (2009) The use of physical props in motion capture studies. SAE Int J Passeng Cars - Mech Syst 1: 1163-1171.
28. Patterson DJ, Fox D, Kautz H., Philipose M. (2005) Fine-grained activity recognition by aggregating abstract object usage. In: Proceedings of the ninth IEEE International Symposium on Wearable Computers. Washington, DC, USA: IEEE Computer Society, pp. 44-51.
29. Wu J, Osuntogun A, Choudhury T., Philipose M, Rehg J.M. (2007) A scalable approach to activity recognition based on object use. In: Proceedings of the eleventh IEEE International Conference on Computer Vision. IEEE, pp. 1-8.
30. Lara OD, Labrador M.A. (2013) A survey on human activity recognition using wearable sensors. Communications Surveys Tutorials, IEEE 15: 1192-1209.
31. de la Torre F, Hodgins J, Montano J, Valcarcel S, Forcada R, et al. (2009) Guide to the carnegie mellon university multimodal activity (CMU-MMAC) database. Technical Report CMU-RI-TR-08-22, Robotics Institute, Carnegie Mellon University.
32. de la Torre F, Hodgins JK, Montano J, Valcarcel S (2009) Detailed human data acquisition of kitchen activities: the CMU-Multimodal Activity Database (CMU-MMAC). In: Workshop on Developing Shared Home Behavior Datasets to Advance HCI and Ubiquitous Computing Research, in conjuction with CHI 2009.
33. Doucet A, de Freitas N, Gordon N. (2001) Sequential Monte Carlo Methods in Practice. Springer.
34. Doucet A, Godsill S, Andrieu C. (2000) On sequential monte carlo sampling methods for bayesian filtering. Statistics and Computing 10: 197-208.
35. Russell S, Norvig P. (2010) Artificial Intelligence - A Modern Approach. Prentice Hall, third edition.
36. Ward JA, Lukowicz P, Gellersen H.W. (2011) Performance metrics for activity recognition. ACM Transactions on Intelligent Systems and Technology 2: 6:1-6:23.
37. Lin J (1992) Divergence measures based on the shannon entropy. IEEE Transactions on Information Theory 37: 145-151.
38. Olejnik S, Algina J. (2003) Generalized Eta and Omega Squared statistics: Measures of effect size for some common research designs. Psychological Methods 8: 434-447.
39. Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum Associates, chapter The Analysis of Variance. second edition.
40. Jaeger H, Haas H. (2004) Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 304: 78-80.
41. Pearl J (2009) Causality: Models, Reasoning, and Inference. Cambridge University Press, second edition.
42. Gal Y, Reddy S, Shieber S.M., Rubin A., Grosz B.J. (2012) Plan recognition in exploratory domains. Artificial Intelligence 176: 2270-2290.
43. Roy P, Bouchard B, Bouzouane A., Giroux S. (2007) A hybrid plan recognition model for Alzheimer's patients: interleaved-erroneous dilemma. In: Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT). pp. 131-137.
44. van Kasteren TLM, Noulas A, Englebienne G, Kröse BJA (2008) Accurate activity recognition in a home setting. In: Proceedings of the tenth International Conference on Ubiquitous Computing (Ubicomp). ACM, Seoul, Korea: ACM, pp. 1-9.
45. Szewcyzk S, Dwan K, Minor B., Swedlove B, Cook D. (2009) Annotating smart environment sensor data for activity learning. Technology and Health Care 17: 161-169.
46. Krippendorff K (2013) Content analysis: An introduction to its methodology. Thousand Oaks, CA: Sage, third edition.
47. Mendeling J, Reijers HA, Recker J. (2010) Activity labeling in process modeling: Empirical insights and recommendations. Information Systems 35: 467-482.
48. Tanenbaum AS (2009) Modern operating systems. Upper Saddle River and NJ: Pearson/Prentice Hall, third edition.
49. Nielson F, Nielson HR, Hankin C. (2004) Principles of Program Analysis. Springer.
50. Clarke EM Jr., Grumberg O, Peled D.A. (1999) Model Checking. MIT Press.
51. van der Aalst WMP, Reijers HA, Weijters AJMM, van Dongen BF, Alves de Medeiros AK, et al. (2007) Business process mining: An industrial application. Inf Syst 32: 713-732.
52. Zhuo HH, Kambhampati S. (2013) Action-model acquisition from noisy plan traces. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI). Beijing, China: AAAI, pp. 2444-2450.
53. Perkowitz M, Philipose M, Fishkin K., Patterson D.J. (2004) Mining models of human activities from the web. In: Proceedings of the 13th International Conference on World Wide Web. New York, NY, USA: ACM, pp. 573-582.
54. Doucet A, de Freitas N, Murphy K, Russell S. (2000) Rao-blackwellised particle filtering for dynamic bayesian networks. In: Proceedings of the 16th conference on Uncertainty in Artificial Intelligence (UAI). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc., pp. 176-183.
55. Fox C, Roberts S. (2012) A tutorial on variational bayesian inference. Artificial Intelligence Review 38: 85-95.
56. Walsh T, editor (2011) Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Menlo Park, California: AAAI Press.
57. Hoey J, Poupart P, Bertoldi A.v., Craig T., Boutilier C, et al. (2010) Automated handwashing assistance for persons with dementia using video and a partially observable markov decision process. Computer Vision and Image Understanding 114: 503-519.
58. Dash D, Voortman M, de Jongh M (2013) Sequences of mechanisms for causal reasoning in artificial intelligence. In: Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI). Beijing, China, pp. 839-845.
59. Rossi F, editor (2013) Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Menlo Park, California: AAAI Press.
60. Duong T, Phung D, Bui H., Venkatesh S. (2009) Efficient duration and hierarchical modeling for human activity recognition. Artif Intell 173: 830-856.
61. Kalra L, Zhao X, Soto A.J., Milios E. (2013) Detection of daily living activities using a two-stage markov model. Journal of Ambient Intelligence and Smart Environments 5: 273-285.
62. Nguyen N, Venkatesh S, Bui H. (2006) Recognising behaviours of multiple people with hierarchical probabilistic model and statistical data association. In: Proceedings of the 17th British Machine Vision Conference. British Machine Vision Association, pp. 1239-1248.
63. Nguyen NT, Bui HH, Venkatesh S, West G. (2003) Recognizing and monitoring high-level behaviors in complex spatial environments. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Los Alamitos, CA, USA, pp. 620-625.
64. Sadilek A, Kautz H. (2012) Location-based reasoning about complex multi-agent behavior. Journal of Artificial Intelligence Research 43: 87-133.
65. Bui HH, Phung D, Venkatesh S., Phan H. (2008) The hidden permutation model and location-based activity recognition. In: Proceedings of the 23rd national conference on Artificial Intelligence (AAAI). AAAI Press, pp. 1345-1350.
66. Bouchard B, Bouzouane A, Giroux S. (2007) A keyhole plan recognition model for Alzheimer's patients: first results. Applied Artificial Intelligence 21: 623-658.
67. Chen L, Nugent CD, Wang H. (2012) A knowledge-driven approach to activity recognition in smart homes. IEEE Trans on Knowl and Data Eng 24: 961-974.
68. Roy PC, Giroux S, Bouchard B., Bouzouane A, Phua C, et al (2011) A possibilistic approach for activity recognition in smart homes for cognitive assistance to Alzheimer's patients. In: Chen L, Nugent CD, Biswas J, Hoey J, editors, Activity Recognition in Pervasive Intelligent Environments, Atlantis Press, Volume 4 of Atlantis Ambient and Pervasive Intelligence. pp. 33-58.