A process for systematic development of symbolic models for activity recognition

ACM Transactions on Interactive Intelligent Systems

Volumn 5, Issue 4, 2015, Pages

  Yordanova, Kristina ^a   Kirste, Thomas ^a  

^a UNIVERSITY OF ROSTOCK   (Germany)

Author keywords

Activity recognition; Context awareness; Human behaviour models; Model development; Probabilistic models; Symbolic models

Indexed keywords

BEHAVIORAL RESEARCH; PATTERN RECOGNITION; SOCIAL SCIENCES;

ACTIVITY RECOGNITION; CONTEXT- AWARENESS; HUMAN BEHAVIOURS; MODEL DEVELOPMENT; PROBABILISTIC MODELS; SYMBOLIC MODEL;

HUMAN FORM MODELS;

EID: 84967185429     PISSN: 21606455     EISSN: 21606463     Source Type: Journal    
DOI: 10.1145/2806893     Document Type: Article

References (77)

1. John. R. Anderson. 1983. The Architecture of Cognition. Lawrence Erlbaum Associates, Mahwah, NJ.
2. Sebastian Bader, Gernot Ruscher, and Thomas Kirste. 2010. A middleware for rapid prototyping smart environments. In Proceedings of the 12th ACM International Conference Adjunct Papers on Ubiquitous Computing. ACM, New York, NY, 355-356. DOI:http://dx.doi.org/10.1145/1864431.1864433
3. Chris L. Baker, Rebecca Saxe, and Joshua B. Tenenbaum. 2009. Action understanding as inverse planning. Cognition 113, 3, 329-349.
4. Osman Balci. 2012. A life cycle for modeling and simulation. Simulation: Transactions of the Society for Modeling and Simulation International 88, 4, 1-14.
5. Jerry Banks, John S. Carlson II, Barry L. Nelson, and David M. Nicol. 2010. Discrete-Event-System Simulation. Pearson, Upper Saddle River, NJ.
6. Barry W. Boehm. 1988. A spiral model of software development and enhancement. Computer 21, 5, 61-72. DOI:http://dx.doi.org/10.1109/2.59
7. L. Chen, J. Hoey, C. D. Nugent, D. J. Cook, and Z. Yu. 2012. Sensor-based activity recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 42, 6, 790-808. DOI:http://dx. doi.org/10.1109/TSMCC.2012.2198883
8. L. Chen, C. Nugent, and G. Okeyo. 2014. An ontology-based hybrid approach to activity modeling for smart homes. IEEE Transactions on Human-Machine Systems 44, 1, 92-105. DOI:http://dx.doi.org/10.1109/THMS.2013.2293714
9. Jongmyung Choi, RosaI. Arriaga, Hyun-Joo Moon, and Eun-Ser Lee. 2011. A context-driven development methodology for context-aware systems. In Convergence and Hybrid Information Technology. Lecture Notes in Computer Science, Vol. 6935. Springer, 429-436. DOI:http://dx.doi.org/10.1007/978-3-642-24082-9-53
10. Paul R. Cohen. 1995. Empirical Methods for Artificial Intelligence. MIT Press, Cambridge, MA.
11. Mark Donnelly, Tommaso Magherini, Chris Nugent, Federico Cruciani, and Cristiano Paggetti. 2011. Annotating sensor data to identify activities of daily living. In Toward Useful Services for Elderly and People with Disabilities. Lecture Notes in Computer Science, Vol. 6719. Springer, 41-48. DOI:http://dx.doi. org/10.1007/978-3-642-21535-3-6
12. Richard O. Duda, Peter E. Hart, and David G. Stork. 2001. Pattern Classification. Wiley & Sons, New York, NY.
13. Tore Dyba. 2000. An instrument for measuring the key factors of success in software process improvement. Empirical Software Engineering 5, 4, 357-390. DOI:http://dx.doi.org/10.1023/A:1009800404137
14. Gerhard Fischer. 2012. Context-aware systems: The 'right' information, at the 'right' time, in the 'right' place, in the 'right' way, to the 'right' person. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI'12). ACM, New York, NY, 287-294. DOI:http://dx.doi.org/10. 1145/2254556.2254611
15. Frederic Fondement and Raul Silaghi. 2004. Defining model driven engineering processes. In Proceedings of the 3rd Workshop in Software Model Engineering Satellite Workshop at the 7th International Conference on the UML.
16. Mariano Frenandez-Lopez, Asuncion Gomez-Perez, and Natalia Juristo. 1997. METHONTOLOGY: From ontological art towards ontological engineering. In Proceedings of the Spring Symposium on Ontological Engineering of AAAI. 33-40.
17. Milton Friedman. 1937. The use of ranks to avoid the assumption of normality implicit in the analysis of variance. Journal of the American Statistical Association 32, 200, 675-701.
18. Asuncion Gomez-Perez, Mariano Frenandez-Lopez, and Oscar Corcho. 2004. Ontological Engineering. Springer-Verlag, London. UK.
19. Avelino J. Gonzalez and Douglas D. Dankel. 1993. The Engineering Book of Knowledge-Based Systems: Theory and Practice. Prentice Hall, Hemel Hempstead, UK.
20. Bastian Hartmann. 2011. Human Worker Activity Recognition in Industrial Environments. Ph.D. Dissertation. Karlsruher Institut für Technologie, Karlsruhe, Germany.
21. Laura M. Hiatt, Anthony M. Harrison, and J. Gregory Trafton. 2011. Accommodating human variability in human-robot teams through theory of mind. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI'11). 2066-2071. DOI:http://dx.doi.org/10.5591/978-1-57735-516-8/IJCAI11-345
22. Jesse Hoey, Thomas Plötz, Dan Jackson, Andrew Monk, Cuong Pham, and Patrick Olivier. 2011. Rapid specification and automated generation of prompting systems to assist people with dementia. Journal of Pervasive Mobile Computing 7, 3, 299-318. DOI:http://dx.doi.org/10.1016/j.pmcj.2010.11.007
23. Jesse Hoey, Pascal Poupart, Axel von Bertoldi, Tammy Craig, Craig Boutilier, and Alex Mihailidis. 2010. Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process. Computer Vision and Image Understanding 114, 5, 503-519. DOI:http://dx.doi.org/10.1016/j.cviu.2009.06.008
24. Watts S. Humphrey. 1989. Managing the Software Process. Addison Wesley Longman, Boston, MA.
25. Watts S. Humphrey. 2000. The Personal Software Process (PSP). Technical Report CMU/SEI-2000-TR-022. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.
26. Jadwiga Indulska and Karen Henricksen. 2008. Context awareness. In The Engineering Handbook of Smart Technology for Aging, Disability, and Independence, A. Helal, M. Mokhtari, and B. Abdulrazak (Eds.). John Wiley & Sons, Hoboken, NJ, 585-606 http://dx.doi.org/10.1002/9780470379424.ch31
27. Jaykaran. 2010. How to select appropriate statistical test? Journal of Pharmaceutical Negative Results 1, 2, 61-63. DOI:http://dx.doi.org/10.4103/0976-9234.75708
28. David A. Kenny. 1987. Statistics for the Social and Behavioral Sciences. Little, Brown, Boston, MA.
29. Thomas Kirste and FrankKrüger. 2012.CCBM-ATool for Activity RecognitionUsing Computational Causal Behavior Models. Technical Report CS-01-12. Institut für Informatik, Universität Rostock, Rostock, Germany.
30. Frank Krüger, Alexander Steiniger, Sebastian Bader, and Thomas Kirste. 2012a. Evaluating the robustness of activity recognition using computational causal behavior models. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12). ACM, New York, NY, 1066-1074. DOI:http://dx.doi.org/10.1145/2370216.2370443
31. Frank Krüger, Kristina Yordanova, Albert Hein, and Thomas Kirste. 2013. Plan synthesis for probabilistic activity recognition. In Proceedings of the 5th International Conference on Agents and Artificial Intelligence (ICAART'13). 283-288.
32. Frank Krüger, Kristina Yordanova, Veit Köppen, and Thomas Kirste. 2012b. Towards tool support for computational causal behavior models for activity recognition. In Proceedings of the 1stWorkshop on Situation-Aware Assistant Systems Engineering: Requirements, Methods, and Challenges (SeASE'12). 561-572.
33. Frank Krüger, Martin Nyolt, Kristina Yordanova, Albert Hein, and Thomas Kirste. 2014. Computational state space models for activity and intention recognition. A feasibility study. PLoS ONE 9, 11, e109381. DOI:http://dx.doi.org/10.1371/journal.pone.0109381
34. Frank Krüger, Kristina Yordanova, Christoph Burghardt, and Thomas Kirste. 2012c. Towards creating assistive software by employing human behavior models. Journal of Ambient Intelligence and Smart Environments 4, 3, 209-226. DOI:http://dx.doi.org/10.3233/AIS-2012-0148
35. Rensis Likert. 1932. A technique for the measurement of attitudes. Archives of Psychology 22, 140, 5-55.
36. Kent Lyons, Helene Brashear, Tracy Westeyn, JungSoo Kim, and Thad Starner. 2007. GART: The gesture and activity recognition toolkit. In Human-Computer Interaction: HCI Intelligent Multimodal Interaction Environments. Lecture Notes in Computer Science, Vol. 4552. Springer, 718-727. DOI:http://dx. doi.org/10.1007/978-3-540-73110-8-78
37. Paul Maier, Dominik Jain, andMartin Sachenbacher. 2011. Compiling AI engineeringmodels for probabilistic inference. In KI 2011: Advances in Artificial Intelligence. Lecture Notes in Computer Science, Vol. 7006. Springer, 191-203. DOI:http://dx.doi.org/10.1007/978-3-642-24455-1-18
38. Deborah J. Mayhew. 1999. The Usability Engineering Lifecycle: A Practitioner's Handbook for User Interface Design. Morgan Kaufmann, San Francisco, CA.
39. Nolberto Munier. 2011. A Strategy for Using Multicriteria Analysis in Decision-Making. Springer, Netherlands.
40. Jakob Nielsen and Thomas K. Landauer. 1993. A mathematical model of the finding of usability problems. In Proceedings of the International Conference on Human-Computer Interaction'93 and the Conference on Human Aspects in Computing Systems'93. ACM, New York, NY, 206-213.
41. Robert Nisbet, John Elder, and Gary Miner. 2009. Handbook of Statistical Analysis and Data Mining Applications. Elsevier, Toronto, Canada.
42. Martin Nyolt, Frank Krüger, Kristina Yordanova, Albert Hein, and Thomas Kirste. 2015. Marginal filtering in large state spaces. International Journal of Approximate Reasoning 61, 16-32. DOI:http://dx.doi. org/10.1016/j.ijar.2015.04.003
43. Yoosoo Oh, A. Schmidt, and Woontack Woo. 2007. Designing, developing, and evaluating context-aware systems. In Proceedings of the International Conference on Multimedia and Ubiquitous Engineering, (MUE'07). IEEE, Los Alamitos, CA, 1158-1163. DOI:http://dx.doi.org/10.1109/MUE.2007.118
44. George Okeyo, Liming Chen, Hui Wang, and Roy Sterritt. 2011. Ontology-based learning framework for activity assistance in an adaptive smart home. In Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, Vol. 4. Atlantis Press, Amsterdam, Netherlands, 237-263. DOI:http://dx.doi.org/10.2991/978-94-91216-05-3-11
45. Ant Ozok. 2012. Survey Design and Implementation in HCI. CRC Press, New York, NY, 1259-1278.
46. David Lorge Parnas and Paul C. Clements. 1986. A rational design process: How and why to fake it. IEEE Transactions on Software Engineering 12, 2, 251-257. http://dl.acm.org/citation.cfm?id=9794.9800
47. Fabio Paterno, CristianoMancini, and Silvia Meniconi. 1997. ConcurTaskTrees: A diagrammatic notation for specifying taskmodels. In Human-Computer Interaction: International Conference on Human-Computer Interaction'97, S. Howard, J. Hammond, and G. Lindgaard (Eds.). Springer, London, UK, 362-369. DOI:http://dx.doi.org/10.1007/978-0-387-35175-9-58
48. Donald J. Patterson, Lin Liao, Dieter Fox, and Henry Kautz. 2003. Inferring high-level behavior from lowlevel sensors. In UbiComp 2003: Ubiquitous Computing. Lecture Notes in Computer Science, Vol. 2864. Springer, 73-89. DOI:http://dx.doi.org/10.1007/978-3-540-39653-6-6
49. DavidM.W. Powers. 2011. Evaluation: From precision, recall, and F-measure to ROC, informedness,markedness, and correlation. Journal of Machine Learning Technologies 2, 1, 37-63.
50. Miquel Ramírez and Hector Geffner. 2010. Probabilistic plan recognition using off-the-shelf classical planners. In Proceedings of the 24th National Conference of Artificial Intelligence (AAAI'10). 1211-1217.
51. Miquel Ramírez and Hector Geffner. 2011. Goal recognition over POMDPs: Inferring the intention of a POMDP agent. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI'11), Vol. 3. 2009-2014. DOI:http://dx.doi.org/10.5591/978-1-57735-516-8/IJCAI11-335
52. Silvia Richter. 2011. Landmark-Based Heuristics and Search Control for Automated Planning. Ph.D. Dissertation. Institute of Intelligent and Integrated Systems, Griffith University, Brisbane, Australia.
53. Silvia Richter and Matthias Westphal. 2010. The LAMA planner: Guiding cost-based anytime planning with landmarks. Journal of Artificial Intelligence Research 39, 1, 127-177. http://dl.acm.org/citation.cfm?id=1946417.1946420.
54. Patrice C. Roy, Sylvain Giroux, Bruno Bouchard, Abdenour Bouzouane, Clifton Phua, Andrei Tolstikov, and Jit Biswas. 2011. A possibilistic approach for activity recognition in smart homes for cognitive assistance to Alzheimer's patients. In Activity Recognition in Pervasive Intelligent Environments. Atlantis Ambient and Pervasive Intelligence, Vol. 4. Atlantis Press, Amsterdam, 33-58. http://dx.doi.org/10.2991/978-94-91216-05-3\-2.
55. Walker W. Royce. 1987. Managing the development of large software systems: Concepts and techniques. In Proceedings of the 9th International Conference on Software Engineering (ICSE'87). IEEE, Los Alamitos, CA, 328-338. http://dl.acm.org/citation.cfm?id=41765.41801.
56. Ioana Rus, Holger Neu, and Jürgen Münch. 2003. A systematic methodology for developing discrete event simulation models of software development processes. In Proceedings of the 4th International Workshop on Software Process Simulation Modeling (ProSim) at the International Conference on Software Engineering.
57. Colin Shearer. 2000. The CRISP-DM model: The new blueprint for data mining. Journal of DataWarehousing 5, 4, 13-22.
58. Ian Sommerville. 1996. Software Engineering. Addison-Wesley, Boston, MA.
59. Steffen Staab, Rudi Studer, Hans-Peter Schnurr, and York Sure. 2001. Knowledge processes and ontologies. IEEE Intelligent Systems 16, 1, 26-34. DOI:http://dx.doi.org/10.1109/5254.912382
60. H. Storf, M. Becker, and M. Riedl. 2009. Rule-based activity recognition framework: Challenges, technique and learning. In Proceedings of the 3rd International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth'09). 1-7. DOI:http://dx.doi.org/10.4108/ICST. PERVASIVEHEALTH2009.6108
61. Fernando de la Torre, Jessica Hodgins, Javier Montano, and Sergio Valcarcel. 2009. Guide to the Carnegie Mellon University Multimodal Activity (CMU-MMAC) Database. Technical Report CMU-RI-TR-08-22. Robotics Institute, Carnegie Mellon University, Pittsburgh, PA.
62. Dorra Trabelsi, Sabah Mohammed, Faicel Chamroukhi, Latifa Oukhellou, and Yacine Amirat. 2013. An unsupervised approach for automatic activity recognition based on hidden Markov model regression. IEEE Transactions on Automation Science and Engineering 10, 3, 829-835.
63. J. Grogory Trafton, Laura M. Hiatt, Anthony M. Harrison, Franklin P. Tamborello, Sangeet S. Khemlani, and Alan C. Schultz. 2013. ACT-R/E: An embodied cognitive architecture for human-robot interaction. Journal of Human-Robot Interaction 2, 1, 30-55.
64. Michael Unterkalmsteiner, Tony Gorschek, A. K. M. Moinul Islam, Chow Kian Cheng, Rahadian B. Permadi, and Robert Feldt. 2012. Evaluation and measurement of software process improvement-a systematic literature review. IEEE Transactions on Software Engineering 38, 2, 398-424. DOI:http://dx. doi.org/10.1109/TSE.2011.26
65. Mike Uschold and Martin King. 1995. Towards a methodology for building ontologies. In Proceedings of the Workshop on Basic Ontological Issues in Knowledge Sharing in Conjunction with the International Joint Conference in Artificial Intelligence (IJCAI-95). University of Edinburgh, Montreal, Canada, 6.1-6.10.
66. Douglas L.Vail, Manuela M. Veloso, and JohnD. Lafferty. 2007. Conditional random fields for activity recognition. In Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS'07). ACM, New York, NY, Article No. 235. DOI:http://dx.doi.org/10.1145/1329125.1329409
67. T. L. M. van Kasteren and B. J. A. Kröse. 2009. A sensing and annotation system for recording datasets in multiple homes. In Proceedings of the 27th Annual Conference on Human Factors and Computing Systems. ACM, New York, NY, 4763-4766.
68. Tim L. M. van Kasteren, Athanasios Noulas, Gwenn Englebienne, and Ben Kröse. 2008. Accurate activity recognition in a home setting. In Proceedings of the 10th International Conference on Ubiquitous Computing. ACM, New York, NY, 1-9. DOI:http://dx.doi.org/10.1145/1409635.1409637
69. Jean Vanderdonckt. 2008. Model-driven engineering of user interfaces: Promises, successes, failures, and challenges. In Proceedings of the Annual Romanian Conference on Human-Computer Interaction, Vol. 8. 1-10.
70. Jamie A. Ward, Paul Lukowicz, and Hans W. Gellersen. 2011. Performance metrics for activity recognition. ACM Transactions on Intelligent Systems and Technology 2, 1, Article No. 6. DOI:http://dx.doi. org/10.1145/1889681.1889687
71. Juan Ye, Graeme Stevenson, and Simon Dobson. 2014. USMART: An unsupervised semantic mining activity recognition technique. ACM Transactions on Interactive Intelligent Systems 4, 4, Article No. 16. DOI:http://dx.doi.org/10.1145/2662870
72. Kristina Yordanova. 2011a. Human behaviour modelling approach for intention recognition in ambient assisted living. In Ambient Intelligence-Software and Applications. Advances in Intelligent and Soft Computing, Vol. 92. Springer, 247-251. DOI:http://dx.doi.org/10.1007/978-3-642-19937-0-32
73. Kristina Yordanova. 2011b.Modelling human behaviour using partial order planning based on atomic action templates. In Proceedings of the 7th International Conference on Intelligent Environments. IEEE, Los Alamitos, CA, 338-341. DOI:http://dx.doi.org/10.1109/IE.2011.27
74. Kristina Yordanova. 2014. Methods for Engineering Symbolic Human Behaviour Models for Activity Recognition. Ph.D. Dissertation. Institute of Computer Science, Rostock, Germany.
75. Kristina Yordanova, Frank Krüger, and Thomas Kirste. 2012a. Strategies for modelling human behaviour for activity recognition with precondition-effect rules. In KI 2012: Advances in Artificial Intelligence. Lecture Notes in Computer Science, Vol. 7526. Springer, 257-261. DOI:http://dx.doi.org/10.1007/978-3-642-33347-7-27
76. Kristina Yordanova, Frank Krüger, and Thomas Kirste. 2012b. Context aware approach for activity recognition based on precondition-effect rules. In Proceedings of the 2012 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops'12). IEEE, Los Alamitos, CA, 602-607. DOI:http://dx.doi.org/10.1109/PerComW.2012.6197586
77. Kristina Yordanova, Martin Nyolt, and Thomas Kirste. 2014. Strategies for reducing the complexity of symbolic models for activity recognition. In Artificial Intelligence: Methodology, Systems, and Applications. Lecture Notes in Computer Science, Vol. 8722. Springer, 295-300. DOI:http://dx.doi. org/10.1007/978-3-319-10554-3-31