Using temporal logic and model checking in automated recognition of human activities for ambient-assisted living

IEEE Transactions on Human-Machine Systems

Volumn 43, Issue 6, 2013, Pages 509-521

  Magherini, Tommaso ^a   Fantechi, Alessandro ^a   Nugent, Chris D ^b   Vicario, Enrico ^a  

^a UNIVERSITY OF FLORENCE   (Italy)

^b UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Activities of Daily Living (ADL); Activity recognition; Ambient Assisted Living (AAL); Model checking; Real time processing; Temporal logic

Indexed keywords

ACTIVITIES OF DAILY LIVING; ACTIVITIES OF DAILY LIVING (ADLS); ACTIVITY RECOGNITION; AMBIENT ASSISTED LIVING (AAL); AUTOMATED RECOGNITION; ON-LINE MODEL CHECKING; REALTIME PROCESSING; SENSORIZED ENVIRONMENT;

AUTOMATION; SENSORS; TEMPORAL LOGIC;

MODEL CHECKING;

EID: 84893115844     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMC.2013.2283661     Document Type: Article

References (46)

1. N. Abid, S. D. Zilio, and D. L. Botlan, "Real-time specification patterns and tools," in Formal Methods for Industrial Critical Systems. New York, NY, USA: Springer, 2012, pp. 1-15.
2. J. K. Aggarwal and M. S. Ryoo, "Human activity analysis: A review," ACM Comput. Surv., vol. 43, no. 3, pp. 16:1-16:43, Apr. 2011.
3. R. Alur and T. A. Henzinger, "Logics and models of real time: A survey," in Proc. Real-Time: Theory in Practice, REXWorkshop, 1992, pp. 74-106.
4. A. Aziz, K. Sanwal, V. Singhal, and R. Brayton, "Verifying continuous time Markov chains," in Computer Aided Verification. New York, NY, USA: Springer, 1996, pp. 269-276.
5. C. Bernardeschi, A. Fantechi, S. Gnesi, S. Larosa, G. Mongardi, and D. Romano, "A formal verification environment for railway signaling system design," Formal Methods Syst. Des., vol. 12, pp. 139-161, 1998.
6. N. Bevan and M. Azuma, "Quality in use: Incorporating human factors into the software engineering lifecycle," presented at the 3rd Int. Software Engineering Standards Symp., Washington, DC, USA, 1997.
7. J. Boger, P. Poupart, J.Hoey, C. Boutilier,G. Fernie, andA.Mihailidis, "A decision-Theoretic approach to task assistance for persons with dementia," in Proc. Int. Joint Conf. Artif. Intell., 2005, pp. 1293-1299.
8. L. Chen, C. D. Nugent,M.Mulvenna, D. Finlay, X. Hong, andM. Poland, "Using event calculus for behavior reasoning and assistance in a smart home," in Proc. 6th Int. Conf. Smart Homes Health Telematics, 2008, pp. 81-89.
9. A. Cimatti, M. Roveri, and D. Sheridan, "Bounded verification of past ltl," in Proc. Int. Conf. Formal Methods Comput-Aided Design, 2004, pp. 245-259.
10. E. M. Clarke, E. A. Emerson, and A. P. Sistla, "Automatic verification of finite-state concurrent systems using temporal logic specifications," ACM Trans. Program. Languages Syst., vol. 8, pp. 244-263, 1986.
11. J. Coutaz, J. L. Crowley, S. Dobson, and D. Garlan, "Context is key," Commun. ACM, vol. 48, pp. 49-53, Mar. 2005.
12. F. Cruciani, M. P. Donnelly, C. D. Nugent, G. Parente, and C. Paggetti, "Dante: A video based annotation tool for smart environments," in presented at the Int. Conf. Software Testing, Conf. Sensor Systems and Software, Miami, FL, USA, 2010.
13. S. K. Das, D. J. Cook, A. Battacharya, III E. O. Heierman, and T.-Y. Lin, "The role of prediction algorithms in the mavhome smart home architecture," IEEE Wireless Commun., vol. 9, no. 6, pp. 77-84, Dec. 2002.
14. L. De Alfaro,M. Faella, T. A. Henzinger, R. Majumdar, and M. Stoelinga, "Model checking discounted temporal properties," Theoretical Comput. Sci., vol. 345, no. 1, pp. 139-170, 2005.
15. M. P. Donnelly, T. Magherini, C. D. Nugent, F. Cruciani, and C. Paggetti, "Annotating sensor data to detect activities of daily living," in Proc. 9th Int. Conf. Smart Homes Health Telematics, 2011, pp. 41-48.
16. T. V. Duong, H. H. Bui, D. Q. Phung, and S. Venkatesh, "Activity recognition and abnormality detection with the switching hidden semimarkov model," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recog., Jun. 2005, vol. 1, pp. 838-845.
17. M. B. Dwyer, G. S. Avrunin, and J. C. Corbett, "Patterns in property specifications for finite-state verification," in Proc. Int. Conf. Softw. Eng., 1999, pp. 411-420.
18. H. Hansson and B. Jonsson, "A logic for reasoning about time and reliability," Formal Aspects Comput., vol. 6, no. 5, pp. 512-535, 1994.
19. X. Hong, C. D. Nugent, M. Mulvenna, S. McClean, B. Scotney, and S. Devlin, "Evidential fusion of sensor data for activity recognition in smart homes," Pervasive Mob. Comput., vol. 5, pp. 236-252, Jun. 2009.
20. Y. A. Ivanov and A. F. Bobick, "Recognition of visual activities and interactions by stochastic parsing," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 852-872, Aug. 2000.
21. D. N. Jansen, "More or less true DCTL for continuous-time MDPS," in Formal Modeling and Analysis of Timed Systems. New York, NY, USA: Springer, 2013, pp. 137-151.
22. R. Jhala and R. Majumdar, "Software model checking," ACM Comput. Surveys, vol. 41, no. 4, pp. 1-21, Article 21, 2009.
23. E. M. Clarke Jr., O. Grumberg, and D. A. Peled, Model Checking. Cambridge, MA, USA: MIT Press, 1999.
24. S. Katz, T. D. Downs, H. R. Cash, and R. C. Grotz, "Progress in development of the index of ADL," The Gerontologist, vol. 10, no. 1 Part 1, pp. 20-30, 1970.
25. D. H. Kraft, G. Pasi, and G. Bordogna, "Vagueness and uncertainty in information retrieval: Howcan fuzzy sets help?" in Proc. 2006 Int.Workshop Res. Issues Digital Libraries, New York, NY, USA, 2007, pp. 3:1-3:10.
26. K. J. Kristoffersen, C. Pedersen, and H. R. Andersen, "Runtime verification of timed ltl using disjunctive normalized equation systems," Electron. Notes Theoretical Comput. Sci., vol. 89, no. 2, pp. 210-225, 2003.
27. V. G. Kulkarni, Modeling and Analysis of Stochastic Systems. London, U.K.: Chapman & Hall, 1995.
28. T. Magherini, G. Parente, C. D. Nugent, M. P. Donnelly, E. Vicario, F. Cruciani, and C. Paggetti, "Temporal logic bounded model-checking for recognition of activities of daily living," in Proc. 10th IEEE Int. Conf. Inform. Technol. Appl. Biomed., 2010, pp. 1-4.
29. S. Mckeever, J. Ye, L. Coyle, C. Bleakley, and S. Dobson, "Activity recognition using temporal evidence theory," J. Ambient Intell. Smart Environ., vol. 2, pp. 253-269, Aug. 2010.
30. A. Mihailidis, B. Carmichael, and J. Boger, "The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home," IEEE Trans. Inform. Technol. Biomed., vol. 8, no. 3, pp. 238-247, Sep. 2004.
31. S. P. Miller, M. W. Whalen, and D. D. Cofer, "Software model checking takes off," Commun. ACM, vol. 53, no. 2, pp. 58-64, Feb. 2010.
32. C. D. Nugent, M. D. Mulvenna, X. Hong, and S. Devlin, "Experiences in the development of a smart lab," Int. J. Biomed. Eng. Technol., vol. 2, pp. 319-331, 2009.
33. S. A. ONeill, S. Mason, G. Parente, M. P. Donnelly, C. D. Nugent, S. McClean, B. Scotney, and D. Craig, "Video reminders as cognitive prosthetics for people with dementia," Ageing Int., vol. 36, no. 2, pp. 267- 282, 2011.
34. M. Philipose, K. P. Fishkin, M. Perkowitz, D. J. Patterson, D. Fox, H. Kautz, and D. Hahnel, "Inferring activities from interactions with objects," IEEE Pervasive Comput., vol. 3, no. 4, pp. 50-57, Oct.-Dec. 2004.
35. A. Rugnone, E. Vicario, C. D. Nugent, M. P. Donnelly, D. Craig, C. Paggetti, and E. Tamburini, "Hometl: A visual formalism, based on temporal logic, for the design of home based care," in Proc. IEEE Int. Conf. Autom. Sci. Eng., Sep. 2007, pp. 747-752.
36. M. S. Ryoo and J. K. Aggarwal, "Recognition of composite human activities through context-free grammar based representation," in Proc. IEEE Comp. Soc. Conf. Comput. Vis. Pattern Recog., 2006, vol. 2, pp. 1709- 1718.
37. M. S. Ryoo and J. K. Aggarwal, "Semantic representation and recognition of continued and recursive human activities," Int. J. Comput. Vis., vol. 82, no. 1, pp. 1-24, 2009.
38. A. Serna, H. Pigot, andV. Rialle, "Modeling the progression of alzheimer's disease for cognitive assistance in smart homes," User Modeling User- Adapted Interaction, vol. 17, pp. 415-438, Sep. 2007.
39. P. Smets, "Imperfect information: Imprecision, and uncertainty," Uncertainty Manage. Inform. Syst., pp. 225-254, 1996.
40. P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea, "Machine recognition of human activities: A survey," IEEE Trans. Circuits Syst. Video Technol., vol. 18, no. 11, pp. 1473-1488, Sep. 2008.
41. D. L. Vail, M. M. Veloso, and J. D. Lafferty, "Conditional random fields for activity recognition," in Proc. 6th Int. Joint Conf. Auton. Agents Multiagent Syst., New York, NY, USA, 2007, pp. 235:1-235:8.
42. T. van Kasteren, A. Noulas, G. Englebienne, and B. Krose, "Accurate activity recognition in a home setting," in Proc. 10th Int. Conf. Ubiquitous Comput., 2008, pp. 1-9.
43. C.-L.Wu and L.-C. Fu, "Design and realization of a framework for humansystem interaction in smart homes," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 42, no. 1, pp. 15-31, Jan. 2012.
44. S. S. Yau, F. Karim, Y. Wang, and B. Wang, "Reconfigurable contextsensitive middleware for pervasive computing," IEEE Pervasive Comput., vol. 1, no. 3, pp. 33-40, Jul.-Sep. 2002.
45. J. Ye, S. Dobson, and S.McKeever, "Situation identification techniques in pervasive computing: A review," Pervasive Mobile Comput., vol. 8, no. 1, pp. 36-66, 2012.
46. X. Zhang, X. Chen, Y. Li, V. Lantz, K. Wang, and J. Yang, "A framework for hand gesture recognition based on accelerometer and emg sensors," IEEE Trans. Syst., Man, Cybern., A, Syst., Humans, vol. 41, no. 6, pp. 1064-1076, Nov. 2011.