Bridging vision and commonsense for multimodal situation recognition in pervasive systems

2012 IEEE International Conference on Pervasive Computing and Communications, PerCom 2012

Volumn , Issue , 2012, Pages 48-56

  Bicocchi, Nicola ^a   Lasagni, Matteo ^b   Zambonelli, Franco ^a  

^a UNIVERSITY OF MODENA AND REGGIO EMILIA   (Italy)

^b UNIVERSITY OF LÜBECK   (Germany)

Author keywords

activity recognition; commonsense knowledge; image analysis; mobility; pervasive computing; situation recognition

Indexed keywords

ACTIVITY RECOGNITION; CLASSIFICATION ACCURACY; CLASSIFICATION RESULTS; COMMONSENSE KNOWLEDGE; COMMONSENSE KNOWLEDGE BASE; INDIVIDUAL OBJECTS; MULTI-MODAL; MULTIMODAL CLASSIFIERS; NON-PARAMETRIC ALGORITHM; PERVASIVE SERVICE; PERVASIVE SYSTEMS; SITUATION RECOGNITION; VISION SENSORS;

CARRIER MOBILITY; IMAGE ANALYSIS; KNOWLEDGE BASED SYSTEMS; SENSORS;

UBIQUITOUS COMPUTING;

EID: 84861588136     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PerCom.2012.6199848     Document Type: Conference Paper

References (31)

1. N. Bicocchi, G. Castelli, M. Mamei, and F. Zambonelli. Improving situation recognition via commonsense sensor fusion. In Proceedings of the 1st DEXA Workshop on Information Systems for Situation Awareness and Situation Management, Toulouse (F), SEP 2011. IEEE CS Press.
2. N. Bicocchi, M. Mamei, A. Prati, R. Cucchiara, and F. Zambonelli. Pervasive self-learning with multi-modal distributed sensors. In Proceedings of the 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops, pages 61-66, Washington, DC, USA, 2008. IEEE CS Press.
3. N. Bicocchi, M. Mamei, and F. Zambonelli. Detecting activities from body-worn accelerometers via instancebased algorithms. Pervasive and Mobile Computing, 6(4):482-495, 2010.
4. C. A. Boano, M. Lasagni, K. Römer, and T. Lange. Accurate Temperature Measurements for Medical Research using Body Sensor Networks. In Proceedings of the 2nd International Workshop on Self-Organizing Real-Time Systems (SORT), pages 189-198, Newport Beach, CA, USA, Mar. 2011. IEEE CS Press.
5. J. Bravo, R. Hervás, G. Chavira, and S. W. Nava. Modeling contexts by rfid-sensor fusion. In IEEE International Conference on Pervasive Computing and Communications Workshops, pages 30-34, Los Alamitos, CA, USA, 2006. IEEE CS Press.
6. G. Castelli, A. Rosi, M. Mamei, and F. Zambonelli. A simple model and infrastructure for context-aware browsing of the world. In IEEE International Conference on Pervasive Computing and Communications, pages 229-238, Los Alamitos, CA, USA, 2007. IEEE CS Press.
7. A. Dey, J. Mankoff, G. Abowd, and S. Carter. Distributed mediation of ambiguous context in aware environments. In Proceedings of the 15th annual ACM symposium on User interface software and technology, UIST '02, pages 121-130, New York, NY, USA, 2002. ACM.
8. A. K. Dey, G. D. Abowd, and D. Salber. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16:97-166, December 2001.
9. L. Ferrari and M. Mamei. Discovering daily routines from google latitude with topic models. In Proceedings of 11th IEEE International Conference on Pervasive Computing and Communications Workshops, pages 397-402. IEEE CS Press, 2011.
10. C. Galleguillos and S. J. Belongie. Context based object categorization: A critical survey. Computer Vision and Image Understanding, 114(6):712-722, 2010.
11. R. K. Ganti, S. Srinivasan, and A. Gacic. Multisensor fusion in smartphones for lifestyle monitoring. In Proceedings of the International Conference on Body Sensor Networks, pages 36-43. IEEE CS Press, 2010.
12. J. I. Hong and J. A. Landay. An infrastructure approach to context-aware computing. Human-Computer Interaction, 16:287-303, December 2001.
13. K. S. Hwang and S. B. Cho. Life log management based on machine learning technique. In Proocedings of International Conference on Multisensor Fusion and Integration for Intelligent Systems, pages 691-696. IEEE CS Press, 2008.
14. E. Kim, S. Helal, and D. Cook. Human activity recognition and pattern discovery. Pervasive Computing, IEEE, 9(1):48-53, January 2010.
15. L.-J. Li, R. Socher, and L. Fei-Fei. Towards total scene understanding:classification, annotation and segmentation in an automatic framework. In IEEE Computer Vision and Pattern Recognition (CVPR), 2009.
16. M. Mamei. Applying commonsense reasoning to place identification. IJHCR, 1(2):36-53, 2010.
17. A. Oliva. Diagnostic colors mediate scene recognition. Cognitive Psychology, 41:176-210, 2000.
18. J. Park and H. Y. Song. Multilevel localization for mobile sensor network platforms. In Computer Science and Information Technology, 2008. IMCSIT 2008. International Multiconference on, pages 711-718, October 2008.
19. A. Pentland, T. Choudhury, N. Eagle, and P. Singh. Human dynamics: computation for organizations. Pattern Recognition Letters, 26:503-511, 2005.
20. M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. IEEE Pervasive Computing, 3(4):50-57, 2004.
21. M. Pijl, S. van de Par, and C. Shan. An event-based approach to multi-modal activity modeling and recognition. In Pervasive Computing and Communications (PerCom), 2010 IEEE International Conference on, pages 98-106, April 2010.
22. A. Quattoni and A. Torralba. Recognizing indoor scenes. In IEEE Computer Vision and Pattern Recognition (CVPR), pages 413-420, 2009.
23. C. Rother, V. Kolmogorov, and A. Blake. "proceedings": interactive foreground extraction using iterated graph cuts. ACM Trans. Graph., 23:309-314, August 2004.
24. N. Roy, T. Gu, and S. K. Das. Supporting pervasive computing applications with active context fusion and semantic context delivery. Pervasive and Mobile Computing, 6(1):21-42, 2010.
25. M. Stikic, T. Huynh, K. Van Laerhoven, and B. Schiele. Adl recognition based on the combination of rfid and accelerometer sensing. In 2nd International Conference on Pervasive Computing Technologies for Healthcare, pages 258-263, 2008.
26. A. Torralba, R. Fergus, and W. T. Freeman. 80 million tiny images: A large data set for nonparametric object and scene recognition. IEEE Transactions on Pattern Analysis Machine Intelligence, 30:1958-1970, November 2008.
27. D. T. Tran and D. Q. Phung. A probabilistic model with parsinomious representation for sensor fusion in recognizing activity in pervasive environment. In Proceedings of the 18th International Conference on Pattern Recognition-Volume 03, ICPR '06, pages 168-172, Washington, DC, USA, 2006. IEEE CS Press.
28. S. Wang, W. Pentney, A.-M. Popescu, T. Choudhury, and M. Philipose. Common sense based joint training of human activity recognizers. In Proceedings of the 20th international joint conference on Artifical intelligence, pages 2237-2242, San Francisco, CA, USA, 2007. Morgan Kaufmann Publishers Inc.
29. Y. Weiss, A. B. Torralba, and R. Fergus. Spectral hashing. In D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, editors, NIPS, pages 1753-1760. MIT Press, 2008.
30. Widyawan, G. Pirkl, D. Munaretto, C., Fischer, C. An P. Lukowicz, M. Klepal, A. Timm-Giel, J. Widmer, D. Pesch, and H. Gellersen. Virtual lifeline: Multimodal sensor data fusion for robust navigation in unknown environments. Pervasive and Mobile Computing, 2011.
31. C. Zhu and W. Sheng. Recognizing human daily activity using a single inertial sensor. In Intelligent Control and Automation (WCICA), 2010 8th World Congress on, pages 282-287, July 2010.