NuActiv: Recognizing unseen new activities using semantic attribute-based learning

MobiSys 2013 - Proceedings of the 11th Annual International Conference on Mobile Systems, Applications, and Services

Volumn , Issue , 2013, Pages 361-374

  Cheng, Heng Tze ^a   Sun, Feng Tso ^a   Griss, Martin ^a   Davis, Paul ^b   Li, Jianguo ^b   You, Di ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b MOTOROLA INC   (United States)

Author keywords

Active learning; Activity recognition; Context aware computing; Machine learning; Mobile sensing; Semantic attributes; Wearable computing; Zero shot learning

Indexed keywords

ACTIVE LEARNING; ACTIVITY RECOGNITION; CONTEXT-AWARE COMPUTING; MOBILE SENSING; SEMANTIC ATTRIBUTE; WEARABLE COMPUTING; ZERO-SHOT LEARNING;

LEARNING SYSTEMS; PATTERN RECOGNITION; SEMANTICS; WEARABLE COMPUTERS;

LEARNING ALGORITHMS;

EID: 84881189893     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2462456.2464438     Document Type: Conference Paper

References (41)

1. M. Azizyan, I. Constandache, and R. Roy Choudhury. SurroundSense: Mobile phone localization via ambience fingerprinting. In Proc. Int'l Conf. Mobile Computing and Networking, pages 261-272, 2009.
2. L. Bao and S. S. Intille. Activity recognition from user-annotated acceleration data. In Proceedings of The International Conference on Pervasive Computing, pages 1-17. Springer, 2004.
3. E. Berlin and K. Van Laerhoven. Detecting leisure activities with dense motif discovery. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp '12, pages 250-259, New York, NY, USA, 2012. ACM.
4. C. M. Bishop. Pattern Recognition and Machine Learning. Springer-Verlag Inc., 2006.
5. U. Blanke and B. Schiele. Remember and transfer what you have learned - recognizing composite activities based on activity spotting. In International Symposium on Wearable Computers (ISWC), pages 1-8, Oct. 2010.
6. C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
7. K.-H. Chang, M. Y. Chen, and J. Canny. Tracking free-weight exercises. In Proc. Int'l Conf. Ubiquitous computing, UbiComp '07, pages 19-37, 2007.
8. Google Inc. Google Glass, Apr. 2013. http://www.google.com/glass/.
9. T. Huynh, M. Fritz, and B. Schiele. Discovery of activity patterns using topic models. In Proceedings of The International Conference on Ubiquitous Computing, UbiComp '08, pages 10-19, New York, NY, USA, 2008. ACM.
10. S. Kang, J. Lee, H. Jang, H. Lee, Y. Lee, S. Park, T. Park, and J. Song. Seemon: scalable and energy-efficient context monitoring framework for sensor-rich mobile environments. In Proceedings of The 6th International Conference On Mobile Systems, Applications, and Services, MobiSys '08, pages 267-280, New York, NY, USA, 2008. ACM.
11. S. Kang, Y. Lee, C. Min, Y. Ju, T. Park, J. Lee, Y. Rhee, and J. Song. Orchestrator: An active resource orchestration framework for mobile context monitoring in sensor-rich mobile environments. In International Conference on Pervasive Computing and Communications (PerCom), pages 135-144, 2010.
12. C. Kemp, J. B. Tenenbaum, T. L. Griffiths, T. Yamada, and N. Ueda. Learning systems of concepts with an infinite relational model. In Proceedings of the 21st national conference on Artificial intelligence - Volume 1, AAAI'06, pages 381-388. AAAI Press, 2006.
13. C. H. Lampert, H. Nickisch, and S. Harmeling. Learning to detect unseen object classes by between-class attribute transfer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 951-958, 2009.
14. N. D. Lane, E. Miluzzo, H. Lu, D. Peebles, T. Choudhury, and A. T. Campbell. A survey of mobile phone sensing. IEEE Comm. Magazine, 48:140-150, September 2010.
15. H. Larochelle, D. Erhan, and Y. Bengio. Zero-data learning of new tasks. In Proc. Conf. on Artificial intelligence, AAAI'08, pages 646-651, 2008.
16. J. Liu, B. Kuipers, and S. Savarese. Recognizing human actions by attributes. In Conf. Computer Vision and Pattern Recognition, pages 3337-3344, 2011.
17. R. Liu, T. Chen, and L. Huang. Research on human activity recognition based on active learning. In International Conference on Machine Learning and Cybernetics (ICMLC), Volume 1, pages 285-290, 2010.
18. B. Logan, J. Healey, M. Philipose, E. M. Tapia, and S. Intille. A long-term evaluation of sensing modalities for activity recognition. In Proc. Int'l Conf. Ubiquitous computing, UbiComp '07, pages 483-500, 2007.
19. B. Longstaff, S. Reddy, and D. Estrin. Improving activity classification for health applications on mobile devices using active and semi-supervised learning. In International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth'10, pages 1-7, 2010.
20. H. Lu, W. Pan, N. Lane, T. Choudhury, and A. Campbell. SoundSense: Scalable sound sensing for people-centric applications on mobile phones. In Proc. Int'l Conf. Mobile systems, Applications, and Services, pages 165-178, 2009.
21. H. Lu, J. Yang, Z. Liu, N. D. Lane, T. Choudhury, and A. T. Campbell. The Jigsaw continuous sensing engine for mobile phone applications. In Proc. ACM Conf. Embedded Networked Sensor Systems, SenSys '10, pages 71-84, 2010.
22. M. Mahdaviani and T. Choudhury. Fast and scalable training of semi-supervised CRFs with application to activity recognition. In J. C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems, pages 977-984. MIT Press, Cambridge, MA, 2007.
23. L. M. Manevitz and M. Yousef. One-class SVMs for document classification. Journal of Machine Learning Research, 2:139-154, Mar. 2002.
24. E. Miluzzo, C. T. Cornelius, A. Ramaswamy, T. Choudhury, Z. Liu, and A. T. Campbell. Darwin phones: the evolution of sensing and inference on mobile phones. In Proc. Int'l Conf. Mobile systems, Applications, and Services, pages 5-20, 2010.
25. E. Miluzzo, N. D. Lane, K. Fodor, R. Peterson, H. Lu, M. Musolesi, S. B. Eisenman, X. Zheng, and A. T. Campbell. Sensing meets mobile social networks: the design, implementation and evaluation of the CenceMe application. In Proc. ACM Conf. Embedded network sensor systems, SenSys '08, pages 337-350, 2008.
26. D. Minnen, T. Starner, I. Essa, and C. Isbell. Discovering characteristic actions from on-body sensor data. In Proc. International Symposium On Wearable Computing, pages 11-18, 2006.
27. Motorola Mobility. MotoACTV, Apr. 2013. https://motoactv.com/.
28. M. Muehlbauer, G. Bahle, and P. Lukowicz. What can an arm holster worn smart phone do for activity recognition? In Proc. International Symposium on Wearable Computers, ISWC '11, pages 79-82, 2011.
29. S. Nath. ACE: exploiting correlation for energy-efficient and continuous context sensing. In Proc. Int'l Conf. Mobile systems, Applications, and Services, MobiSys '12, pages 29-42, 2012.
30. M. Palatucci, D. Pomerleau, G. E. Hinton, and T. M. Mitchell. Zero-shot learning with semantic output codes. In Proceedings of the Neural Information Processing Systems (NIPS), pages 1410-1418, 2009.
31. D. Parikh and K. Grauman. Interactively building a discriminative vocabulary of nameable attributes. In Proc. Int'l Conf. Computer Vision and Pattern Recognition, pages 1681-1688, 2011.
32. D. Parikh and K. Grauman. Relative attributes. In IEEE International Conference on Computer Vision (ICCV), pages 503-510, 2011.
33. S. Rosenthal, A. K. Dey, and M. Veloso. Using decision-theoretic experience sampling to build personalized mobile phone interruption models. In Proc. International Conference on Pervasive Computing, Pervasive'11, pages 170-187, Berlin, Heidelberg, 2011. Springer-Verlag.
34. O. Russakovsky and L. Fei-Fei. Attribute learning in large-scale datasets. In Proceedings of the 11th European Conference on Trends and Topics in Computer Vision, ECCV'10, pages 1-14, Berlin, Heidelberg, 2012. Springer-Verlag.
35. B. Settles. Active Learning. Morgan & Claypool, 2012.
36. M. Stikic, D. Larlus, S. Ebert, and B. Schiele. Weakly supervised recognition of daily life activities with wearable sensors. IEEE Trans. Pattern Analysis and Machine Intelligence, 33(12):2521-2537, 2011.
37. M. Stikic, K. Van Laerhoven, and B. Schiele. Exploring semi-supervised and active learning for activity recognition. In Proc. International Symposium on Wearable Computers (ISWC), pages 81-88, 2008.
38. U.S. Bureau of Labor Statistics. American time use survey activity lexicon. American Time Use Survey, 2011.
39. S. Wang, W. Pentney, A.-M. Popescu, T. Choudhury, and M. Philipose. Common sense based joint training of human activity recognizers. In Proceedings of the 20th international joint conference on Artifical intelligence, IJCAI'07, pages 2237-2242, San Francisco, CA, USA, 2007. Morgan Kaufmann Publishers Inc.
40. Y. Wang, J. Lin, M. Annavaram, Q. A. Jacobson, J. Hong, B. Krishnamachari, and N. Sadeh. A framework of energy efficient mobile sensing for automatic user state recognition. In Proc. Int'l Conf. Mobile systems, Applications, and Services, MobiSys '09, pages 179-192, 2009.
41. V. W. Zheng, D. H. Hu, and Q. Yang. Cross-domain activity recognition. In Proc. International Conference on Ubiquitous Computing, Ubicomp '09, pages 61-70, New York, NY, USA, 2009. ACM.