Performance metrics for activity recognition

ACM Transactions on Intelligent Systems and Technology

Volumn 2, Issue 1, 2011, Pages

  Ward, Jamie A ^a   Lukowicz, Paul ^a   Gellersen, Hans W ^a  

^a UNIVERSITY OF PASSAU   (Germany)

Author keywords

Activity recognition; Metrics; Performance evaluation

Indexed keywords

A-FRAMES; ACTIVITY RECOGNITION; COMMON ARTEFACTS; EVENT-BASED; GRAPHICAL REPRESENTATIONS; METRICS; PATTERN RECOGNITION PROBLEMS; PERFORMANCE EVALUATION; PERFORMANCE METRICS; PRECISION AND RECALL; SKEW INVARIANT; STANDARD EVALUATIONS; STANDARD METRICS; TIMING OFFSETS; VISUALISATION;

PATTERN RECOGNITION;

VISUALIZATION;

EID: 79955140421     PISSN: 21576904     EISSN: 21576912     Source Type: Journal    
DOI: 10.1145/1889681.1889687     Document Type: Article

References (36)

1. Agrawal, R., Lin, K.-L, Sawhney, H. S., and Shim, K. 1995. Fast similarity search in the presence of noise, scaling, and translation in time-series databases. In Proceedings of the 21st International Conference on Very Large Data Bases. 490-501.
2. Albinali, F., Goodwin, M.S., and Intille, S. S. 2009. Recognizing stereotypical motor movements in the laboratory and classroom: a case study with children on the autism spectrum. In Proceedings of the International Conference on Ubiquitous Computing. ACM, New York, 71-80.
3. Amft, O. and Troester, G. 2006. Methods for detection and classification of normal swallowing from muscle activation and sound. In Proceedings of the Pervasive Health Conference and Workshops, 1-10.
4. Bao, L. and Intille, S. 2004. Activity recognition from user-annotated acceleration data. In Proceedings of the International Conference on Pervasive Computing.
5. Berndt, D. and Clifford, J. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the Workshop on Knowledge Discovery in Databases (KDD). AAAI, 359-370.
6. Buettner, M., Prasad, R., Philipose, M., and Wetherall, D. 2009. Recognizing daily activities with rfid-based sensors. In Proceedings of the 11th International Conference on Ubiquitous Computing. ACM, New York, 51-60.
7. Bulling, A., Ward, J.A., Gellersen, H.-W., and Tröster, G. 2008. Robust recognition of reading activity in transit using wearable electrooculography. In Proceedings of the International Conference on Pervasive Computing. 19-37.
8. Choujaa, D. and Dulay, N. 2008. Tracme: Temporal activity recognition using mobile phone data. In Proceedings of the IEEE/IFIP International Conference on Embedded and Ubiquitous Computing. Vol. 1, 119-126.
9. Fawcett, T. 2004. ROC Graphs: Notes and Practical Considerations for Researchers.Kluwer.
10. Fogarty, J., Au, C., and Hudson, S. E. 2006. Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition. In Proceedings of the 19th Symposium on User Interface Software and Technology. ACM, New York, 91-100. (Pubitemid 47142429)
11. Hoover, A., Jean-Baptiste, G., Jiang, X., Flynn, P., Bunke, H., Goldof, D., Bowyer, K., Eggert, D., Fitzgibbon, A., and Fisher, R. 1996. An experimental comparison of range image segmentation algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 18, 7, 673-689. (Pubitemid 126771378)
12. Huynh, T., Blank, U., and Schiele, B. 2007. Scalable recognition of daily activities with wearable sensors. In Proceedings of the Conference on Location-and Context-Awareness.
13. Huynh, T., Fritz, M., and Schiele, B. 2008. Discovery of activity patterns using topic models. In Proceedings of the International Conference on Ubiquitous Computing. ACM, New York, 10-19.
14. Intille, S.S., Larson, K., Tapia, E.M., Beaudin, J., Kaushik, P., Nawyn, J., and Rockinson, R. 2006. Using a live-in laboratory for ubiquitous computing research. In Proceedings of the International Conference on Pervasive Computing.
15. Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Garofolo, J., Bowers, R., Boonstra, M., Korzhova, V., and Zhang, J. 2009. Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. IEEE Trans. Patt. Anal. Mach. Intell. 31, 2, 319-336.
16. Lester, J., Choudhury, T., Kern, N., Borriello, G., and Hannaford, B. 2005. A hybrid discriminative/generative approach for modeling human activities. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). 766-772.
17. Ling, C.X., Huang, J., and Zhang, H. 2003. Auc: A statistically consistent and more discriminating measure than accuracy. In Proceedings of the 18th International Conference on Artificial Intelligence (IJCAI). 329-341.
18. Logan, B., Healey, J., Philipose, M., Munguia-Tapia, E., and Intille, S. 2007. A longitudinal evaluation of sensing modalities for activity recognition. In Proceedings of the International Conference on Ubiquitous Computing.
19. Lukowicz, P., Ward, J., Junker, H., Tröster, G., Atrash, A., and Starner, T. 2004. Recognizing workshop activity using body worn microphones and accelerometers. In Proceedings of the International Conference on Pervasive Computing.
20. Maekawa, T., Yanagisawa, Y., Kishino, Y., Ishiguro, K., Kamei, K., Sakurai, Y., and Okadome, T. 2010. Object-based activity recognition with heterogeneous sensors on wrist. In Proceedings of the International Conference on Pervasive Computing. 246-264.
21. McCowan, I., Moore , D. , Dines, J. , Gatica-Perez , D. , Flynn, M. , Wellner, P. , and Bourlard, H. 2004. On the use of information retrieval measures for speech recognition evaluation. IDIAP-RR 73, IDIAP, Martigny, Switzerland.
22. Minnen, D., Westeyn, T., Ashbrook, D., Presti, P., and Starner, T. 2007. Recognizing soldier activities in the field. In Body Sensor Networks, vol. 13, 236-242.
23. MÜller, H., MÜller, W., Squire, D.M., Marchand-Maillet, S., and Pun, T. 1999. Performance evaluation in content-based image retrieval: Overview and proposals. Tech. rep., University of Geneve, Switzerland.
24. Patterson, D., Fox, D., Kautz, H., and Philipose, M. 2005. Fine-grained activity recognition by aggregating abstract object usage. In Proceedings of the International Symposium on Wearable Computers. IEEE, 44-51. (Pubitemid 44867493)
25. Perng, C.-S., Wang, H., Zhang, S., and Parker, D. 2000. Landmarks: a new model for similaritybased pattern querying in time series databases. In Proceedings of the International Conference on Data Engineering. IEEE, 33-42. (Pubitemid 30585778)
26. Provost, F., Fawcett, T., and Kohavi, R. 1998. The case against accuracy estimation for comparing induction algorithms. In Proceedings of the 15th International Conference on Machine Learning 445-453.
27. Shafait, F., Keysers, D., and Breuel, T. 2008. Performance evaluation and benchmarking of six-page segmentation algorithms. IEEE Trans. Patt. Anal. Mach. Intell. 30, 6, 941-954. (Pubitemid 351650100)
28. Stiefmeier, T., Ogris, G., Junker, H., Lukowicz, P., and Troester, G. 2006. Combining motion sensors and ultrasonic hands tracking for continuous activity recognition in a maintenance scenario. In Proceeding of the International Symposium on Wearable Computers. 97-104. (Pubitemid 351698932)
29. Tapia, E., Intille, S., and Larson, K. 2004. Activity recognition in the home using simple and ubiquitous sensors. In Proceedings of the International Conference on Pervasive Computing.
30. van Kasteren, T., Englebienne, G., and Krose, B. 2010. Transferring knowledge of activity recognition across sensor networks. In Proceedings of the International Conference on Pervasive Computing. 283-300.
31. van Rijsbergen, C. 1979. Information Retrieval 2nd Ed. Dept. of Computer Science, University of Glasgow.
32. Ward, J., Lukowicz, P., and Tröster, G. 2006a. Evaluating performance in continuous context recognition using event-driven error characterisation. In Proceedings of the Symposium on Location and Context Awareness. 239-255. (Pubitemid 44045007)
33. Ward, J., Lukowicz, P., Tröster, G., and Starner, T. 2006b. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Patt. Anal. Mach. Intell. 28, 10, 1553-1567.
34. Westeyn, T., Vadas, K., Bian, X., Starner, T., and Abowd, G. D. 2005. Recognizing mimicked autistic self-stimulatory behaviors using HMMs. In Proceedings of the International Symposium on Wearable Computers. 164-169.
35. Zhang, Y. 2001. A review of recent evaluation methods for image segmentation. In Proceedings of the International Symposium on Signal Processing and its Applications. 148-151.
36. Zinnen, A., Wojek, C., and Schiele, B. 2009. Multi activity recognition based on bodymodelderived primitives. In Proceedings of the Symposium on Location-and Context-Awareness. 1-18.