Object interaction detection using hand posture cues in an office setting

International Journal of Human Computer Studies

Volumn 69, Issue 1-2, 2011, Pages 19-29

  Paulson, Brandon ^a   Cummings, Danielle ^a   Hammond, Tracy ^a  

^a TEXAS A AND M UNIVERSITY   (United States)

Author keywords

Activity recognition; Context aware; Cyberglove; Glove based interaction; Hand gesture; Hand posture; Haptics

Indexed keywords

ACTIVITY RECOGNITION; CONTEXT-AWARE; CYBERGLOVE; GLOVE-BASED INTERACTION; HAND GESTURE; HAND POSTURE; HAPTICS;

ACTIVITY COEFFICIENTS;

GESTURE RECOGNITION;

EID: 78649750820     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2010.09.003     Document Type: Article

References (41)

1. D. Ayers, and M. Shah Monitoring human behavior from video taken in an office environment Image and Vision Computing 19 12 2001 833 846
2. L. Bao, and S.S. Intille Activity recognition from user-annotated acceleration data Pervasive Computing 3001 2004 1 17
3. K. Bernardin, K. Ogawara, K. Ikeuchi, and R. Dillmann A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models IEEE Transactions on Robotics 21 1 2005 47 57
4. C.M. Bishop Pattern Recognition and Machine Learning 2006 Springer Berlin
5. J. Bussmann, W. Martens, J. Tulen, F. Schasfoot, H. vanden Berg-Emons, and H. Stam Measuring daily behavior using ambulatory accelerometry: the activity monitor Behavior Research Methods, Instruments, & Computers 33 3 2001 349 356
6. Chang, L.; Pollard, N.; Mitchell, T.; Xing, E.; 2007. Feature selection for grasp recognition from optical markers. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 29442950.
7. Dey, A.; Salber, D.; Abowd, G.; Futakawa, M.; 1999. The conference assistant: combining context-awareness with wearable computing. In: Proceedings of the Third International Symposium on Wearable Computers, pp. 2128.
8. Dey, A.K.; Abowd, G.D.; 2000. Towards a better understanding of context and context-awareness. In: Workshop on The What, Who, Where, When, and How of Context-Awareness at the 2000 Conference on Human Factors in Computing Systems.
9. R. Fisher The statistical utilization of multiple measurements Annals of Eugenics 8 1938 376 386
10. F. Foerster, M. Smeja, and J. Fahrenberg Detection of posture and motion by accelerometry: a validation study in ambulatory monitoring Computers in Human Behavior 15 5 1999 571 583
11. K. Fukunaga Introduction to Statistical Pattern Recognition second ed. 1990 Academic Press Burlington, MA
12. Hammond, T.; Eoff, B.; Paulson, B.; Wolin, A.; Dahmen, K.; Johnston, J.; Rajan, P.; 2008. Free-sketch recognition: putting the chi in sketching. In: CHI '08 Extended Abstracts on Human Factors in Computing Systems, pp. 30273032.
13. Harling, P.A.; Edwards, A.D.N.; 1996. Hand tension as a gesture segmentation cue. In: Proceedings of Gesture Workshop on Progress in Gestural Interaction, pp. 7588.
14. Hotelling, H.; 1933. Analysis of a complex of statistical variables into principal components.
15. Iba, S.; Weghe, J.; Paredis, C.; Khosla, P.; 1999. An architecture for gesture-based control of mobile robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 2, pp. 851857.
16. Immersion, 2009. Wireless data glove: the CyberGlove II wireless system 〈 http://www.immersion.com/3d/products/cyber-glove.php 〉.
17. N. Kern, B. Schiele, and A. Schmidt Multi-sensor activity context detection for wearable computing Ambient Intelligence 2875 2003 220 232
18. R. Kohavi, and F. Provost Glossary of terms Machine Learning 30 2 1998 271 274
19. K. Kuutti Activity theory as a potential framework for humancomputer interaction research B.A. Nardi, Context and Consciousness: Activity Theory and Human-computer Interaction 1995 MIT Press Cambridge, MA, USA 17 44
20. S.-W. Lee, and K. Mase Activity and location recognition using wearable sensors IEEE Pervasive Computing 1 3 2002 24 32
21. Lester, J.; Choudhury, T.; Kern, N.; Borriello, G.; Hannaford, B.; 2005. A hybrid discriminative/generative approach for modeling human activities. In: International Joint Conferences on Artificial Intelligence, pp. 766772.
22. Li, C.; Prabhakaran, B.; 2005. A similarity measure for motion stream segmentation and recognition. In: Proceedings of the Sixth International Workshop on Multimedia Data Mining, pp. 8994.
23. Mayol, W.W.; Murray, D.W.; 2005. Wearable hand activity recognition for event summarization. In: Proceedings of the Ninth IEEE International Symposium on Wearable Computers, pp. 122129.
24. Minnen, D.; Starner, T.; Ward, J.; Lukowicz, P.; Troster, G.; 2005. Recognizing and discovering human actions from on-body sensor data. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 15451548.
25. Moore, D.; Essa, I.; Hayes, M.H.; I.; 1999. Exploiting human actions and object context for recognition tasks. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, pp. 8086.
26. B.A. Nardi Studying context: a comparison of activity theory, situated action models, and distributed cognition B.A. Nardi, Context and Consciousness: Activity Theory and Human-computer Interaction 1995 MIT Press Cambridge, MA, USA 69 102
27. N. Oliver, A. Garg, and E. Horvitz Layered representations for learning and inferring office activity from multiple sensory channels Computer Vision Image Understanding 96 2 2004 163 180
28. Pascoe, J.; 1998. Adding generic contextual capabilities to wearable computers. In: Proceedings of the Second International Symposium on Wearable Computers, pp. 9299.
29. Patterson, D.J.; Fox, D.; Kautz, H.; Philipose, M.; 2005. Fine-grained activity recognition by aggregating abstract object usage. In: Proceedings of the Ninth IEEE International Symposium on Wearable Computers, pp. 4451.
30. B. Paulson, and T. Hammond Marqs: retrieving sketches using domain- and style-independent features learned from a single example using a dual-classifier Journal of Multi-Modal User Interfaces 2 1 2008 3 11
31. Paulson, B.; Hammond, T.; 2008b. Office activity recognition using hand posture cues. In: BCS-HCI '08: Proceedings of the 22nd British CHI Group Annual Conference on HCI 2008. British Computer Society, Swinton, UK, pp. 7578.
32. K. Pearson On lines and planes of closest fit to systems of points in space Philosophical Magazine 2 1901 559 572
33. M. Philipose, K.P. Fishkin, M. Perkowitz, D.J. Patterson, D. Fox, H. Kautz, and D. Hahnel Inferring activities from interactions with objects IEEE Pervasive Computing 3 4 2004 50 57
34. Rubine, D.; 1991. Specifying gestures by example. In: Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques, pp. 329337.
35. Schilit, B.; Adams, N.; Want, R.; 1994. Context-aware computing applications. In: Proceedings of the Workshop on Mobile Computing Systems and Applications, pp. 8590.
36. Sun, X.; Chen, C.-W.; Manjunath, B.; 2002. Probabilistic motion parameter models for human activity recognition. In: Proceedings of the 16th International Conference on Pattern Recognition, vol. 1, pp. 443446.
37. D. Surie, F. Lagriffoul, T. Pederson, and D. Sjolie Activity recognition based on intra and extra manipulation of everyday objects Ubiquitous Computing Systems 4836 2007 196 210
38. Surie, D.; Pederson, T.; Lagriffoul, F.; Janlert, L.-E.; Sjolie, D.; 2007b. Activity recognition using an egocentric perspective of everyday objects. Lecture Notes in Computer Science 4611, 246257.
39. A. Tikhonov On the stability on inverse problems Doklady Akademii Nauk SSSR 39 5 1943 195 198
40. R. Want, B. Schilit, N. Adams, R. Gold, K. Petersen, D. Goldberg, J. Ellis, and M. Weiser The parctab ubiquitous computing experiment Mobile Computing 353 1996 45 101
41. J.A. Ward, P. Lukowicz, G. Troster, and T.E. Starner Activity recognition of assembly tasks using body-worn microphones and accelerometers IEEE Transactions on Pattern Analysis and Machine Intelligence 28 10 2006 1553 1567