The evolution of first person vision methods: A survey

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 5, 2015, Pages 744-760

  Betancourt, Alejandro ^a,b   Morerio, Pietro ^a   Regazzoni, Carlo S ^a   Rauterberg, Matthias ^b  

^a UNIVERSITY OF GENOA   (Italy)

^b EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Computer vision; egocentric vision; first person vision (FPV); human machine interaction; smart glasses; video analytics; wearable devices

Indexed keywords

GLASS; HUMAN COMPUTER INTERACTION; WEARABLE TECHNOLOGY;

FIRST-PERSON VISIONS; HUMAN MACHINE INTERACTION; SMART GLASS; VIDEO ANALYTICS; WEARABLE DEVICES;

COMPUTER VISION;

EID: 84929079074     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2015.2409731     Document Type: Article

References (150)

1. S. Mann, "'WearCam' (the wearable camera): Personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis," in 2nd Int. Symp. Wearable Comput. Dig. Papers, Oct. 1998, pp. 124-131.
2. W. W. Mayol, B. Tordoff, and D. W. Murray, "Wearable visual robots," in Proc. 4th Int. Symp. Wearable Comput., Oct. 2000, pp. 95-102.
3. W. Mayol, A. Davison, B. Tordoff, and D. Murray, "Applying active vision and SLAM to wearables," in Springer Tracts in Advanced Robotics, vol. 15, P. Dario and R. Chatila, Eds. Berlin, Germany: Springer-Verlag, 2005, pp. 325-334, doi: 10.1007/b9795829:
4. S. Hodges et al., "SenseCam: A retrospective memory aid," in Proc. Int. Conf. Ubiquitous Comput., 2006, pp. 177-193.
5. M. Blum, A. Pentland, and G. Tröster, "InSense: Interest-based life logging," IEEE MultiMedia, vol. 13, no. 4, pp. 40-48, Oct. 2006.
6. T. Starner, B. Schiele, and A. Pentland, "Visual contextual awareness in wearable computing," in Proc. Int. Symp. Wearable Comput., Oct. 1998, pp. 50-57.
7. T. Starner, J. Weaver, and A. Pentland, "Real-time American sign language recognition using desk and wearable computer based video," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 12, pp. 1371-1375, Dec. 1998.
8. B. Schiele, T. Starner, B. Rhodes, B. Clarkson, and A. Pentland, "Situation aware computing with wearable computers," in Proc. Augmented Reality Wearable Comput., 1999, pp. 1-20.
9. B. Schiele, N. Oliver, T. Jebara, and A. Pentland, "An interactive computer vision system DyPERS: Dynamic personal enhanced reality system," in Computer Vision Systems, vol. 1542. Berlin, Germany: Springer-Verlag, 1999, pp. 51-65, doi: 10.1007/3-540-49256-9.
10. T. E. Starner, "Wearable computing and contextual awareness," Ph.D. dissertation, School Archit. Planning, Massachusetts Inst. Technol., Cambridge, MA, USA, 1999.
11. H. Aoki, B. Schiele, and A. Pentland, "Realtime personal positioning system for a wearable computer," in 3rd Int. Symp. Wearable Comput. Dig. Papers, San Francisco, CA, USA, Oct. 1999, pp. 37-43.
12. S. Mann, "Wearable computing: A first step toward personal imaging," Computer, vol. 30, no. 2, pp. 25-32, Feb. 1997.
13. G. Serra, M. Camurri, L. Baraldi, M. Benedetti, and R. Cucchiara, "Hand segmentation for gesture recognition in EGO-vision," in Proc. Workshop Interact. Multimedia Mobile Portable Devices, New York, NY, USA, 2013, pp. 31-36.
14. S. Mann, J. Nolan, and B. Wellman, "Sousveillance: Inventing and using wearable computing devices for data collection in surveillance environments," Surveill. Soc., vol. 1, no. 3, pp. 331-355, 2003.
15. S. Karaman, J. Benois-Pineau, R. Mégret, V. Dovgalecs, J.-F. Dartigues, and Y. Gaëstel, "Human daily activities indexing in videos from wearable cameras for monitoring of patients with dementia diseases," in Proc. Int. Conf. Pattern Recognit., Aug. 2010, pp. 4113-4116.
16. K.-Y. Liu, S.-C. Hsu, and C.-L. Huang, "First-person-vision-based driver assistance system," in Proc. Int. Conf. Audio, Lang. Image Process. (ICALIP), Jul. 2014, pp. 239-244.
17. D. H. Nguyen et al., "Encountering SenseCam: Personal recording technologies in everyday life," in Proc. Int. Conf. Ubiquitous Comput., 2009, pp. 165-174.
18. T. Kanade and M. Hebert, "First-person vision," Proc. IEEE, vol. 100, no. 8, pp. 2442-2453, Aug. 2012.
19. D. Guan, W. Yuan, A. M. J. Sarkar, T. Ma, and Y.-K. Lee, "Review of sensor-based activity recognition systems," IETE Tech. Rev., vol. 28, no. 5, pp. 418-433, 2011.
20. A. R. Doherty et al., "Wearable cameras in health: The state of the art and future possibilities," Amer. J. Preventive Med., vol. 44, no. 3, pp. 320-323, Mar. 2013.
21. M. F. Land and M. Hayhoe, "In what ways do eye movements contribute to everyday activities?" Vis. Res., vol. 41, nos. 25-26, pp. 3559-3565, Dec. 2001.
22. S. Mann, M. A. Ali, R. Lo, and H. Wu, "FreeGlass for developers, 'haccessibility', and digital eye glass + lifeglogging research in a (sur/sous)veillance society," in Proc. Int. Conf. Inf. Soc., Jun. 2013, pp. 48-53.
23. A. Fathi, J. K. Hodgins, and J. M. Rehg, "Social interactions: A first-person perspective," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 1226-1233.
24. Z. Lu and K. Grauman, "Story-driven summarization for egocentric video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 2714-2721.
25. A. Yarbus, Eye Movements and Vision. New York, NY, USA: Plenum Press, 1967.
26. I. Bisio, A. Delfino, F. Lavagetto, and M. Marchese, "Opportunistic detection methods for emotion-aware smartphone applications," in Creating Personal, Social and Urban Awarness Through Pervasive Computing, B. Guo, D. Riboni, and P. Hu, Eds. Hershey, PA, USA: IGI Global, 2014, pp. 53-85, doi: 10.4018/978-1-4666-4695-7.
27. M. Philipose and X. Ren, "Egocentric recognition of handled objects: Benchmark and analysis," in Proc. Comput. Vis. Pattern Recognit., Miami, FL, USA, Jun. 2009, pp. 1-8.
28. A. Betancourt, "A sequential classifier for hand detection in the framework of egocentric vision," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, vol. 1. Columbus, OH, USA, Jun. 2014, pp. 600-605, doi: 10.1109/CVPRW.2014.92.
29. J. Ghosh, K. Grauman, and Y. J. Lee, "Discovering important people and objects for egocentric video summarization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1346-1353.
30. P. Morerio, L. Marcenaro, and C. S. Regazzoni, "Hand detection in first person vision," in Proc. 18th Int. Conf. Inf. Fusion, Istanbul, Turkey, Jul. 2013, pp. 1502-1507.
31. G. R. Bradski, "Real time face and object tracking as a component of a perceptual user interface," in Proc. 4th Appl. Comput. Vis., Oct. 1998, pp. 214-219.
32. B. Clarkson and A. Pentland, "Unsupervised clustering of ambulatory audio and video," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Phoenix, AZ, USA, Mar. 1999, pp. 3037-3040.
33. J. Farringdon and V. Oni, "Visual augmented memory (VAM)," in Proc. 4th Int. Symp. Wearable Comput., Atlanta GA, USA, Oct. 2000, pp. 167-168.
34. B. Clarkson, K. Mase, and A. Pentland, "Recognizing user context via wearable sensors," in Proc. 4th Int. Symp. Wearable Comput., Atlanta, GA, USA, Oct. 2000, pp. 69-75.
35. T. Kurata, T. Okuma, M. Kourogi, and K. Sakaue, "The hand-mouse: A human interface suitable for augmented reality environments enabled by visual wearables," in Proc. Symp. Mixed Reality, 2000, pp. 4-5.
36. T. Kurata, T. Okuma, and M. Kourogi, "Vizwear: Toward Humancentered Interaction Through Wearable Vision and Visualization," Lecture Notes Comput. Sci., vol. 2195, no. 1, pp. 40-47, 2001. [Online]. Available: http://link.springer.com/chapter/10.1007/3-540-45453-5-6
37. T. Kurata, T. Okuma, M. Kourogi, and K. Sakaue, "The hand mouse: GMM hand-color classification and mean shift tracking," in Proc. Recognit., Anal., Tracking Faces Gestures Real-Time Syst., Vancouver, BC, Canada, 2001, pp. 119-124.
38. Y. Kojima et al., "Hand manipulation of virtual objects in wearable augmented reality," in Proc. Virtual Syst. Multimedia, Oct. 2001, pp. 463-469.
39. K. Aizawa, K. Ishijima, and M. Shiina, "Summarizing wearable video," in Proc. Int. Conf. Image Process., vol. 2. 2001, pp. 398-401.
40. H. W. Ng, Y. Sawahata, and K. Aizawa, "Summarization of wearable videos using support vector machine," in Proc. IEEE Int. Conf. Multimedia Expo, Aug. 2002, pp. 325-328, doi: 10.1109/ICME.2002.1035784.
41. J. Gemmell, R. Lueder, and G. Bell, "The MyLifeBits lifetime store," in Transactions on Multimedia Computing, Communications and Applications. New York, NY, USA: ACM, 2002, pp. 1-5.
42. R. W. DeVaul, A. Pentland, and V. R. Corey, "The memory glasses: Subliminal vs. overt memory support with imperfect information," in Proc. 7th IEEE Int. Symp. Wearable Comput., Oct. 2005, pp. 146-153.
43. Y. Sawahata and K. Aizawa, "Wearable imaging system for summarizing personal experiences," in Proc. Int. Conf. Multimedia Expo, 2003, pp. 1-45, doi: 10.1109/ICME.2003.1220850.
44. T. Hori and K. Aizawa, "Context-based video retrieval system for the life-log applications," in Proc. 5th ACM SIGMM Int. Workshop Multimedia Inf. Retr., 2003, pp. 31-38.
45. R. Bane and T. Hollerer, "Interactive tools for virtual X-ray vision in mobile augmented reality," in Proc. 3rd IEEE ACM Int. Symp. Mixed Augmented Reality, Nov. 2004, pp. 231-239.
46. M. Kolsch and M. Turk, "Fast 2D hand tracking with flocks of features and multi-cue integration," in Proc. Comput. Vis. Pattern Recognit. Workshop, Jun. 2004, p. 158.
47. J. Gemmell, L. Williams, K. Wood, R. Lueder, and G. Bell, "Passive capture and ensuing issues for a personal lifetime store," in Proc. 1st ACM Workshop Continuous Arch. Retr. Pers. Exper., New York, NY, USA, 2004, pp. 48-55.
48. S. Mann, "Continuous lifelong capture of personal experience with EyeTap," in Proc. 1st ACM Workshop Continuous Arch. Retr. Pers. Exper., 2004, pp. 1-21.
49. W. W. Mayol and D. W. Murray, "Wearable hand activity recognition for event summarization," in Proc. 9th IEEE Int. Symp. Wearable Comput., Oct. 2005, pp. 122-129.
50. L. Sun, U. Klank, and M. Beetz, "EYEWATCHME - 3D hand and object tracking for inside out activity analysis," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2009, pp. 9-16.
51. R. Tenmoku, M. Kanbara, and N. Yokoya, "Annotating user-viewed objects for wearable AR systems," in Proc. 4th IEEE ACM Int. Symp. Mixed Augmented Reality, Oct. 2005, pp. 192-193.
52. D. Tancharoen, T. Yamasaki, and K. Aizawa, "Practical experience recording and indexing of Life Log video," in Proc. 2nd ACM Workshop Continuous Arch. Retr. Pers. Exper., 2005, pp. 61-66.
53. K. Aizawa, "Digitizing personal experiences: Capture and retrieval of life log," in Proc. 11th Int. Multimedia Modelling Conf., Jan. 2005, pp. 10-15.
54. M. Kölsch, R. Bane, T. Höllerer, and M. Turk, "Multimodal interaction with a wearable augmented reality system," IEEE Comput. Graph. Appl., vol. 26, no. 3, pp. 62-71, May/Jun. 2006.
55. M. Kölsch, R. Bane, T. Höllerer, and M. Turk, "Touching the visualized invisible: Wearable AR with a multimodal interface," IEEE Comput. Graph. Appl., vol. 26, no. 3, pp. 62-71, Jun. 2006.
56. R. O. Castle, D. J. Gawley, G. Klein, and D. W. Murray, "Video-rate recognition and localization for wearable cameras," in Proc. 18th Brit. Mach. Vis. Conf., 2007, pp. 112.1-112.10.
57. R. O. Castle, D. J. Gawley, G. Klein, and D. W. Murray, "Towards simultaneous recognition, localization and mapping for hand-held and wearable cameras," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2007, pp. 4102-4107.
58. J. Wu, A. Osuntogun, T. Choudhury, M. Philipose, and J. M. Rehg, "A scalable approach to activity recognition based on object use," in Proc. IEEE 11th Int. Conf. Comput. Vis., Rio de Janeiro, Brazil, Oct. 2007, pp. 1-8.
59. A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, "MonoSLAM: Real-time single camera SLAM," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1052-1067, Jun. 2007.
60. R. Castle, G. Klein, and D. W. Murray, "Video-rate localization in multiple maps for wearable augmented reality," in Proc. 11th IEEE Int. Symp. Wearable Comput., Sep./Oct. 2008, pp. 15-22.
61. W. Yi and D. Ballard, "Recognizing behavior in hand-eye coordination patterns," Int. J. Humanoid Robot., vol. 6, no. 3, pp. 337-359, 2009.
62. E. H. Spriggs, F. De La Torre, and M. Hebert, "Temporal segmentation and activity classification from first-person sensing," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2009, pp. 17-24.
63. S. Sundaram and W. W. M. Cuevas, "High level activity recognition using low resolution wearable vision," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2009, pp. 25-32.
64. K. Makita, M. Kanbara, and N. Yokoya, "View management of annotations for wearable augmented reality," in Proc. IEEE Int. Conf. Multimedia Expo, Jun./Jul. 2009, pp. 982-985.
65. X. Ren and C. Gu, "Figure-ground segmentation improves handled object recognition in egocentric video," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 3137-3144.
66. V. Dovgalecs, R. Megret, H. Wannous, and Y. Berthoumieu, "Semisupervised learning for location recognition from wearable video," in Proc. Int. Workshop Content Based Multimedia Indexing, Jun. 2010, pp. 1-6.
67. D. Byrne, A. R. Doherty, C. G. M. Snoek, G. J. F. Jones, and A. F. Smeaton, "Everyday concept detection in visual lifelogs: Validation, relationships and trends," Multimedia Tools Appl., vol. 49, no. 1, pp. 119-144, 2010.
68. H. Kang, M. Hebert, and T. Kanade, "Discovering object instances from scenes of daily living," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 762-769.
69. A. Fathi, X. Ren, and J. M. Rehg, "Learning to recognize objects in egocentric activities," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2011, pp. 3281-3288.
70. A. R. Doherty et al., "Passively recognising human activities through lifelogging," Comput. Human Behavior, vol. 27, no. 5, pp. 1948-1958, 2011.
71. A. Fathi, A. Farhadi, and J. M. Rehg, "Understanding egocentric activities," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 407-414.
72. O. Aghazadeh, J. Sullivan, and S. Carlsson, "Novelty detection from an ego-centric perspective," in Proc. IEEE Comput. Vis. Pattern Recognit., Pittsburgh, PA, USA, Jun. 2011, pp. 3297-3304, doi: 10.1109/CVPR.2011.5995731.
73. K. M. Kitani, T. Okabe, Y. Sato, and A. Sugimoto, "Fast unsupervised ego-action learning for first-person sports videos," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2011, pp. 3241-3248.
74. K. Yamada, Y. Sugano, T. Okabe, Y. Sato, A. Sugimoto, and K. Hiraki, "Can saliency map models predict human egocentric visual attention?" in Proc. Int. Conf. Comput. Vis., 2011, pp. 420-429.
75. M. Devyver, A. Tsukada, and T. Kanade, "A wearable device for first person vision," in Proc. Int. Symp. Quality Life Technol., Jul. 2011, pp. 1-6.
76. A. Borji, D. N. Sihite, and L. Itti, "Probabilistic learning of task-specific visual attention," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 470-477.
77. H. Pirsiavash and D. Ramanan, "Detecting activities of daily living in first-person camera views," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2847-2854.
78. A. Fathi, Y. Li, and J. M. Rehg, "Learning to recognize daily actions using gaze," in Proc. Eur. Conf. Comput. Vis., Florence, Italy, 2012, pp. 314-327.
79. K. Kitani, "Ego-action analysis for first-person sports videos," Pervasive Comput., vol. 11, no. 2, pp. 92-95, Feb. 2012.
80. K. Ogaki, K. M. Kitani, Y. Sugano, and Y. Sato, "Coupling eye-motion and ego-motion features for first-person activity recognition," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1-7.
81. R. Grasset, T. Langlotz, M. Tatzgern, D. Schmalstieg, and D. Kalkofen, "Image-driven view management for augmented reality browsers," in Proc. IEEE ISMAR, Nov. 2012, pp. 177-186.
82. H. S. Park, E. Jain, and Y. Sheikh, "3D social saliency from headmounted cameras," in Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran & Associates Inc., 2012, pp. 431-439.
83. K. Yamada, Y. Sugano, T. Okabe, Y. Sato, A. Sugimoto, and K. Hiraki, "Attention prediction in egocentric video using motion and visual saliency," in Proc. Pacific Rim Conf. Adv. Image Video Technol., 2012, pp. 277-288.
84. H. Boujut, J. Benois-Pineau, and R. Megret, "Fusion of multiple visual cues for visual saliency extraction from wearable camera settings with strong motion," in Proc. Int. Conf. Comput. Vis., 2012, pp. 436-445.
85. C. Li and K. M. Kitani, "Model recommendation with virtual probes for egocentric hand detection," in Proc. IEEE ICCV, Sydney, NSW, Australia, Dec. 2013, pp. 2624-2631.
86. C. Li and K. M. Kitani, "Pixel-level hand detection in ego-centric videos," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3570-3577.
87. H. Wang, R. R. Choudhury, S. Nelakuditi, and X. Bao, "InSight: Recognizing humans without face recognition," in Proc. 14th Workshop Mobile Comput. Syst. Appl., New York, NY, USA, 2013, Art. ID 7.
88. J. Zariffa and M. R. Popovic, "Hand contour detection in wearable camera video using an adaptive histogram region of interest," J. NeuroEng. Rehabil., vol. 10, no. 114, pp. 1-10, 2013.
89. Y. Li, A. Fathi, and J. M. Rehg, "Learning to predict gaze in egocentric video," in Proc. Int. Conf. Comput. Vis., Portland, OR, USA, Dec. 2013, pp. 3216-3223.
90. I. G. Díaz, V. Buso, J. Benois-Pineau, G. Bourmaud, and R. Megret, "Modeling instrumental activities of daily living in egocentric vision as sequences of active objects and context for alzheimer disease research," in Proc. 1st ACM Int. Workshop Multimedia Indexing Inf. Retr. Healthcare, New York, NY, USA, 2013, pp. 11-14.
91. A. Fathi and J. M. Rehg, "Modeling actions through state changes," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2013, pp. 2579-2586.
92. J. Zhang, L. Zhuang, Y. Wang, Y. Zhou, Y. Meng, and G. Hua, "An egocentric vision based assistive co-robot," in Proc. IEEE Int. Conf. Rehabil. Robot., Jun. 2013, pp. 1-7, doi: 10.1109/ICORR.2013.6650473.
93. M. S. Ryoo and L. Matthies, "First-person activity recognition: What are they doing to me?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 2730-2737.
94. F. Martinez, A. Carbone, and E. Pissaloux, "Combining first-person and third-person gaze for attention recognition," in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit. (FG), Apr. 2013, pp. 1-6.
95. T. Starner, "Project glass: An extension of the self," Pervasive Comput., vol. 12, no. 2, pp. 14-16, Apr./Jun. 2013.
96. S. Narayan, M. S. Kankanhalli, and K. R. Ramakrishnan, "Action and interaction recognition in first-person videos," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 526-532.
97. K. Matsuo, K. Yamada, S. Ueno, and S. Naito, "An attention-based activity recognition for egocentric video," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 565-570.
98. D. Damen, T. Leelasawassuk, O. Haines, A. Calway, and W. Mayol-Cuevas, "Multi-user egocentric online system for unsupervised assistance on object usage," in Proc. Eur. Conf. Comput. Vis., 2014.
99. Y. Poleg, C. Arora, and S. Peleg, "Temporal segmentation of egocentric videos," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 2537-2544.
100. K. Zheng et al., "Video-based action detection using multiple wearable cameras," in Proc. Workshop ChaLearn Looking People, 2014.
101. K. Zhan, S. Faux, and F. Ramos, "Multi-scale conditional random fields for first-person activity recognition," in Proc. IEEE Int. Conf. Pervasive Comput. Commun., Mar. 2014, pp. 51-59.
102. S. Alletto, G. Serra, S. Calderara, F. Solera, and R. Cucchiara, "From ego to nos-vision: Detecting social relationships in first-person views," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 594-599.
103. S. Alletto, G. Serra, S. Calderara, and R. Cucchiara, "Head pose estimation in first-person camera views," in Proc. 22nd Int. Conf. Pattern Recognit., Aug. 2014, pp. 4188-4193.
104. S. Lee, S. Bambach, D. J. Crandall, J. M. Franchak, and C. Yu, "This hand is my hand: A probabilistic approach to hand disambiguation in egocentric video," in Proc. IEEE Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 1-8.
105. S. Han, M. Philipose, A. Krishnamurthy, and D. Wetherall, "Glimpse- Data: Towards continuous vision-based personal analytics," J. Experim. Psychol., Human Perception Perform., vol. 40, no. 2, p. 457, 2014.
106. A. Scheck, "Seeing the (Google) glass as half full," Emergency Med. News, vol. 36, no. 2, pp. 20-21, 2014.
107. W. Jingtao and Y. Chunxuan, "Finger-fist detection in first-person view based on monocular vision using Haar-like features," in Proc. Chin. Control Conf., Jul. 2014, pp. 4920-4923.
108. Y. Liu, Y. Jang, W. Woo, and T.-K. Kim, "Video-based object recognition using novel set-of-sets representations," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 533-540.
109. S. Feng, R. Caire, B. Cortazar, M. Turan, A. Wong, and A. Ozcan, "Immunochromatographic diagnostic test analysis using Google Glass," ACS Nano, vol. 8, no. 3, pp. 3069-3079, Feb. 2014.
110. Y. Poleg, C. Arora, and S. Peleg, "Head motion signatures from egocentric videos," in Proc. Asian Conf. Comput. Vis., Singapore, 2014, pp. 1-15.
111. G. Rogez and J. S. III, "3D hand pose detection in egocentric RGB-D images," in Proc. ECCV Workshop Consum. Depth Camera Comput. Vis., Nov. 2014, pp. 1-14.
112. G. Rogez, J. S. Supancic, and D. Ramanan, "Egocentric pose recognition in four lines of code," in Proc. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 1-9.
113. R. Templeman, M. Korayem, D. Crandall, and A. Kapadia, "PlaceAvoider: Steering first-person cameras away from sensitive spaces," in Proc. Netw. Distrib. Syst. Security Symp., 2014, pp. 23-26.
114. V. Buso, J. Benois-Pineau, and J.-P. Domenger, "Geometrical cues in visual saliency models for active object recognition in egocentric videos," in Proc. Int. Workshop Perception Inspired Video Process., New York, NY, USA, 2014, pp. 9-14.
115. B. Xiong and K. Grauman, "Detecting snap points in egocentric video with a web photo prior," in Proc. 13th Eur. Int. Conf. Comput. Vis., 2014, pp. 282-298.
116. V. Chandrasekhar et al., "Efficient retrieval from large-scale egocentric visual data using a sparse graph representation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 541-548.
117. M. Bolaños, M. Garolera, and P. Radeva, "Video segmentation of life-logging videos," in Articulated Motion and Deformable Objects. Palma de Mallorca, Spain: Springer-Verlag, 2014, pp. 1-9, doi:10.1007/978-3-319-08849-5-1.
118. J. W. Barker and J. W. Davis, "Temporally-dependent Dirichlet process mixtures for egocentric video segmentation," in Proc. IEEE Comput. Vis. Pattern Recognit., Jun. 2014, pp. 571-578.
119. M. Okamoto and K. Yanai, "Summarization of egocentric moving videos for generating walking route guidance," in Image and Video Technology. Berlin, Germany: Springer-Verlag, 2014, pp. 431-442.
120. I. Arev, H. S. Park, Y. Sheikh, J. Hodgins, and A. Shamir, "Automatic editing of footage from multiple social cameras," ACM Trans. Graph., vol. 33, no. 4, pp. 1-11, Jul. 2014.
121. M. Jones and J. Rehg, "Statistical color models with application to skin detection 2 histogram color models," in Proc. Comput. Vis. Pattern Recognit., Fort Collins, CO, USA, Jun. 1999, pp. 1-23, doi: 10.1109/CVPR.1999.786951.
122. M. Schlattmann, F. Kahlesz, R. Sarlette, and R. Klein, "Markerless 4 gestures 6 DOF real-time visual tracking of the human hand with automatic initialization," Comput. Graph. Forum, vol. 26, no. 3, pp. 467-476, Sep. 2007.
123. M. Schlattman and R. Klein, "Simultaneous 4 gestures 6 DOF realtime two-hand tracking without any markers," in Proc. Symp. Virt. Real. Softw. Technol., New York, NY, USA, 2007, pp. 39-42.
124. J. M. Rehg and T. Kanade, "DigitEyes: Vision-based hand tracking for human-computer interaction," in Proc. IEEE Workshop Motion Non-Rigid Articulated Bodies, Nov. 1994, pp. 16-22.
125. P. Morerio, G. C. Georgiu, L. Marcenaro, and C. Regazzoni, "Optimizing superpixel clustering for real-time egocentric-vision applications," IEEE Signal Process. Lett., vol. 22, no. 4, pp. 469-473, Apr. 2014.
126. V. Bettadapura, I. Essa, and C. Pantofaru, "Egocentric field-of-view localization using first-person point-of-view devices," in Proc. Winter Conf. Appl. Comput. Vis., Jan. 2015, pp. 626-633.
127. Y. Hoshen and S. Peleg. (Nov. 2014). "Egocentric video biometrics." [Online]. Available: http://arxiv.org/abs/1411.7591
128. M. Spain and P. Perona, "Measuring and predicting object importance," Int. J. Comput. Vis., vol. 91, no. 1, pp. 59-76, Aug. 2010.
129. T. L. Berg and D. A. Forsyth, "Animals on the web," in Proc. Comput. Soc. Conf. Conf. Comput. Vis. Pattern Recognit., Jan. 2006, vol. 2, no. 1, pp. 1463-1470.
130. C. Yu and D. H. Ballard, "Learning to recognize human action sequences," in Proc. 2nd Int. Conf. Develop. Learn., 2002, pp. 28-33.
131. N. Krahnstoever, J. Rittscher, P. Tu, K. Chean, and T. Tomlinson, "Activity recognition using visual tracking and RFID," in Proc. 7th IEEE Workshops Appl. Comput. Vis. (WACV/MOTION), vol. 1. Breckenridge, CO, USA, Jan. 2005, pp. 494-500.
132. D. J. Patterson, D. Fox, H. Kautz, and M. Philipose, "Fine-grained activity recognition by aggregating abstract object usage," in Proc. 9th IEEE Int. Symp. Wearable Comput. (ISWC), Oct. 2005, pp. 44-51.
133. M. Philipose et al., "Inferring activities from interactions with objects," Pervasive Comput., vol. 3, no. 4, pp. 50-57, 2004.
134. G. Riva, F. Vatalaro, F. Davide, and M. Alcañiz, Eds., Ambient Intelligence - The Evolution of Technology, Communication and Cognition Towards the Future of Human-Computer Interaction, vol. 6. Piscataway, NJ, USA: IEEE Press, Jan. 2005.
135. J. García-Rodríguez and J. M. García-Chamizo, "Surveillance and human-computer interaction applications of self-growing models," Appl. Soft Comput., vol. 11, no. 7, pp. 4413-4431, 2011.
136. M. Kolsch, M. Turk, and T. Hollerer, "Vision-based interfaces for mobility," in Proc. 1st Annu. Int. Conf. Mobile Ubiquitous Syst., Netw. Services, Aug. 2004, pp. 86-94.
137. M. Morshidi and T. Tjahjadi, "Gravity optimised particle filter for hand tracking," Pattern Recognit., vol. 47, no. 1, pp. 194-207, 2014.
138. V. Spruyt, A. Ledda, and W. Philips, "Real-time, long-term hand tracking with unsupervised initialization," in Proc. IEEE 20th Int. Conf. Image Process., Melbourne, VIC, Australia, Sep. 2013, pp. 3730-3734.
139. C. Shan, T. Tan, and Y. Wei, "Real-time hand tracking using a mean shift embedded particle filter," Pattern Recognit., vol. 40, no. 7, pp. 1958-1970, Jul. 2007.
140. G. Ben-Artzi, M. Werman, and S. Peleg. (Dec. 2014). "Event matching from significantly different views using motion barcodes." [Online]. Available: http://arxiv.org/abs/1412.1455
141. D. Lu and Q. Weng, "A survey of image classification methods and techniques for improving classification performance," Int. J. Remote Sens., vol. 28, no. 5, pp. 823-870, Mar. 2007.
142. S. Chiappino, L. Marcenaro, P. Morerio, and C. Regazzoni, "Event based switched dynamic Bayesian networks for autonomous cognitive crowd monitoring," in Wide Area Surveillance (Augmented Vision and Reality), vol. 6, V. K. Asari, Ed. Berlin, Germany: Springer-Verlag, 2013, pp. 93-122, doi:10.1007/978-3-642-37841-6.
143. F. Camastra and A. Vinciarelli, Machine Learning for Audio, Image and Video Analysis: Theory and Applications. Berlin, Germany: Springer-Verlag, 2007.
144. R. Achanta, A. Shaji, K. Smith, A. Lucchi, P. Fua, and S. Süsstrunk, "SLIC superpixels compared to state-of-the-art superpixel methods," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 11, pp. 2274-2282, Nov. 2012.
145. P. Morerio, L. Marcenaro, and C. S. Regazzoni, "A generative superpixel method," in Proc. 17th IEEE Int. Conf. Inf. Fusion (FUSION), Jul. 2014, pp. 1-7.
146. Y. J. Lee and K. Grauman, "Predicting important objects for egocentric video summarization," Int. J. Comput. Vis., vol. 1, pp. 1-19, Jan. 2015, doi: 10.1007/s11263-014-0794-5.
147. A. Knittel, "Learning feature hierarchies under reinforcement," in Proc. IEEE Congr. Evol. Comput. (CEC), Jun. 2012, pp. 1-8.
148. C. Tan, H. Goh, V. Chandrasekhar, L. Li, and J.-H. Lim, "Understanding the nature of first-person videos: Characterization and classification using low-level features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops, Jun. 2014, pp. 535-542.
149. S. Chiappino, P. Morerio, L. Marcenaro, and C. S. Regazzoni, "A bio-inspired knowledge representation method for anomaly detection in cognitive video surveillance systems," in Proc. 16th Int. Conf. Inf. Fusion (FUSION), Jul. 2013, pp. 242-249.
150. S. Chiappino, P. Morerio, L. Marcenaro, and C. S. Regazzoni, "Bio-inspired relevant interaction modelling in cognitive crowd management," J. Ambient Intell. Humanized Comput., vol. 1, pp. 1-22, Feb. 2014, doi: 10.1007/s12652-014-0224-0.