Using visual lifelogs to automatically characterize everyday activities

Information Sciences

Volumn 230, Issue , 2013, Pages 147-161

  Wang, Peng ^a   Smeaton, Alan F ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

Author keywords

Activity classification; Lifelogging; Patient monitoring; SenseCam; Wearable camera

Indexed keywords

ACTIVITY CLASSIFICATIONS; F-SCORE; GAIN INSIGHT; LIFE LOG; LIFELOGGING; REDUCTION TECHNIQUES; SEMANTIC CONCEPT; SENSECAM; USER EXPERIMENTS; WEARABLE CAMERAS;

CAMERAS; DATA REDUCTION; PATIENT MONITORING; SEMANTICS;

ALGORITHMS;

EID: 84874114160     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.12.028     Document Type: Article

References (51)

1. R. Aly, A.R. Doherty, D. Hiemstra, and A.F. Smeaton Beyond shot retrieval: searching for broadcast news items using language models of concepts Advances in Information Retrieval Lecture Notes in Computer Science vol. 5993 2010 Springer Berlin/Heidelberg 241 252
2. R. Aly, and D. Hiemstra Concept detectors: how good is good enough? Proceedings of the 17th ACM International Conference on Multimedia, MM '09 2009 ACM New York, NY, USA 233 242
3. R. Aly, D. Hiemstra, F. de Jong, and P. Apers Simulating the future of concept-based video retrieval under improved detector performance Multimedia Tools and Applications 2011 1 29
4. E. Berry, N. Kapur, L. Williams, S. Hodges, P. Watson, G. Smyth, J. Srinivasan, R. Smith, B. Wilson, and K. Wood The use of a wearable camera, sensecam, as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: a preliminary report Neuropsychological Rehabilitation 17 2007 582 601
5. G. Browne, E. Berry, N. Kapur, S. Hodges, G. Smyth, P. Watson, and K. Wood Sensecam improves memory for recent events and quality of life in a patient with memory retrieval difficulties Memory 19 2011 713 722
6. R. Chilvers, S. Corr, and S. Hayley Investigation into the occupational lives of healthy older people through their use of time Australian Occupational Therapy Journal 57 2010 24 33
7. C.O. Conaire, D. Connaghan, P. Kelly, N.E. O'Connor, M. Gaffney, and J. Buckley Combining inertial and visual sensing for human action recognition in tennis Proceedings of the first ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams, ARTEMIS '10 2010 ACM New York, NY, USA 51 56
8. S. Deerwester, S.T. Dumais, G.W. Furnas, T.K. Landauer, and R. Harshman Indexing by latent semantic analysis Journal of the American Society for Information Science 41 1990 391 407
9. A.R. Doherty, N. Caprani, C. O Conaire, V. Kalnikaite, C. Gurrin, N.E. O'Connor, and A.F. Smeaton Passively recognising human activities through lifelogging Computers in Human Behavior 27 2011 1948 1958
10. S. Ebadollahi, L. Xie, S.F. Chang, and J.R. Smith Visual event detection using multi-dimensional concept dynamics ICME 2006 IEEE 881 884
11. P.A. Gambrel, and R. Cianci Maslow's hierarchy of needs: does it apply in a collectivist culture Journal of Applied Management and Entrepreneurship 8 2003 143 161
12. N. Harte, D. Lennon, and A. Kokaram On parsing visual sequences with the hidden Markov model Journal of Image Video Processing 2009 2009 6:1 6:13
13. M. Hill, G. Hua, A. Natsev, J.R. Smith, L. Xie, B. Huang, M. Merler, H. Ouyang, M. Zhou, IBM Rsesearch TRECVid-2010 video copy detection and multimedia event detection system, in: NIST TRECVid Workshop 2010.
14. S. Hodges, L. Williams, E. Berry, S. Izadi, J. Srinivasan, A. Butler, G. Smyth, N. Kapur, K. Wood, SenseCam: a retrospective memory aid, in: Proc. 8th International Conference on Ubicomp, Orange County, CA, USA, 2006, pp. 177-193.
15. B. Huurnink, K. Hofmann, and M. de Rijke Assessing concept selection for video retrieval MIR '08: Proceeding of the 1st ACM International Conference on Multimedia Information Retrieval 2008 ACM New York, NY, USA 459 466
16. Y.G. Jiang, X. Zeng, G. Ye, S. Bhattacharya, D. Ellis, M. Shah, S.F. Chang, Columbia-UCF TRECVid2010 multimedia event detection: combining multiple modalities, contextual concepts, and temporal matching, in: NIST TRECVid Workshop 2010.
17. C.H. Kaczkowski, P.J.H. Jones, J. Feng, and H.S. Bayley Four-day multimedia diet records underestimate energy needs in middle-aged and elderly women as determined by doubly-labeled water Journal of Nutrition 130 2000 802 805
18. D. Kahneman, A.B. Krueger, D.A. Schkade, N. Schwarz, and A.A. Stone A survey method for characterizing daily life experience: the day reconstruction method Science 306 2004 1776 1780
19. S. Karaman, J. Benois-Pineau, R. Megret, J. Pinquier, Y. Gaestel, J.F. Dartigues, Activities of daily living indexing by hierarchical HMM for dementia diagnostics, in: The 9th International Workshop on Content-Based Multimedia Indexing (CBMI), Madrid, Spain, 2011, pp. 79-84.
20. P. Kelly, A.R. Doherty, E. Berry, S. Hodges, A.M. Batterham, and C. Foster Can we use digital life-log images to investigate active and sedentary travel behaviour? Results from a pilot study International Journal of Behavioral Nutrition and Physical Activity 8 2011 44-
21. D.T. Kenrick, V. Griskevicius, S.L. Neuberg, and M. Schaller Renovating the pyramid of needs: contemporary extensions built upon ancient foundations Perspectives on Psychological Science 5 2010 292 314
22. G. Lakoff Women, Fire, and Dangerous Things 1990 University of Chicago Press
23. T.K. Landauer, P.W. Foltz, and D. Laham An introduction to latent semantic analysis Discourse Processes 1998 259 284
24. M. Law, S. Steinwender, and L. Leclair Occupation, health and well-being Canadian Journal of Occupational Therapy 65 1998 81 91
25. M.L. Lee, and A.K. Dey Lifelogging memory appliance for people with episodic memory impairment Proceedings of the 10th International Conference on Ubiquitous Computing, UbiComp '08 2008 ACM New York, NY, USA 44 53
26. W.H. Lin, and A.G. Hauptmann Which thousand words are worth a picture? Experiments on video retrieval using a thousand concepts IEEE International Conference on Multimedia and Expo 2006 IEEE Computer Society Los Alamitos, CA, USA 41 44
27. X. Ma, D. Schonfeld, and A.A. Khokhar Video event classification and image segmentation based on non-causal multi-dimensional hidden markov models Transactions on Image Processing 18 2009 1304 1313
28. A.H. Maslow A theory of human motivation Psychological Review 50 1943 370 396
29. K. McKenna, K. Broome, and J. Liddle What older people do: time use and exploring the link between role participation and life satisfaction in people aged 65 years and over Australian Occupational Therapy Journal 54 2007 273 284
30. R. Mégret, V. Dovgalecs, H. Wannous, S. Karaman, J. Benois-Pineau, E.E. Khoury, J. Pinquier, P. Joly, R. André-Obrecht, Y. Gaëstel, and J.F. Dartigues The IMMED project: wearable video monitoring of people with age dementia Proceedings of the International Conference on Multimedia, MM '10 2010 ACM New York, NY, USA 1299 1302
31. W. Mittelman Maslow's study of self-actualization-a reinterpretation Journal of Humanistic Psychology 31 1991 114 135
32. M. Naphade, J.R. Smith, J. Tesic, S.F. Chang, W. Hsu, L. Kennedy, A. Hauptmann, and J. Curtis Large-scale concept ontology for multimedia IEEE Multimedia 13 2006 86 91
33. M.R. Naphade, L. Kennedy, J.R. Kender, S.F. Chang, J.R. Smith, P. Over, A. Hauptmann, A light scale concept ontology for multimedia understanding for TRECVid 2005, Technical Report, IBM Research, 2005.
34. A. Nijholt, and Google home: Experience support and re-experience of social home activities Information Sciences 178 2008 612 630
35. L.R. Rabiner A tutorial on hidden markov models and selected applications in speech recognition Readings in Speech Recognition 1990 Morgan Kaufman Publishers Inc. San Francisco, CA, USA 267 296
36. S. Reddy, A. Parker, J. Hyman, J. Burke, D. Estrin, and M. Hansen Image browsing, processing, and clustering for participatory sensing: lessons from a dietsense prototype EmNets'07: Proceedings of the 4th Workshop on Embedded Networked Sensors 2007 ACM Press Cork, Ireland 13 17
37. M. Ros, M. Cuéllar, M. Delgado, and A. Vila Online recognition of human activities and adaptation to habit changes by means of learning automata and fuzzy temporal windows Information Sciences 220 2013 86 101
38. A.F. Smeaton, P. Over, and W. Kraaij Evaluation campaigns and TRECVid MIR '06: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval 2006 ACM Press New York, NY, USA 321 330
39. A.F. Smeaton, P. Over, and W. Kraaij High-level feature detection from video in TRECVid: a 5-year retrospective of achievements A. Divakaran, Multimedia Content Analysis, Theory and Applications 2009 Springer Verlag Berlin 151 174
40. C.G.M. Snoek, and M. Worring Concept-based video retrieval Foundations and Trends in Information Retrieval 2 2009 215 322
41. C.G.M. Snoek, M. Worring, J.C. van Gemert, J.M. Geusebroek, and A.W.M. Smeulders The challenge problem for automated detection of 101 semantic concepts in multimedia Proceedings of the 14th Annual ACM International Conference on Multimedia, MULTIMEDIA '06 2006 ACM New York, NY, USA 421 430
42. P.L. St. Jacques, M.A. Conway, M.W. Lowder, and R. Cabeza Watching my mind unfold versus yours: an fMRI study using a novel camera technology to examine neural differences in self-projection of self versus other perspectives Journal of Cognitive Neuroscience 23 2011 1275 1284
43. T.L.P. Tang, and A.H. Safwat Ibrahim Importance of human needs during retrospective peacetime and the persian gulf war: Mideastern employees International Journal of Stress Management 5 1998 25 37
44. T.L.P. Tang, W.B. Safwat Ibrahim, and H. Abdul West, effects of war-related stress on the satisfaction of human needs: the united states and the middle east International Journal of Management Theory and Practices 3 2002 35 53
45. P. Toharia, O. Robles, A.F. Smeaton, and A. Rodrguez Measuring the influence of concept detection on video retrieval X. Jiang, N. Petkov, Computer Analysis of Images and Patterns Lecture Notes in Computer Science vol. 5702 2009 Springer Berlin/Heidelberg 581 589
46. UK Government, Office for National Statistics (ONS), The United Kingdom 2000 time use survey, 2003. (Last accessed January 2012).
47. UK Government, Office for National Statistics (ONS), The Time Use Survey, 2005: How We Spend Our Time (Amended), 2006. (Last accessed January 2012).
48. A.V. Vasilakos, L. Wei, T.H.D. Nguyen, T.C.T. Qui, L.C. Chen, C. Boj, D. Diaz, A.D. Cheok, and G. Marentakis Interactive theatre via mixed reality and ambient intelligence Information Sciences 178 2008 679 693
49. P. Wang, and A.F. Smeaton Semantics-based selection of everyday concepts in visual lifelogging International Journal of Multimedia Information Retrieval 1 2012 87 101. 10.1007/s13735-012-0010-
50. L. Xie, S.F. Chang, A. Divakaran, and H. Sun Unsupervised mining of statistical temporal structures in video A. Rosenfeld, D. Doremann, D. Dementhon, Video Mining 2003 Kluwer Academic Publishers.
51. J.M. Zacks, T.S. Braver, M.A. Sheridan, D.I. Donaldson, A.Z. Snyder, J.M. Ollinger, R.L. Buckner, and M.E. Raichle Human brain activity time-locked to perceptual event boundaries Nature Neuroscience 4 2001 651 655