Everyday concept detection in visual lifelogs: Validation, relationships and trends

Multimedia Tools and Applications

Volumn 49, Issue 1, 2010, Pages 119-144

  Byrne, Daragh ^a   Doherty, Aiden R ^a   Snoek, Cees G M ^b   Jones, Gareth J F ^a   Smeaton, Alan F ^a  

^a DUBLIN CITY UNIVERSITY   (Ireland)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Concept detection; Lifelog; Microsoft SenseCam; Passive photos; Supervised learning

Indexed keywords

CONCEPT DETECTION; DETECTOR MODELS; HIGH LEVEL SEMANTICS; IMAGE DATA; LIFE LOG; MICROSOFT SENSECAM; PASSIVE PHOTOS; SEMANTIC CONCEPT; SEMANTIC CONCEPT DETECTION; SENSECAM; SENSOR READINGS; SUPERVISED MACHINE LEARNING; TEMPORAL CONSISTENCY; TYPICAL DAY; VIDEO RETRIEVAL; VISUAL FEATURE; WEARABLE CAMERAS;

DIGITAL STORAGE; SENSORS; SUPERVISED LEARNING;

SEMANTICS;

EID: 77952954642     PISSN: 13807501     EISSN: 15737721     Source Type: Journal    
DOI: 10.1007/s11042-009-0403-8     Document Type: Article

References (37)

1. Bell G, Gemmell J (2007) A digital life. Scientific American, New York
2. A Bovik M Clark W Geisler 1990 Multichannel texture analysis using localized spatial filters IEEE Trans Pattern Anal Mach Intell 12 1 55 73 10.1109/34.41384 (Pubitemid 20653599)
3. Byrne D, Doherty AR, Snoek CG, Jones GG, Smeaton AF (2008) Validating the detection of everyday concepts in visual lifelogs. In: SAMT '08: proceedings of the 3rd international conference on semantic and digital media technologies. Springer, Berlin, pp 15-30
4. Byrne D, Lavelle B, Doherty AR, Jones GJF, Smeaton AF (2007) Using bluetooth and GPS metadata to measure event similarity in sensecam images. In: IMAI'07 - 5th international conference on intelligent multimedia and ambient intelligence, Salt Lake City, pp 1454-1460
5. Chang CC, Lin CJ (2001) LIBSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm
6. Chang SF, He J, Jiang YG, Khoury EE, Ngo CW, Yanagawa A, Zavesky E (2008) Columbia University/VIREO-CityU/IRIT TRECVid2008 High-Level feature extraction and interactive video search. In: Proceedings of TRECVid workshop, Gaithersburg, 2008
7. DeVaul R (2001) Real-time motion classification for wearable computing applications. Tech. rep., Massachusetts Institute of Technology, MIT, Cambridge
8. Doherty A, Smeaton AF (2008) Combining face detection and novelty to identify important events in a visual lifelog. In: CIT 2008-IEEE international conference on computer and information technology, workshop on image- and video-based pattern analysis and applications, Sydney
9. Doherty AR, Byrne D, Smeaton AF, Jones GJF, Hughes M (2008) Investigating keyframe selection methods in the novel domain of passively captured visual lifelogs. In: CIVR '08: proceedings of the 2008 international conference on content-based image and video retrieval, Niagara Falls, Canada. ACM, New York, pp 259-268
10. Doherty AR, Smeaton AF (2008) Automatically segmenting lifelog data into events. In: WIAMIS '08: proceedings of the 2008 ninth international workshop on image analysis for multimedia interactive services, Klagenfurt, Germany. IEEE Computer Society, Washington, DC, pp 20-23
11. J Fleiss 1971 Measuring nominal scale agreement among many raters Psychol Bull 76 5 378 382 10.1037/h0031619
12. Fuller M, Kelly L, Jones GJF (2008) Applying contextual memory cues for retrieval from personal information archives. In: PIM 2008 - proceedings of personal information management, workshop at CHI 2008
13. Geusebroek JM (2006) Compact object descriptors from local colour invariant histograms. In: British machine vision conference, vol 3, pp 1029-1038
14. JM Geusebroek AWM Smeulders 2005 A six-stimulus theory for stochastic texture Int J Comput Vis 62 7 16
15. Gurrin C, Smeaton AF, Byrne D, O'Hare N, Jones GJF, O'Connor NE (2008) An examination of a large visual lifelog. In: AIRS 2008-Asia information retrieval symposium, Harbin
16. Hauptmann A, Yan R, Lin WH (2007) How many high-level concepts will fill the semantic gap in news video retrieval? In: CIVR '07: proceedings of the 6th ACM international conference on image and video retrieval. ACM, New York, pp 627-634 (Pubitemid 350229681)
17. MA Hoang JM Geusebroek AWM Smeulders 2005 Color texture measurement and segmentation Signal Process 85 2 265 275 1148.94311 10.1016/j.sigpro.2004.10.009 (Pubitemid 41536590)
18. Hodges S, Williams L, Berry E, Izadi S, Srinivasan J, Butler A, Smyth G, Kapur N, Wood K (2006) SenseCam: a retrospective memory aid. In: UbiComp - 8th international conference on ubiquitous computing, Calif., USA
19. Jiang YG, Ngo CW, Yang J (2007) Towards optimal bag-of-features for object categorization and semantic video retrieval. In: CIVR '07: proceedings of the 6th ACM international conference on image and video retrieval. ACM, New York, NY, USA, pp 494-501
20. Jurie F, Triggs B (2005) Creating efficient codebooks for visual recognition. In: Computer vision, 2005. ICCV 2005. Tenth IEEE international conference on 1, 604-610, vol 1
21. J Kapur P Sahoo A Wong 1985 A new method for gray-level picture thresholding using the entropy of the histogram Comput Vis Graph Image Process 29 3 273 285 10.1016/0734-189X(85)90125-2
22. JR Landis GG Koch 1977 The measurement of observer agreement for categorical data Biometrics 33 1 159 174 0351.62039 10.2307/2529310 483213
23. Lee H, Smeaton AF, O'Connor NE, Jones GJ (2006) Adaptive visual summary of lifelog photos for personal information management. In: AIR Workshop-1st international workshop on adaptive information retrieval, Glasgow, pp 22-23
24. HT Lin CJ Lin R Weng 2007 A note on Platt's probabilistic outputs for support vector machines Mach Learn 68 3 267 276 10.1007/s10994-007-5018-6 (Pubitemid 47312490)
25. H Naphade T Huang 2001 A probabilistic framework for semantic video indexing, filtering, and retrieval IEEE Trans Multimedia 3 1 141 151 10.1109/6046.909601 (Pubitemid 32248394)
26. Naphade MR, Kennedy L, Kender JR, Chang SF, Smith JR, Over P, Hauptmann A (2005) A light scale concept ontology for multimedia understanding for TRECVid 2005. Tech. rep., In IBM Research Technical Report
27. Natsev A, Jiangy W, Merlery M, Smith JR, Tesic J, Xie L, Yan R (2008) IBM research TRECVid-2008 video retrieval system. In: Proceedings of TRECVid workshop, 2008, Gaithersburg
28. O'Hare N, Lee H, Cooray S, Gurrin C, Jones GJF, Malobabic J, O'Connor NE, Smeaton AF, Uscilowski B (2006) MediAssist: using content-based analysis and context to manage personal photo collections. In: CIVR2006 - 5th international conference on image and video retrieval. Springer, Tempe, pp 529-532
29. Smeaton A, Over P, Kraaij W (2006) Evaluation campaigns and TRECVid. In: Proceedings of the 8th ACM international workshop on multimedia information retrieval. ACM, New York, pp 321-330 (Pubitemid 47168230)
30. Snoek CGM, Everts I, van Gemert JC, Geusebroek JM, Huurnink B, Koelma DC, van Liempt M, de Rooij O, van de Sande KEA, Smeulders AWM, Uijlings JRR, Worring M (2007) The MediaMill TRECVid 2007 semantic video search engine. In: Proceedings of TRECVid workshop, Gaithersburg, 2007
31. Snoek CGM, van Gemert JC, Gevers T, Huurnink B, Koelma DC, van Liempt M, de Rooij O, van de Sande KEA, Seinstra FJ, Smeulders AWM, Thean AHC, Veenman CJ, Worring M (2006) The MediaMill TRECVID 2006 semantic video search engine. In: Proceedings of the TRECVID workshop, Gaithersburg
32. Snoek CGM, Worring M, van Gemert JC, Geusebroek JM, Smeulders AWM (2006) The challenge problem for automated detection of 101 semantic concepts in multimedia. In: MULTIMEDIA '06: proceedings of the 14th annual ACM international conference on multimedia, Santa Barbara, CA, USA. ACM, New York, pp 421-430 (Pubitemid 47113558)
33. JC van Gemert CGM Snoek CJ Veenman AWM Smeulders JM Geusebroek 2009 Comparing compact codebooks for visual categorization Comput Vis Image Underst 10.1016/j.cviu.2009.08.004
34. Vapnik VN (2000) The nature of statistical learning theory, 2nd edn. Springer, New York
35. Wang D, Liu X, Luo L, Li J, Zhang B (2007) Video diver: generic video indexing with diverse features. In: MIR '07: proceedings of the 9th ACM international workshop on workshop on multimedia information retrieval, Augsburg, Germany. ACM, New York, pp 61-70
36. Yanagawa A, Chang SF, Kennedy L, Hsu W (2007) Columbia University's baseline detectors for 374 LSCOM semantic visual concepts. Tech. rep., Columbia University
37. Yang J, Hauptmann AG (2006) Exploring temporal consistency for video analysis and retrieval. In: MIR '06: proceedings of the 8th ACM international workshop on multimedia information retrieval, Santa Barbara, pp 33-42 (Pubitemid 47168199)