A language-based approach to indexing heterogeneous multimedia lifelog

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction, ICMI-MLMI 2010

Volumn , Issue , 2010, Pages

  Cheng, Peng Wen ^a   Chennuru, Snehal ^a   Buthpitiya, Senaka ^a   Zhang, Ying ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

activity languages; indexing heterogeneous multimedia; lifelogs

Indexed keywords

ACTIVITY LANGUAGES; HIGH LEVEL SEMANTICS; HIGH-DIMENSIONAL; INDEXING HETEROGENEOUS MULTIMEDIA; LIFE LOG; LIFE-LOG DATA; LIFELOGS; MULTIMEDIA DATABASE; SENSORY DATA; STATISTICAL NATURAL LANGUAGE PROCESSING; SYSTEM SUPPORTS; TEXT REPRESENTATION; VANNEVAR BUSHES;

CHARACTER RECOGNITION; COMPUTATIONAL LINGUISTICS; INDEXING (OF INFORMATION); INTERACTIVE COMPUTER SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS; SEMANTICS;

HIGH LEVEL LANGUAGES;

EID: 78650933202     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1891903.1891937     Document Type: Conference Paper

References (20)

1. R. Aipperspach, E. Cohen, and J. Canny. Modeling human behavior from simple sensors in the home. In Proceedings of IEEE Conf. on Pervasive Computing, pages 337-348, Dublin, Ireland, April 2006.
2. K. Aizawa, D. Tancharoen, S. Kawasaki, and T. Yamasaki. Efficient retrieval of life log based on context and content. In CARPE'04: Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences, pages 22-31, New York, NY, USA, 2004. ACM.
3. R. Brookmeyer, E. Johnson, K. Ziegler-Graham, and H. M. Arrighi. Forecasting the global burden of alzheimer's disease. Alzheimer's and Dementia, 3(3):186-191, July 2007. predicted 107 million people will suffer from Alzheimer by 2050.
4. K. Burke. Language as Symbolic Action. University of California Press, 1966.
5. B. Clarkson and A. Pentland. Unsupervised clustering of ambulatory audio and video. In ICASSP '99: Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference, pages 3037-3040, Washington, DC, USA, 1999. IEEE Computer Society.
6. S. Fine, Y. Singer, and N. Tishby. The hierarchical hidden markov model: Analysis and applications. Mach. Learn., 32(1):41-62, 1998.
7. J. Gemmell, G. Bell, R. Lueder, S. Drucker, and C. Wong. Mylifebits: fulfilling the memex vision. In MULTIMEDIA '02: Proceedings of the tenth ACM international conference on Multimedia, pages 235-238, New York, NY, USA, 2002. ACM.
8. F. Giannotti, M. Nanni, F. Pinelli, and D. Pedreschi. Trajectory pattern mining. In KDD '07: Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 330-339, New York, NY, USA, 2007. ACM.
9. I. jae Kim, S. C. Ahn, and H. gon Kim. Personalized life log media system in ubiquitous environment. Lecture Notes in Computer Science, 4412, 2006.
10. I.-J. Kim, S. C. Ahn, H. Ko, and H. G. Kim. Automatic lifelog media annotation based on heterogeneous sensor fusion. In Proceedings of IEEE International Conference on Multi Sensor fu-sion and Integration for Intelligent systems, Seoul, Korea, August 20-22 2008.
11. U. Manber and G. Myers. Suffix arrays: a new method for on-line string searches. SIAM J. Comput., 22(5):935-948, 1993.
12. L. Neergaard. Report: 35 million-plus worldwide have dementia. Associate Press, Sep. 21 2009.
13. A. Nguyen, D. Moore, and I. McCowan. Unsupervised clustering of free-living human activities using ambulatory accelerometry. In Proceedings of the 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), pages 4895-4898, Lyon, France, Aug 22-26 2007.
14. N. Oliver, E. Horvitz, and A. Garg. Layered representations for human activity recognition. In ICMI '02: Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, page 3, Washington, DC, USA, 2002. IEEE Computer Society.
15. K. Papineni, S. Roukos, T. Ward, and W. Zhu. Bleu: a method for automatic evaluation of machine translation. Technical Report RC22176(W0109-022), IBM Research Division, Thomas J. Watson Research Center, 2001.
16. D. Patterson, L. Liao, D. Fox, and H. Kautz. Inferring high-level behavior from low-level sensors. In Proceedings of the Fifth International Conference on Ubiquitous Computing (UbiComp 2003), pages 73-89, Seattle, Washington, October 12-15 2003.
17. A. Stolcke. Srilm - an extensible language modeling toolkit. In Proc. Intl. Conf. on Spoken Language Processing, volume 2, pages 901-904, Denver, CO, 2002.
18. K. Takata, J. Ma, B. O. Apduhan, R. Huang, and Q. Jin. Modeling and analyzing individual's daily activities using lifelog. In ICESS '08: Proceedings of the 2008 International Conference on Embedded Software and Systems, pages 503-510, Washington, DC, USA, 2008. IEEE Computer Society.
19. J. V. Wertsch. Mind As Action. Oxford University Press, USA, 1998.
20. L. Xie, S.-F. Chang, A. Divakaran, and H. Sun. Unsupervised discovery of multilevel statistical video structures using hierarchical hidden markov models. In ICME '03: Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03), pages 29-32, Washington, DC, USA, 2003. IEEE Computer Society.