Playing games as a way to improve automatic image annotation

2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops

Volumn , Issue , 2008, Pages

  Jesus, Rui ^a,b   Gonçalves, Duarte ^a   Abrantes, Arnaldo J ^b   Correia, Nuno ^a  

^a UNIVERSIDADE NOVA DE LISBOA   (Portugal)

^b INSTITUTO SUPERIOR DE ENGENHARIA DE LISBOA   (Portugal)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER VISION; FEATURE EXTRACTION; GAME THEORY; IMAGE ANALYSIS; IMAGE CLASSIFICATION; IMAGE PROCESSING; INFORMATION THEORY; INTERFACES (COMPUTER); PATTERN RECOGNITION;

3D GAME; AUTOMATIC ANNOTATION; AUTOMATIC IMAGE ANNOTATION; AUTOMATIC IMAGE CLASSIFICATION; AUTOMATIC WAY; COMPUTER GAMES; GAME ENGINES; HUMAN INTERVENTION; IMAGE ANNOTATION; SEMANTIC MODELING; SEMI-AUTOMATIC ANNOTATION; TRAINING SETS; USABILITY TESTING;

THREE DIMENSIONAL;

EID: 51849147880     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPRW.2008.4563045     Document Type: Conference Paper

References (31)

1. A. Smeulders, Worring, M., Santini, S., Gupta, A., and Jain, A., "Content-based image retrieval at the end of the early years," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22 (12), pp. 1349-1380, 2000.
2. X. Zhou, and Huang, T., "Relevance feedback in image retrieval: A comprehensive review," Multimedia Systems, vol. 8(6), pp. 536-544, 2003.
3. J. Kustanowitz, and Shneiderman, B., "Motivating annotation for personal digital photo libraries: Lowering barriers while raising incentives," Technical report, HCIL, Univ. of Maryland, 2004.
4. M. Lew, Sebe, N., Djeraba, C., and Jain R., "Content-based Multimedia Information Retrieval: State-of-the-art and Challenges," A CM Transactions on Multimedia Computing, Communication, and Applications, vol. 2 (1), pp. 1-19, 2006.
5. P. Over, Ianeva, T., Kraaij, W., Smeaton, A., "Trecvid 2006 overview," NIST TRECVID-2006, 2006.
6. D. Frohlich, Kuchinsky, A., Pering, C., Don, A., and Ariss, S., "Requirements for Photoware," Proc. of the ACM conference on Computer supported cooperative work pp. 166-175, 2002.
7. L. Wenyin, Dumais, S., Sun, Y., Zhang, H., Czerwinski, M., Field, B., "Semi-Automatic Image Annotation," Human-Computer Interaction-Interact '01, 2001.
8. L. von Ahn, Dabbish, L., "Labeling images with a computer game," Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI'04, pp. 319-326, 2004.
9. K. Barnard, Forsyth, D., "Learning the semantics of words and pictures," International Conference on Computer Vision, pp. 408-415, 2001.
10. J. Li, Wang, J., "Real-time computerized annotation of pictures," ACM International Conference on Multimedia, pp. 911-920, 2006.
11. P. Duygulu, Barnard, K., Freitas, J., Forsyth, D., "Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary," Proceedings of the 7th European Conference on Computer Vision, LNCS, vol. 2353, Springer pp. 97-112, 2002.
12. V. Lavrenko, Manmatha, R., Jeon, J., "A model for learning the semantics of pictures," Neural Information Processing System Conference, 2003.
13. M. Naphade, and Huang, T., "A probabilistic framework for semantic video indexing, filtering, and retrieval," IEEE Transactions on Multimedia, vol. 3 (1), pp. 141-151, 2001.
14. F. Monay, Gatica-Perez, D., "On image auto-annotation with latent space models," Proceedings of the Eleventh ACM international Conference on Multimedia, pp. 275-278, 2003.
15. J. Fan, Gao, Y., Luo, H., "Hierarchical classification for automatic image annotation.," Proceedings of the 30th Annual international ACM SIGIR Conference on Research and Development in information Retrieval, pp. 111-118, 2007.
16. J. Magalhães, Rüger, S., "Information-theoretic semantic multimedia indexing," Proceedings of the 6th ACM international Conference on Image and Video Retrieval, pp. 619-626, 2007.
17. A. Yavlinsky, Schofield, E., Rüger, S., "Automated image annotation using global features and robust nonparametric density estimation," International Conference on Image and Video Retrieval, pp. 507-517, 2005.
18. Y. Mori, Takahashi, H., and Oka, R., "Image-to-word transformation based on dividing and vector quantizing images with words," Proceedings of the International Workshop on Multimedia Intelligent Storage and Retrieval Management, 1999.
19. L. Jiebo, Boutell, M., and Brown, C., "Pictures are not taken in a vacuum - an overview of exploiting context for semantic scene content understanding," Signal Processing Magazine, IEEE, vol. 23 (2), pp. 101-114, 2006.
20. X. Wang, Zhang, L., Jing, F., Ma, W., "AnnoSearch: Image Auto-Annotation by Search," Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1483-1490, 2006.
21. S. Chang, Chen, W., Sundaram, H., "Semantic visual templates: linking visual features to semantics," International Conference on Image Processing (ICIP), Workshop on Content Based Video Search and Retrieval, vol. 3, pp. 531-534, 1998.
22. Y. Lu, Hu, C., Zhu, X., Zhang, H., Yang, Q., "A Unified Framework for Semantics and Feature Based Relevance Feedback in Image Retrieval Systems," Proceedings ACM Multimedia, pp. 31-38, 2000.
23. M. Davis, King, S., Good N., Sarvas, R., "From Context to Content: Leveraging Context to Infer Media Metadata," Proc. of ACM International Conference on Multimedia pp. 188-195, 2004.
24. R. Jesus, Dias, R., Frias, R., Abrantes, A., Correia, N., "Sharing Personal Experiences while Navigating in Physical Spaces", 5th Workshop on Multimedia Information Retrieval, ACM SIGIR Conference on Research and Development in information Retrieval (SIGIR07), 2007.
25. R. Yan, Natsev, A., Campbell, M., "An efficient manual image annotation approach based on tagging and browsing," Workshop on Multimedia information Retrieval on the Many Faces of Multimedia Semantics, pp. 13-20, 2007.
26. V. Tuulos, Scheible, J., Nyholm, H., "Combining Web, Mobile Phones and Public Displays in Large-Scale: Manhattan Story Mashup," Proceedings of the Fifth International Conference on Pervasive Computing, 2007.
27. S. Tong, Chang, E., "Support vector machine active learning for image retrieval," MULTIMEDIA'01: Proceedings of the ninth ACM international conference on Multimedia, ACM Press, pp. 107-118, 2001.
28. P. Yin, Bhanu, B., Chang, K., and Dong, A., "Reinforcement Learning for Combining Relevance Feedback Techniques.," proceedings of the Ninth IEEE international Conference on Computer Vision, vol. 2, pp. 150, 2003.
29. T. Poggio, and Smale, S., "The mathematics of learning: Dealing with data," Notice of American Mathematical Society, 2003.
30. J. C. Platt, "Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods," Advances in Large Margin Classifiers, pp. 61-74, 1999.
31. D. Gonçalves, Jesus R., Correia, N., "A Gesture Based Game for Image Tagging". Extented Abstract in ACM Conference on Human Factors in Computing Systems (CHI 2008), pp. 2685-2690, 2008.