YouTube scale, large vocabulary video annotation

Studies in Computational Intelligence

Volumn 287, Issue , 2010, Pages 357-386

  Morsillo, Nicholas ^a   Mann, Gideon ^b   Pal, Christopher ^c  

^a University of Rochester   (United States)

^b GOOGLE INC   (United States)

^c ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77951750177     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-12900-1_14     Document Type: Article

References (48)

1. Andoni, A., Indyk, P.:Near-optimal hashing algorithms for approximate nearest neighbor in high dimensions. Communications of the ACM 51(1), 117-122 (2008)
2. Baluja, S., Seth, R., Sivakumar, D., Jing, Y., Yagnik, J., Kumar, S., Ravichandran, D., Aly, M.: Video suggestion and discovery for youtube: taking random walks through the view graph. In: WWW 2008: Proceeding of the 17th international conference on World Wide Web, pp. 895-904. ACM, New York (2008)
3. Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 245-250. ACM, New York (2001)
4. Bobick, A., Davis, J.W.: The recognition of human movement using temporal templates. IEEE PAMI 23, 257-267 (2001)
5. Boiman, O., Shechtman, E., Irani, M.: In defense of nearest-neighbor based imageclassification. In: Computer Vision and Pattern Recognition (2008)
6. Crandall, D., Backstrom, L., Huttenlocher, D., Kleinberg, J.: Mapping the world's photos. In: WWW(2009)
7. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. Computer Vision and Pattern Recognition 1, 886-893 (2005)
8. Dasgupta, S., Gupta, A.: An elementary proof of the Johnson-Lindenstrauss lemma. Tech. Rep. TR-99-106, Intl. Comput. Sci. Inst. (1999)
9. Dean, J., Ghemawat, S.: MapReduce: Simplified Data Processing on Large Clusters. In: OSDI (2004)
10. Duygulu, P., Barnard, K., de Freitas, J.F.G., Forsyth, D.A.: Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol.2353, pp. 97-112. Springer, Heidelberg (2002)
11. Everingham, M., Van Gool, L.,Williams, C.K.I.,Winn, J., Zisserman, A.: The PASCAL Visual Object Classes Challenge (VOC 2008) Results (2008), http://www.pascal-network.org/challenges/VOC/ voc2008/workshop/index.html
12. Fei-Fei, L., Fergus, R., Perona, P.: One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(4), 594-611 (2006)
13. Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. Computer Vision and Pattern Recognition 2, 524-531 (2005)
14. Feng, S., Manmatha, R., Lavrenko, V.: Multiple bernoulli relevance models for image and video annotation. In: Computer Vision and Pattern Recognition (2004)
15. Friedman, J., Bentley, J., Finkel, R.: An algorithm for finding best matches in logarithmic expected time. ACM transactions on mathematical software 3(3), 209-226 (1977)
16. Gionis, A., Indyk, P.,Motwani, R.: Similarity search in high dimensions via hashing. In: Proc. 25th Internat. Conf. on Very Large Data Bases (1999)
17. Griffin, G., Holub, A., Perona, P.: Caltech-256 object category dataset. Technical Report 7694, California Institute of Technology (2007)
18. Grubinger, M., Clough, P.D., Leung, C.: The iapr tc-12 benchmark for visual information search. IAPR Newsletter 28(2), 10-12 (2006)
19. Hauptmann, A., Christel, M.: Successful approaches in the TREC video retrieval evaluations. In: Proceedings of the 12th annual ACM international conference on Multimedia, pp. 668-675. ACM, New York (2004)
20. Hays, J., Efros, A.: Scene Completion Using Millions of Photographs. ACM Transactions on Graphics (SIGGRAPH 2007) 26(3) (2007)
21. Iyengar, G., Duygulu, P., Feng, S., Ircing, P., Khudanpur, S., Klakow, D., Krause, M., Manmatha, R., Nock, H., Petkova, D., et al.: Joint visual-text modeling for automatic retrieval ofmultimedia documents. In: Proceedings of the 13th annual ACM international conference on Multimedia, pp. 21-30. ACM, New York (2005)
22. Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: SIGIR 2003: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pp. 119-126. ACM, New York (2003)
23. Laptev, I., Marszalek, M., Schmid, C., Rozenfeld, B.: Learning realistic human actions from movies. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
24. Liu, T., Moore, A., Gray, A., Yang, K.: An investigation of practical approximate nearest neighbor algorithms. In: Advances in neural information processing systems (2004)
25. Liu, T., Rosenberg, C., Rowley, H.: Clustering billions of images with large scale nearest neighbor search. In: Proceedings of the Eighth IEEE Workshop on Applications of Computer Vision. IEEE Computer Society, Washington (2007)
26. Loui, A., Luo, J., Chang, S., Ellis, D., Jiang, W., Kennedy, L., Lee, K., Yanagawa, A.: Kodak's consumer video benchmark data set: concept definition and annotation. In: Proceedings of the international workshop on multimedia information retrieval, pp. 245-254. ACM, New York (2007)
27. Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91-110 (2004)
28. Makadia, A., Pavlovic, V., Kumar, S.:A New Baseline for Image Annotation. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol.5304, pp. 316-329. Springer, Heidelberg (2008)
29. Matas, J., Chum, O., Martin, U., Pajdla, T.: Robust wide baseline stereo from maximally stable extremal regions. In: BMVC, vol.1, pp. 384-393 (2002)
30. Messing, R., Pal, C.: Behavior recognition in video with extended models of feature velocity dynamics. Technical report, AAAI Spring Symposium Technical Reports (2009)
31. Mori, Y., Takahashi, H., Oka, R.: Image-to-word transformation based on dividing and vector quantizing images with words. In: International Workshop on Multimedia Intelligent Storage and Retrieval Management (1999)
32. Nist́er, D., Steẃenius, H.: Scalable recognition with a vocabulary tree. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2006, vol.2, pp. 2161-2168 (2006)
33. Omohundro, S.: Efficient algorithms with neural network behavior. Complex Systems 1(2), 273-347 (1987)
34. Over, P., Awad, G., Rose, T., Fiscus, J., Kraaij,W., Smeaton-Alan, A.: TRECVID 2008- Goals, Tasks, Data, Evaluation Mechanisms and Metrics (2008)
35. Polana, R., Nelson, R.: Detecting activities. In: Computer Vision and Pattern Recognition, CVPR 2003 (2003)
36. Russell, B., Torralba, A.,Murphy, K., Freeman,W.: LabelMe: a database and web-based tool for image annotation. International Journal of Computer Vision 77(1), 157-173 (2008)
37. Schindler, G., Brown, M., Szeliski, R.: City-scale location recognition. In: IEEE Conf. on Computer Vision and Pattern Recognition, CVPR (2007)
38. Schuldt, C., Laptev, I., Caputo, B.: Recognizing human actions: A local svm approach. In: International Conference on Pattern Recognition (2004)
39. Shakhnarovich, G., Viola, P., Darrell, T.: Fast pose estimation with parameter-sensitive hashing. In: Ninth IEEE International Conference on Computer Vision (2003)
40. Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Ninth IEEE International Conference on Computer Vision (2003)
41. Smeaton, A., Over, P., Kraaij, W.: Evaluation campaigns and TRECVid. In: Proceedings of the 8th ACM international workshop on Multimedia information retrieval, pp. 321-330. ACM, New York (2006)
42. Torralba, A., Fergus, R., Freeman, W.T.: 80 million tiny images: a large dataset for nonparametric object and scene recognition. IEEE PAMI (2008)
43. Uhlmann, J.: Satisfying general proximity/similarity queries with metric trees. Information Processing Letters 40(4), 175-179 (1991)
44. Ulges, A., Schulze, C., Keysers, D., Breuel, T.: A System that Learns to Tag Videos by Watching Youtube. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol.5008, p. 415. Springer, Heidelberg (2008)
45. Von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 319-326. ACM, New York (2004)
46. Von Ahn, L., Liu, R., Blum, M.: Peekaboom: a game for locating objects in images. In: Proceedings of the SIGCHI conference on Human Factors in computing systems, pp. 55-64. ACM, New York (2006)
47. Witten, I., Moffat, A., Bell, T.: Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann, San Francisco (1999)
48. Zanetti, S., Zelnik-Manor, L., Perona, P.: A walk through the webs video clips. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (2008)