Matching Words and Pictures

Journal of Machine Learning Research

Volumn 3, Issue 6, 2003, Pages 1107-1135

  Barnard, Kobus ^a   Duygulu, Pinar ^b   Forsyth, David ^c   De Freitas, Nando ^d   Blei, David M ^c   Jordan, Michael I ^c  

^a University of Arizona   (United States)

^b MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; HIERARCHICAL SYSTEMS; LEARNING SYSTEMS;

DATA SETS;

IMAGE SEGMENTATION;

EID: 0041876117     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/153244303322533214     Document Type: Conference Paper

References (39)

1. L. H. Armitage and P. G. B. Enser. Analysis of user need in image archives. Journal of Information Science, 23(4):287-299, 1997.
2. K. Barnard, P. Duygulu, and D. A. Forsyth. Clustering art. In IEEE Conference on Computer Vision and Pattern Recognition, pages II:434-441, Hawaii, 2001.
3. K. Barnard and D. A. Forsyth. Learning the semantics of words and pictures. In International Conference on Computer Vision, pages II:408-415, 2001.
4. D. Blei and M. Jordan. Modeling annotated data. Technical Report CSD-02-1202, U.C. Berkeley CS Division, 2002.
5. D. Blei, A. Ng, and M. Jordan. Latent Dirichlet allocation. In Advances in Neural Information Processing Systems 14, 2002.
6. P. F. Brown, S. A. Della Pietra, V. J. Della Pietra, and R. L. Mercer. The mathematics of machine translation: Parameter estimation. Computational Linguistics, 19(10):263-311, 1993.
7. C. Carson, S. Belongie, H. Greenspan, and J. Malik. Blobworld: Image segmentation using expectation-maximization and its application to image querying. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(8): 1026-1038, 2002.
8. G. Celeux, D. Chauveau, and J. Diebolt. On stochastic versions of the EM algorithm. Technical report 2514, INRIA, March 1995.
9. F. Chen, U. Gargi, L. Niles, and H. Schtze. Multi-modal browsing of images in web documents. In SPIE Document Recognition and Retrieval, 1999.
10. J. Chen, C. A. Bouman, and J. C. Dalton. Hierarchical browsing and search of large image databases. IEEE Transactions on Image Processing, 9(3):442-455, 2000.
11. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39:1-38, 1977.
12. P. Duygulu, Kobus B., J. F. G de Freitas, and D. A. Forsyth. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. In The Seventh European Conference on Computer Vision, pages IV:97-112, 2002.
13. P. G. B. Enser. Query analysis in a visual information retrieval context. Journal of Document and Text Management, 1(1):25-39, 1993.
14. P. G. B. Enser. Progress in documentation pictorial information retrieval. Journal of Documentation, 51(2):126-170, 1995.
15. M. M. Fleck, D. A. Forsyth, and C. Bregler. Finding naked people. In Bernard Buxton and Roberto Cipolla, editors, 4th European Conference on Computer Vision, pages II:591-602. Springer, 1996.
16. D. A. Forsyth. Computer vision tools for finding images and video sequences. Library Trends, 48 (2):326-355, 1999.
17. D. A. Forsyth and J. Ponce. Computer Vision - A Modern Approach. Prentice-Hall, 2002.
18. C. O. Frost, B. Taylor, A. Noakes, S. Markel, D. Torres, and K. M. Drabenstott. Browse and search patterns in a digital image database. Information retrieval, 1:287-313, 2000.
19. T. Hofmann. Learning and representing topic. A hierarchical mixture model for word occurrence in document databases. In Workshop on learning from text and the web, CMU, 1998.
20. T. Hofmann and J. Puzicha. Statistical models for co-occurrence data. A.I. Memo 1635, Massachusetts Institute of Technology, 1998.
21. R. Jonker and A. Volgenant. A shortest augmenting path algorithm for dense and sparse linear assignment problems. Computing, 38:325-340, 1987.
22. D. Jurafsky and J.H. Martin. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition. Prentice-Hall, 2000.
23. L.H. Keister. User types and queries: impact on image access systems. In Challenges in indexing electronic text and images. Learned Information, 1994.
24. M. La Cascia, S. Sethi, and S. Sclaroff. Combining textual and visual cues for content-based image retrieval on the world wide web. In IEEE Workshop on Content-Based Access of Image and Video Libraries, 1998.
25. C. Manning and H. Schütze. Foundations of Statistical Natural Language Processing. MIT Press. Cambridge, MA, 1999.
26. M. Markkula and E. Sormunen. End-user searching challenges indexing practices in the digital newspaper photo archive. Information retrieval, 1:259-285, 2000.
27. O. Maron. Learning from Ambiguity. Ph.D. dissertation, Massachusetts Institute of Technology, 1998.
28. O. Maron and A.L. Ratan. Multiple-instance learning for natural scene classification. In The Fifteenth International Conference on Machine Learning, 1998.
29. D. Melamed. Empirical methods for exploiting parallel texts. MIT Press, Cambridge, Massachusetts, 2001.
30. Y. Mori, H. Takahashi, and R. Oka. Image-to-word transformation based on dividing and vector quantizing images with words. In First International Workshop on Multimedia Intelligent Storage and Retrieval Management (in conjunction with ACM Multimedia Conference 1999), Orlando, Florida, 1999.
31. M. Oren, C. Papageorgiou, P. Sinha, and E. Osuna. Pedestrian detection using wavelet templates. In Computer vision and pattern recognition, pages 193-9, 1997.
32. S. Ornager. View a picture: Theoretical image analysis and empirical user studies on indexing and retrieval. Swedis Library Research, 2(3):31-41, 1996.
33. Shin'ichi Satoh and T. Kanade. Name-it: Association of face and name in video. In Proceedings of 1997 IEEE Computer Vision and Pattern Recognition (CVPR '97), pages 368-373, June 1997.
34. H. Schneiderman and T. Kanade. A statistical approach to 3d object recognition applied to faces and cars. In IEEE Conference on Computer Vision and Pattern Recognition, page 100. IEEE, 2000.
35. J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(9):888-905, 2000.
36. R. K. Srihari. Extracting Visual Information from Text: Using Captions to Label Human Faces in Newspaper Photographs. Ph.d. thesis, SUNY at Buffalo, 1991.
37. R. K. Srihari and D. T. Burhans. Visual semantics: Extracting visual information from text accompanying pictures. In AAAI'94, Seattle, WA, 1994.
38. R. K. Srihari, R. Chopra, D. Burhans, M. Venkataraman, and V. Govindaraju. Use of collateral text in image interpretation. In ARPA Image Understanding Workshop, Monterey, CA, 1994.
39. M. J. Swain, C. Frankel, and V. Athitsos. Webseer: An image search engine for the world wide web. Technical Report TR-96-14, Computer Science Department, University of Chicago, 1996.