Learning structured visual detectors from user input at multiple levels

International Journal of Image and Graphics

Volumn 1, Issue 3, 2001, Pages 415-444

  Jaimes, Alejandro ^a   Chang, Shih Fu ^a  

^a Columbia University ^*  (United States)

Author keywords

Content Based Retrieval; Machine Learning; Model Based Classifiers; Structured Visual Detectors; User Input; Video Image Classification; Visual Semantics

Indexed keywords

BASEBALL; CLASSIFICATION (OF INFORMATION); CONTENT BASED RETRIEVAL; IMAGE CLASSIFICATION; LEARNING SYSTEMS; MACHINE LEARNING; OBJECT DETECTION; SEMANTICS; TEXTURES;

BASEBALL VIDEOS; CROSS VALIDATION; DYNAMIC APPROACHES; DYNAMIC CONSTRUCTION; LEARNING TECHNIQUES; MODEL-BASED CLASSIFIERS; USER INPUT; VISUAL SEMANTICS;

LEARNING ALGORITHMS;

EID: 0038573163     PISSN: 02194678     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219467801000256     Document Type: Article

References (80)

1. A. Jaimes and S.-F. Chang, \A conceptual framework for indexing visual information at multiple levels," in Proceedings of SPIE Internet Imaging 2000 3964, 2 (2000).
2. L. D. Bergman and V. Castelli (eds.), Image Databases, Search and Retrieval of Digital Imagery (John Wiley &Sons, New York), forthcoming.
3. A. Del Bimbo, Visual Information Retrieval (Morgan Kaufmann Publishers, San Francisco, USA, 1999).
4. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, \Content-based image retrieval at the end of the early years," IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI ) 22(12), 1349 (2000).
5. Y. Rui, T. S. Huang, and S.-F. Chang, \Image retrieval: Current directions, promising techniques, and open issues," J. Visual Commun. Image Representation 10, 1 (1999).
6. A. Yoshitaka and T. Ichikawa, \A survey on content-based retrieval for multimedia databases," IEEE Trans. Knowledge and Data Eng. 11(1), 81 (1999).
7. S.-F. Chang, Q. Huang, T. S. Huang, A. Puri, and B. Shahraray, \Multimedia search and retrieval," in Advances in Multimedia: Systems, Standards and Networks, eds. A. Puri and T. Chen (Marcel Dekker, 1999).
8. S.-F. Chang, J. R. Smith, M. Beigi, and A. Benitez, \Visual information retrieval from large distributed on-line repositories," Commun. ACM 40(12), 63 (1997).
9. A. Jaimes and S.-F. Chang, \Concepts and techniques for indexing visual semantics," in Image Databases, Search and Retrieval of Digital Imagery, eds. L. D. Bergman and V. Castelli (John Wiley &Sons, New York), forthcoming.
10. C. Jorgensen, A. Jaimes, A. B. Benitez, and S.-F. Chang, \A conceptual framework and research for classifying visual descriptors," invited paper, J. Amer. Society for Information Sci. (JASIS), Special Issue on \Image Access: Bridging Multiple Needs and Multiple Perspectives," Fall 2001, to appear.
11. D. A. Forsyth and M. Fleck, \Body plans," in Proceedings of IEEE Computer Vision and Pattern Recognition (CVPR '97), San Juan, Puerto Rico, 1997, pp. 678{683.
12. M. Szummer and R. W. Picard, \Indoor-outdoor image classification," in Proceedings of IEEE International Workshop on Content-based Access of Image and Video Databases, Bombay, India, 1998, pp. 42{51.
13. A. Vailaya, M. Figueiredo, A. Jain, and H. J. Zhang, \Image classification for contentbased indexing," IEEE Trans. Image Processing 10(1), 117 (2001).
14. S.-F. Chang, T. Sikora, and A. Puri, \Overview of the MPEG-7 Standard," IEEE Trans. Circuits Syst Video Technology, Special Issue on MPEG-7, June 2001.
15. MPEG Multimedia Description Scheme Group, \Text of ISO/IEC CD 15938-5 information technology | Multimedia content description interface: Multimedia description schemes," ISO/IEC JTC1/SC29/WG11 MPEG00/N3705, La Baule, France, Oct. 2000 (see also MPEG-7 website: http://drogo.cselt.stet.it).
16. T. Mitchell, Machine Learning (McGraw-Hill, New York, 1997).
17. G. Briscoe and T. Caelli (eds.) A Compendium of Machine Learning, Ablex Series in Artificial Intelligence (Norwood, NJ, 1996).
18. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification (John Wiley &Sons, New York, 2001).
19. D. Aha (Ed.), Lazy Learning (Kluwer Academic Publishers, The Netherlands, 1997).
20. A. Jaimes and S.-F. Chang, \Model-based classification of visual information for content-based retrieval," in Proceedings of SPIE Storage and Retrieval for Image and Video Databases VII 3656, 402 (1999).
21. A. Jaimes and S.-F. Chang, \Integrating multiple classifiers in visual object detectors learned from user input," invited paper, in Session on Image and Video Databases, 4th Asian Conference on Computer Vision (ACCV 2000), Vol. 1, Taipei, Taiwan, January 8{11, 2000, pp. 376{381.
22. A. Jaimes and S.-F. Chang, \Automatic selection of visual features and classifiers," in Proceedings of SPIE Storage and Retrieval for Media Databases 2000 3972, 346 (2000).
23. W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, and G. Taubin, \The QBIC project: Quering images by content using color, texture, and shape," in Proceedings of SPIE Storage and Retrieval for Image and Video Databases 1908, 173 (1993).
24. J. R. Smith and S.-F. Chang. \VisualSEEk: A fully automated content-based image query system," in Proceedings of the ACM Conference on Multimedia (ACM MM '96 ), November 1996, pp. 87{98.
25. S.-F. Chang, W. Chen, H. J. Meng, H. Sundaram, and D. Zhong, \A fully automatic content-based video search engine supporting multi-object spatio-temporal queries," IEEE Trans. Circuits Syst. Video Technology, Special Issue on Image and Video Processing for Interactive Multimedia 8(5), 602 (1998).
26. J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. C. Jain, and C. Shu, \The VIRAGE image search engine: An open framework for image management," in Proceedings of SPIE Storage and Retrieval for Still Image and Video Databases IV 2670, 76 (1996).
27. L. D. Bergman, V. Castelli, C.-S. Li, and J. R. Smith, \SPIRE, a digital library for Scientific information," Int. J. Digital Libraries, Special Issue \In the Tradition of the Alexandrian Scholars" 3(1), 85 (2000).
28. S.-F. Chang, B. Chen, and H. Sundaram, \Semantic visual templates: Linking visual features to semantics," in Proceedings of International Conference on Image Processing (ICIP '98), Workshop on Content Based Video Search and Retrieval, Chicago IL, October 1998, pp. 531{535.
29. J. R. Smith and S.-F. Chang, \An image and video search engine for the world-wide web," in Proceedings of SPIE Storage &Retrieval for Image and Video Databases V 3022, 84 (1997).
30. S. Paek, C. L. Sable, V. Hatzivassiloglou, A. Jaimes, B. H. Schiffman, S.-F. Chang, and K. R. McKeown, \Integration of visual and text based approaches for the content labeling and classification of photographs," in Proceedings of ACM SIGIR '99 Workshop on Multimedia Indexing and Retrieval, Berkeley, CA. August 1999.
31. M. R. Napahde and T. S. Huang, \A probabilistic framework for semantic video indexing, filtering, and retrieval," IEEE Trans. Multimedia 3(1), 141 (2001).
32. C. Frankel, M. J. Swain, and V. Athitsos, \WebSeer: An image search engine for the world wide web," University of Chicago Technical Report TR-96-14, July 31, 1996.
33. J. R. Smith and S.-F. Chang, \Multi-stage classification of images from features and related text," in Proceedings Fourth DELOS Workshop, Pisa, Italy, August 1997.
34. P. Lipson, \Context and configuration based scene classification," Ph.D. Thesis, MIT Electrical and Computer Science Department, September 1996.
35. H. A. Rowley, S. Baluja, and T. Kanade, \Human face detection in visual scenes," Carnigie Mellon University, Technical Report CMU-CS-95, 158, 1995.
36. K. Ikeuchi and M. Veloso (eds.), Symbolic Visual Learning (Oxford University Press, New York, 1997).
37. B. A. Draper, \Learning object recognition strategies," Ph.D. Thesis, Computer Science Department, University of Massachusetts, MA, 1993.
38. W. E. L. Grimson, Object Recognition by Computer: The Role of Geometric Constraints (MIT Press, Cambridge, MA, 1990).
39. T. Minka and R. Picard, \Interactive learning using a society of models," Pattern Recognition 30(4), (1997).
40. D. Zhong and S.-F. Chang, \Structure analysis of sports video using domain models," IEEE International Conference on Multimedia and Expo (ICME 2001), Tokyo, Japan, 2001.
41. G. Durand, C. Thienot, and P. Faudemay, \Extraction of composite visual objects from audiovisual materials," in Proceedings of SPIE Multimedia and Archiving Systems IV 3846, 194 (1999).
42. U. Srinivasan, C. Lindley, and B. Simpson-Young, \A multi-model framework for video information systems," in Database Semantics: Issues in Multimedia Systems (Kluwer Academic Publishers, 1999), pp. 85{108.
43. R. W. Picard, \Computer learning of subjectivity," ACM Computing Surveys 27(4), 621 (1995).
44. A. Jaimes, A. B. Benitez, S.-F. Chang, and A. C. Loui, \Discovering recurrent visual semantics in consumer photographs," invited paper in International Conference on Image Processing (ICIP 2000), Special Session on Semantic Feature Extraction in Consumer Contents, Vancouver, Canada, September 10{13, 2000.
45. D. G. Lowe, Perceptual Organization and Visual Recognition (Kluwer Academic Publishers, Boston, 1985).
46. A. Amir and M. Lindenbaum, \A generic grouping algorithm and its quantitative analysis," IEEE Trans. Pattern Recognition and Machine Intelligence (PAMI ) 20(2), 186 (1998).
47. T. F. Syeda-Mahmood, \Data and model-driven selection using color regions," Int J. Comput. Vision 21(1/2), 9 (1997).
48. D. Healey, \Preattentive processing in visualization," http://www.cs.berkeley.edu/healey/PP/PP.shtml.
49. D. Zhong and S.-F. Chang, \Video object model and segmentation for content-based video indexing," in Proceedings of IEEE International Conference on Circuits and Systems, Special Session on Networked Multimedia Technology &Applications 2, 1492 (1997).
50. J. Russ, The Image Processing Handbook, 3rd edition (CRC Press, Boca Raton, Fl, 1999).
51. T. R. Reed and J. M. Hans Du Buf, \A review of recent texture segmentation and feature extraction techniques," Comput. Vision, Graphics, and Image Processing (CVGIP): Image Understanding 57(3) (1993).
52. E. G. M. Petrakis and C. Faloutsos, \Similarity searching in large image databases," University of Maryland, Department of Computer Science, Technical Report, No. 3388, 1995.
53. S. J. Russell and P. Norvig, Artificial Intelligence: A Modern Approach, Prentice Hall Series in Artificial Intelligence (Prentice Hall, Englewood Clifis, N.J., 1995).
54. T. G. Dietterich, \Proper statistical tests for comparing supervised classification learning algorithms," Technical Report, Department of Computer Science, Oregon State University, 1996.
55. A. Y. Ng, \On feature selection: Learning with exponentially many irrelevant features as training examples," in Proceedings of International Conference on Machine Learning (ICML), 1998.
56. D. Koller and M. Sahami, \Toward optimal feature selection," in Proceedings of 13th International Conference on Machine Learning (ICML), Bary, Italy, July 1996.
57. G. H. John, R. Kohavi, and K. Pfleger, \Irrelevant features and the subset selection problem," in Proceedings of 11th International Conference on Machine Learning (ICML '94), 1994, pp. 121{129.
58. A. Jain and D. Zongker, \Feature selection: Evaluation, application, and small sample performance," IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI ) 19(2), 153 (1997).
59. R. Kohavi, \Feature subset selection using the wrapper model: Overfitting and dynamic search space topology," in Proceedings of First International Conference on Knowledge Discovery and Data Mining, 1995, pp. 192{197.
60. S. L. Salzberg, \On comparing classifiers: A critique of current research and methods," Data Mining and Knowledge Discovery 1, 1 (1999).
61. P. M. Murphy, \UCI repository of machine learning databases | A machinereadable data repository," maintained at the Department of Information and Computer Science, University of California, Irvine. Anonymous FTP from ics.uci.edu in the directory pub/machine-learning-databases, 1995.
62. R. Kohavi, G. John, R. Long, D. Manley, and K. Pfleger, \MLC++: A machine learning library in C++," in Proceedings of Conference on Tools with Artificial Intelligence 94, 1994.
63. R. Kohavi, \A study of cross-validation and bootstrap for accuracy estimation and model selection," in Proceedings of the 14th International Joint Conference on Artificial Intelligence (JCAI '95 ) (Morgan Kaufmann Publishers, Inc., 1995), pp. 1137{1143.
64. A. W. Moore and M. S. Lee, \Efficient algorithms for minimizing cross validation error," in Proceedings of the 11th International Conference on Machine Learning (Morgan Kaufmann, 1994).
65. S. Paek and S.-F. Chang, \The case for image classification systems based on probabilistic reasoning," in Proceedings, IEEE International Conference on Multimedia and Expo (ICME 2000), New York City, July, 2000.
66. J. M. Keller, M. R. Gray, and J. A. Givens Jr., \A fuzzy k-nearest neighbor algorithm," IEEE Trans. Syst. Man, and Cybernetics 15(4), 580 (1985).
67. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs (Springer-Verlag, New York, 1992).
68. J. Meng and S.-F. Chang, \Tools for compressed-domain video indexing and editing," in Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Database 2670, 180 (1996).
69. C. M. Privitera and L. W. Stark, \Algorithms for defining visual regions-of-interest: Comparison with eye fixations," IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI ), 22(9), 970 (2000).
70. A. Jaimes, J. B. Pelz, T. Grabowski, J. Babcock, and S.-F. Chang, \Using human observers' eye movements in automatic image classifiers," in Proceedings of SPIE Human Vision and Electronic Imaging VI, San Jose, CA, 2001.
71. W. Cohen, \Learning trees and rules with set-valued features", in Thirteenth National Conference on Artificial Intelligence, AAAI 1996, Portland, Oregon, August 1996.
72. B. Gunsel, A. M. Ferman, and A. M. Tekalp, \Temporal video segmentation using unsupervised clustering and semantic object tracking," IS&T/SPIE J. Electronic Imaging 7(3), 592 (1998).
73. R. Kasturi and R. C. Jain (eds.), Computer Vision: Principles (IEEE Computer Society Press, 1991).
74. D. Marr, Vision: A Computational Investigation into the Human Representation and Processing of Visual Information (W. H. Freeman and Company, San Francisco, 1982).
75. S. Nayar and T. Poggio (eds.), Early Visual Learning (Oxford University Press, New York, 1996).
76. R. W. Picard, \A society of models for video and image libraries," MIT Media Laboratory Perceptual Computing Section Technical Report, No. 360, Cambridge, Massachusetts, 1996.
77. Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra, \Relevance feedback: A power tool for interactive content-based image retrieval," IEEE Trans. Circuits and Video Technology 8(5), 644 (1998).
78. D. L. Swets and J. J. Weng, \Efficient content-based image retrieval using automatic feature selection," in Proceedings of International Conference on Computer Vision (ICCV '95), Coral Gables, Florida, November 1995.
79. H. Tamura, S. Mori, and T. Yamawaki, \Textural features corresponding to visual perception," IEEE Trans. Syst. Man, and Cybernetics SMC-8, 6 (1978).
80. A. Triesman, \Preattentive processing in vision," Comput. Vision, Graphics, and Image Processing (CGVIP), 31, 156 (1985).