Semantic home photo categorization

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 17, Issue 3, 2007, Pages 324-335

  Yang, Seungji ^b   Kim, Sang Kyun ^c   Ro, Yong Man ^a,b  

^a Information and Communications University ^*

^b Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^c Samsung Advanced Institute of Technology (SAIT)   (South Korea)

Author keywords

Camera metadata; Image classification; Photo album; Support vector machine

Indexed keywords

CAMERAS; DATABASE SYSTEMS; METADATA; SEMANTICS; SUPPORT VECTOR MACHINES;

CAMERA METADATA; PHOTO ALBUM; POSTERIOR PROBABILITY;

IMAGE CLASSIFICATION;

EID: 33847770784     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2007.890829     Document Type: Article

References (41)

1. T. Yamazaki and D. Gingras, "Image classification using spectral and spatial information based on MRP models," IEEE Trans. Image Process., vol. 4, no. 9, pp. 1333-1339, Sep. 1995.
2. J. R. Smith and C. S. Li, "Image classification and querying using composite region template," J. Comp. Vis. Pattern Recognit., vol. 75, no. 1, pp. 165-174, 1999.
3. O. Chapelle, P. Haffner, and V. N. Vapnik, "Support vector machines for histogram-based image classification," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1055-1064, May 1999.
4. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of early years," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 12, pp. 1349-1380, 2000.
5. S. Yang, J. H. Yoon, H. K. Kang, and Y. M. Ro, "Category classification using multiple MPEG-7 descriptors," in Proc. Int. Conf. Imaging Sci., Syst., Technol., 2002, vol. 1, pp. 396-401.
6. S. Yang, J. H. Yoon, and Y. M. Ro, "Automatic Image Categorization using MPEG-7 Description," Proc. SPIE Electron. Imag. Internet Imag., vol. 5018, pp. 139-147, 2003.
7. J. Smith, M. Naphade, and A. Natsev, "Multimedia semantic indexing using model vectors," in Proc. IEEE Int. Conf. Multimedia Expo, 2002, vol. 2, pp. 445-448.
8. S. Newsam, B. Sumengen, and B. S. Manjunath, "Category-based image retrieval," in Proc. IEEE Int. Conf. Image Process., 2003, vol. 2, pp. 596-599.
9. S. Kim, S. Yang, K. S. Seo, Y. M. Ro, J. Kim, and Y. Seo, "Home photo categorization based on photographic region templates," in LNCS, 2005, vol. 3689, pp. 328-338.
10. V. N. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
11. K. Muller, K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf et al., "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Netw., vol. 12, no. 2, pp. 181-201, 2001.
12. B. Scholkopf and A. Smola, Learning With Kernels. London, U.K.: MIT Press, 2002.
13. P. Murphy, A. Torralba, and W. Freeman, "Using the forest to see the trees: a graphical model relating features, objects and scenes," in Neural Information Processing Systems. Cambridge, U.K.: MIT Press, 2003.
14. E. Sudderth, A. Torralba, W. T. Freeman, and A. Wilsky, "Learning hierarchical models of scenes, objects, and parts," in Proc. IEEE Int. Conf. Comput. Vis., 2005, vol. 2, pp. 1331-1338.
15. M. Naphade and T. Huang, "A probabilistic framework for semantic video indexing, filtering and retrieval," IEEE Trans. Multimedia, vol. 3. no. 1, pp. 141-151, 2001.
16. J. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," in Advances in Large Margin Classifier. Cambridge, MA: MIT Press, 2000.
17. H. T. Lin, C. J. Lin, and R. C. Weng, A note on Plait's probabilistic outputs for support vector machines Dept. Comp. Sci., National Taiwan Univ., 2003 [Online]. Available: http://www.csie.ntu.edu/tw/~cjlin/papers/plattprob.ps, Tech. Rep.
18. Exchangeable Image File Format for Digital Still Cameras, JEITA CP-3451, Japan Electronics and Information Technology Industries Association, 2002.
19. J. H. Lim, Q. Tian, and P. Mulhem, "Home photo content modeling for personalized event-based retrieval," IEEE Trans. Multimedia, vol. 10, no. 4, pp. 24-37, 2003.
20. A. C. Loui and A. Savakis, "Automated event clustering and quality screening of consumer pictures for digital albuming," IEEE Trans. Multimedia, vol. 5, no. 3, pp. 390-402, 2003.
21. J. C. Platt, M. Czerwinski, and B. A. Field, "PhotoTOC: Automatic clustering for browsing personal photographs," in Proc. 4th IEEE Pacific Rim Conf., 2003, vol. 1, pp. 6-10.
22. M. Cooper, J. Foote, A. Girgensohn, and L. Wilcox, "Temporal event clustering for digital photo collections," in Proc. ACM Multimedia, 2003, pp. 364-373.
23. S. Yang, S. K. Kim, K. S. Seo, and Y. M. Ro, "Automated situation change clustering of home photos for digital albuming," in Proc. SPIE Electron. Imag. Storage Retrieval, 2005, vol. 5682, pp. 212-223.
24. S. Yang, K. S. Seo, Y. M. Ro, S. K. Kim, J. Kim, and Y. Seo, "Usercentric digital home photo album," in Proc. IEEE Int. Conf. Consum. Electron., 2005, pp. 226-229.
25. M. Boutell and J. Luo, "Beyond pixels: Exploiting camera metadata for photo classification," Pattern Recognit., vol. 38, pp. 935-946, 2005.
26. Y. M. Ro and H. K. Kang, "Hierarchical rotational invariant similarity measurement for MPEG-7 homogeneous texture descriptor," Electron. Lett., vol. 36, no. 15, pp. 1268-1270, 2000.
27. B. S. Manjunath et al., Introduction to MPEG-7. New York: Wiley, 2002.
28. Z. Sun, "Adaptation for multiple cue integration," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2003, vol. 1, pp. 1440-1445.
29. C. Liu and H. Y. Shum, "Kullback-Leibler boosting," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), 2003, pp. 587-594.
30. P. Salembier and F. Marques, "Region-based representations of image and video: Segmentation tools for multimedia services," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 8, pp. 1147-1169, Dec. 1999.
31. V. Oria, M. T. Ozsu, P. J. Iglinkski, B. Xu, and L. I. Cheng, "DISIMA: An object-oriented approach to developing an image database system," in Proc. IEEE Int. Conf. Data Eng., 2000, pp. 672-673.
32. X. Shi and R. Manduchi, "A study on Bayes feature fusion for image classification," in Proc. IEEE Workshop Statist. Alg. Comput. Vis., 2003, vol. 8, pp. 1-9.
33. G. Tsoumakas, I. Katakis, and I. Vlahavas, "A review of multi-label classification methods," in Proc. 2nd ADBIS Workshop Data Mining Knowl. Discov., 2006, pp. 99-109.
34. J.-M. Renders, E. Gaussier, C. Goutte, F. Pacull, and G. Csurka, "Categorization in multiple category systems," in Proc. 23rd Int. Conf. Mach. Learning, 2006, pp. 745-752.
35. M. Boutell, X. Shen, J. Luo, and C. M. Brown, "Learning multilabel semantic scene classification," Pattern Recognit., vol. 37, no. 9, pp. 1757-1771, Sep. 2004.
36. J. Rousu, C. Saunders, S. Szedmak, and J. Shawe-Taylor, "Kernel-based learning of hierarchical multilabel classification models," J. Mach. Learning Res., vol. 7, pp. 1601-1626, 2006.
37. X. Li, L. Wang, and E. Sung, "Multilabel SVM active learning for image classification," in Proc. IEEE Int. Conf. Image Process., 2004, pp. 2207-2210.
38. H. C. Kim, S. Pang, H.-M. Je, D. Kim, and S. Y. Bang, "Pattern classification using support vector machine ensemble," in Proc. IEEE Int. Conf. Pattern Recognit., 2002, vol. 2, pp. 160-163.
39. Y. Yu, X. L. Wang, and B.-Q. Liu, "A gradual combining method for multiSVM classifiers based on distance estimation," in Proc. IEEE Int. Conf. Mach. Learning Cybern., 2006, vol. 6, pp. 3434-3438.
40. M. Boutell, "Exploiting context for semantic scene classification," Univ. Rochester, Rochester, NY, Tech. Rep. 894, 2006.
41. R. O'Callaghan and M. Bober, Results on Image Categorization (VCE-2), ISO/IEC JTC1/SC29/WG11 MPEG-7 Visual, M12049, Apr. 2005.