Mining compositional features from gps and visual cues for event recognition in photo collections

IEEE Transactions on Multimedia

Volumn 12, Issue 7, 2010, Pages 705-716

  Yuan, Junsong ^a   Luo, Jiebo ^b   Wu, Ying ^c  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b EASTMAN KODAK COMPANY   (United States)

^c Northwestern University   (United States)

Author keywords

Compositional feature mining; event recognition; geo tagged images; image data mining

Indexed keywords

ADABOOST; CLASSIFICATION ERRORS; CO-OCCURRENCE; COMPOSITIONAL FEATURES; DATA MINING METHODS; DATA SETS; EVENT CLASSIFICATION; EVENT RECOGNITION; GEO-TAGGED IMAGES; IMAGE CONTENT; IMAGE DATA; MOVEMENT PATTERN; MULTI-CLASS; PHOTO COLLECTIONS; SEMANTIC EVENT; SPATIO-TEMPORAL; TIME STAMPS; VISUAL CUES; VISUAL MODALITIES;

ADAPTIVE BOOSTING; CAMERAS; CLASSIFICATION (OF INFORMATION); COMPUTER GRAPHICS; DATA MINING; GLOBAL POSITIONING SYSTEM;

FEATURE EXTRACTION;

EID: 77958118680     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2010.2051868     Document Type: Article

References (40)

1. J. Amores, N. Sebe, and P. Radeva, "Context-based object-class recognition and retrieval by generalized correlograms," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.10, pp. 1818-1833, Oct. 2007.
2. L. Cao, J. Luo, H. Kautz, and T. S. Huang, "Image annotation within the context of personal photo collections using hierarchical event and scene models," IEEE Trans. Multimedia, vol.11, no.2, pp. 208-219, Feb. 2009.
3. S.-F. Chang, D. Ellis, W. Jiang, K. Lee, A. Yanagawa, A. C. Loui, and J. Luo, "Large-scale multimodal semantic concept detection for consumer video," in Proc. ACMInt.Workshop Multimedia Information Retrieval, 2007.
4. H. Cheng, X. Yan, J. Han, and C.-W. Hsu, "Discriminative frequent pattern analysis for effective classification," in Proc. Int. Conf. Data Engineering, 2007.
5. H. Cheng, X. Yan, J. Han, and P. S. Yu, "Direct discriminative pattern mining for effective classification," in Proc. Int. Conf. Data Engineering, 2008.
6. G. Dong and J. Li, "Efficient mining of emerging patterns: Discovering trends and differences," in Proc. SIGKDD, 1999.
7. S. Ebadollahi, L. Xie, S.-F. Chang, and J. R. Smith, "Visual event detection using multi-dimensional concept dynamics," in Proc. IEEE Conf. Multimedia Expo, 2006.
8. W. Fan, K. Zhang, H. Cheng, J. Gao, X. Yan, J. Han, P. Yu, and O. Verscheure, "Direct mining of discriminative and essential frequent patterns via model-based search tree," in Proc. ACM SIGKDD, 2008.
9. J. Friedman, T. Hastie, and R. Tibshirani, "Additive logistic regression: A statistical view of boosting," Ann. Statist., vol.28, pp. 337-407, 2000.
10. G. Grahne and J. Zhu, "Fast algorithms for frequent itemset mining using FP-trees," IEEE Trans. Knowl. Data Eng., vol.17, no.10, pp. 1347-1362, Oct. 2005.
11. J. Han, H. Cheng, D. Xin, and X. Yan, "Frequent pattern mining: Current status and future directions," Data Min. Knowl. Discov., vol.15, no.1, pp. 55-86, 2007.
12. W. Jiang, C. Cotton, S.-F. Chang, D. Ellis, and A. C. Loui, "Short-term audio-visual atoms for generic video concept classification," in Proc. ACM Multimedia, 2009.
13. L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury, "How flickr helps us make sense of the world: Context and content in community- contributed media collections," in Proc. ACM Multimedia, 2007.
14. S. Lazebnik, C. Schmid, and J. Ponce, "Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
15. J. Li, G. Liu, and L.Wong, "Mining statistically important equivalence classes and delta-discriminative emerging patterns," in Proc. ACM SIGKDD, 2007.
16. L.-J. Li and L. Fei-Fei, "What, where and who? Classifying events by scene and object recognition," in Proc. IEEE Int. Conf. Computer Vision, 2007.
17. W. Li, J. Han, and J. Pei, "CMAR: Accurate and efficient classification based on multiple class-association rules," in Proc. Int. Conf. Data Mining, 2001.
18. J.-H. Lim, Q. Tian, and P. Mulhem, "Home photo content modeling for personalized event-based retrieval," IEEE Multimedia, vol.10, no.4, pp. 28-37, Oct.-Dec. 2003.
19. B. Liu, W. Hsu, and Y. Ma, "Integrating classification and association rule mining," in Proc. SIGKDD, 1998.
20. D. Liu, G. Hua, P. Viola, and T. Chen, "Integrated feature selection and higher-order spatial feature extraction for object categorization," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
21. D. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol.60, no.2, pp. 91-110, 2004.
22. J. Luo and M. Boutell, "Automatic image orientation detection via confidence- based integration of low-level and semantic cues," IEEE Trans. Pattern Anal. Mach. Intell., vol.27, no.5, pp. 715-726, May 2005.
23. J. Luo, M. Boutell, and C. Brown, "Pictures are not taken in a vacuum: An overview of exploiting context for semantic scene content understanding," IEEE Signal Process. Mag., vol.23, no.2, pp. 101-114, Mar. 2006.
24. J. Luo, J. Yu, D. Joshi, and W. Hao, "Event recognition: Viewing the world with a third eye," in Proc. ACM Multimedia, 2008, pp. 1071-1080.
25. T. Mitchell, Machine Learning. New York: McGraw-Hill, 1997.
26. E. Moxley, T. Mei, X.-S. Hua, W.-Y. Ma, and B. Manjunath, "Automatic video annotation through search and mining," in Proc. IEEE Conf. Multimedia Expo, 2008.
27. M. V. Peelen, L. Fei-Fei, and S. Kastner, "Neural mechanisms of rapid natural scene categorization in human visual cortex," Nature, advanced online publication: 06 2009/06/07/online.
28. N. Rasiwasia and N. Vasconcelos, "Holistic context modeling using semantic co-occurrences," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
29. L. Reyzin and R. E. Schapire, "How boosting the margin can also boost classifier complexity," in Proc. Int. Conf. Machine Learning, 2006.
30. J. Sivic and A. Zisserman, "Video data mining using configurations of viewpoint invariant regions," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
31. A. Torralba, K. P. Murphy, and W. T. Freeman, "Sharing visual features for multiclass and multiview object detection," IEEE Trans. Pattern Anal. Mach. Intell., vol.29, no.5, pp. 854-869, May 2007.
32. D. Xu and S.-F. Chang, "Video event recognition using kernel methods with multi-level temporal alignment," IEEE Trans. Pattern Anal. Mach. Intell., vol.30, no.11, pp. 1985-1997, Nov. 2008.
33. R. Yan, J. Tesic, and J. R. Smith, "Model-shared subspace boosting for multi-label classification," in Proc. ACM SIGKDD, 2007.
34. J. Yang, R. Yan, and A. G. Hauptmann, "Cross-domain video concept detection using adaptive SVMs," in Proc. ACM Multimedia, 2007.
35. X. Yin and J. Han, "CPAR: Classification based on predictive association rules," in Proc. SIAM Int. Conf. Data Mining (SDM), 2003.
36. J. Yuan, J. Luo, H. Kautz, and Y. Wu, "Mining GPS traces and visual words for event classification," in Proc. ACM Int. Conf. Multimedia Information Retrieval, 2008.
37. J. Yuan, J. Luo, and Y. Wu, "Mining compositional features for boosting," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
38. J. Yuan, Y.Wu, and M. Yang, "Discovery of collocation patterns: From visual words to visual phrases," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
39. J. Yuan, Y.Wu, and M. Yang, "From frequent itemsets to semantically meaningful visual patterns," in Proc. ACM SIGKDD, 2007.
40. J. Zhu, S. Rosset, H. Zou, and T. Hastie, "Multi-class adaboost," Technique Report, 2005.