Multi-objective optimization for multimodal visualization

IEEE Transactions on Multimedia

Volumn 16, Issue 5, 2014, Pages 1460-1472

  Kalamaras, Ilias ^a,b   Drosou, Anastasios ^b   Tzovaras, Dimitrios ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

Author keywords

Image clustering; multi objective optimization; multimodal visualization; pareto optimization

Indexed keywords

COST FUNCTIONS; DATA VISUALIZATION; PARETO PRINCIPLE; TELECOMMUNICATION NETWORKS; VISUALIZATION;

EXPERIMENTAL EVALUATION; IMAGE CLUSTERING; MINIMUM SPANNING TREES; MULTI-MODAL VISUALIZATION; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; MULTIMEDIA DATABASE; PARETO OPTIMIZATION; VISUALIZATION TECHNIQUE;

MULTIOBJECTIVE OPTIMIZATION;

EID: 84904755445     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2014.2316473     Document Type: Article

References (50)

1. U. M. Fayyad, A. Wierse, and G. G. Grinstein, Information Visualization in Data Mining and Knowledge Discovery. San Francisco, CA, USA: Morgan Kaufmann, 2002.
2. W. Köhler, Gestalt Psychology. New York, NY, USA: Liveright, 1929.
3. E. B. Goldstein, Sensation and Perception. Stamford, CT,USA: Cengage Learning, 2013.
4. M. Chen and H. Jaenicke, "An information-theoretic framework for visualization," IEEE Trans. Visualiz. Comput. Graph., vol. 16, no. 6, pp. 1206-1215, 2010.
5. Y. -Y. Lin, T. -L. Liu, and C. -S. Fuh, "Multiple kernel learning for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1147-1160, 2011.
6. H. Zhang and J. Weng, "Measuring multi-modality similarities via subspace learning for cross-media retrieval," in Proc. Advances in Multimedia Information Processing-PCM 2006, 2006, pp. 979-988. (Pubitemid 44860735)
7. C. Chen,W. Härdle, and A. Unwin, Handbook of Data Visualization. New York, NY, USA: Springer, 2008.
8. P. K. Atrey,M. A. Hossain, A. El Saddik, and M. S. Kankanhalli, "Multimodal fusion for multimedia analysis: A survey," Multimedia Syst., vol. 16, no. 6, pp. 345-379, 2010.
9. I. Kalamaras, A. Mademlis, S. Malassiotis, and D. Tzovaras, "A novel framework for multimodal retrieval and visualization of multimedia data," in Signal Processing, Pattern Recognition and Applications/779: Computer Graphics and Imaging. Calgary,AB, Canada: ACTA Press, 2012.
10. M. Ehrgott, Multicriteria Optimization. Berlin, Germany: Springer, 2005, vol. 2.
11. H. Purchase, "Metrics for graph drawing aesthetics," J. Visual Lang. Comput., vol. 13, no. 5, pp. 501-516, 2002.
12. T. Fruchterman and E. Reingold, "Graph drawing by force-directed placement," Softw.: Practice Experience, vol. 21, no. 11, pp. 1129-1164, 1991.
13. J. Choo, S. Bohn, and H. Park, "Two-stage framework for visualization of clustered high dimensional data," in Proc. IEEE Symp. Visual Analytics Science and Technology, 2009 VAST 2009, 2009, pp. 67-74, IEEE.
14. Y. Yang, D. Xu, F. Nie, J. Luo, and Y. Zhuang, "Ranking with local regression and global alignment for cross media retrieval," in Proc. 17th ACM Int. Conf. Multimedia, ser. MM '09, 2009, pp. 175-184.
15. H. Tong, J. He, M. Li, C. Zhang, and W. Ma, "Graph based multimodality learning," in Proc. 13th Annu. ACM Int. Conf. Multimedia, ser. Multimedia '05, 2005, pp. 862-871.
16. X. Wu, Y. -J. Lu, Q. Peng, and C. -W. Ngo, "Mining event structures from web videos," IEEE Multimedia, vol. 18, no. 1, pp. 38-51, 2011.
17. M. Gönen and E. Alpaydin, "Multiple kernel learning algorithms," J. Mach. Learn. Res., vol. 12, pp. 2211-2268, 2011.
18. J. Sang and C. Xu, "Faceted subtopic retrieval: Exploiting the topic hierarchy via a multi-modal framework," J. Multimedia, vol. 7, no. 1, pp. 9-20, 2012.
19. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training," in Proc. 11th Annu. ACM Conf. Computational Learning Theory, 1998, pp. 92-100.
20. K. Nigam and R. Ghani, "Analyzing the effectiveness and applicability of co-training," in Proc. 9th ACM Int. Conf. Information and Knowledge Management, ser. CIKM '00, 2000, pp. 86-93.
21. A. Dempster, N. Laird, and D. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., vol. 39, no. 1, pp. 1-38, 1977.
22. I. S. Dhillon, S. Mallela, and D. S. Modha, "Information-theoretic co-clustering," in Proc. 9th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2003, pp. 89-98.
23. D. -Q. Zhang, C. -Y. Lin, S. -F. Chang, and J. R. Smith, "Semantic video clustering across sources using bipartite spectral clustering," in Proc. 2004 IEEE Int. Conf. Multimedia and Expo (ICME'04), 2004, vol. 1, pp. 117-120. (Pubitemid 40062981)
24. T. Evgeniou and M. Pontil, "Regularized multi-task learning," in Proc. 10th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, 2004, pp. 109-117. (Pubitemid 40114921)
25. Y. Xue, X. Liao, L. Carin, and B. Krishnapuram, "Multi-task learning for classification with dirichlet process priors," J. Mach. Learn. Res., vol. 8, pp. 35-63, 2007. (Pubitemid 46155123)
26. C. Coello, G. Lamont, and D. Van Veldhuizen, Evolutionary Algorithms for Solving Multi-Objective Problems. NewYork,NY,USA: Springer, 2007, vol. 5.
27. A. P. Wierzbicki, "On the completeness and constructiveness of parametric characterizations to vector optimization problems," Oper. -Res. - Spektrum, vol. 8, no. 2, pp. 73-87, 1986.
28. E. Zitzler, M. Laumanns, and S. Bleuler, "A tutorial on evolutionary multiobjective optimization," Metaheurist. Multiobject. Optimis., pp. 3-37, 2004.
29. P. Hajela and C. -Y. Lin, "Genetic search strategies in multicriterion optimal design," Struct. Optimiz., vol. 4, no. 2, pp. 99-107, 1992.
30. E. Zitzler, M. Laumanns, and L. Thiele, "SPEA2: Improving the strength pareto evolutionary algorithm," Eidgenossische Technische Hochschule Zurich (ETH), Institut fur Technische Informatik und Kommunikationsnetze (TIK), Tech. Rep. TIK-Report 103, 2001.
31. R. L. Becerra and C. A. C. Coello, "Solving hard multiobjective optimization problems using -constraint with cultured differential evolution," in Parallel Problem Solving from Nature-PPSN IX. NewYork, NY, USA: Springer, 2006, pp. 543-552. (Pubitemid 44609430)
32. R. T. Marler and J. S. Arora, "Survey of multi-objective optimization methods for engineering," Struct. Multidiscipl. Optimiz., vol. 26, no. 6, pp. 369-395, 2004.
33. S. Malitz, "On the angular resolution of planar graphs," in Proc. 24th Annu. ACM Symp. Theory of Computing, 1992, pp. 527-538. (Pubitemid 23608071)
34. R. T. Marler and J. S. Arora, "The weighted sum method for multiobjective optimization: New insights," Struct. Multidiscipl. Optimiz., vol. 41, no. 6, pp. 853-862, 2010.
35. L. Fei-Fei, R. Fergus, and P. Perona, "Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories," Comput. Vision Image Understand., vol. 106, no. 1, pp. 59-70, 2007. (Pubitemid 46528761)
36. C. Wah, S. Branson, P. Welinder, P. Perona, and S. Belongie, "The caltech-UCSD birds-200-2011 dataset," Tech. Rep., 2011.
37. Xeno-canto, "Bird sounds from America," [Online]. Available: http:// www. xeno-canto. org
38. Information Technologies Institute, "Multimodal image-sound dataset of birds," [Online]. Available: http://160. 40. 50. 78/image-sounddataset/
39. J. Revaud, M. Douze, C. Schmid, and H. Jégou, "Event retrieval in large video collections with circulant temporal encoding," in Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2013, 2013, pp. 2459-2466.
40. J. Krapac, M. Allan, J. Verbeek, and F. Jurie, "Improving web-image search results using query-relative classifiers," in Proc. IEEE Conf. Computer Vision & Pattern Recognition, Jun. 2010, pp. 1094-1101 [Online]. Available: http://lear. inrialpes. fr/pubs/2010/KAVJ10
41. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vision, vol. 60, no. 2, pp. 91-110, 2004.
42. H. Zhang, A. C. Berg, M. Maire, and J. Malik, "Svm-knn: Discriminative nearest neighbor classification for visual category recognition," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2006, 2006, vol. 2, pp. 2126-2136. (Pubitemid 44931577)
43. A. Bosch, A. Zisserman, and X. Muoz, "Image classification using random forests and ferns," in Proc. IEEE 11th Int. Conf. Computer Vision, 2007 (ICCV 2007), 2007, pp. 1-8.
44. A. Oliva and A. Torralba, "Modeling the shape of the scene: A holistic representation of the spatial envelope," Int. J. Comput. Vision, vol. 42, no. 3, pp. 145-175, 2001. (Pubitemid 32680801)
45. A. C. Berg and J. Malik, "Geometric blur for template matching," in Proc. 2001 IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2001 (CVPR 2001), 2001, vol. 1, pp. I-607.
46. S. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech, Signal Process., vol. 28, no. 4, pp. 357-366, 1980. (Pubitemid 11464930)
47. J. C. Dunn, "A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters," J. Cybern., vol. 3, no. 3, pp. 32-57, 1974.
48. J. Handl, J. D. Knowles, and M. Dorigo, "On the performance of antbased clustering," in Proc. HIS, 2003, pp. 204-213.
49. S. Günter and H. Bunke, "Validation indices for graph clustering," Pattern Recognit. Lett., vol. 24, no. 8, pp. 1107-1113, 2003. (Pubitemid 36189564)
50. D. L. Horn, C. R. Hampton, and A. J. Vandenberg, "Practical application of district compactness," Polit. Geogr., vol. 12, no. 2, pp. 103-120, 1993.