A MapReduce-based distributed SVM algorithm for automatic image annotation

Computers and Mathematics with Applications

Volumn 62, Issue 7, 2011, Pages 2801-2811

  Alham, Nasullah Khalid ^a   Li, Maozhen ^a   Liu, Yang ^a   Hammoud, Suhel ^a  

^a BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

Automatic image annotation; MapReduce framework; Sequential minimal optimization; Support vector machine

Indexed keywords

AUTOMATIC IMAGE ANNOTATION; DISTRIBUTED SVM; EXPERIMENTAL ENVIRONMENT; GENERALIZATION PROPERTIES; MACHINE LEARNING TECHNIQUES; MAP-REDUCE; MULTI-CLASS CLASSIFICATION; SEQUENTIAL MINIMAL OPTIMIZATION; SUPPORT VECTOR; TRAINING DATASET; TRAINING TIME;

CLUSTERING ALGORITHMS; IMAGE ANALYSIS; OPTIMIZATION; SUPPORT VECTOR MACHINES;

IMAGE RETRIEVAL;

EID: 80052961124     PISSN: 08981221     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.camwa.2011.07.046     Document Type: Conference Paper

References (40)

1. A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain Content based image retrieval at the end of the early years IEEE Trans. Pattern Anal. Mach. Intell. 22 12 2000 1349 1380 (Pubitemid 32088465)
2. C. Tsai, and C. Hung Automatically annotating images with keywords: a review of image annotation Recent Patents on Comput. Sci. 1 2008 55 68
3. W-T. Wong, and S-H. Hsu Application of SVM and ANN for image retrieval European J. Oper. Res. 173 2006 938 950 (Pubitemid 43866336)
4. Y. Gao, J. Fan, Semantic image classification with hierarchical feature subset selection, in: Proceedings of the ACM Multimedia Workshop on Multimedia Information Retrieval, Hilton, Singapore, Nov. 1011, 2005, pp. 135142.
5. M. Boutell, J. Luo, X. Shen, and C.M. Brown Learning multi-label scene classification Pattern Recognit. 37 5 2004 1757 1771 (Pubitemid 38804465)
6. Y. Chen, and J.Z. Wang Image categorization by learning and reasoning with regions J. Mach. Learn. Res. 5 2004 913 939. Y
7. C. Cusano, G. Ciocca, R. Schettini, Image annotation using SVM, in: Proceedings of SPIE Conference on Internet Imaging V, San Jose, California, 5304, Jan. 1920 2004, pp. 330338.
8. J. Fan, Y. Gao, H. Luo, G. Xu, Automatic image annotation by using concept-sensitive salient objects for image content representation, in: Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield, UK, July 2529 2004, pp. 361368.
9. B. Le Saux, G. Amato, Image recognition for digital libraries, in: Proceedings of the ACM Multimedia Workshop on Multimedia Information Retrieval, New York, Oct. 15-16, 2004.
10. N. Cristianini, and J. Shawe-Taylor An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods 2000 Cambridge University Press pp. 1172
11. C. Waring, and Xiuwen Liu Face detection using spectral histograms and SVMs IEEE Trans. Syst. Man Cybern. Part B: Cybernetics 35 2005 467 476 (Pubitemid 40794858)
12. F. Colas, P. Brazdil, Comparison of SVM and some older classification algorithms in text classification tasks, in: IFIP-AI 2006, World Computer Congress, Santiago de Chile, Chile, Springer, vol. 217, 18612288, 2006, pp. 169178. (Pubitemid 44920580)
13. T. Do, V. Nguyen, F. Poulet, Speed up SVM algorithm for massive classification tasks, in: ADMA'08: Proceedings of the 4th International Conference on Advanced Data Mining and Applications, Berlin, Heidelberg, Springer-Verlag, vol. 5139, 16113349, 2008, pp. 147157.
14. N. Khalid Alham, M. Li, S. Hammoud, and H. Qi Evaluating machine learning techniques for automatic image annotations Proc. of FSKD09 Aug.2009 IEEE CS
15. L. Cao, S. Keerthi, Chong-Jin Ong, J. Zhang, U. Periyathamby, Xiu Ju Fu, and H. Lee Parallel sequential minimal optimization for the training of support vector machines IEEE Trans. Neural Netw. 17 2006 1039 1049 (Pubitemid 44194161)
16. R. Collobert, S. Bengio, and Y. Bengio A Parallel Mixture of SVMs for Very Large Scale Problems 2002
17. Guang-Bin Huang, K. Mao, Chee-Kheong Siew, and De-Shuang Huang Fast modular network implementation for support vector machines IEEE Trans. Neural Netw. 16 2005 1651 1663 (Pubitemid 41709660)
18. T. Hazan, A. Man, A. Shashua, A parallel decomposition solver for SVM: distributed dual ascend using Fenchel duality, in: Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference, 2008, pp.18.
19. Yumao Lu, V. Roychowdhury, and L. Vandenberghe Distributed parallel support vector machines in strongly connected networks IEEE Trans. Neural Netw. 19 2008 1167 1178
20. J. Dong, A. Krzyak, and C. Suen A fast parallel optimization for training support vector machine Mach. Learn. Data Mining Pattern Recognit. 2003 96 105 (Pubitemid 36904947)
21. B. Catanzaro, N. Sundaram, and K. Keutzer Fast support vector machine training and classification on graphics processors Proceedings of the 25th International Conference on Machine Learning 2008 ACM Helsinki, Finland 104 111
22. R. Lmmel Google's mapreduce programming model revisited Sci. Comput. Program. 70 Jan.2008 1 30
23. Apache Hadoop, Available: http://hadoop.apache.org/.
24. G. Zanghirati, and L. Zanni A parallel solver for large quadratic programs in training support vector machines Parallel Comput. 29 2003 535 551
25. S. Winters-Hilt, K. Armond, Distributed SVM learning and support vector reduction submitted to BMC bioinformatics, 2008, available: http://cs.uno.edu/ ~winters/SVMSWHpreprint.pdf.
26. D. Bickson, E. Yom-Tov, D. Dolev, A Gaussian belief propagation solver for large scale support vector machines. 2008, available: http://www.cs.huji.ac. il/~dolev/pubs/dd-ECCS08.pdf.
27. H. Graf, E. Cosatto, L. Bottou, I. Durdanovic, and V. Vapnik Parallel support vector machines: the cascade SVM Neural Information Processing Systems 2004
28. D. Kun, L. Yih, A. Perera, Parallel SMO for training support vector machines, SMA 5505 Project Final Report. May 2003, available at www.geocities.com/asankha/Contents/Education/APC-SVM.pdf.
29. B.C. Kuszmaul Cilk provides the "best overall productivity" for high performance computing: (and won the HPC challenge award to prove it) Proceedings of the Nineteenth Annual ACM Symposium on Parallel Algorithms and Architectures 2007 ACM San Diego, California, USA 299 300
30. D. Gillick, A. Faria, J. DeNero, Mapreduce: distributed computing for machine learning, 2006, [Online available: www.icsi.berkeley.edu/~arlo/ publications/gillickcs262aproj.pdf.
31. C. Chu, S. Kim, Y. Lin, Y. Yu, G. Bradski, A. Ng, and K. Olukotun Map-reduce for machine learning on multicore NIPS 2006 MIT Press pp. 288, 281
32. J.C. Platt, Sequential minimal optimization:a fast algorithm for training support vector machines. 1998, available: http://research.microsoft.com/enus/ um/people/jplatt/smoTR.pdf.
33. S.S. Keerthi, S.K. Shevade, C. Bhattacharyya, and K.R.K. Murthy Improvements to platt's SMO algorithm for svm classifier design Neural Computing 13 2001 637 649 (Pubitemid 33595014)
34. J. Venner Pro Hadoop 2009 Springer pp. 1407
35. S. Ghemawat, H. Gobioff, and S. Leung The google file system SIGOPS Oper. Syst. Rev. 37 2003 29 43 (Pubitemid 40929686)
36. Weka, 3 Data mining with open source machine learning software in Java, available at: http://www.cs.waikato.ac.nz/ml/weka/.
37. T. Sikora, The MPEG-7 visual standard for content description-an overview: 696-702. 2001, available: http://www.ee.columbia.edu/~sfchang/course/ vis/REF/sikora01.pdf.
38. Corel image databases, available: www.corel.com.
39. Lire, An open source java content based image retrieval library available at: http://www.semanticmetadata.net/lire/.
40. S. Abe Support Vector Machines for Pattern Classification (Advances in Pattern Recognition) 2005 Springer-Verlag New York, Inc.