Tabu search model selection for SVM

International Journal of Neural Systems

Volumn 18, Issue 1, 2008, Pages 19-31

  Lebrun, Gilles ^a   Charrier, Christophe ^a   Lezoray, Olivier ^a   Cardot, Hubert ^b  

^a UNIVERSITÉ DE CAEN   (France)

^b UNIVERSITÉ DE TOURS   (France)

Author keywords

Data mining; Machine learning; Metaheuristic; Model selection; Pattern recognition; Support Vector Machines; Tabu search; Vector quantisation

Indexed keywords

DATA MINING; MATHEMATICAL MODELS; PATTERN RECOGNITION; SUPPORT VECTOR MACHINES; VECTOR QUANTIZATION;

DECISION FUNCTION QUALITY CRITERION; METAHEURISTICS; MODEL SELECTION;

TABU SEARCH;

ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; DECISION SUPPORT SYSTEM; HUMAN; INFORMATION RETRIEVAL; METHODOLOGY; THEORETICAL MODEL;

ANIMALS; ARTIFICIAL INTELLIGENCE; DECISION SUPPORT TECHNIQUES; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 43949141755     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065708001348     Document Type: Conference Paper

References (61)

1. V. N. Vapnik, Statistical Learning Theory (New York, Wiley edition, 1998).
2. N. Cristianini and J, Shawe-Teylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods (Cambridge University Press, 2000).
3. J. Platt, Fast training of SVMs using sequential minimal optimization, advances in kernel methods support vector learning, MIT Press (1999) 185-208.
4. H. Yu, J. Yang and J. Han, Classifying large data, sets using SVM with hierarchical clusters, in SIGKDD (2003) 306-315.
5. G. Lebrun, C. Charrier and H. Cardot, SVM training time reduction using vector quantization, in ICPR, Vol. 1 (2004), pp. 160-163.
6. I. Steinwart, Sparseness of support vector machines -some asymptotically sharp bounds, in NIPS (2004), pp. 169-184.
7. S. S. Keerthi, O. Chapelle and D. DeCoste, Building support vector machines with reduced classifier complexity, JMLR 7 (2006) 1493-1515.
8. D. Martin, C. Fowlkes and J. Malik, Learning to detect natural image boundaries using local brightness, color and texture cues, TPAMI 26(5) (2004) 530-549.
9. ∼cjlin/libsvm (2001).
10. S. V. N. Vishwanathan, A. J. Smola and M. N. Murty, SimpleSVM, in ICML (2003) 760-767.
11. Y. Y. Ou, C. Y. Chen, S. C. Hwang and Y. J. Oyang, Expediting model selection for SVMs based on data reduction, in IEEE Proc. SMC (2003) 786-791.
12. 1. W. Tsang, J. T. Kwok and P.-M. Cheung, Core vector machines: Fast SVM training on very large data sets, JMLR 6 (2005) 363-392.
13. E. Parrado-Hernndez, I. Mora-Jimnez, J. Arenas Garca, A. R. Figueiras-Vidal and A. Navia-Vzquez, Growing support vector classifiers with controlled complexity, Pattern Recognition 36(7) (2003) 1479-1488.
14. J. Yang, Z.-W. Li and J.-P. Zhang, A training algorithm of incremental support vector machine with recombining method, in Machine Learning and Cybernetics, Vol. 7 (2005), pp. 4285-4288.
15. S. Katagiri and S. Abe, Incremental training of support vector machines using hyperspheres, Pattern R.ecogn. Lett. 27(13) (2006) 1495-1507.
16. R. Herbrich, Learning Kernel Classifiers (The MIT Press, 2002).
17. K. Lin and C. Lin, A study on reduced support vector machines, Neural Networks 14(6) (2003) 1449-1507.
18. T. Thies and F. Weber, Optimal reduced-set vectors for support vector machines with a quadratic kernel, Neural Comput. 16(9) (2004) 1769-1777.
19. S. Abe, Support Vector Machines for Pattern Classification (Springer, 2005).
20. N. Christianini, Dimension reduction in text classification with support vector machines, JMLR 6 (2005) 37-53.
21. O. Chapelle, V. Vapnik, O. Bousquet and S. Mukherjee, Choosing multiple parameters for support vector machines, Machine Learning 46(1-3) (2002) 131-159.
22. H. Fro¨hlich, O. Chapelle and B. Scho¨lkopf, Feature selection for support vector machines using genetic algorithms, International Journal on Artificial Intelligence Tools 13(4) (2004) 791-800.
23. J. Bi, Multi-objective programming in SVMs, in ICML (2003), pp. 35-42.
24. O. Chapelle and V. Vapnik, Model selection for support vector machines, in Advances in Neural Information Processing Systems, Vol. 12 (1999), pp. 230-236.
25. H. Nakayama, Y. Yun, T. Asada and M. Yoon, Mop/gp models for machine learning, European Journal of Operational Research 166(3) (2005) 756-768.
26. R. Rifkin and A. Klautau, in defense of one-vs-all classification, JMLR. 5 (2004) 101-141.
27. G. Lebrun, O. Lezoray, C. Charrier and H. Cardot, An EA Multi-Model Selection for SVM Multi- Class Schemes, Encyclopedia of Artificial Intelligence, information Science Reference, J. R. Rabual and J. Dorado and A. Pazos edition (2008).
28. G. Lebrun, C. Charrier, O. Lezoray, C. Meurie and H. Cardot, Fast pixel classification by SVM using vector quantization, tabu search and hybrid color space, in CAIP (2005) 685-692.
29. G. Lebrun, O. Lezoray, C. Charrier and H. Cardot, A new model selection method for SVM, in IDEAL (2006) 99-107.
30. G. Lebrun, C. Charrier, O. Lezoray, C. Meurie and H. Cardot, A fast and efficient segmentation scheme for cell microscopic image, Cellular and Molecular-Biology, Special Issue on Signal and Image Processing 53(2) (2007) 51-61.
31. A. Tikhonov and V. Arsenin, Solution of Ill-Posed Problems (Winston & Sons, 1977).
32. A. Tikhonov and V. Arsenin, Ill-Posed Problems: Theory and Applications (Kluwer Academic Publishers, 1994).
33. C. A. C Coello and G. B. Lamont D. A. V. Veldhuizen, Evolutionary Algorithms for Solving MultiObjective Problems (Vol. 5) (Kluwer Academic, 2002).
34. A. P. Engelbrecht, Fundamentals of Computational Swarm Intelligence (Wiley, 2006).
35. A. Gersho and R. M. Gray. Vector Quantization and Signal Compression (Kluwer Academic, 1991).
36. J. Han and M. Kamber, Data Mining: Concepts and Techniques, The Morgan Kaufmann Series in Data Management Systems, Jim Gray, Series Editor (Morgan Kaufmann Publishers, 2000).
37. T. Acharya and S. Mitra, Data mining: multimedia, Soft Computing and Bioinformatics (John Wiley and Sons, 2003).
38. P. N. Tan, M. Steinbach and V. Kumar, Introduction to Data Mining (Addison-Wesley, 2006).
39. J.-X. Dong, A. Krzyzak and C. Y. Suen, An improved handwritten Chinese character recognition system using support vector machine, Pattern Recognition Letters 26(12) (2005) 1849-1856.
40. F. Glover and M. Laguna, Tabu Search (Kluwer Academic Publishers, 1997).
41. D. Korycinski, M. M. Crawford and J. W. Barnes, Adaptive feature selection for hyperspectral data analysis, SPIE 5238 (2004) 213-225.
42. Ping-Feng Pai and Yu-Ying Huang, Using directed acyclic graph support vector machines with tabu search for classifying faulty product types, in ISNN (2) (2006) 1117-1125.
43. N. Vandenbroucke, L. Macaire and J.-G. Postaire, Color image segmentation by pixel classification in an adapted hybrid color space: Application to soccer image analysis, Comput. Vis. Image Underst. 90(2) (2003) 190-216.
44. C. Meurie, G. Lebrun, O. Lezoray and A. Elmoataz, A supervised segmentation scheme for cancerology color images, in ISSPIT (2003) 664-667.
45. C. Meurie, O. Lezoray, C. Charrier and A. Elmoataz, Combination of multiple pixel classifiers for microscopic image segmentation, LIRA 20(2)(2005). [Special Issue on Colour Image Processing and Analysis for Machine Vision, ISSN 0826-8185].
46. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Bases Learning Methods (Cambridge University Press, 2000).
47. R. Collobert and S. Bengio, SVMTorch: Support vector machines for large-scale regression problems, in Journal of Machine Learning Research, Vol. 1 (2001), pp. 143-160.
48. J. Platt, Probabilistic outputs for support vector machines and comparison to regularized likelihood methods, in A. J. Smola, P. Bartlett, B. Schoelkopf and D. Schuurmans (eds.), Advances in Large Margin Classifiers (1999) 61-74.
49. D. Price, S. Knerr, L. Personnaz and G. Dreyfus, Pairwise neural network classifiers with probabilistic outputs, in NIPS (1994) 1109-1116.
50. T. Hastie and R. Tibshirani, Classification by pair-wise coupling, in NIPS (1997) 507-513.
51. T. G. Dietterich and G. Bakiri, Solving multiclass learning problems via error-correcting output codes, JAIR 2 (1995) 263-286.
52. M. Moreira and E. Mayoraz, Improved pairwise coupling classification with correcting classifiers, in ECML (1998) 160-171.
53. T.-F. Wu, C.-J. Lin and R. G. Weng, Probability estimates for multi-class classification by pairwise coupling, JMLR 5 (2004) 975-1005.
54. C. Blake and C. Merz, UCI repository of machine learning databases, Advances in Kernel Methods, Support Vector Learning (1998).
55. C. Meurie, G. Lebrun, O. Lezoray and A. Elmoataz, A comparison of supervised pixels-based color image segmentation methods, application in cancerology, in WSEAS Transactions on Computers, Vol. 2 (2003), pp. 739-744.
56. L. I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms (Wiley, 2004).
57. C. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, 1995).
58. S. Haykin, Neural Networks: A Comprehensive Foundation (Tom Robbins, 1999).
59. L. Breiman, J. Freidman, R. Olshen and C. Stone, Classification and Regression Trees (Wadsworth and Brooks, 1984).
60. J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann, 1993).
61. V. Kecman, Learning and Soft Computing (MIT Press, 2001).