Parameter selection of gaussian kernel for one-class SVM

IEEE Transactions on Cybernetics

Volumn 45, Issue 5, 2015, Pages 941-953

  Xiao, Yingchao ^a   Wang, Huangang ^a   Xu, Wenli ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Gaussian kernel; one class SVM (OCSVM); parameter selection

Indexed keywords

FAULT DETECTION; GAUSSIAN DISTRIBUTION;

APPLICATION FIELDS; EFFECTIVE TOOL; GAUSSIAN KERNELS; KERNEL PARAMETER; ONE CLASS-SVM; ONE-CLASS CLASSIFICATION; OPTIMIZATION OBJECTIVE FUNCTION; PARAMETER SELECTION;

SUPPORT VECTOR MACHINES;

EID: 85027932710     PISSN: 21682267     EISSN: 21682275     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2340433     Document Type: Article

References (39)

1. M. A. Bin Shams, H. M. Budman, and T. A. Duever, "Fault detection, identification and diagnosis using CUSUM based PCA," Chem. Eng. Sci., vol. 66, no. 20, pp. 4488-4498, 2011.
2. Y. H. Liu, Y. C. Liu, and Y. Z. Chen, "High-speed inline defect detection for TFT-LCD array process using a novel support vector data description," Expert Syst. Appl., vol. 38, no. 5, pp. 6222-6231, 2011.
3. H. Deng and R. Xu, "Model selection for anomaly detection in wireless ad hoc networks," in Proc. IEEE Symp. Comput. Intell. Data Mining (CIDM), Honolulu, HI, USA, 2007, pp. 540-546.
4. S. Khazai, S. Homayouni, A. Safari, and B. Mojaradi, "Anomaly detection in hyperspectral images based on an adaptive support vector method," IEEE Geosci. Remote Sens. Lett., vol. 8, no. 4, pp. 646-650, Jul. 2011.
5. M. Markou and S. Singh, "Novelty detection: A review-Part 1: Statistical approaches," Signal Process., vol. 83, no. 12, pp. 2481-2497, 2003.
6. M. Markou and S. Singh, "Novelty detection: A review-Part 2: Neural network based approaches," Signal Process., vol. 83, no. 12, pp. 2499-2521, 2003.
7. S. J. Wang, J. B. Yu, E. Lapira, and J. Lee, "A modified support vector data description based novelty detection approach for machinery components," Appl. Soft Comput., vol. 13, no. 2, pp. 1193-1205, 2013.
8. S. J. Qin, "Statistical process monitoring: Basics and beyond," J. Chemometrics, vol. 17, nos. 8-9, pp. 480-502, 2003.
9. A. B. Gardner, A. M. Krieger, G. Vachtsevanos, and B. Litt, "One-class novelty detection for seizure analysis from intracranial EEG," J. Mach. Learn. Res., vol. 7, pp. 1025-1044, Jun. 2006.
10. Z. Q. Ge and Z. H. Song, "Semiconductor manufacturing process monitoring based on adaptive substatistical PCA," IEEE Trans. Semicond. Manuf., vol. 23, no. 1, pp. 99-108, Feb. 2010.
11. S. Roberts and L. Tarassenko, "A probabilistic resource allocating network for novelty detection," Neural Comput., vol. 6, no. 2, pp. 270-284, 1994.
12. Y. Savran and B. Gunsel, "Novelty detection on metallic surfaces by GMM learning in Gabor space," in Proc. Image Anal. Recognit. II, vol. 6112. 2010, pp. 325-334.
13. G. Cohen, H. Sax, and A. Geissbuhler, "Novelty detection using one-class Parzen density estimator. An application to surveillance of nosocomial infections," in Ehealth Beyond the Horizon-Get It There, vol. 136. Amsterdam, The Netherland: IOS Press, 2008, pp. 21-26.
14. W. Sun et al., "A method for multiphase batch process monitoring based on auto phase identification," J. Process Control, vol. 21, no. 4, pp. 627-638, 2011.
15. S. Mika et al., "Kernel PCA and de-noising in feature spaces," in Advances in Neural Information Processing Systems, vol. 11. Denver, CO, USA: MIT press, 1999, pp. 536-542.
16. C. Y. Cheng, C. C. Hsu, and M. C. Chen, "Adaptive kernel principal component analysis (KPCA) for monitoring small disturbances of nonlinear processes," Ind. Eng. Chem. Res., vol. 49, no. 5, pp. 2254-2262, 2010.
17. H. Hoffmann, "Kernel PCA for novelty detection," Pattern Recognit., vol. 40, no. 3, pp. 863-874, 2007.
18. Y. Xiao, H. Wang, W. Xu, and J. Zhou, "L1 norm based KPCA for novelty detection," Pattern Recognit., vol. 46, no. 1, pp. 389-396, 2013.
19. Z. Xu, M. Dai, and D. Meng, "Fast and efficient strategies for model selection of Gaussian support vector machine," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 5, pp. 1292-1307, Oct. 2009.
20. M. Varewyck and J.-P. Martens, "A practical approach to model selection for support vector machines with a Gaussian kernel," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 2, pp. 330-340, Apr. 2011.
21. K.-P. Wu and S.-D. Wang, "Choosing the kernel parameters for support vector machines by the inter-cluster distance in the feature space," Pattern Recognit., vol. 42, no. 5, pp. 710-717, 2009.
22. L. Wang, P. Xue, and K. L. Chan, "Two criteria for model selection in multiclass support vector machines," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1432-1448, Dec. 2008.
23. D. M. J. Tax and R. P. W. Duin, "Uniform object generation for optimizing one-class classifiers," J. Mach. Learn. Res., vol. 2, no. 2, pp. 155-173, 2002.
24. P. F. Evangelista, M. J. Embrechts, and B. K. Szymanski, Some Properties of the Gaussian Kernel for One Class Learning. Berlin, Germany: Springer, 2007, pp. 269-278.
25. B. Schölkopf, J. C. Platt, J. Shawe-Taylor, A. J. Smola, and R. C. Williamson, "Estimating the support of a high-dimensional distribution," Neural Comput., vol. 13, no. 7, pp. 1443-1471, 2001.
26. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA, USA: MIT Press, 2002.
27. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. New York, NY, USA: Cambridge Univ. Press, 2004.
28. J. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," Adv. Large Margin Classifiers, vol. 10, no. 3, pp. 61-74, 1999.
29. T. Glasmachers and C. Igel, "Maximum likelihood model selection for 1-Norm soft margin SVMs with multiple parameters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 8, pp. 1522-1528, Aug. 2010.
30. Y. H. Li and L. Maguire, "Selecting critical patterns based on local geometrical and statistical information," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1189-1201, Jun. 2011.
31. Y. Chen, X. Dang, H. Peng, J. Bart, and L. Henry, "Outlier detection with the kernelized spatial depth function," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 288-305, Feb. 2009.
32. R. Duin et al., (2007). A MATLAB Toolbox for Pattern Recognition [Online]. Available: http://www.prtools.org/
33. C. Chih-Chung and L. Chih-Jen (2001). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/libsvm
34. M. Kubat and S. Matwin, "Addressing the curse of imbalanced training sets: One-sided selection," in Proc. Int. Conf. Mach. Learn., 1997, p. 179.
35. G. Wu and E. Y. Chang, "Class-boundary alignment for imbalanced dataset learning," in Proc. Int. Conf. Mach. Learn. (ICML), Washington, DC, USA, 2003, pp. 49-56.
36. M. R. Wu and J. P. Ye, "A small sphere and large margin approach for novelty detection using training data with outliers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 11, pp. 2088-2092, Nov. 2009.
37. J. Demsar, "Statistical comparisons of classifiers over multiple data sets," J. Mach. Learn. Res., vol. 7, pp. 1-30, Jan. 2006.
38. X. W. Liu, L. Wang, J. P. Yin, E. Zhu, and J. Zhang, "An efficient approach to integrating radius information into multiple kernel learning," IEEE Trans. Cybern., vol. 43, no. 2, pp. 557-569, Apr. 2013.
39. X. W. Liu et al., "An adaptive approach to learning optimal neighborhood kernels," IEEE Trans. Cybern., vol. 43, no. 1, pp. 371-384, Feb. 2013.