Active learning support vector machines for optimal sample selection in classification

Journal of Chemometrics

Volumn 18, Issue 6, 2004, Pages 294-305

  Zomer, Simeone ^a   Del Nogal Sánchez, Miguel ^b   Brereton, Richard G ^a   Pérez Pavón, José L ^b  

^a UNIVERSITY OF BRISTOL   (United Kingdom)

^b UNIVERSITY OF SALAMANCA   (Spain)

Author keywords

Active learning; Classification; Sample selection; Support vector machines

Indexed keywords

MASS SPECTROMETRY; SUPPORT VECTOR MACHINES; VECTORS;

ACTIVE LEARNING; LABELINGS; LARGE DATASETS; LEARNING SUPPORT; OPTIMAL SAMPLES; SAMPLES SELECTION; SUPPORT VECTOR; SUPPORT VECTOR MACHINE CLASSIFIERS; SUPPORT VECTORS MACHINE; TRAINING SETS;

CLASSIFICATION (OF INFORMATION);

HYDROCARBON;

ALGORITHM; ARTICLE; CHEMICAL ANALYSIS; CHEMICAL LABELING; CLASSIFICATION; DATA BASE; MACHINE; MASS SPECTROMETRY; SOIL;

EID: 9444283161     PISSN: 08869383     EISSN: None     Source Type: Journal    
DOI: 10.1002/cem.872     Document Type: Article

References (38)

1. Bakken GA, Jurs PC. Classification of multidrug-resistance reversal agents using structure-based descriptors and linear discriminant analysis. J. Med. Chem. 2000; 43: 4534-4541.
2. Page CD, Hatzis C. Knowledge Discovery and Data Mining Cup 2001 [Online]. University of Wisconsin, WI, 2001. Available: http://www.cs.wisc.edu/ ∼dpage/kddcup2001/[17 March 2003].
3. Service K, Brereton RG, Harris S. Analysis of badger urine volatiles using gas chromatography mass spectrometry and pattern recognition techniques. Analyst 2000; 126: 615-623.
4. Zomer S, Guillo C, Brereton RG, Hanna-Brown M. Toxicological classification of urine samples using pattern recognition techniques and capillary electrophoresis. Anal. Bioanal. Chem. in press.
5. Idborg-Bjorkman H, Edlund PO, Kvalheim OM, Schuppe-Koistinen I, Jacobsson SP. Screening of biomarkers in rat urine using LC/electrospray ionization-MS and two-way data analysis. Anal. Chem. 2003; 75: 4784-4792.
6. Angluin D. Queries and concept of learning. Mach. Learn. 1988; 2: 319-342.
7. Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann: CA, 2000; 111-118, 839-846, 999-1006.
8. Blake C, Keogh E, Merz CJ. UCI Repository of Machine Learning Database [Online]. University of California, Irvine, CA, 1998. Available: http://www.ics.uci.edu/∼mlearn/MLRepository.html [17 March 2004].
9. Warmuth MK, Ratsch G, Mathieson M, Liao J, Lemmen C. Active learning in the drug discovery process. In Advances in Neural Information Processing Systems 14. MIT Press: Cambridge, MA, 2002; 1449-1456.
10. Pérez Pavón JL, Del Nogal Sánchez M, García Pinto C, Fernández Laespada ME, Moreno Cordero B, Guerrero Peña A. A method for the detection of hydrocarbon pollution in soils by headspace mass spectrometry and pattern recognition techniques. Anal. Chem. 2003; 75: 2034-2041.
11. Vapnik VN. The Nature of Statistical Learning Theory (2nd edn). Springer: New York, 2000.
12. Tay FEH, Cao LJ. Modified support vector machines in financial time series forecasting. Neurocomp. 2002; 48: 847-861.
13. Furey TS, Cristianini N, Duffy N, Bednarski DW, Schummer M, Haussler D. Support vector machines classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 2000; 16: 906-914.
14. Guo G, Li SZ, Chan KL. Support vector machines for face recognition. Image Vis. Comput. 2001; 19: 631-638.
15. Belousov AI, Verzakov SA, Von Frese J. A flexible classification approach with optimal generalisation performance: support vector machines. Chemometrics Intell. Lab. Syst. 2002; 64: 15-25.
16. Thiessen U, Van Brakel R, De Weijer AP, Meissen WJ, Buydens LMC. Using support vector machines for time series prediction. Chemometrics Intell. Lab. Syst. 2003; 69: 35-49.
17. Zomer S, Brereton RG, Carter JF, Eckers C. Support vector machines for the discrimination of analytical chemical data: application to the determination of tablet production by pyrolysis-gas chromatography mass spectrometry. Analyst 2004; 129: 175-181.
18. Amendolia SR, Cossu G, Ganadu ML, Golisio B, Masala GL, Mura GM. A comparative study of k-nearest neighbour, support vector machine and multi-layer perceptron for thalassemia screening. Chemometrics Intell. Lab. Syst. 2003; 69:13-20.
19. Burges CJC. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Disc. 1998; 2: 121-167.
20. Scholkopf B, Smola AJ. Learning with Kernels: Support Vector Machines, Regularization, Optimisation and Beyond. MIT Press: Cambridge, 2002.
21. Campbell C. Kernel methods: a survey of current techniques. Neurocomp. 2002; 48: 63-84.
22. Rivest RL, Eisenberg B. On the sample complexity of pac-learning using random and chosen examples. Proc. 1990 Workshop on Computational Learning Theory, San Mateo, CA, 1990; 154-162.
23. Brereton RG. Chemometrics Data Analysis for the Laboratory and Chemical Plant. Wiley: Chichester, 2003.
24. Nodland E. Studies of self association in alcohols as functions of concentrations and temperature: Part 1. Sample selection. Chemometrics Intell. Lab. Syst. 1999; 49: 33-40.
25. Stanton DT, Morris TW, Roychoudhury S, Parker CN. Application of nearest-neighbour and cluster analysis in pharmaceutical lead discovery. J. Chem. Info. Comput. Sci. 1999; 39: 21-27.
26. Kohonen T. Self-organisation and Associative Memory. Springer: Heidelberg, 1984.
27. Kennard RW, Stone LA. Computer aided design of experiments. Technometrics 1969; 11: 137-148.
28. Wu W, Walczak B, Massart DL, Heuerbing S, Erni F, Last IR, Prebble KA. Artificial neural networks in classification of NIR spectral data: design of the training set. Chemometrics Intell. Lab. Syst. 1996; 33: 35-46.
29. De Groot PJ, Postma GJ, Meissen WJ. Selecting a representative training set for the classification of demolition waste using remote NIR sensing. Anal. Chim. Acta 1999; 392: 67-75.
30. Golbraikh A, Tropsha A. Predictive QSAR modelling based on diversity sampling of experimental datasets for the training and test set selection. Mol. Divers. 2000; 5: 231-243.
31. Rajer-Kanduc K, Zupan J, Majcen N. Separation of data on the training and test set for modelling: a case study for modelling of five colour properties of a white pigment. Chemometrics Intell. Lab. Syst. 2003; 65: 221-229.
32. Kocjancic R, Zupan J. Modelling of the river flowrate: the influence of the training set selection. Chemometrics Intell. Lab. Syst. 2000; 54: 21-34.
33. Xu Y, Brereton RG. A comparative study of cluster validation indices applied to genotyping data. Submitted.
34. Belousov AI, Verzakov SA, Von Frese J. Applicational aspects of support vector machines. J. Chemometrics 2002; 16: 482-489.
35. Ma J, Ahalt S. OSU SVM Classifier Matlab Toolbox (Version 3.00) [Online]. Ohio State University, Columbus, OH, 2001. Available: http://eewww.eng.ohio- state.edu/∼maj/osu_svm/ [17 March 2004].
36. Nadim F, Hoag GE, Liu S, Carley RJ, Zack P. Detection and remediation of soil and aquifer systems contaminated with petroleum products: an overview. J. Petrol. Sci. Eng. 2000; 26: 169-178.
37. Bezdek J. Pattern Recognition with Fuzzy Objective Function Algorithm. Plenum: New York, 1981.
38. Shen H, Carter JF, Brereton RG, Eckers C. Discrimination between tablet production methods using pyrolysis-gas chromatography-mass spectrometry and pattern recognition techniques. Analyst 2003; 128: 287-292.