Feature selection using stochastic search: An application to system identification

Journal of Computing in Civil Engineering

Volumn 24, Issue 1, 2010, Pages 3-10

  Saitta, Sandro ^a   Kripakaran, Prakash ^a   Raphael, Benny ^b   Smith, Ian F C ^a  

^a EPFL   (Switzerland)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Decision support; Feature selection; Global search; Indentification; Support vector machine; Wrapper

Indexed keywords

BENCHMARK DATA; CANDIDATE MODELS; DECISION SUPPORTS; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; GLOBAL SEARCH; INDENTIFICATION; MULTIPLE MODELS; STOCHASTIC SAMPLING; STOCHASTIC SEARCH; SYSTEM IDENTIFICATIONS; WRAPPER APPROACH;

ALGORITHMS; DECISION MAKING; DECISION SUPPORT SYSTEMS; IMAGE RETRIEVAL; STOCHASTIC SYSTEMS; SUPPORT VECTOR MACHINES;

IDENTIFICATION (CONTROL SYSTEMS);

EID: 73349136765     PISSN: 08873801     EISSN: None     Source Type: Journal    
DOI: 10.1061/(ASCE)CP.1943-5487.0000003     Document Type: Article

References (43)

1. Caruana, R., and Freitag, D. (1994). " Greedy attribute selection.." Int. Conf. on Machine Learning, Morgan Kaufmann, San Francisco, Calif., 28-36.
2. Catbas, F. N., Ciloglu, S. K., Hasancebi, O., Grimmelsman, K., and Aktan, A. E. (2007). " Limitations in structural identification of large constructed structures.." J. Struct. Eng. 0733-9445, 133 (8), 1051-1066. 10.1061/(ASCE)0733-9445(2007)133:8(1051)
3. Chapelle, O., Vapnik, V., Bousquet, O., and Mukherjee, S. (2002). " Choosing multiple parameters for support vector machines.." Mach. Learn. 0885-6125, 46 (1-3), 131-159. 10.1023/A:1012450327387 (Pubitemid 34129966)
4. Cheng, H., Chen, H., Jiang, G., and Yoshihira, K. (2007). " Nonlinear feature selection by relevance feature vector machine.." Machine learning and data mining in pattern recognition, Springer, Heidelberg, Germany, 144-159.
5. Cristianini, N., and Shawe-Taylor, J. (2000). An introduction to support vector machines and other kernel-based learning methods, Cambridge University Press, Cambridge, U.K.
6. Dash, M., and Liu, H. (1997). " Feature selection for classification.." Intell. Data Anal. 1088-467X, 1 (1-4), 131-156. 10.1016/S1088-467X(97)00008-5
7. Domer, B., Raphael, B., Shea, K., and Smith, I. F. C. (2003). " A study of two stochastic search methods for structural control.." J. Comput. Civ. Eng. 0887-3801, 17 (3), 132-141. 10.1061/(ASCE)0887-3801(2003)17:3(132) (Pubitemid 40475455)
8. Farrar, C. R., and Jauregui, D. A. (1998). " Comparative study of damage identification algorithms applied to a bridge. I: Experiment.." Smart Mater. Struct. 0964-1726, 7 (5), 704-719. 10.1088/0964-1726/7/5/013
9. Frohlich, H., Chapelle, O., and Schölkopf, B. (2003). " Feature selection for support vector machines by means of genetic algorithms.." Proc., 15th IEEE Int. Conf. on Tools with Artificial Intelligence, IEEE Computer Society, Los Alamitos, Calif., 142-148.
10. Gold, C., and Sollich, P. (2003). " Model selection for support vector machine classification.." Neurocomputing 0925-2312, 55 (1-2), 221-249. 10.1016/S0925-2312(03)00375-8 (Pubitemid 37336677)
11. Hsu, C. -W., Chang, C. -C., and Lin, C. -J. (2003). A practical guide to support vector classification, National Taiwan University, Taipei, Taiwan.
12. Huang, J., Cai, Y., and Xu, X. (2007). " A hybrid genetic algorithm for feature selection wrapper based on mutual information.." Pattern Recogn. Lett. 0167-8655, 28 (13), 1825-1844. 10.1016/j.patrec.2007.05.011 (Pubitemid 47058633)
13. Huang, P. -W., and Liu, C. -L. (2006). " Using genetic algorithms for feature selection in predicting financial distresses with support vector machines.." IEEE Int. Conf. on Systems, Man, and Cybernetics, IEEE, New York.
14. Kohavi, R., and John, G. (1998). " The wrapper approach.." Feature selection for knowledge discovery and data mining, Kluwer Academic, Boston, 33-50.
15. Kohavi, R., and Sommerfield, D. (1995). " Feature subset selection using the wrapper model: Overfitting and dynamic search space topology.." The 1st Int. Conf. on Knowledge Discovery and Data Mining, AAAI Press, Menlo Park, Calif., 192-197.
16. Kotsia, I., and Pitas, I. (2007). " Facial expression recognition in image sequences using geometric deformation features and support vector machines.." IEEE Trans. Image Process. 1057-7149, 16 (1), 172-187. 10.1109/TIP.2006.884954 (Pubitemid 46437480)
17. Kudo, M., and Sklansky, J. (2000). " Comparison of algorithms that select features for pattern classiers.." Pattern Recogn. 0031-3203, 33, 25-41. 10.1016/S0031-3203(99)00041-2 (Pubitemid 32081876)
18. Lin, S. -W., Tseng, T. -Y., Chen, S. -C., and Huang, J. -F. (2006). " A SA-based feature selection and parameter optimization approach for support vector machine.." IEEE Int. Conf. on Systems, Man, and Cybernetics, IEEE, New York.
19. Ljung, L. (1999). System identification-Theory for the user, Prentice-Hall, Upper Saddle River, N.J.
20. Luxburg, U., Bousquet, O., and Schölkopf, B. (2004). " A Compression approach to support vector model selection.." J. Mach. Learn. Res. 1532-4435, 5, 293-323.
21. Mao, K. Z. (2004). " Feature subset selection for support vector machines through discriminative function pruning analysis.." IEEE Trans. Syst. Man Cybern. 0018-9472, 34 (1), 60-67. 10.1109/TSMCB.2002.805808
22. Merz, C. J., and Murphy, P. M. (1996). UCI machine learning repository, University of California, Irvine, School of Information and Computer Sciences, Irvine, Calif.
23. Molina, L. C., Belanche, L., and Nebot, A. (2002). " Feature selection algorithms: A survey and experimental evaluation.." Proc., 2002 IEEE Int. Conf. on Data Mining (ICDM'02), IEEE Computer Society, Los Alamitos, Calif.
24. Oh, I. -S., Lee, J. -S., and Moon, B. -R. (2004). " Hybrid genetic algorithms for feature selection.." IEEE Trans. Pattern Anal. Mach. Intell. 0162-8828, 26 (11), 1424-1437. 10.1109/TPAMI.2004.105 (Pubitemid 40168020)
25. Posenato, D., Lanata, F., Inaudi, D., and Smith, I. F. C. (2008). " Model-free data interpretation for continuous monitoring of complex structures.." Adv. Eng. Inf. 1474-0346, 22 (1), 135-144. 10.1016/j.aei.2007.02.002 (Pubitemid 351273672)
26. Rakotomamonjy, A. (2003). " Variable selection using SVM-based criteria.." J. Mach. Learn. Res. 1532-4435, 3, 1357-1370. 10.1162/153244303322753706
27. Raphael, B., and Smith, I. F. C. (2003a). " A direct stochastic algorithm for global search.." Appl. Math. Comput. 0096-3003, 146 (2-3), 729-758. 10.1016/S0096-3003(02)00629-X
28. Raphael, B., and Smith, I. F. C. (2003b). Fundamentals of computer-aided engineering, Wiley, New York.
29. Raphael, B., and Smith, I. F. C. (2005). " Engineering applications of a direct search algorithm, PGSL.." Proc., 2005 ASCE Computing Conf., ASCE, Reston, Va.
30. Reunanen, J. (2003). " Overfitting in making comparisons between variable selection methods.." J. Mach. Learn. Res. 1532-4435, 3, 1371-1382. 10.1162/153244303322753715
31. Robert-Nicoud, Y., Raphael, B., Burdet, O., and Smith, I. F. C. (2005a). " Model identification of bridges using measurement data.." Comput. Aided Civ. Infrastruct. Eng. 1093-9687, 20 (2), 118-131. 10.1111/j.1467-8667. 2005.00381.x
32. Robert-Nicoud, Y., Raphael, B., and Smith, I. F. C. (2005b). " System identification through model composition and stochastic search.." J. Comput. Civ. Eng. 0887-3801, 19 (3), 239-247. 10.1061/(ASCE)0887-3801(2005)19: 3(239) (Pubitemid 41092936)
33. Saitta, S. (2008). " Data mining methodologies for supporting engineers during system identification.," Ph.D. dissertation, EPFL, Lausanne.
34. Saitta, S., Kripakaran, P., Raphael, B., and Smith, I. F. C. (2008). " Improving System Identification using Clustering.." J. Comput. Civ. Eng. 0887-3801, 22 (5), 292-302. 10.1061/(ASCE)0887-3801(2008)22:5(292)
35. Saitta, S., Raphael, B., and Smith, I. F. C. (2005). " Data mining techniques for improving the reliability of system identification.." Adv. Eng. Inf. 1474-0346, 19 (4), 289-298. 10.1016/j.aei.2005.07.005 (Pubitemid 41501631)
36. Salvo, A. (2006). Ponts de Robert Maillart, EPFL-MCS, Lausanne, Switzerland.
37. Sanayei, M., Imbaro, G., McClain, J. A. S., and Brown, L. C. (1997). " Structural model updating using experimental static measurements.." J. Struct. Eng. 0733-9445, 123 (6), 792-798. 10.1061/(ASCE)0733-9445(1997)123: 6(792)
38. Soares, C., Brazdil, P., and Kuba, P. (2004). " A meta-learning method to select the kernel width in support vector regression.." Mach. Learn. 0885-6125, 54 (3), 195-209. 10.1023/B:MACH.0000015879.28004.9b
39. Tan, P. -N., Steinbach, M., and Kumar, V. (2006). Introduction to data mining, Addison-Wesley, Reading, Mass.
40. Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., and Vapnik, V. (2001). " Feature selection for SVMs.." Advances in neural information processing systems, MIT Press, Cambridge, Mass., Vol. 13.
41. Weston, J., and Watkins, C. (1998). " Multi-class support vector machines.." CSD-TR-98-04, Department of Computer Science, Royal Holloway, University of London, Surrey, England.
42. Yang, J., and Honavar, V. (1998). " Feature subset selection using a genetic algorithm.." Feature selection for knowledge discovery and data mining, Kluwer Academic, Boston, 117-136.
43. Zhuang, D., Zhang, B., Yang, Q., Yan, J., Chen, Z., and Chen, Y. (2005). " Efficient text classification by weighted proximal SVM.." 5th IEEE Int. Conf. on Data Mining, IEEE Computer Society, Washington, D.C., 538-545. (Pubitemid 47385736)