Penalized feature selection and classification in bioinformatics

Briefings in Bioinformatics

Volumn 9, Issue 5, 2008, Pages 392-403

  Ma, Shuangge ^a,b   Huang, Jian ^c  

^a University of Wisconsin ^*  (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Bioinformatics application; Feature selection; Penalization

Indexed keywords

BIOLOGICAL MARKER; DNA;

BIOINFORMATICS; CANCER CLASSIFICATION; CLASSIFICATION ALGORITHM; DISCRIMINANT ANALYSIS; DNA METHYLATION; DNA MICROARRAY; EPIGENETICS; GENOMICS; INFORMATION PROCESSING; MALIGNANT NEOPLASTIC DISEASE; MASS SPECTROMETRY; MATHEMATICAL COMPUTING; PARAMETRIC TEST; PROTEIN LOCALIZATION; PROTEOMICS; REVIEW; SEQUENCE HOMOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; COMPUTER SIMULATION; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; SOFTWARE;

EID: 49949090353     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbn027     Document Type: Review

References (63)

1. Lesk AM. Introduction to Bioinformatics. USA: Oxford University Press, 2002.
2. Wong S. The Practical Bioinformatician. World Scientific Publishing Company, 2004.
3. Dai J, Lieu L, Rocke D. Dimension reduction for classification with gene expression microarray data. Stat Appl Genet Mol Biol 2006;5 6.
4. Guyon I, Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res 2003;3:1157-82.
5. Saeys Y, Inza I, Larranaga P. A review of feature selection techniques in bioinformatics. Bioinformatics 2007;19: 2507-17.
6. Boulesteix AL. Dimension reduction and classification with high dimensional microarray data. Dissertation, LMU Munchen, Faculty of Mathematics, Computer Science and Statistics, 2005.
7. Nguyen DV, Rocke DM. Tumor classification by partial least squares using microarray gene expression data. Bioinformatics 2002;18 39-50.
8. Blum A, Langley P. Selection of relevant features and examples in machine learning. Artif Intell 1997;97:245-71.
9. Ghosh D, Chinnaiyan AM. Classification and selection and biomarkers in genomic data using Lasso. J Biomed Biotechnol 2005;2:147-54.
10. Zhang H, Ahn J, Lin X, et al. Gene selection using support vector machines with non-convex penalty. Bioinformatics 2006;22 88-95.
11. Liu Z, Jiang F, Tian G, et al. Sparse logistic regression with Lp penalty for biomarker identification. Stat Appl Genet Mol Biol 2007;6:6.
12. Golub TR, Slonim DK, Tamayo, P, et al. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 1999;286:531-7.
13. West M, Blanchette C, Dressmna H, et al. Predicting the clinical status of human breast cancer by using gene expression profiles. Proc Natl Acad Sci USA 2001;98: 11462-67.
14. Zukiel R, Nowak S, Barciszewska A, et al. A simple epigenetic method for the diagnosis and classification of brain tumors. Mol Cancer Res 2004;2:196-202.
15. Piyathilake C, Johannig GL. Cellular vitamins, DNA methylation and cancer risk. Am Soc Nutri Sci 2002;132: 2340S-22344S.
16. Tibshirani R, Hastie T, Narasimhan B, Soltys S, et al. Sample classification from protein mass spectrometry, by 'peak probability contrasts'. Bioinformatics 2004;20: 3034-44.
17. Yang H, Mukomel Y, Fink E. Diagnosis of ovarian cancer based on mass spectra of blood samples. In: Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. The Hague, The Netherlands, 2004;3444-50.
18. Diamandis EP, van der Merwe DE. Plasma protein profiling by mass spectrometry for cancer diagnosis: Opportunities and limitations. Clin Cancer Res 2005;11:963-5.
19. Leslie CS, Eskin E, Cohen A, et al. Mismatch string kernels for discriminative protein classification. Bioinformatics 2004; 20 467-76.
20. Weston J, Leslie C, Zhou D, et al. Semi-supervised protein classification using cluster kernels. Adv Neural Inf Process Syst 2004;16:595-602.
21. Wang H, Fu Y, Sun R, et al. A SVM score for more sensitive and reliable peptide identification via tandem mass spectrometry. Pac Symp Biocomput 2006;11:303-14.
22. Park KJ, Kanehisa M. Prediction of protein subcellular locations by support vector machines using compositions of amino acid and amino acid pairs. Bioinformatics 2003;19: 1656-63.
23. Rey S, Gardy JL, Brinkman FSL. Assessing the precision of high-throughput computational and laboratory approaches for the genome-wide identification of protein subcellular localization in bacteria. BMC Genomics 2005;6:162.
24. Yu CS, Chen YC, Lu CH, et al. Prediction of protein subcellular localization. Proteins 2006:64:643-51.
25. Zou H, Hastie T, Tibshirani R. Sparse principal component analysis. J Comput Graph Stat 2006;15:265-86.
26. McCullagh P, Nelder JA. Generalized Linear Models. London: Chapman and Hall, 1989.
27. Zhu J, Hastie T. Classification of gene microarrays by penalized logistic regression. Biostatistics 2004;5:427-43.
28. Shen L, Tan EC. Dimension reduction based penalized logistic regression for cancer classification using microarray data. IEEE/ACM Trans Comput Biol Bioinform 2005;2:166-75.
29. Shevade SK, Keerthi SS. A simple and efficient algorithm for gene selecting using sparse logistic regression. Bioinformatics 2003; 19:2246-53.
30. Dudoit S, Fridlyand J, Speed TP, et al. Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc 2002;97:77-87.
31. Pepe MS. The Statistical Evaluation of Medical Tests for Classification and Prediction. UK: Oxford University Press, 2003.
32. Ma S, Huang J. Regularized ROC method for disease classification and biomarker selection with microarray data. Bioinformatics 2005; 21:4356-62.
33. Ma S, Song X, Huang J. Regularized binormal ROC method in disease classification using microarray data. BMC Bioinformatics 2006;7 253.
34. Mossman D. Three-way ROCs. Med Decis Making 1999;19: 78-89.
35. Provost F, Domingos P. Tree induction for probability based rankings. Mach Learn 2003;52:199-215.
36. Cristianini N, Shawe-Taylor J. Art Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, 2000.
37. Guyon I, Weston J, Barnhill S, et al. Gene selection for cancer classification using support vector machine. Mach Learn 2004;46 389-422.
38. Hua S, Sun Z. Support vector machine approach for protein subcellular localization prediction. Bioinformatics 2001;17: 721-8.
39. Noble WS. Support vector machine applications in computational biology. In: Scholkopf B, Tsuda K, Vert J, (eds). Kernel Methods in Computational Biology. MIT Press, 2004, pp. 71-92.
40. An J, Wang Z, Ma Z. An incremental learning algorithm for support vector machine. In: Proceedings of the Second International Conference on Machine Learning and Cybernetics. Xi An, China, 2003,
41. Tibshirani R. Regression shrinkage and selection via the Lasso. JRSSB 1996;58:267-88.
42. Knight K, Fu W. Asymptotics for Lasso-type estimators. Ann Stat 2000;28:1356-78.
43. Roth V. The generalized LASSO: A wrapper approach to gene selection for microarray data. Technical Report IAI-TR-2002-8, University of Bonn, Computer Science III, 2002 http://people.inf.ethz.ch/vroth/GenLASSO/ index.html.
44. Wei P, Pan W. Incorporating gene functions into regression analysis of DNA-protein binding data and gene expression data to construct transcriptional networks. IEEE Trans Comput Biol Bioinform 2006; 99:1.
45. Segal MR, Dahlquist KD, Conklin BR. Regression approaches for microarray data analysis. J Comput Biol 2003;10:961-80.
46. Leng C, Lin Y, Wahba G. A note on the LASSO and related procedures in model selection. Star Sin 2006;16: 1273-84.
47. Zhao P, Yu B. On model selection consistency of LASSO. J Mach Learn Res 2006;7:2541-63.
48. Zou H. The adaptive Lasso and its oracle properties. JASA 2006; 101:1418-29.
49. Huang J, Ma S, Zhang C. Adaptive Lasso for sparse high dimensional regression models. Stat Sin 2007. In press.
50. Pan W, Shen X, Jiang A, et al. Semi-supervised learning via penalized mixture model with application to microarray sample classification. Bioinformatics 2006;22:2388-95.
51. Frank IE, Friedman JH. A statistical view of some chemometrics regression tools (with discussion). Technometrics 1993;35 109-48.
52. Fu W. Penalized regressions: The bridge versus the Lasso. J Comput Graph Stat 1998;7:397-416.
53. Huang J, Horowitz J, Ma S. Asymptotic properties of bridge estimators in sparse high-dimensional regression models. Ann Stat 2008;36 587-613.
54. Zou H, Hastie T. Regularization and variable selection via the elastic net. J Roy Stat Soc B 2005;67:301-20.
55. Fan J, Li R. Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 2001;96: 1348-60.
56. Wang L, Chen G, Li H. Group SCAD regression analysis for microarray time course gene expression data. Bioinformatics 2007;23:1486-94.
57. Friedman JH. Herding Lambdas: Fast algorithms for penalized regression and classification. Manuscript, Department of Statistics, Stanford University, 2006 http://www-stat.stanford.edu/~jhf/.
58. Efron B, Hastie T, Johnstone I, et al. Least angle regression (with discussion). Ann Stat 2004;32:407-99.
59. 1 regularization path algorithm for generalized linear models. J Roy Stat Soc B 2007;69:659-77.
60. Kim Y, Kim J. Gradient LASSO for feature selection. In: Proceedings of the 21st International Conference on Machine Learning. Omnipress: Banff, Alberta, Canada, 2004.
61. Ma S, Huang J. Additive risk survival model with microarray data. BMC Bioinformatics 2007;8:192.
62. van't Veer LJ, Dai H, van de Vijver MJ, et al. Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002;415:530-6.
63. Ma S. Empirical study of supervised gene screening. BMC Bioinformatics 2006;7:537.