The C1C2: A framework for simultaneous model selection and assessment

BMC Bioinformatics

Volumn 9, Issue , 2008, Pages

  Eklund, Martin ^a   Spjuth, Ola ^a   Wikberg, Jarl E S ^a  

^a UPPSALA UNIVERSITY   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC SEARCHES; GENERALIZATION ERROR; INDEPENDENT VARIABLES; K FOLD CROSS VALIDATIONS; PREDICTIVE MODELING; REAL-WORLD DATASETS; SIMULTANEOUS MODEL; VARIABLE SELECTION;

GENETIC ALGORITHMS;

ESTIMATION;

CITRININ; PROTEINASE INHIBITOR;

ACCURACY; ANALYTICAL ERROR; ARTICLE; BIOINFORMATICS; CONCEPTUAL FRAMEWORK; CONTROLLED STUDY; CORRELATION FUNCTION; DEPENDENT VARIABLE; GENETIC ALGORITHM; INDEPENDENT VARIABLE; INFORMATION RETRIEVAL; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; PHYSICAL CHEMISTRY; QUANTITATIVE STRUCTURE ACTIVITY RELATION; SIMULATION; STATISTICAL MODEL; ALGORITHM; BIOLOGICAL MODEL; COMPUTER SIMULATION; DATA BASE; FACTUAL DATABASE; METHODOLOGY; STATISTICAL ANALYSIS;

ALGORITHMS; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; DATABASE MANAGEMENT SYSTEMS; DATABASES, FACTUAL; INFORMATION STORAGE AND RETRIEVAL; MODELS, BIOLOGICAL; MODELS, STATISTICAL;

EID: 52949118135     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-9-360     Document Type: Article

References (43)

1. Kontijevskis A Prusis P Petrovska R Yahorava S Mutulis F Mutule I Komorowski J Wikberg JES A look inside HIV resistance through retroviral protease interaction maps PloS Computational Biology 2007, 3:3. 1817660 17352531
2. Wikberg JES Lapinsh M Prusis P Proteochemometrics: A tool for modelling the molecular interaction space Chemogenomics in Drug Discovery - A Medicinal Chemistry Perspective Weinheim, Wiley-VCH Kubinyi H, Müller G 2004:289-309.
3. Hansch C A Quantitative Approach to Biochemical Structure-Activity Relationships Accounts of Chemical Research 1969, 2:232-239. 10.1021/ ar50020a002
4. Hvidsten TR Wilczynski B Kryshtafovych A Tiuryn J Komorowski J Fidelis K Discovering regulatory binding-site modules using rule-based learning Genome Res 2005/06/03 2005, 15(6):856-866. 1142476 15930496 10.1101/ gr.3760605
5. van't Veer LJ Dai H van de Vijver MJ He YD Hart AA Mao M Peterse HL van der Kooy K Marton MJ Witteveen AT Schreiber GJ Kerkhoven RM Roberts C Linsley PS Bernards R Friend SH Gene expression profiling predicts clinical outcome of breast cancer Nature 2002, 415(6871):530-536. 10.1038/415530a 11823860
6. Johnson SR The Trouble with QSAR (or How I Learned To Stop Worrying and Embrace Fallacy) J Chem Inf Model 2008:25-26. 10.1021/ci700332k 18161959
7. Michiels S Koscielny S Hill C Prediction of cancer outcome with microarrays: A multiple random validation strategy The Lancet 2005, 365(9458):488-492. 10.1016/S0140-6736(05)17866-0
8. Ntzani EE Ioannidis JPA Predictive ability of DNA microarrays for cancer outcomes and correlates: An empirical assessment The Lancet 2003, 362(9394):1439-1444. 10.1016/S0140-6736(03)14686-7
9. Freyhult E Peteris P Lapinsh M Wikberg JES Moulton V Gustafsson MG Unbiased descriptor and parameter selection confirms the potential of proteochemometric modelling BMC Bioinformatics 2005, 6(50):1-14. 545949 15631638
10. Golbraikh A Tropsha A Beware of q2! J Mol Graph Model 2002/02/23 2002, 20(4):269-276. 10.1016/S1093-3263(01)00123-1 11858635
11. Stone M Cross-Validatory Choice and Assessment of Statistical Predictions Journal of the Royal Statistical Society Series B (Methodological) Royal Statistical Society 1974, 36(2):111-147.
12. Cartmell J Enoch S Krstajic D Leahy DE Automated QSPR through Competitive Workflow J Comput Aided Mol Des 2005, 19(11):821-833. 10.1007/s10822-005-9029-8 16416245
13. Cartmell J Krstajic D Leahy DE Competitive Workflow: Novel software architecture for automating drug design Curr Opin Drug Discov Devel 2007, 10(3):347-352. 17554862
14. Obrezanova O Gola JM Champness EJ Segall MD Automatic QSAR modeling of ADME properties: Blood-brain barrier penetration and aqueous solubility J Comput Aided Mol Des 2008, 22(6-7):431-440. 10.1007/s10822-008-9193-8 18273554
15. Efron B Tibshirani R An Introduction to the Bootstrap New York, Chapman & Hall/CRC. 1993.
16. Hastie T Tibshirani R Friedman J The Elements of Statistical Learning Springer series in statistics New York, Springer-Verlag 2001:533.
17. Schwarz G Estimating the Dimension of a Model The Annals of Statistics Institute of Mathematical Statistics 1978, 6(2):461-464. 10.1214/aos/ 1176344136
18. The Selwood dataset http://www.ndsu.edu/qsar_soc/resource/datasets/ selwood.htm
19. Selwood DL Livingstone DJ Comley JCW O'Dowd AB Hudson AT Jackson P Jandu KS Rose VS Stables JN Structure-activity relationships of antifilarial antimycin analogs: A multivariate pattern recognition study Journal of Medicinal Chemistry 1990, 33(1):136-142. 10.1021/jm00163a023 2296013
20. Nicolotti O Carotti A QSAR and QSPR studies of a highly structured physicochemical domain J Chem Inf Model 2006/01/24 2006, 46(1):264-276. 10.1021/ci050293l 16426062
21. Todeschini R Consonni V Mauri A Pavan M Detecting "bad" regression models: Multicriteria fitness functions in regression analysis Analytica Chimica Acta 2004, 515(1):99-208.
22. Burman P A Comparative Study of Ordinary Cross-Validation, v-Fold Cross-Validation and the Repeated Learning-Testing Methods Biometrika Biometrika Trust 1989, 76(3):503-514.
23. Efron B The Estimation of Prediction Error: Covariance Penalties and Cross-Validation Journal of the American Statistical Association American Statistical Association Journal of the American Statistical Association 2004, 99:619-632. 10.1198/016214504000000692
24. Amaldi E Kann V On the Approximability of Minimizing Nonzero Variables Or Unsatisfied Relations in Linear Systems Theoretical Computer Science 1997, 209:237-260.
25. Kubinyi H Variable Selection in QSAR Studies. II. A Highly Efficient Combination of Systematic Search and Evolution QSAR & Combinatorial Science 1994, 13(4):393-401. 10.1002/qsar.19940130403
26. Java - The Source for Java Developers http://java.sun.com/
27. Spjuth O Helmus T Willighagen EL Kuhn S Eklund M Wagener J Murray-Rust P Steinbeck C Wikberg JE Bioclipse: An open source workbench for chemo- and bioinformatics BMC Bioinformatics 2007/02/24 2007, 8:59. 1808478 17316423 10.1186/1471-2105-8-59
28. P http://www.genettasoft.com/p/P.zip
29. JGAP - Java Genetic Algorithms Package http://jgap.sourceforge.net/
30. JGAPm http://www.genettasoft.com/p/JGAPm.zip
31. Shimodaira H Approximately unbiased tests of regions using multistep-multiscale bootstrap resampling Annals of Statistics 2004, 32:2616-2641. 10.1214/009053604000000823
32. pvclust http://www.is.titech.ac.jp/~shimo/prog/pvclust/
33. Skurichina M Stabilizing Weak Classifiers - Regularization and Combining Techniques in Discriminant Analysis Vilnius State University 2001. PhD
34. Cho SJ Hermsmeier MA Genetic Algorithm Guided Selection: Variable Selection and Subset Selection J Chem Inf Comput Sci 2002, 42(4):927-9936. 10.1021/ci010247v 12132894
35. Tibshirani R Regression Shrinkage and Selection via the Lasso Journal of the Royal Statistical Society Series B (Methodological) Royal Statistical Society 1996, 58(1):267-288.
36. Akaike H A new look at the statistical model identification IEEE transactions on automatic control 1974, 19(6);716-7723. 10.1109/ TAC.1974.1100705
37. Shao J An asymptotic theory for linear model selection Statistica Sinica 1997, 7:221-264.
38. Wolpert D Stacked Generalization Neural Networks, 1992, 5:241-259. 10.1016/S0893-6080(05)80023-1
39. Kass RE Wasserman L A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion Journal of the American Statistical Association American Statistical Association 1995, 90(431):928-934. 10.2307/2291327
40. Wasserman L Bayesian model selection and model averaging Mathematical Psychology Symposium Bloomington, Indiana 1999.
41. Kuha J AIC and BIC - Comparisons of Assumptions and Performance Sociological Methods & Research 2004, 33(2):188-229. 10.1177/ 0049124103262065
42. Hoerl AE Kennard RW Ridge Regression: Biased Estimation for Nonorthogonal Problems Technometrics American Statistical Association 1970, 12(1):55-67. 10.2307/1267351
43. Goldberg DE Genetic Algorithms in Search, Optimization and Machine Learning Boston, Addison-Wesley Longman Publishing Co., Inc. 1989:372.