Knowledge discovery in medical and biological datasets using a hybrid bayes classifier/evolutionary algorithm

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 33, Issue 5, 2003, Pages 802-813

  Raymer, Michael L ^a   Doom, Travis E ^a   Kuhn, Leslie A ^b   Punch, William F ^c  

^a Wright State University   (United States)

^b Michigan State University   (United States)

^c Michigan State University   (United States)

Author keywords

Bioinformatics; Evolutionary computing; Genetic algorithms; Pattern recognition

Indexed keywords

DATA MINING; DATA STRUCTURES; EVOLUTIONARY ALGORITHMS; FEATURE EXTRACTION; MEDICAL IMAGING; PATTERN RECOGNITION; STATISTICAL METHODS; X RAY CRYSTALLOGRAPHY;

BIOINFORMATICS; BIOLOGICAL DATASETS; HYBRID BAYES CLASSIFIER; SOLVATION;

BIOMEDICAL ENGINEERING;

EID: 0142009655     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.816922     Document Type: Article

References (52)

1. M.L. Raymer, P. C. Sanschagrin, W. F. Punch, S. Venkataraman, E. D. Goodman, and L. A. Kuhn, "Predicting conserved water-mediated and polar ligand interactions in proteins using a k-nearest-neighbors genetic algorithm," J. Mol. Biol., vol. 265, pp. 445-464, 1997.
2. M. L. Raymer, W. F. Punch, F. D. Goodman, P. C. Sanschagrin, and L. A. Kuhn, "Simultaneous feature scaling and selection using a genetic algorithm," in Proc. 7th Int. Conf Genetic Algorithms (ICGA), T. Bäck, Ed., San Francisco, CA, 1997, pp. 561-567.
3. M. L. Raymer, W. F. Punch, F. D. Goodman, L. A. Kuhn, and A. K. Jain, "Dimensionality reduction using genetic algorithms," IEEE Trans. Evol. Comput., vol. 4, pp. 164-171, July 2000.
4. C. S. Poornima and P. M. Dean, "Hydration in drug design. 1. Multiple hydrogen-bonding features of water molecules in mediating protein ligand interactions," J. Comput. Aided Mol. Design, vol. 9, pp. 500-512, 1995.
5. L. A. Kuhn, M. A. Siani, M. F. Pique, C. L. Fisher, E. D. Getzoff, and J. A. Tainer, "The interdependence of protein surface topography and bound water molecules revealed by surface accessibility and fractal density measures," J. Mol. Biol, vol. 228, pp. 13-22, 1992.
6. C. S. Poornima and P. M. Dean, "Hydration in drug design. 2. Influence of local site surface shape on water binding," J. Comput. Aided Mol. Design, vol. 9, pp. 513-520, 1995.
7. E. N. Baker and R. E. Hubbard, "Hydrogen bonding in globular proteins," Prog. Biophys. Mol. Biol, vol. 44, pp. 97-179, 1984.
8. T. Bayes, "An essay toward solving a problem in the doctrine of chances," Phil. Trans. Roy. Soc., vol. 53, 1763.
9. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
10. P. Domingos and A. Pazzani, "Beyond independence: Conditions for the optimality of the simple bayesian classifier," in Proc. 13th Int. Conf. Machine Learning, L. Saitta, Ed., San Francisco, CA, 1996, pp. 105-112.
11. E. T. Jaynes, "Prior probabilities," IEEE Trans. Syst. Sci. Cybern., vol. SSC-4, pp. 227-241, 1968.
12. A. K. Jain and B. Chandrasekaran, "Dimensionality and sample size considerations in pattern recognition in practice," in Handbook Statistics, P. R. Krishnaiah and L. N. Kanal, Eds. North-Holland, The Netherlands, 1982, vol. 2, pp. 835-855.
13. G. V. Trunk, "A problem of dimensionality: A simple example," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-1, pp. 306-307, 1979.
14. T. M. Cover and J. M. V. Campenhout, "On the possible orderings in the measurement selection problem," IEEE Trans. Syst., Man, Cybern., vol. SMC-7, pp. 657-661, 1977.
15. P. M. Narendra and K. Fukunaga, "A branch and bound algorithm for feature subset selection," IEEE Trans. Comput., vol. C-26, pp. 917-922, 1977.
16. A. Whitney, "A direct method of nonparametric measurement selection," IEEE Trans. Comput., vol. C-20, pp. 1100-1103, 1971.
17. P. Pudil, J. Novovicova, and J. Kittler, "Floating search methods in feature selection," Pattern Recognit. Lett., vol. 15, pp. 1119-1125, Nov. 1994.
18. A. K. Jain and D. Zongker, "Feature selection: Evaluation, application, and small sample performance," IEEE Trans. Pattern Anal. Machine Intell., vol. 19, pp. 153-158, Feb. 1997.
19. J. Mao, K. Mohiuddin, and A. K. Jain, "Parsimonious network design and feature selection through node pruning," in Proc. Intl. Conf Pattern Recognition, Jerusalem, Israel, October 1994, pp. 622-624
20. K. Nozaki, H. Ishibuchi, and H. Tanaka, "Adaptive fuzzy rule-based classification systems," IEEE Trans. Fuzzy Syst., vol. 4, pp. 238-250, Aug. 1996.
21. H. Ishibuchi, K. Nozaki, N. Yamamoto, and H. Tanaka, "Selecting fuzzy if-then rules for classification problems using genetic algorithms," IEEE Trans. Fuzzy Syst., vol. 3, pp. 260-270, Aug. 1995.
22. J. R. Quinlan, "Induction of decision trees," Mach. Learn., vol. 1, pp. 81-106, 1986.
23. ____, "Simplifying decision trees," Int. J. Man-Mach. Stud., pp. 221-234, 1987.
24. W. Siedlecki and J. Sklansky, "A note on genetic algorithms for large-scale feature selection," Pattern Recognit. Lett., vol. 10, pp. 335-347, 1989.
25. T. M. Cover and P. F. Hart, "Nearest neighbor pattern classification," IEEE Trans. Inform. Theory, vol. IT-13, pp. 21-27, Jan., 1967.
26. W. F. Punch E. D. Goodman, M. Pei, L. Chia-Shun, P. Hovland, and R. Enbody, "Further research on feature selection and classification using genetic algorithms," in Proc. Int. Conf. Genetic Algorithms 93, 1993, pp. 557-564.
27. J. D. Kelly and L. Davis, "Hybridizing the genetic algorithm and the k nearest neighbors classification algorithm," in Proc. 4th Int. Conf. Genetic Algorithms Their Applications, 1991, pp. 377-383.
28. J. Yang and V. Honavar, "Feature subset selection using a genetic algorithm," in Feature Extraction, Construction and Selection: A Data Mining Perspective, H. Liu and H. Motoda, Eds. Norwell, MA: Kluwer, 1998, ch. 8, pp. 117-136.
29. J. Yang, R. Parekh, and V. Honavar, "Dist. Al: An inter-pattern distance-based constructive learning algorithm," in Proc. Int. Joint Conf. Neural Networks, Anchorage, AL, 1998.
30. H. Vafaie and K. De Jong, "Evolutionary feature space transformation," in Feature Extraction, Construction and Selection: A Data Mining Perspective, H. Liu and H. Motoda, Eds. Norwell, MA: Kluwer, 1998, ch. 19, pp. 307-323.
31. J. R. Quinlan, "The effect of noise on concept learning," in Machine Learning: An Artificial Intelligence Approach, R. Michalski. J. Carbonnell, and T. Mitchell, Eds. San Mateo, CA: Morgan Kaufmann, 1986, pp. 149-166.
32. K. Fukunaga and P. M. Narendra, "A branch and bound algorithm for computing k-nearest neighbors," IEEE Trans. Comput., vol. C-26, pp. 750-753, 1975.
33. C. L. Blake and C. J. Merz. (1998) UCI Repository of Machine Learning Databases. University of California, Irvine, Dept. Inform. Comput. Sci., [Online]. Available:http://www.ics.uci.edu/~mlearn/IMLRepository.html.
34. P. Diaconis and B. Efron, "Computer-intensive methods in statistics," in Sci. Amer., 1983, vol. 248.
35. G. Cestnik, I. Konenenko, and I. Bratko, "Assistant-86: A knowledge-elicitation tool for sophisticated users," in Progress in Machine Learning, I. Bratko and N. Lavrac, Eds., Islamabad, Pakistan: Sigma,1987, pp. 31-45.
36. J. W. Smith, J. E. Everhart, W. C. Dickson, W. C. Knowler, and R. S. Johannes, "Using the ADAP learning algorithm to forecast the onset of diabetes mellitus," in Proc. Symp. Computer Applications Medical Care, 1988, pp. 261-265.
37. S. Aeberhard, D. Coomans, and O. de Vel, "The Classification Performance of RDA," Dept. Computer Science Dept. Mathematics Statistics, James Cook University of North Queensland, Tech. Rep. 92-01, 1992.
38. ____, "Comparison of Classifiers in High Dimensional Settings," Dept. Comput. Sci., Dept. Math. Stat., James Cook University of North Queensland, Australia, Tech. Rep. 92-02, 1992.
39. V. G. Sigillito, S. P. Wing, L. V. Hutton, and K. B. Baker, "Classification of radar returns from the ionosphere using neural networks," in Proc. Johns Hopkins APL Tech. Dig., vol. 10, 1989, pp. 262-266.
40. S. Weiss and I. Kapouleas, "An empirical comparison of pattern recognition, neural nets, and machine learning classification methods," in Proc. 11th Int. Joint Conf. Artificial Intelligence, N. S. Sridharan, Ed., Detroit, MI, 1989, pp. 781-787.
41. ___, An Empirical Comparison of Pattern Recognition Neural Nets, and Machine Learning Classification Methods. San Mateo, CA: Morgan Kaufmann 1990.
42. J. R. Quinlan, P. J. Compton, K. A. Horn, and L. Lazurus, "Inductive knowledge acquisition: A case study," in Proc. 2nd Australian Conf. Applications Expert Systems, Sydney, Australia, 1986.
43. A. Marchand, F. V. Lente, and R. Galen, "The assessment of laboratory tests in the diagnosis of acute appendicitis," Amer. J. Clin. Pathol., vol. 80, no. 3, pp. 369-374, 1983.
44. E. E. Abola, F. C. Bernstein, S. H. Bryant, T. F. Koetzle, and J. Weng, Protein Data Bank. Bonn/Cambridge/Chester: Data Comm. Int. Union Crystallography, 1987, pp. 107-132.
45. F. C. Bernstein, T. F. Koetzle, G. J. B. Williams, E. F. Meyer Jr., M. D. Brice, J. R. Rodgers, O. Kennard, T. Shimanouchi, and M. Tasumi, "The protein data bank: A computer-based archival file for macromolecular structures," J. Mol. Biol., vol. 112, pp. 535-542, 1977.
46. U. Hobohm, M. Scharf, R. Schneider, and C. Sander, "Selection of representative protein data sets," Protein Sci., vol. 1, pp. 409-417, 1992.
47. L. A. Kuhn, C. A. Swanson, M. E. Pique, J. A. Tainer, and E. D. Getzoff, "Atomic and residue hydrophilicity in the context of folded protein structures," Proteins: Str. Funct. Genet., vol. 23, pp. 536-547, 1995.
48. M. L. Connolly, "Solvent-accessible surfaces of proteins and nucleic acids," Science, vol. 221. pp. 709-713, 1983.
49. R. C. Wade, K. J. Clark, and P. J. Goodford, "Further developments of hydrogen bond functions for use in determining energetically favorable binding sites on molecules of known structure," J. Med. Chem., pp. 140-147, 1993.
50. W. R. Pitt, J. Murray-Rust, and J. M. Goodfellow, "AQUARIUS2: Knowledge-based modeling of solvent sites around proteins," J. Comp. Chem., vol. 14, no. 9, pp. 1007-1018, 1993.
51. A. Vedani and D. W. Huhta, "An algorithm for the systematic solvation of proteins based on the directionality of hydrogen bonds," J. Am. Chem. Soc., vol. 113, pp. 5860-5862, 1991.
52. M. L. Raymer, D. Holstius, and L. A. Kuhn, "Identifying the determinants of favorable solvation sites," Protein Eng.,., 2001, submitted for publication.