Logic Regression

Journal of Computational and Graphical Statistics

Volumn 12, Issue 3, 2003, Pages 475-511

  Ruczinski, Ingo ^a   Kooperberg, Charles ^b   Leblanc, Michael ^b  

^a JOHNS HOPKINS BLOOMBERG SCHOOL OF PUBLIC HEALTH   (United States)

^b Fred Hutchinson Cancer Research Center   (United States)

Author keywords

Adaptive model selection; Binary variables; Boolean logic; Interactions; Simulated annealing; Snp data

Indexed keywords

EID: 0141872478     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/1061860032238     Document Type: Review

References (66)

1. Amit Y., and Geman, D. (1997), "Shape Quantization and Recognition with Randomized Trees," Neural Computation, 9, 1545-1588.
2. Anthony, M. (2001), "Discrete Mathematics of Neural Networks: Selected Topics," SIAM Monographs on Discrete Mathematics and Applications, 8.
3. Apte, C., Damerau, F., and Weiss, S. M. (1994), "Towards Language Independent Automated Learning of Text Categorisation Models," Research and Development in Information Retrieval, 23-30.
4. Apte, C., and Weiss, S. M. (1997), "Data Mining with Decision Trees and Decision Rules," Future Generation Computer Systems, 13, 197-210.
5. Bala, J., DeJong, K., and Pachowicz, P. (1991), "Learning Noise Tolerant Classification Procedures by Integrating Inductive Learning and Genetic Algorithms," in Proceedings of the First International Workshop on Multistrategy Learning MSL-91, pp. 316-323.
6. Bayardo, R. J. Jr., and Agrawal, R. (1999), "Mining the Most Interesting Rules," Knowledge Discovery and Data Mining, 145-154.
7. Breiman, L. (1996), "Bagging Predictors," Machine Learning, 24, 123-140.
8. _ (1999), "Random Forests - Random Features," Technical report. Department of Statistics, University of California Berkeley.
9. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. I. (1984), Classification and Regiession Trees, Belmont, CA: Wadsworm.
10. Bryan, R. N., Manolio, T. A., Schertz, L. D., Jungreis, C., Poirier, V. C., Elster, A. D., and Kronmal, R. A. (1994), "A Method for Using MR to Evaluate the Effects of Cardiovascular Disease on the Brain: the Cardiovascular Health Study", American Journal of Neuroradiology, 15, 1625-1633.
11. Buntine, W. (1992), "Learning Classification Trees," Statistics and Computing, 2, 63-73.
12. Chipman, H., George, E., and McCulloch, R. (1998), "Bayesian CART Model Search" (with discussion), Journal of the American Statistical Association, 93, 935-960.
13. _ (2002), "Bayesian Treed Models," Machine Learning, 48, 299-320.
14. Clark, P., and Niblett, T. (1989), "The CN2 Induction Algorithm," Machine Learning, 3, 261-283.
15. Cohen, W. (199S), "Fast Effective Rule Induction," International Conference on Machine Learning, 115-123.
16. Cohen, W., and Singer, Y. (1999), "A Simple, Fast, and Effective Rule Learner," in Proceedings of Annual Conference of American Association for Artificial Intelligence, 335-342.
17. Duly, M. J., Rioux, J. D., Schaffner, S. F., Hudson, T. J., and Lander, E. S. (2001), "High Resolution Haplotype Structure in the Human Genome," Nature Genetics, 29, 229-232.
18. Denison, D., Mallick, B., and Smith, A. F. M. (1998), "A Bayesian CART Algorithm," Biometrika, 85, 363-377.
19. Deshpande, A. S., and Triantaphyllou, E. (1998). "A Greedy Randomized Adaptive Search Procedure," Mathematical Computer Modelling, 27, 75-99.
20. Dietterich, T.G. (1999), "An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization," Machine Learning, 40, 139-158.
21. Domingos, P. (1996), "Linear-Time Rule Induction," Knowledge Discovery and Data Mining, 96-101.
22. Fleisher, H., Tavel, M., and Yeager, J. (1983), "Exclusive-OR Representations of Boolean Functions," IBM Journal of Research and Development, 27, 412-416.
23. Fleisher, H., Giraldi, J., Martin, D. B., Phoenix, R. L., and Tavel, M. A. (1985), "Simulated Annealing as a Tool for Logic Optimization in a CAD Environment," in Proceedings of the International Conference on Computer-Aided Design, pp. 203-205.
24. Frean, M. (1990), "Small Nets and Short Paths: Optimising Neural Computation," PhD thesis, University of Edinburgh, Center for Cognitive Science.
25. Freund, Y., and Schapire, R. (1996), "Experiments With a New Boosting Algorithm," in Proceedings of the 13th International Conference on Machine Learning, pp. 148-156.
26. Fried, L. P., Borhani, N. O., Enright, P., Furberg, C. D., Gardin, J. M., Kronmal, R. A., Kuller, L. H., Manolio, T. A., Mittelmark, M. B., Newman, A. B., O'Leary, D. H., Psaty, B., Rautaharju, P., Tracy, R. P., and Weiler, P. G. (1991), "The Cardiovascular Health Study: Design and Rationale " Annals of Epidemiology, 1, 263-276.
27. Friedman, J. H. (1991), "Multivariate Adaptive Regression Splines" (with discussion). The Annals of Statistics, 19, 1-141.
28. Friedman, J. H., and Fisher, N. L. (1999), "Bump Hunting in High-Dimensional Data," Statistics and Computing, 9, 123-162.
29. Giordana, A., and Saitta, L. (1993), "REGAL: An Integrated System for Learning Relations Using Genetic Algorithms," in Proceedings of the Second International Workshop on Multistrategy Learning (MSL-93), pp. 234-249.
30. Gray, D. L., and Michel, A. N. (1992), "A Training Algorithm for Binary Feedforward Neural Networks," IEEE Transactions on Neural Networks, 3, 176-194.
31. Hong, S. (1997), "R-MINI: An Iterative Approach for Generating Minimal Rules from Examples," IEEE Transactions on Knowledge and Data Engineering, 9, 709-717.
32. Hong, S., Cain, R. G., and Ostapko, D. L. (1974), "MINI: A Heuristic Approach for Logic Minimization," IBM Journal of Research and Development, 18, 443-458.
33. Jordan, M. I., and Jacobs, R. A. (1994), "Hierarchical Mixtures of Experts and the EM Algorithm," Neural Computation, 6, 181-214.
34. Kooperberg, C., Ruczinski, L., LeBlanc, M. L., and Hsu, L. (2001), "Sequence Analysis using Logic Regression," Genetic Epidemiology, 21. Supplement 1, 626-631.
35. Liu, B., Hsu, W., and Ma, Y. (1998), "Integrating Classification and Association Rule Mining," Proceedings of International Confon Knowledge Discovery and Data Mining, pp. 80-86.
36. Lucek, P. R., and Ott, J. (1997), "Neural Network Analysis of Complex Traits," Genetic Epidemiology, 14, 1101-1106.
37. Lutsko, J. F., and Kuijpers, B. (1994), "Simulated Annealing in the Construction of Near-Optimal Decision Trees," in Selecting Models from Data: AI&Statistics IV, New York: Springer, pp. 453-462.
38. McClelland, R. (2000), "Regression Based Variable Clustering for Data Reduction," PhD thesis. University of Washington, Department of Biostatistics.
39. Mehta, M., Rissanen, J., and Agrawal, R. (1995), "MDL-Based Decision Tree Pruning," in Proceedings of the First International Conference on Knowledge Discovery and Data Mining KDD95, pp. 216-221.
40. Mehta, M., Agrawal, R., and Rissanen, J. (1996), "SLIQ: A Fast Scalable Classifier for Data Mining," Extending Database Technology, 18-32.
41. Meretakis, D., and Wuthrich, B. (1999), "Extending Naive Bayes Classifiers Using Long Itemsets," Knowledge Discovery and Data Mining, 165-174.
42. Michalski, R., Mozetic, I., Hong, J., and Lavrac, N. (1986), The Multi-Purpose Incremental Learning System AQ15 and its Testing Application to Three Medical Domains," Proceedings of the AAAI, pp. 1041-1045.
43. Murthy, S. K., and Salzberg, S. (1995), "Decision Tree Induction: How Effective is the Greedy Heuristic?," Knowledge Discovery and Data Mining, 222-227.
44. Otten, R. H., and Ginneken, L. P. (1989), The Annealing Algorithm, Boston: Kluwer Academic Publishers.
45. Quinlan, J. R. (1986), "Induction of Decision Trees," Machine Learning, 1, 81-106.
46. _ (1992), "Learning with Continuous Classes," 5th Australian Joint Conference on Artificial Intelligence, 343-348.
47. _ (1993), C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann.
48. _ (1996), "Bagging, Boosting and C4.5", in Proceedings of AAAI'96 National Conference on Artificial Intelligence, pp. 725-730.
49. Ruczinski, I. (2000), "Logic Regression and Statistical Issues Related to the Protein Folding Problem," PhD thesis, University of Washington, Department of Statistics.
50. Sutton, C. (1991), "Improving Classification Trees with Simulated Annealing," in Proceedings of the 23rd Symposium on the Interface, ed. E. Kazimadas, Fairfax, VA: Interface Foundation of North America.
51. Teng, E. L., and Chui, H. C. (1987), The Modified Mini-Mental State (3MS) Examination," Journal of Clinical Psychiatry, 48, 314-318.
52. Thimm, G., and Fiesler, E. (1996), "A Boolean Approach to Construct Neural Networks for Non-Boolean Problems," Proceedings of the Eighth International Conference on Tools with Artificial Intelligence (ICTAI), pp. 458-459.
53. Tibshirani, R., and Knight, K. (1999), "Model Search and Inference by Bootstrap 'Bumping'," Journal of Computational and Graphical Statistics', 8, 671-686.
54. Torgo, L. (1995), "Data Fitting with Rule-based Regression," in Proceedings of the 2nd International Workshop on Artificial Intelligence Techniques (AIT'95), eds. J. Zizka, and P. Brazdil, Brno, Czech Republic.
55. Torgo, L., and Gama, J. (1996), "Regression by Classification, " Brazilian Symposium on Artificial Intelligence, 51-60.
56. Vafaie, H., and Delong, K. (1991), "Improving the Performance of a Rule Induction System Using Genetic Algorithms," in Proceedings of the First International Workshop on Multistralegy Learning MSL-91, pp. 305-315.
57. van Laarhoven, P. J., and Aarts, E. H. (1987), Simulated Annealing: Theory and Applications, Boston: Kluwer Academic Publishers.
58. Webb, G. (2000), "Efficient Search for Association Rules," in Proceedings of the sixth International Conference on Knowledge Discovery and Data Mining KDD 2000, 99-107.
59. _ (2001), "Discovering Associations with Numeric Variables," in Proceedings of the seventh International Conference on Knowledge Discovery and Data Mining KDD 2001, pp. 383-388.
60. Weiss, S. M., and Indurkhya, N. (1993a), "Optimized Rule Induction," IEEE Expert, December, 61-69.
61. _ (1993b), "Rule-Based Regression," in Proceedings of the 13th International Joint Conference on Artificial Intelligence (IJCAI), pp. 1072-1078.
62. _ (1995), "Rule-Based Machine Learning Methods for Functional Prediction," Journal of Artificial Intelligence Research, 3, 383-403.
63. Wijsman, E. M., Almasy, L., Amos, C. I., Borecki, I., Falk, C. T., King, T. M., Martinez, M. M., Meyers, D., Neuman, R., Olson, J. M., Rich, S., Spence, M. A., Thomas, D. C., Vieland, V. J., Witte, J. S., MacCluer, J. W. (2001), "Analysis of Complex Genetic Traits: Applications to Asthma and Simulated Data," Genetic Epidemiology, 21, Supplement 1.
64. Witte, J. S., and Fijal, B. A. (2001), "Introduction: Analysis of Sequence Data and Population Structure," Genetic Epidemiology, 21, Supplement 1, pp. 600-601.
65. Wnek, J., and Michalski, R. (1994), "Comparing Symbolic and Subsymbolic Learning: Three Studies," Machine Learning: A Multistrategy Approach, eds. R. Michalski and G. Tecuci, 4, San Francisco: Morgan-Kaufmann.
66. Zhang, J., and Michalski, R. S. (1989), "Rule Optimization via SG-Trunc Method," European Working Session on Learning, 251-262.