Randomized variable elimination

Journal of Machine Learning Research

Volumn 5, Issue , 2004, Pages 1331-1362

  Stracuzzi, David J ^a   Utgoff, Paul E ^a  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

COMPUTATIONAL EXPENSE; COMPUTATIONAL REQUIREMENTS; CONSTANT FACTORS; INPUT VARIABLES; LEARNING COMMUNITY; LEARNING PROBLEM; VARIABLE ELIMINATION; VARIABLE SELECTION;

LEARNING ALGORITHMS;

EID: 33845302828     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (48)

1. D. W. Aha and R. L. Bankert. Feature selection for case-based classification of cloud types: An empirical comparision. In Working Notes of the AAAI-94 Workshop on Case-Based Reasoning, pages 106-112, Seattle, WA, 1994. AAAI Press.
2. H. Almuallim and T. G. Dietterich. Learning with many irrelevant features. In Proceedings of the Ninth National Conference on Artificial Intelligence, Anaheim, CA, 1991. MIT Press.
3. C. L. Blake and C. J. Merz. Uci repository of machine learning databases. Technical report, University of California, Department of Information and Computer Science, 1998.
4. C. Cardie. Using decision trees to improve case-based learning. In Machine Learning: Proceedings of the Tenth International Conference, Amherst, MA, 1993. Morgan Kaufmann.
5. R. Caruana and D. Freitag. Greedy attribute selection. In Machine Learning: Proceedings of the Eleventh International Conference, New Brunswick, NJ, 1994. Morgan Kaufmann.
6. K. J. Cherkauer and J. W. Shavlik. Growing simpler decision trees to facilitate knowledge discovery. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. AAAI Press, 1996.
7. W. W. Cooley and P. R. Lohnes. Multivariate data analysis. Wiley, New York, 1971.
8. P. A. Devijver and J. Kittler. Pattern recognition: A statistical approach. Prentice Hall/International, 1982.
9. P. Domingos. Context sensitive feature selection for lazy learners. Artificial Intelligence Review, 11:227-253, 1997.
10. G. H. Dunteman. Principal components analysis. Sage Publications, Inc., Newbury Park CA, 1989.
11. B. Efron, T. Hastie, I. Johnstone, and R. Tibsharini. Least angle regression. Technical Report TR-220, Stanford University, Department of Statistics, 2003.
12. S. E. Fahlman and C. Lebiere. The cascade-correlation learning architecture. Advances in Neural Information Processing Systems, 2:524-532, 1990.
13. W. Finnoff, F. Hergert, and H. G. Zimmermann. Improving model selection by nonconvergent methods. Neural Networks, 6:771-783, 1993.
14. M. Frean. A "thermal" perceptron learning rule. Neural Computation, 4(6):946-957, 1992.
15. J. H. Friedman and J. W. Tukey. A projection pursuit algorithm for exploratory data analysis. IEEE Transactions on Computers, C-23(9):881-889, 1974.
16. S. I. Gallant. Perceptron-based learning. IEEE Transactions on Neural Networks, 1(2):179-191, 1990.
17. D. Goldberg. Genetic algorithms in search, optimization, and machine learning. Addison-Wesley, Reading, MA, 1989.
18. M. A. Hall. Correlation-based feature selection for machine learning. PhD thesis, Department of Computer Science, University of Waikato, Hamilton, New Zealand, 1999.
19. B. Hassibi and D. G. Stork. Second order derivatives for network pruning: Optimal brain surgeon. In Advances in Neural Information Processing Systems 5. Morgan Kaufmann, 1993.
20. I. Inza, P. Larranaga, R. Etxeberria, and B. Sierra. Feature subset selection by Bayesian networkbased optimization. Artificial Intelligence, 123(1-2):157-184, 2000.
21. G. H. John, R. Kohavi, and K. Pfleger. Irrelevant features and the subset selection problem. In Machine Learning: Proceedings of the Eleventh International Conference, pages 121-129, New Brunswick, NJ, 1994. Morgan Kaufmann.
22. R. Kerber. Chimerge: Discretization of numeric attributes. In Proceedings of the Tenth National Conference on Artificial Intelligence, pages 123-128, San Jose, CA, 1992. MIT Press.
23. R. King, C. Feng, and A. Shutherland. Statlog: Comparison of classification algorithms on large real-world problems. Applied Artificial Intelligence, 9(3):259-287, 1995.
24. K. Kira and L. Rendell. A practical approach to feature selection. In D. Sleeman and P. Edwards, editors, Machine Learning: Proceedings of the Ninth International Conference, San Mateo, CA, 1992. Morgan Kaufmann.
25. J. Kivinen and M. K. Warmuth. Additive versus exponentiated gradient updates for linear prediction. Information and Computation, 132(1):1-64, 1997.
26. R. Kohavi. Wrappers for performance enhancement and oblivious decision graphs. PhD thesis, Department of Computer Science, Stanford University, Stanford, CA, 1995.
27. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2):273-324, 1997.
28. D. Koller and M. Sahami. Toward optimal feature selection. In Machine Learning: Proceedings of the Fourteenth International Conference, pages 284-292. Morgan Kaufmann, 1996.
29. M. Kubat, D. Flotzinger, and G. Pfurtscheller. Discovering patterns in Eeg signals: Comparative study of a few methods. In Proceedings of the European Conference on Machine Learning, pages 367-371, 1993.
30. P. Langley and S. Sage. Oblivious decision trees and abstract cases. In Working Notes of the AAAI-94 Workshop on Case-Based Reasoning, Seattle, WA, 1994. AAAI Press.
31. Y. Le Cun, J. Denker, and S. Solla. Optimal brain damage. In Advances in Neural Information Processing Systems 2, pages 598-605, San Mateo, CA, 1990. Morgan Kaufmann.
32. N. Littlestone. Learning quickly when irrelevant attributes abound: A new linear-threshold algorithm. Machine Learning, 1988.
33. H. Liu and R. Setino. A probabilistic approach to feature selection: A filter solution. In Machine Learning: Proceedings of the Fourteenth International Conference. Morgan Kaufmann, 1996.
34. H. Liu and R. Setiono. Feature selection via discretization. IEEE Transaction on Knowledge and Data Engineering, 9(4):642-645, 1997.
35. O. Maron and A. W. Moore. Hoeffding races: Accelerating model selection search for classification and function approximation. In Advances in Neural Information Processing Systems, volume 6. Morgan Kaufmann, 1994.
36. M. Mitchell. An introduction to genetic algorithms. MIT Press, Cambridge, MA, 1996.
37. M. Mitchell, T. Machine learning. MIT Press, 1997.
38. J. Moody and J. Utans. Architecture selection for neural networks: Application to corporate bond rating prediction. In A. N. Refenes, editor, Neural Networks in the Capital Markets. John Wiley and Sons, 1995.
39. J. R. Quinlan. Induction of decision trees. Machine Learning, 1(1):81-106, 1986.
40. J. R. Quinlan. C4.5: Machine learning programs. Morgan Kaufmann, 1993.
41. F. Rosenblatt. The perceptron: A probabilistic model for information storage and orginization in the brain. Psychological Review, 65:386-407, 1958.
42. D. E. Rumelhart and J. L. McClelland. Parallel distributed processing. MIT Press, Cambridge, MA, 1986. 2 volumes.
43. L. Thurstone. Multivariate data analysis. Psychological Review, 38:406-427, 1931.
44. P. E. Utgoff and D. J. Stracuzzi. Many-layered learning. Neural Computation, 14(10):2497-2529, 2002.
45. H. Vafaie and K. De Jong. Genetic algorithms as a tool for restructuring feature space representations. In Proceedings of the International Conference on Tools with AI. IEEE Computer Society Press, 1995.
46. L. G. Valiant. A theory of the learnable. Communications of the ACM, 27(11):1134-1142, 1984.
47. P. Werbos. Backpropagation: Past and future. In IEEE International Conference on Neural Networks. IEEE Press, 1988.
48. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik. Feature selection for SVMs. In Advances in Neural Information Processing Systems 13, pages 668-674. MIT Press, 2000.