Transform regression and the Kolmogorov superposition theorem

Proceedings of the Sixth SIAM International Conference on Data Mining

Volumn 2006, Issue , 2006, Pages 35-46

  Pednault, Edwin ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Decision trees; Generalized additive modeling; Gradient boosting

Indexed keywords

ALGORITHMS; DECISION THEORY; MATHEMATICAL TRANSFORMATIONS; REGRESSION ANALYSIS; TREES (MATHEMATICS);

DECISION TREES; GENERALIZED ADDITIVE MODELING; GRADIENT BOOSTING; SUPERPOSITION THEOREM;

THEOREM PROVING;

EID: 33745469725     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972764.4     Document Type: Conference Paper

References (23)

1. Biggs, D., de Ville, B., and Suen, E. (1991). A method of choosing multiway partitions for classification and decision trees. Journal of Applied Statistics, 18(1):49-62.
2. Dorneich, A., Natarajan, R., Pednault, E., & Tipu, F. (2006). Embedded predictive modeling in a parallel relational database, to appear in Proceedings of the 21st ACM Symposium on Applied Computing, April 2006, Dijon, France.
3. Friedman, J.H. (2001). Greedy function approximation: a gradient boosting machine. Annals of Statistics 29(5):1189-1232.
4. Friedman, J.H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis 38(4):367-378.
5. Girosi, F. & Poggio, T. (1989). Representation properties of networks: Kolmogorov's theorem is irrelevant. Neural Computation 1(4):465-469.
6. Hand, D.J. (1997). Construction and Assessment of Classification Rules. New York: John Wiley and Sons.
7. Hastie, T. & Tibshirani, R. (1990). Generalized Additive Models. New York: Chapman and Hall.
8. Hecht-Nielsen, R. (1987). Kolmogorov's mapping neural network existence theorem. Proc. IEEE International Conference on Neural Networks, Vol. 3, 11-14.
9. th Intl. Workshop on AI and Statistics, 57-64, San Mateo, California: Morgan Kaufmann.
10. Jiang, W. (2002). On weak base hypotheses and their implications for boosting regression and classification. Annals of Statistics 30(1):51-73.
11. Kass, G. V. (1980). An exploratory technique for investigating large quantities of categorical data. Applied Statistics 29(2):119-127.
12. Kolmogorov, A.N. (1957). On the representation of continuous functions of many variables by superposition of continuous functions of one variable and addition. Doklady Akademii Nauk SSSR, 144(5):953-956,
13. Translated in American Mathematical Society Translations Issue Series 2, 28:55-59 (1963).
14. Kůrková, V. (1991). Kolmogorov's theorem is relevant. Neural Computation 3(4):617-622.
15. Kůrková, V. (1992). Kolmogorov's theorem and multilayer neural networks. Neural Networks 5(3):501-506.
16. Lorentz, G.G. (1962). Metric entropy, widths, and superposition of functions. American Mathematical Monthly, 69:469-485.
17. Mallat, S.G. and Zhang, Z. (1993). Matching pursuits with time-frequency dictionaries. IEEE Trans. Signal Processing 41(12):3397-3415.
18. Natarajan, R. & Pednault, E.P.D. (2002). Segmented regression estimators for massive data sets. Proc. Second SIAM International Conference on Data Mining, available online at www.siam.org.
19. Neruda, R., Štědrý, A., & Drkošová J. (2000). Towards feasible learning algorithm based on Kolmogorov theorem. Proc. International Conference on Artificial Intelligence, Vol. II, pp. 915-920. CSREA Press.
20. Sprecher, D.A. (1965). On the structure of continuous functions of several variables. Transactions American Mathematical Society, 115(3):340-355.
21. Sprecher, D.A. (1996). A numerical implementation of Kolmogorov's superpositions. Neural Networks 9(5):765-772.
22. Sprecher, D.A. (1997). A numerical implementation of Kolmogorov's superpositions II. Neural Networks 10(3):447-457.
23. Sprecher, D.A. (2002). Space-filling curves and Kolmogorov superposition-based neural networks. Neural Networks 15(1):57-67.