Correction of regression predictions using the secondary learner on the sensitivity analysis outputs

Computing and Informatics

Volumn 29, Issue 6, 2010, Pages 929-946

  Bosnić, Zoran ^a   Kononenko, Igor ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

Correction of predictions; Prediction accuracy; Prediction error; Predictions; Regression; Sensitivity analysis

Indexed keywords

ERRORS; FORESTRY; REGRESSION ANALYSIS; SENSITIVITY ANALYSIS;

INDIVIDUAL PREDICTION; LOCALLY WEIGHTED REGRESSION; PREDICTION ACCURACY; PREDICTION ERRORS; REGRESSION; REGRESSION MODEL; REGRESSION PREDICTIONS; REGRESSION TREES;

FORECASTING;

EID: 78650252142     PISSN: 13359150     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (37)

1. ALPAYDIN, E.: Introduction to machine Learning. The MIT Press, Cambridge, Massachusetts 2004.
2. CROWDER, M.J.-KIMBER, A.C.-SMITH, R.L.-SWEETING, T.J.: Statistical Concepts in Reliability. Statistical Analysis of Reliability Data, Chapman & Hall, London, UK 1991, pp. 1-11.
3. BOSNIO, Z.-KONONENKO, I.: An Overview of Advances in Reliability Estimation of Individual Predictions in Machine Learning. Intelligent Data Analysis, Vol. 13, 2008, No. 2, pp. 385-401.
4. BOSNIO, Z.-KONONENKO, I.: Estimation of Individual Prediction Reliability Using the Local Sensitivity Analysis. Applied intelligence, Vol. 29, 2007, No. 3, pp. 187-203.
5. th Conference on Uncertainty in Artificial Intelligence, Madison, Wisconsin1998, pp. 148-155.
6. SAUNDERS, C.-GAMMERMAN, A.-VOVK, V.: Transduction with Confidence and Credibility. Proceedings of IJCAI, Vol. 2, 1999, pp. 722-726.
7. th International Conf. on Machine Learning, Morgan Kaufmann, San Francisco 2001, pp. 385-39.
8. WEIGEND, A.-NIX, D.: Predictions with Confidence Intervals (Local Error Bars). In: Proceedings of the International Conference on Neural Information Processing (ICONIP '94), Seoul, Korea 1994, pp. 847-852.
9. HESKES, T.: Practical Confidence and Prediction Intervals. In: Michael C. Mozer, Michael I. Jordan, Thomas Petsche (Eds.): Advances in Neural Information Processing Systems, 1997, Vol. 9, The MIT Press, pp. 176-182.
10. CARNEY, J.-CUNNINGHAM, P.: Confidence and Prediction Intervals for Neural Network Ensembles. In: Proceedings of IJCNN '99, The International Joint Conference on Neural Networks, Washington, USA 1999, pp. 1215-1218.
11. th Belgian-Dutch Conference on Machine Learning 1998, pp. 55-61.
12. SCHAAL, S.-ATKESON, C. G.: Constructive Incremental Learning from Only Local Information. In: Neural Computation, Vol. 10, 1998, No. 8, pp. 2047-2084.
13. WOODS, K.-KEGELMEYER, W. P.-BOWYER, K.: Combination of Multiple Classifiers Using Local Accuracy Estimates. In: IEEE Transactions on PAMI, Vol. 19, 1997, No. 4, pp. 405-410.
14. GIACINTO, G.-ROLI, F.: Dynamic Classifier Selection Based on Multiple Classifier Behaviour. In: Pattern Recognition, Vol. 34, 2001, No. 9, pp. 1879-881.
15. VAPNIK, V.: The Nature of Statistical Learning Theory. Springer Verlag 1995.
16. KUKAR, M.-KONONENKO, I.: Reliable Classifications With Machine Learning. In: Proc. Machine Learning: ECML-2002, Helsinki (Finland) 2002, Springer Verlag, pp. 219-31.
17. BOSNIC, Z.-KONONENKO, I.-ROBNIK-ŠIKONJA, M.-KUKAR, M.: Evaluation of Prediction Reliability in Regression Using the Transduction Principle. In: Proc. of Eurocon 2003, Ljubljana, pp. 99-103.
18. BOUSQUET, O.-ELISSEEFF, E.: Stability and Generalization. Journal of Machine Learning Research, Vol. 2, pp. 499-526, 2002.
19. BOUSQUET, O.-ELISSEEFF, A.: Algorithmic Stability and Generalization Performance. In: NIPS, 2000, pp. 196-202.
20. BOUSQUET, O.-PONTIL, M.: Leave-One-Out Error and Stability of Learning Algorithms With Applications. In: Suykens, J. A. K. et al. (Eds.): Advances in Learning Theory: Methods, Models and Applications, IOS Press 2003.
21. KEARNS, M.J.-RON, D.: Algorithmic Stability and Sanity-Check Bounds for Leave-One-Out Cross-Validation. In: Computational Learning Theory, 1977, pp. 152-162.
22. BREIMAN, L.: Bagging Predictors. In: Machine Learning, Vol. 24, 1996, pp. 123-140.
23. SCHAPIRE, R. E.: A Brief Introduction to Boosting. Proc. IJCAI, pp. 1401-1406, 1999.
24. DRUCKER, H.: Improving Regressors Using Boosting Techniques. In: Machine Learning: Proceedings of the Fourteenth International Conference 1977, pp. 107-115.
25. RIDGEWAY, G.-MADIGAN, D.-RICHARDSON, T.: Boosting Methodology for Regression Problems. In: Proc. Artificial Intelligence and Statistics 1999, pp. 152-161.
26. TIBSHIRANI, J. R.-KNIGHT, K.: The Covariance Inflation Criterion for Adaptive Model Selection. In: Journal of the Royal Statistical Society, Series B 61, 1999, pp. 529-546.
27. ROSIPAL, R.-GIROLAMI, M.-TREJO, L.: On Kernel Principal Component Regression with Covariance Inflation Criterion for Model Selection. Technical report, University of Paisley 2000.
28. ELIDAN, G.-NINIO, M.-FRIEDMAN, N.-SHUURMANS, D.: Data Perturbation for Escaping Local Maxima in Learning. In: Proc. AAAI/IAAI, 2002, pp. 132-139.
29. th International Colloquium of Cognitive Science, San Sebastian, Spain, 1999.
30. th Annual Conference on Computational Learning Theory 1998, pp. 92-100.
31. Li, M.-VITÁNYI, P.: An Introduction to Kolmogorov Complexity and its Applications. Springer-Verlag, New York 1993.
32. NEWMAN, D. J.-HETTICH, S.-BLAKE, C. L.-MERZ, C. J.: UCI Repository of Machine Learning Databases. University of California, Irvine, Dept. of Information and Computer Sciences 1998.
33. Department of Statistics at Carnegie Mellon University: StatLib - Data, Software and News from the Statistics Community. 2005.
34. CESTNIK, B.-BRATKO, I.: On Estimating Probabilities in Tree Pruning. In: Proceedings of European working session on learning (EWSL-91), Porto, Portugal 1991, pp. 138-150.
35. MCCULLOCH, W. S.-PlTTS, W.: A Logical Calculus of the Ideas Imminent in Nervous Activity. In: Bull. of Math, and Biophysics, Vol. 5, 1943, pp. 115-133.
36. KONONENKO, I.: Estimating Attributes: Analysis and Extensions of RELIEF. In: Proc. Machine learning: ECML-94, European conference on machine learning, ISBN 3-540-57868-4, Catania, Sicily 1994, Springer-Verlag, pp. 171-182.
37. ROBNIK-ŠIKONJA, M.-KONONENKO, I.: An Adaptation of Relief for Attribute Estimation in Regression. In Proc. Int. Conf. on Machine Learning ICML-97, ISBN 1-55860-486-3, Nashville, pp. 296-304.