Estimation of individual prediction reliability using the local sensitivity analysis

Applied Intelligence

Volumn 29, Issue 3, 2008, Pages 187-203

  Bosnić, Zoran ^a   Kononenko, Igor ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

FORECASTING; IMAGE RETRIEVAL; LEARNING SYSTEMS; MATHEMATICAL MODELS; NETWORK PROTOCOLS; NEURAL NETWORKS; QUALITY ASSURANCE; REGRESSION ANALYSIS; RELIABILITY; RELIABILITY ANALYSIS; RISK ASSESSMENT; RISK PERCEPTION; SENSOR NETWORKS; SUPPORT VECTOR MACHINES; VECTORS;

DATA SETS; EMPIRICAL MEASURES; INDIVIDUAL PREDICTIONS; LOCALLY WEIGHTED REGRESSIONS; MACHINE LEARNINGS; PREDICTION ACCURACIES; PREDICTION ERRORS; PREDICTION MODELS; REGRESSION MODELS; REGRESSION TREES; RELIABILITY MEASURES; RELIABLE; SENSITIVE APPLICATIONS; SUPPORT VECTORS;

SENSITIVITY ANALYSIS;

EID: 54249164497     PISSN: 0924669X     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10489-007-0084-9     Document Type: Article

References (28)

1. O Bousquet A Elisseeff 2002 Stability and generalization J Mach Learn Res 2 499 526
2. Crowder MJ, Kimber AC, Smith RL, Sweeting TJ (1991) Statistical concepts in reliability. Statistical analysis of reliability data. Chapman & Hall, London, pp 1-11
3. Bousquet O, Elisseeff A (2000) Algorithmic stability and generalization performance. In: NIPS, pp 196-202
4. Bousquet O, Pontil M (2003) Leave-one-out error and stability of learning algorithms with applications. In: Suykens JAK et al, Advances in learning theory: methods, models and applications. IOS Press, Amsterdam
5. Kearns MJ, Ron D (1997) Algorithmic stability and sanity-check bounds for leave-one-out cross-validation. In: Computational learing theory, pp 152-162
6. L Breiman 1996 Bagging predictors Mach Learn 24 123 140
7. Schapire RE (1999) A brief introduction to boosting. In: Proceedings of IJCAI, pp 1401-1406
8. Drucker H (1997) Improving regressors using boosting techniques. In: Machine learning: proceedings of the fourteenth international conference, pp 107-115
9. Ridgeway G, Madigan D, Richardson T (1999) Boosting methodology for regression problems. In: Proceedings of the artificial intelligence and statistics, pp 152-161
10. Breiman L (1997) Pasting bites together for prediction in large data sets and on-line. Department of Statistics technical report, University of California, Berkeley
11. R Tibshirani K Knight 1999 The covariance inflation criterion for adaptive model selection J Roy Stat Soc Ser B 61 529 546
12. Rosipal R, Girolami M, Trejo L (2000) On kernel principal component regression with covariance in action criterion for model selection. Technical report, University of Paisley
13. Elidan G, Ninio M, Friedman N, Shuurmans D (2002) Data perturbation for escaping local maxima in learning. In: Proceedings of AAAI/IAAI, pp 132-139
14. Gammerman A, Vovk V, Vapnik V (1998) Learning by transduction. In: Proceedings of the 14th conference on uncertainty in artificial intelligence, Madison, WI, pp 148-155
15. Saunders C, Gammerman A, Vovk V (1999) Transduction with confidence and credibility. In: Proceedings of IJCAI, vol 2, pp 722-726
16. Nouretdinov I, Melluish T, Vovk V (2001) Ridge regression confidence machine. In: Proceedings of the 18th international conference on machine learning. Kaufmann, San Francisco, pp 385-392
17. Vapnik V (1995) The nature of statistical learning theory. Springer, Berlin
18. Kukar M, Kononenko I (2002) Reliable classifications with machine learning. In: Proceedings of the machine learning: ECML-2002. Springer, Helsinki, pp 219-231
19. Bosnić Z, Kononenko I, Robnik-Šikonja M, Kukar M (2003) Evaluation of prediction reliability in regression using the transduction principle. In Proceedings of Eurocon 2003, Ljubljana, pp 99-103
20. Mitchell T (1999) The role of unlabelled data in supervised learning. In: Proceedings of the 6th international colloquium of cognitive science, San Sebastian, Spain
21. Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. In: Proceedings of the 11th annual conference on computational learning theory, pp 92-100
22. Li M, Vitányi P (1993) An introduction to Kolmogorov complexity and its applications. Springer, New York
23. Press WH et al. (2002) Numerical recipes in C: the art of scientific computing. Cambridge University Press, Cambridge
24. Newman DJ, Hettich S, Blake CL, Merz CJ (1998) UCI repository of machine learning databases. Department of Information and Computer Sciences, University of California, Irvine
25. Department of Statistics at Carnegie Mellon University (2005) StatLib-data, software and news from the statistics community
26. Cestnik B, Bratko I (1991) On estimating probabilities in tree pruning. In: Proceedings of European working session on learning (EWSL-91), Porto, Portugal, pp 138-150
27. Chang C, Lin C (2001) LIBSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm
28. Alpaydin E (2004) Introduction to machine learning. MIT Press, Cambridge