Conditional validity of inductive conformal predictors

Machine Learning

Volumn 92, Issue 2-3, 2013, Pages 349-376

  Vovk, Vladimir ^a  

^a UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Batch mode of learning; Boosting; Conditional validity; Inductive conformal predictors; MART; ROC curves; Spam detection

Indexed keywords

BATCH MODES; BOOSTING; CONDITIONAL VALIDITY; CONFORMAL PREDICTORS; MART; ROC CURVES; SPAM DETECTION;

ARTIFICIAL INTELLIGENCE;

SOFTWARE ENGINEERING;

EID: 84880107869     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-013-5355-6     Document Type: Conference Paper

References (32)

1. Balasubramanian, V. N.; Ho, S. S.; & Vovk, V. (Eds.) (2013). Conformal prediction for reliable machine learning: theory, adaptations, and applications. Waltham: Elsevier (to appear).
2. Bengio, S.; Mariéthoz, J.; & Keller, M. (2005). The expected performance curve. In Proceedings of the ICML 2005 workshop on ROC analysis in machine learning. URL http://users.dsic.upv.es/~flip/ROCML2005/.
3. Frank, A.; & Asuncion, A. (2010). UCI machine learning repository. URL http://archive.ics.uci.edu/ml.
4. Fraser, D. A. S. (1957). Nonparametric methods in statistics. New York: Wiley.
5. Fraser, D. A. S.; & Wormleighton, R. (1951). Nonparametric estimation IV. The Annals of Mathematical Statistics, 22, 294-298.
6. Freund, Y.; & Schapire, R. E. (1997). A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences, 55, 119-139. (Pubitemid 127433398)
7. Friedman, J. H. (2001). Greedy function approximation: a gradient boosting machine. The Annals of Statistics, 29, 1189-1232. (Pubitemid 33405972)
8. Friedman, J. H. (2002). Stochastic gradient boosting. Computational Statistics & Data Analysis, 38, 367-378. (Pubitemid 34197167)
9. Guttman, I. (1970). Statistical tolerance regions: classical and Bayesian. London: Griffin.
10. Hastie, T.; Tibshirani, R.; & Friedman, J. (2009). The elements of statistical learning: data mining, inference, and prediction (2nd ed.). New York: Springer.
11. Langford, J. (2005). Tutorial on practical prediction theory for classification. Journal of Machine Learning Research, 6, 273-306.
12. Lei, J.; & Wasserman, L. (2013). Distribution free prediction bands for nonparametric regression. Journal of the Royal Statistical Society B (to appear), preliminary version published as Technical Report. arXiv:1203.5422 [stat.ME].
13. Lei, J.; Robins, J.; & Wasserman, L. (2013). Distribution free prediction sets. Journal of the American Statistical Association, 108, 278-287. Preliminary version published as Technical Report. arXiv:1111.1418 [math.ST].
14. Maindonald, J.; & Braun, J. (2007). Data analysis and graphics using R: an example-based approach (2nd ed.). Cambridge: Cambridge University Press.
15. McCullagh, P.; Vovk, V.; Nouretdinov, I.; Devetyarov, D.; & Gammerman, A. (2009). Conditional prediction intervals for linear regression. In Proceedings of the eighth international conference on machine learning and applications, December 13-15, Miami, FL (pp. 131-138). Available from http://www.stat.uchicago.edu/pmcc/reports/predict.pdf.
16. National Institute of Standards and Technology (2012). Digital library of mathematical functions. URL http://dlmf.nist.gov/.
17. Nouretdinov, I. R. (2008). Offline Nearest Neighbour transductive Confidence Machine. In Poster and workshop proceedings of the eighth industrial conference on data mining (pp. 16-24).
18. Papadopoulos, H.; Proedrou, K.; Vovk, V.; & Gammerman, A. (2002a). Inductive confidence machines for regression. In T. Elomaa, H. Mannila, & H. Toivonen (Eds.), Lecture notes in computer science: Vol. 2430. Proceedings of the thirteenth European conference on machine learning, August 19-23, 2002, Helsinki (pp. 345-356). Berlin: Springer.
19. Papadopoulos, H.; Vovk, V.; & Gammerman, A. (2002b). Qualified predictions for large data sets in the case of pattern recognition. In Proceedings of the first international conference on machine learning and applications, June 24-27, 2002, Las Vegas, NV (pp. 159-163). Las Vegas: CSREA Press.
20. Papadopoulos, H.; Gammerman, A.; & Vovk, V. (Eds.) (2013). Special Issue of the Annals of Mathematics and Artificial Intelligence on Conformal Prediction and its Applications. Springer (to appear).
21. Saunders, C.; Gammerman, A.; & Vovk, V. (1999). Transduction with confidence and credibility. In T. Dean (Ed.), Proceedings of the sixteenth international joint conference on artificial intelligence, July 31-August 6, 1999, Stockholm (Vol. 2, pp. 722-726). San Francisco: Morgan Kaufmann.
22. Scheffé, H.; & Tukey, J. W. (1945). Nonparametric estimation I: Validation of order statistics. The Annals of Mathematical Statistics, 16, 187-192.
23. Tsybakov, A. B. (2010). Introduction to nonparametric estimation. New York: Springer.
24. Tukey, J. W. (1947). Nonparametric estimation II: Statistically equivalent blocks and tolerance regions - the continuous case. The Annals of Mathematical Statistics, 18, 529-539.
25. Tukey, J. W. (1948). Nonparametric estimation III: Statistically equivalent blocks and tolerance regions - the discontinuous case. The Annals of Mathematical Statistics, 19, 30-39.
26. Vanderlooy, S.; & Sprinkhuizen-Kuyper, I. G. (2007). A comparison of two approaches to classify with guaranteed performance. In J. N. Kok, J. Koronacki, R. L. de Mántaras, S. Matwin, D. Mladenic, & A. Skowron (Eds.), Lecture notes in computer science: Vol. 4702. Proceedings of the eleventh European conference on principles and practice of knowledge discovery in databases, September 17-21, 2007, Warsaw (pp. 288-299). Berlin: Springer.
27. Vanderlooy, S.; van der Maaten, L.; & Sprinkhuizen-Kuyper, I. (2007). Off-line learning with Transductive Confidence Machines: an empirical evaluation. In P. Perner (Ed.), Lecture notes in artificial intelligence: Vol. 4571. Proceedings of the fifth international conference on machine learning and data mining in pattern recognition, July 18-20, 2007, Leipzig, Germany (pp. 310-323). Berlin: Springer. (Pubitemid 350270672)
28. Vovk, V. (2002). On-line Confidence Machines are well-calibrated. In Proceedings of the forty third annual symposium on foundations of computer science, November 16-19, 2002, Vancouver (pp. 187-196). Los Alamitos: IEEE Computer Society.
29. Vovk, V. (2012). Conditional validity of inductive conformal predictors. In S. C. H. Hoi & W. Buntine (Eds.), Asian conference on machine learning: Vol. 25. JMLR: Workshop and conference proceedings (pp. 475-490).
30. Vovk, V.; Gammerman, A.; & Saunders, C. (1999). Machine-learning applications of algorithmic randomness. In Proceedings of the sixteenth international conference on machine learning, June 27-30, 1999, Bled, Slovenia (pp. 444-453). San Francisco: Morgan Kaufmann.
31. Vovk, V.; Gammerman, A.; & Shafer, G. (2005). Algorithmic learning in a random world. New York: Springer.
32. Wilks, S. S. (1941). Determination of sample sizes for setting tolerance limits. The Annals of Mathematical Statistics, 12, 91-96.