Neyman-Pearson classification, convexity and stochastic constraints

Journal of Machine Learning Research

Volumn 12, Issue , 2011, Pages 2831-2855

  Rigollet, Philippe ^a   Tong, Xin ^a  

^a Princeton University   (United States)

Author keywords

Anomaly detection; Binary classification; Chance constrained optimization; Empirical constraint; Empirical risk minimization; Neyman Pearson paradigm

Indexed keywords

ANOMALY DETECTION; BINARY CLASSIFICATION; CHANCE-CONSTRAINED OPTIMIZATIONS; EMPIRICAL CONSTRAINT; EMPIRICAL RISK MINIMIZATION; NEYMAN-PEARSON PARADIGM;

COMPUTER PROGRAMMING;

CONSTRAINED OPTIMIZATION;

EID: 80555154412     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (23)

1. P. L. Bartlett, M. I. Jordan, and J. D. McAuliffe. Convexity, classification, and risk bounds. J. Amer. Statist. Assoc, 101(473):138-156, 2006. (Pubitemid 43500031)
2. A. Ben-Tal, L. El Ghaoui, and A. Nemirovski. Robust Optimization. Princeton Series in Applied Mathematics. Princeton University Press, Princeton, NJ, 2009.
3. G. Blanchard, G. Lee, and C. Scott. Semi-supervised novelty detection. J. Mach. Learn. Res., 11:2973-3009, 2010.
4. S. Boucheron, O. Bousquet, and G. Lugosi. Theory of classification: A survey of some recent advances. ESAIMProbab. Stat, 9:323-375, 2005.
5. S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, Cambridge, 2004.
6. G. C. Calafiore and M. C. Campi. The scenario approach to robust control design. IEEE Trans. Automat. Control, 51(5):742-753, 2006. (Pubitemid 43792636)
7. A. Cannon, J. Howse, D. Hush, and C. Scovel. Learning with the Neyman-Pearson and min-max criteria. Technical Report LA-UR-02-2951, 2002.
8. A. Cannon, J. Howse, D. Hush, and C. Scovel. Simple classifiers. Technical Report LA-UR-03-0193, 2003.
9. D. Casasent and X. Chen. Radial basis function neural networks for nonlinear fisher discrimination and neyman-pearson classification. Neural Networks, 16(5-6):529-535, 2003. (Pubitemid 36794324)
10. L. Devroye, L. Gyorfi, and G. Lugosi. A Probabilistic Theory of Pattern Recognition, Volume 31 of Applications of Mathematics (New York). Springer-Verlag, New York, 1996.
11. W. Feller. An Introduction to Probability Theory and Its Applications. Vol. II. Second edition. John Wiley & Sons Inc., New York, 1971.
12. M. Han, D. Chen, and Z. Sun. Analysis to Neyman-Pearson classification with convex loss function. Anal. Theory Appl, 24(1):18-28, 2008.
13. V. Koltchinskii. Oracle Inequalities in Empirical Risk Minimization and Sparse Recovery Problems. École d'Été de Probability de Saint-Flour XXXVIII-2008. Lecture Notes in Mathematics 2033. Berlin: Springer, ix, 254 p. EUR 48.10, 2011.
14. C. M. Lagoa, X. Li, and M. Sznaier. Probabilistically constrained linear programs and risk-adjusted controller design. SIAM J. Optim., 15(3):938-951 (electronic), 2005. (Pubitemid 41156923)
15. E. L. Lehmann and J. P. Romano. Testing Statistical Hypotheses. Springer Texts in Statistics. Springer, New York, third edition, 2005.
16. A. Nemirovski and A. Shapiro. Convex approximations of chance constrained programs. SIAM J. Optim., 17(4):969-996, 2006.
17. A. Prékopa. Stochastic Programming, volume 324 of Mathematics and its Applications. Kluwer Academic Publishers Group, Dordrecht, 1995.
18. R. T. Rockafellar. Convex Analysis. Princeton Landmarks in Mathematics. Princeton University Press, Princeton, NJ, 1997. Reprint of the 1970 original, Princeton Paperbacks.
19. R. Schapire. The strength of weak learnability. Machine learning, 5(2):197-227, 1990.
20. C. Scott. Comparison and design of Neyman-Pearson classifiers. Unpublished, 2005.
21. C. Scott. Performance measures for Neyman-Pearson classification. IEEE Trans. Inform. Theory, 53(8):2852-2863, 2007. (Pubitemid 47249851)
22. C. Scott and R. Nowak. A Neyman-Pearson approach to statistical learning. IEEE Transactions on Information Theory, 51(11):3806-3819, 2005. (Pubitemid 41622582)
23. E. V. Slud. Distribution inequalities for the binomial law. Ann. Probability, 5(3):404-412, 1977.