Design principles of massive, robust prediction systems

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2012, Pages 1357-1365

  Raeder, Troy ^a   Stitelman, Ori ^a   Dalessandro, Brian ^a   Perlich, Claudia ^a   Provost, Foster ^b  

^a M6D Research   (United States)

^b NEW YORK UNIVERSITY   (United States)

Author keywords

data mining systems; data monitoring; quality control

Indexed keywords

CLASSIFICATION MODELS; CLASSIFICATION PERFORMANCE; CONTROL PROCESS; DATA DISTRIBUTION; DATA MINING SYSTEM; DATA MONITORING; DESIGN PRINCIPLES; EXTERNAL FACTORS; HIGH QUALITY; MANUAL INTERVENTION; MASSIVE PRODUCTION; PREDICTION SYSTEMS; SOURCE DATA; TARGETING SYSTEMS;

QUALITY CONTROL;

DATA MINING;

EID: 84866027803     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2339530.2339740     Document Type: Conference Paper

References (20)

1. D. Chan, R. Ge, O. Gershony, T. Hesterberg, and D. Lambert. Evaluating online ad campaigns in a pipeline: causal models at scale. In Proceedings of KDD, pages 7-16. ACM, 2010.
2. N. Chawla and G. Karakoulas. Learning from labeled and unlabeled data: An empirical study across techniques and domains. Journal of Artificial Intelligence Research, 23(1):331-366, 2005.
3. C. Curry, R. Grossman, D. Locke, S. Vejcik, and J. Bugajski. Detecting changes in large data sets of payment card data: a case study. In Proceedings of KDD, pages 1018-1022. ACM, 2007.
4. F. Provost et al. Audience selection for on-line brand advertising: privacy-friendly social network targeting.
5. T. Fawcett and A. Niculescu-Mizil. PAV and the ROC convex hull. Machine Learning, 68(1):97-106, 2007.
6. T. Fawcett and F. Provost. Adaptive fraud detection. Data mining and knowledge discovery, 1(3):291-316, 1997.
7. R. Ghani and M. Kumar. Interactive learning for efficiently detecting errors in insurance claims. In Proceedings of KDD, pages 325-333. ACM, 2011.
8. A. Goldfarb and C. Tucker. Online display advertising: Targeting and obtrusiveness. Marketing Science, 2010.
9. D. Hand. Measuring classifier performance: a coherent alternative to the area under the roc curve. Machine learning, 77(1):103-123, 2009.
10. T. Hastie and R. Tibshirani. Generalized additive models. Chapman & Hall/CRC, 1990.
11. J. Heckman. Sample selection bias as a specification error. Econometrica, pages 153-161, 1979.
12. J. Moreno-Torres, X. Llorà, D. Goldberg, and R. Bhargava. Repairing fractures between data using genetic programming-based feature extraction: A case study in cancer diagnosis. Information Sciences, 2010.
13. A. Niculescu-Mizil and R. Caruana. Predicting good probabilities with supervised learning. In Proceedings of ICML, pages 625-632. ACM, 2005.
14. C. Perlich, P. Melville, Y. Liu, G. Świrszcz, R. Lawrence, and S. Rosset. Breast cancer identification: Kdd cup winner's report. ACM SIGKDD Explorations Newsletter, 10(2):39-42, 2008.
15. J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Advances in Kernel Methods: Support Vector Learning, 208(MSR-TR-98-14):1-21, 1998.
16. D. Sculley, M. Otey, M. Pohl, B. Spitznagel, J. Hainsworth, and Y. Zhou. Detecting adversarial advertisements in the wild. In Proceedings of KDD, pages 274-282. ACM, 2011.
17. H. Stoll. Electronic trading in stock markets. J. Economic Perspectives, 20(1):153-174, 2006.
18. C. Wei, I. Chiu, et al. Turning telecommunications call details to churn prediction: a data mining approach. Expert systems with applications, 23(2):103-112, 2002.
19. B. Zadrozny. Learning and evaluating classifiers under sample selection bias. In Proceedings of ICML, page 114. ACM, 2004.
20. ZenithOptimedia. Global ad expenditure to return to pre-recession peak level this year. http://www.zenithoptimedia.com/files/media/image/news/ PressReleasefiles/2011/July/AdspendforecastsJuly2011.pdf, 2011