Practical lessons of data mining at Yahoo!

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2009, Pages 1047-1055

  Chen, Ye ^a   Pavlov, Dmitry ^b   Berkhin, Pavel ^a   Seetharaman, Aparna ^c   Meltzer, Albert ^c  

^a EBAY INC   (United States)

^b YANDEX   (Russian Federation)

^c YAHOO INC   (United States)

Author keywords

Advertising and optimization; Classification and clustering; Industrial practice and experience; Large scale statistical modeling

Indexed keywords

BUSINESS ENVIRONMENTS; CLASSIFICATION AND CLUSTERING; COMMERCIAL APPLICATIONS; ILLUSTRATIVE EXAMPLES; INDUSTRIAL PRACTICES; LARGE-SCALE STATISTICAL MODELING; STATISTICAL MODELING; SUCCESS FACTORS;

INDUSTRIAL MANAGEMENT; KNOWLEDGE MANAGEMENT;

TRAJECTORIES;

EID: 74549220810     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1645953.1646087     Document Type: Conference Paper

References (30)

1. http://hadoop.apache.org/.
2. S. Agarwal, P. Renaker, and A. Smith. Determining ad targeting information and/or ad creative information using past search queries. U.S. Patent 10/813,925, filed: March 31, 2004.
3. D. Andersen. Using a fast array of wimpy nodes. In The NIPS 2008 Workshop on "Parallel Implementations of Learning Algorithms: What have you done for me lately?", 2008.
4. R. M. Bell and Y. Koren. Lessons from the Netix prize challenge. ACM SIGKDD Explorations, 9(2):75-79, 2007.
5. K. Beyer. Jaql. Hadoop Summit 2008.
6. C. L. Blake and C. J. Merz. UCI repository of machine learning databases, http://archive.ics.uci.edu/ml/, 1998.
7. D. M. Blei, A. Y. Ng, and M. I. Jordan. Latent Dirichlet allocation. The Journal of Machine Learning Research, 3:993-1022, 2003.
8. J. F. Canny. GaP: a factor model for discrete data. ACM Conference on Information Retrieval (SIGIR 2004), pages 122-129, 2004.
9. E. Chang. Scalable collaborative filtering algorithms for mining social networks. In The NIPS 2008 Workshop on "Beyond Search: Computational Intelligence for the Web", 2008.
10. Y. Chen, D. Pavlov, P. Berkhin, and J. F. Canny. Large-scale behavioral targeting for advertising over a network. U.S. Patent Application 12/351,749, led: January 9, 2009.
11. Y. Chen, D. Pavlov, and J. F. Canny. Large-scale behavioral targeting. ACM Conference on Knowledge Discovery and Data Mining (KDD 2009), 2009.
12. Y. Chen, D. Pavlov, J. F. Canny, and E. Manavoglu. Click through rate prediction using a probabilistic latent variable model. U.S. Patent Application 12/474,668, filed: May 29, 2009.
13. C.-T. Chu, S. K. Kim, Y.-A. Lin, Y. Yu, G. Bradski, and A. Y. Ng. Map-reduce for machine learning on multicore. Proceedings of Neural Information Processing Systems Conference (NIPS), 2006.
14. C. Y. Chung, J. M. Koran, L.-J. Lin, and H. Yin. Model for generating user profiles in a behavioral targeting system. U.S. Patent 11/394,374, led: Mar 29, 2006.
15. D. Cohn, L. Atlas, and R. Ladner. Improving generalization with active learning. Machine Learning, 15(2):201-221, 1994.
16. J. Dean and S. Ghemawat. Mapreduce: Simplified data processing on large clusters. Communications of the ACM, 51(1):107-113, 2008.
17. K. Dixon. Yahoo cuts data retention to three months. www.reuter.com, December 17, 2008.
18. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. John Wiley and Sons, 1973.
19. U. M. Fayyad, G. Piatetsky-Shapiro, and P. Smyth. From data mining to knowledge discovery: an overview. Advances in Knowledge Discovery and Data Mining, pages 1-34, 1996.
20. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin. Bayesian Data Analysis. Chapman & Hall/CRC, second edition, 2003.
21. S. Ghemawat, H. Gobioff, and S.-T. Leung. The Google file system. ACM SIGOPS Operating Systems Review, 37(5):29-43, 2003.
22. R. Kohavi, R. M. Henne, and D. Sommerfield. Practical guide to controlled experiments on the web: listen to your customers not to the hippo. ACM Conference on Knowledge Discovery and Data Mining (KDD 2007), pages 959-967, 2007.
23. G. Linden, B. Smith, and J. York. Amazon.com recommendations: item-to-item collaborative filtering. Internet Computing, 7(1):76-80, 2003.
24. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: a not-so-foreign language for data processing. ACM International Conference on Management of Data (SIGMOD 2008), pages 1099-1110, 2008.
25. D. Pavlov, R. Balasubramanyan, B. Dom, S. Kapur, and J. Parikh. Document preprocessing for naive Bayes classification and clustering with mixture of multinomials. ACM Conference on Knowledge Discovery and Data Mining (KDD 2004), pages 829-834, 2004.
26. M. Richardson, E. Dominowska, and R. Ragno. Predicting clicks: estimating the click-through rate for new ads. International World Wide Web Conference (WWW 2007), pages 521-530, 2007.
27. C. Shearer. The CRISP-DM model: the new blueprint for data mining. Journal of Data Warehousing, 5:13-22, 2000.
28. D. A. Spielman and S.-H. Teng. Smoothed analysis of algorithms: Why the simplex algorithm usually takes polynomial time. Journal of the ACM, 51(3):385-463, 2004.
29. Q. Su, D. Pavlov, J.-H. Chow, and W. Baker. Internet-scale collection of human-reviewed data. Proceedings of the 16th International Conference on World Wide Web, pages 231-240, 2007.
30. Y. Yu, M. Isard, D. Fetterly, M. Budiu, U. Erlingsson, P. K. Gunda, and J. Currey. DryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language. Symposium on Operating System Design and Implementation (OSDI 2008), 2008.