Large-scale machine learning at Twitter

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2012, Pages 793-804

  Lin, Jimmy ^a   Kolcz, Alek ^a  

^a TWITTER INC   (United States)

Author keywords

ensembles; logistic regression; online learning; stochastic gradient descent

Indexed keywords

DATA SAMPLING; ENSEMBLE METHODS; ENSEMBLES; FEATURE GENERATION; LARGE AMOUNTS OF DATA; LOGISTIC REGRESSIONS; ONLINE LEARNING; PREDICTIVE ANALYTICS; PRODUCTION ENVIRONMENTS; SEAMLESS INTEGRATION; STOCHASTIC GRADIENT DESCENT; STORAGE FUNCTION; SUPERVISED CLASSIFICATION; USER DEFINED FUNCTIONS;

DATA WAREHOUSES; INFORMATION MANAGEMENT; LEARNING SYSTEMS; LOGISTICS; MAMMALS; SCHEDULING; SOCIAL NETWORKING (ONLINE); TIME VARYING NETWORKS;

E-LEARNING;

EID: 84862684679     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2213836.2213958     Document Type: Conference Paper

References (49)

1. A. Abouzeid, K. Bajda-Pawlikowski, D. Abadi, A. Silberschatz, and A. Rasin. HadoopDB: An architectural hybrid of MapReduce and DBMS technologies for analytical workloads. VLDB, 2009.
2. A. Agarwal, O. Chapelle, M. Dudik, and J. Langford. A reliable effective terascale linear learning system. arXiv:1110.4198v1, 2011.
3. K. Bajda-Pawlikowski, D. Abadi, A. Silberschatz, and E. Paulson. Efficient processing of data warehousing queries in a split execution environment. SIGMOD, 2011.
4. M. Banko and E. Brill. Scaling to very very large corpora for natural language disambiguation. ACL, 2001.
5. R. Bekkerman and M. Gavish. High-precision phrase-based document classification on a modern scale. KDD, 2011.
6. C. Bishop. Pattern Recognition and Machine Learning. Springer-Verlag, 2006.
7. L. Bottou. Large-scale machine learning with stochastic gradient descent. COMPSTAT, 2010.
8. T. Brants, A. Popat, P. Xu, F. Och, and J. Dean. Large language models in machine translation. EMNLP, 2007.
9. L. Breiman. Bagging predictors. Machine Learning, 24(2):123-140, 1996.
10. L. Breiman. Arcing classifiers. Annals of Statistics, 26(3):801-849, 1998.
11. L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
12. E. Chang, H. Bai, K. Zhu, H. Wang, J. Li, and Z. Qiu. PSVM: Parallel Support Vector Machines with incomplete Cholesky factorization. Scaling up Machine Learning: Parallel and Distributed Approaches. Cambridge University Press, 2012.
13. F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber. Bigtable: A distributed storage system for structured data. OSDI, 2006.
14. J. Cohen, B. Dolan, M. Dunlap, J. Hellerstein, and C. Welton. MAD skills: New analysis practices for big data. VLDB, 2009.
15. J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. OSDI, 2004.
16. C. Dyer, A. Cordova, A. Mont, and J. Lin. Fast, easy, and cheap: Construction of statistical machine translation models with MapReduce. StatMT Workshop, 2008.
17. U. Fayyad and K. Irani. Multi-interval discretization of continuous-valued attributes for classification learning. IJCAI, 1993.
18. A. Gates. Programming Pig. O'Reilly, 2011.
19. A. Gates, O. Natkovich, S. Chopra, P. Kamath, S. Narayanamurthy, C. Olston, B. Reed, S. Srinivasan, and U. Srivastava. Building a high-level dataflow system on top of MapReduce: The Pig experience. VLDB, 2009.
20. A. Ghoting, R. Krishnamurthy, E. Pednault, B. Reinwald, V. Sindhwani, S. Tatikonda, Y. Tian, and S. Vaithyanathan. SystemML: Declarative machine learning on MapReduce. ICDE, 2011.
21. A. Halevy, P. Norvig, and F. Pereira. The unreasonable effectiveness of data. IEEE Intelligent Systems, 24(2):8-12, 2009.
22. J. Hammerbacher. Information platforms and the rise of the data scientist. Beautiful Data: The Stories Behind Elegant Data Solutions. O'Reilly, 2009.
23. T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, 2009.
24. T. Joachims, L. Granka, B. Pan, H. Hembrooke, F. Radlinski, and G. Gay. Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search. ACM TOIS, 25(2):1-27, 2007.
25. E. Kouloumpis, T. Wilson, and J. Moore. Twitter sentiment analysis: The good the bad and the OMG! ICWSM, 2011.
26. L. Kuncheva. Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience, 2004.
27. H. Li. Learning to Rank for Information Retrieval and Natural Language Processing. Morgan & Claypool, 2011.
28. J. Lin and C. Dyer. Data-Intensive Text Processing with MapReduce. Morgan & Claypool, 2010.
29. J. Lin, D. Ryaboy, and K. Weil. Full-text indexing for optimizing selection operations in large-scale data analytics. MAPREDUCE Workshop, 2011.
30. Y. Lin, D. Agrawal, C. Chen, B. Ooi, and S. Wu. Llama: Leveraging columnar storage for scalable join processing in the MapReduce framework. SIGMOD, 2011.
31. LinkedIn. Data infrastructure at LinkedIn. ICDE, 2012.
32. G. Mann, R. McDonald, M. Mohri, N. Silberman, and D. Walker. Efficient large-scale distributed training of conditional maximum entropy models. NIPS, 2009.
33. R. McDonald, K. Hall, and G. Mann. Distributed training strategies for the structured perceptron. HLT, 2010.
34. A. Nandi, C. Yu, P. Bohannon, and R. Ramakrishnan. Distributed cube materialization on holistic measures. ICDE, 2011.
35. A. Ng, G. Bradski, C.-T. Chu, K. Olukotun, S. Kim, Y.-A. Lin, and Y. Yu. Map-reduce for machine learning on multicore. NIPS, 2006.
36. B. O'Connor, R. Balasubramanyan, B. Routledge, and N. Smith. From Tweets to polls: Linking text sentiment to public opinion time series. ICWSM, 2010.
37. C. Olston, B. Reed, U. Srivastava, R. Kumar, and A. Tomkins. Pig Latin: A not-so-foreign language for data processing. SIGMOD, 2008.
38. A. Pak and P. Paroubek. Twitter as a corpus for sentiment analysis and opinion mining. LREC, 2010.
39. B. Panda, J. Herbach, S. Basu, and R. Bayardo. MapReduce and its application to massively parallel learning of decision tree ensembles. Scaling up Machine Learning: Parallel and Distributed Approaches. Cambridge University Press, 2012.
40. B. Pang and L. Lee. Opinion mining and sentiment analysis. FnTIR, 2(1-2):1-135, 2008.
41. D. Patil. Building Data Science Teams. O'Reilly, 2011.
42. D. Sculley, M. Otey, M. Pohl, B. Spitznagel, J. Hainsworth, and Y. Zhou. Detecting adversarial advertisements in the wild. KDD, 2011.
43. Y. Singer and N. Srebro. Pegasos: Primal estimated sub-gradient solver for SVM. ICML, 2007.
44. A. Smola and S. Narayanamurthy. An architecture for parallel topic models. VLDB, 2010.
45. R. Snow, B. O'Connor, D. Jurafsky, and A. Ng. Cheap and fast - but is it good? Evaluating non-expert annotations for natural language tasks. EMNLP, 2008.
46. K. Svore and C. Burges. Large-scale learning to rank using boosted decision trees. Scaling up Machine Learning: Parallel and Distributed Approaches. Cambridge University Press, 2012.
47. A. Thusoo, J. Sarma, N. Jain, Z. Shao, P. Chakka, N. Zhang, S. Anthony, H. Liu, and R. Murthy. Hive - a petabyte scale data warehouse using Hadoop. ICDE, 2010.
48. M. Weimer, T. Condie, and R. Ramakrishnan. Machine learning in ScalOps, a higher order cloud computing language. Big Learning Workshop, 2011.
49. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. Franklin, S. Shenker, and I. Stoica. Resilient distributed datasets: A fault-tolerant abstraction for in-memory cluster computing. Technical Report UCB/EECS-2011-82, Berkeley, 2011.