A database-hadoop hybrid approach to scalable machine learning

Proceedings - 2013 IEEE International Congress on Big Data, BigData 2013

Volumn , Issue , 2013, Pages 1-8

  Yui, Makoto ^a   Kojima, Isao ^a  

^a NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY AIST   (Japan)

Author keywords

Hadoop; in database analytics; iterative parameter mixture; logistic regression; MapReduce; stochastic gradient descent

Indexed keywords

HADOOP; IN-DATABASE ANALYTICS; LOGISTIC REGRESSIONS; MAP-REDUCE; STOCHASTIC GRADIENT DESCENT;

CLASSIFICATION (OF INFORMATION); DATABASE SYSTEMS; MULTIPROCESSING SYSTEMS;

LEARNING SYSTEMS;

EID: 84886017591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigData.Congress.2013.10     Document Type: Conference Paper

References (27)

1. J. M. Hellerstein, C. Ré, F. Schoppmann, D. Z. Wang, E. Fratkin, A. Gorajek, K. S. Ng, C. Welton, X. Feng, K. Li, and A. Kumar, "The MADlib analytics library: or MAD skills, the SQL," Proc. VLDB, vol. 5, no. 12, pp. 1700-1711, Aug. 2012.
2. Fuzzy Logix, LLC., "DB Lytix," http://www.fuzzyl.com/products/ in-database-analytics/.
3. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," in Proc. OSDI, 2004, pp. 137-150.
4. J. Yan, X. Yang, R. Gu, C. Yuan, and Y. Huang, "Performance Optimization for Short MapReduce Job Execution in Hadoop," in Proc. International Conference on Cloud and Green Computing (CGC). IEEE, Nov. 2012, pp. 688-694.
5. KDD Cup 2012, Track 2, " http://www.kddcup2012.org/c/kddcup2012- track2."
6. A. Agarwal, O. Chapelle, M. Dud'?k, and J. Langford, "A Reliable Effective Terascale Linear Learning System," CoRR, vol. abs/1110.4198, 2011.
7. X. Feng, A. Kumar, B. Recht, and C. Ré, "Towards a unified architecture for in-RDBMS analytics," in Proc. SIGMOD, 2012, pp. 325-336.
8. L. Bottou, "Online Algorithms and Stochastic Approximations," in Online Learning and Neural Networks, D. Saad, Ed. Cambridge University Press, 1998.
9. J. Lin and A. Kolcz, "Large-Scale Machine Learning at Twitter," in Proc. SIGMOD, 2012, pp. 793-804.
10. K. B. Hall, S. Gilpin, and G. Mann, "MapReduce/Bigtable for Distributed Optimization," in Proc. NIPS workshop on Leaning on Cores, Clusters, and Clouds, 2010.
11. M. Zinkevich, M. Weimer, A. J. Smola, and L. Li, "Parallelized Stochastic Gradient Descent," in Proc. NIPS, 2010, pp. 2595-2603.
12. B. Recht, C. Re, S. J. Wright, and F. Niu, "Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent," in Proc. NIPS, 2011, pp. 693-701.
13. C. T. Chu, S. K. Kim, Y. A. Lin, Y. Yu, G. R. Bradski, A. Y. Ng, and K. Olukotun, "Map-Reduce for Machine Learning on Multicore," in Proc. NIPS, 2006, pp. 281-288.
14. Apache Mahout, "http://mahout.apache.org/."
15. P.-A?. Larson, "Data Reduction by Partial Preaggregation," in Proc. ICDE, 2002, pp. 706-715.
16. M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica, "Spark: Cluster Computing with Working Sets," in Proc. HotCloud, 2010, p. 10.
17. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S.-H. Bae, J. Qiu, and G. Fox, "Twister: a runtime for iterative MapReduce," in Proc. HPDC, 2010, pp. 810-818.
18. Y. Bu, B. Howe, M. Balazinska, and M. D. Ernst, "HaLoop: Efficient Iterative Data Processing on Large Clusters," PVLDB, vol. 3, no. 1, pp. 285-296, 2010.
19. R. McDonald, K. Hall, and G. Mann, "Distributed Training Strategies for the Structured Perceptron," in Proc. NAACL, 2010, pp. 456-464.
20. S. Das, C. Botev, K. Surlaker, B. Ghosh, B. Varadarajan, S. Nagaraj, D. Zhang, L. Gao, J. Westerman, P. Ganti, B. Shkolnik, S. Topiwala, A. Pachev, N. Somasundaram, and S. Subramaniam, "All aboard the Databus!: Linkedin's scalable consistent change data capture platform," in Proc. SOCC, 2012, pp. 18:1-18:14.
21. Apache Sqoop, "http://sqoop.apache.org/."
22. T. White, Hadoop: The Definitive Guide. O'Reilly Media, June 2009.
23. A. P. Bradley, "The use of the area under the ROC curve in the evaluation of machine learning algorithms," Pattern Recognition, vol. 30, no. 7, pp. 1145-1159, July 1997.
24. K. Weinberger, A. Dasgupta, J. Langford, A. Smola, and J. Attenberg, "Feature hashing for large scale multitask learning," in Proc. ICML, 2009, pp. 1113-1120.
25. R. E. Fan, K. W. Chang, C. J. Hsieh, X. R. Wang, and C. J. Lin, "LIBLINEAR: A Library for Large Linear Classification," J. Mach. Learn. Res., vol. 9, pp. 1871-1874, June 2008.
26. Y. He, R. Lee, Y. Huai, Z. Shao, N. Jain, X. Zhang, and Z. Xu, "RCFile: A fast and space-efficient data placement structure in MapReduce-based warehouse systems," in Proc. ICDE. IEEE, 2011, pp. 1199-1208.
27. The Netflix Tech Blog, "System Architectures for Personalization and Recommendation," http://techblog.netflix.com/2013/03/system- architecturesfor. html.