Research of the big data platform and the traditional data acquisition and transmission based on sqoop technology

Open Automation and Control Systems Journal

Volumn 7, Issue 1, 2015, Pages 1174-1180

  Chen, Changai ^a   Jiang, Shan ^a  

^a HENAN UNIVERSITY OF CHINESE MEDICINE   (China)

Author keywords

Big data platform; Data acquisition and transmission; Sqoop; Transitional data

Indexed keywords

DATA ACQUISITION; DATA WAREHOUSES;

DATA ACQUISITION AND TRANSMISSIONS; DATA PLATFORM; SQOOP; TRANSITIONAL DATA;

BIG DATA;

EID: 84958233945     PISSN: None     EISSN: 18744443     Source Type: Journal    
DOI: 10.2174/1874444301507011174     Document Type: Article

References (7)

1. E. Dumbill, Apache Hadoop What You Need to Know About this Important Big Data Tool. [http://www.forbes.com/sites/oreillymedia/2012/02/07/apachehadoop-what-you-need-to-know-about-this-important-big-datatool/].
2. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S. Bae, J. Qiu, and G. Fox, “Twister: A runtime for iterative mapreduce,” In: Proc. 19th Assoc. Comput. Mach. (ACM) Int. Symp. High Perform. Distrib. Comput., 2010, pp. 810-818.
3. D. Logothetis, and K. Yocum, “Ad-hoc data processing in the cloud,” In: Proc. VLDB Endowment, vol. 1, no. 2, pp. 1472-1475, 2008.
4. T. Condie, N. Conway, P. Alvaro, J. M. Hellerstein, K. Elmeleegy, and R. Sears, “Mapreduce online,” In: Proc. 7th USENIX Conf. Netw. Syst. Des. Implement., 2010, p. 21.
5. B. Li, E. Mazur, Y. Diao, A. McGregor, and P. Shenoy, “A platform for scalable one-pass analytics using mapreduce,” In: Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2011, pp. 985-996.
6. D. Jiang, B. C. Ooi, L. Shi, and S. Wu, “The performance of mapreduce: An in-depth study,” Proc. VLDB Endowment, vol. 3, no. 1-2, pp. 472-483, 2010.
7. A. Ghazal, T. Rabl, M. Hu, F. Raab, M. Poess, A. Crolotte, and H. Jacobsen, “Bigbench: Towards an industry standard benchmark for big data analytics,” In: Proc. Assoc. Comput. Mach. (ACM) SIGMOD Int. Conf. Manag. Data, 2013, pp. 1197-1208.