BDAP: A big data placement strategy for cloud-based scientific workflows

Proceedings - 2015 IEEE 1st International Conference on Big Data Computing Service and Applications, BigDataService 2015

Volumn , Issue , 2015, Pages 105-114

  Ebrahimi, Mahdi ^a   Mohan, Aravind ^a   Kashlev, Andrey ^a   Lu, Shiyong ^a  

^a WAYNE STATE UNIVERSITY   (United States)

Author keywords

Big Data; Cloud Computing; Data Placement; Evolutionary Algorithm; Scientific Workflow

Indexed keywords

CLOUD COMPUTING; EVOLUTIONARY ALGORITHMS;

DATA PLACEMENT; DATA PLACEMENT ALGORITHMS; DISTRIBUTED ENVIRONMENTS; INTERMEDIATE DATASETS; PHYSICAL LOCATIONS; RESOURCE UTILIZATIONS; SCIENTIFIC WORKFLOWS; VIRTUAL MACHINES;

BIG DATA;

EID: 84959573542     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/BigDataService.2015.70     Document Type: Conference Paper

References (15)

1. D. Agrawal, A. E. Abbadi, S. Antony, and S. Das, "Data management challenges in cloud computing infrastructures." In Databases in Networked Information Systems, pp. 1-10, 2010.
2. J. Wang, D. Crawl, I. Altintas, W. Li, "Big Data Applications Using Workflows for Data Parallel Computing," Journal of Computing in Science and Engineering, vol. 16, no. 4, pp. 11-21, 2014.
3. Juve, G., A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, "Characterizing and Profiling Scientific Workflows", Future Generation Computer Systems, vol. 29, no. 3, pp. 682-692, 2013.
4. U. V. Catalyurek, K. Kaya and B. Ucar, "Integrated Data Placement and Task Assignment for Scientific Workflows in clouds," In Proceedings of the fourth international workshop on Data-intensive distributed computing, pp. 45-54, 2011.
5. A. Chervenak, E. Deelman, M. Livny, M. Su, R. Schuler, S. Bharathi, G. Mehta, and K. Vahi, "Data Placement for Scientific Applications in Distributed Environments," In Proceedings of the 8th IEEE/ACM International Conference on Grid Computing, pp. 267-274, 2007.
6. E. Deelman and A. Chervenak, "Data Management Challenges of DataIntensive Scientific Workflows," In Cluster Computing and the Grid, 2008. CCGRID'08. 8th IEEE International Symposium on, pp. 687-692, 2008.
7. Y. Zhao, I. Raicu, X. Fei and S. Lu, "Opportunities and Challenges in Running Scientific Workflows on the cloud," In Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), 2011 International Conference on, pp. 455-462, 2011.
8. Z. Er-Dun, Q. Yong-Qiang, X. Xing-Xing and C. Yi, "A Data Placement Strategy Based on Genetic Algorithm for Scientific Workflows," In Computational Intelligence and Security (CIS), 2012 Eighth International Conference on, pp. 146-149, 2012.
9. I. Foster, Y. Zhao, I. Raicu and S. Lu, "Cloud Computing and Grid Computing 360-Degree Compared," In Grid Computing Environments Workshop, 2008. GCE'08, pp. 1-10, 2008.
10. G. Juve and E. Deelman, "Scientific workflows and clouds," Journal of Crossroads, vol. 16, no. 3, pp. 14-18, 2010.
11. A. K. Kayyoor, A. Deshpande and S. Khuller, "Data Placement and Replica Selection for Improving Co-location in Distributed Environments," arXiv preprint arXiv:1302.4168, 2013.
12. T. Kosar and M. Livny, "A Framework for Reliable and Efficient Data Placement in Distributed Computing Systems," Journal of Parallel and Distributed Computing (JPDC), Vol.65, no. 10, pp. 1146-1157, 2005.
13. C. Lin, S. Lu, Z. Lai, A. Chebotko, X. Fei, J. Hua and F. Fotouhi, "Service-Oriented Architecture for VIEW: a Visual Scientific Workflow Management System," Proceedings of the IEEE International Conference on Services Computing (SCC), pp. 335-342, 2008.
14. D. Yuan, Y. Yang, X. Liu and J. Chen "A data placement strategy in scientific cloud workflows," Future Generation Computing Systems 26, no. 8, pp. 1200-1214, 2010.
15. D. Yuri, P. Membrey, P. Grosso and C. Laat "Addressing Big Data Issues in Scientific Data Infrastructure," In Collaboration Technologies and Systems (CTS), 2013 International Conference on, pp. 48-55, 2013.