A scientific workflow management system architecture and its scheduling based on cloud service platform for manufacturing big data analytics

International Journal of Advanced Manufacturing Technology

Volumn 84, Issue 1-4, 2016, Pages 119-131

  Li, Xiu ^a   Song, Jingdong ^a   Huang, Biqing ^a  

^a TSINGHUA UNIVERSITY   (China)

Author keywords

Cloud service platform; Manufacturing big data; Scheduling algorithm; Scientific workflow

Indexed keywords

ALGORITHMS; BIG DATA; COMPUTER ARCHITECTURE; DISTRIBUTED DATABASE SYSTEMS; MANUFACTURE; NETWORK MANAGEMENT; SCHEDULING; SCHEDULING ALGORITHMS; WORK SIMPLIFICATION;

CLASSIC ALGORITHM; CLOUD MANUFACTURING; CLOUD SERVICES; MANAGEMENT SYSTEMS; NOVEL SCHEDULING ALGORITHMS; SCIENTIFIC WORKFLOW MANAGEMENTS; SCIENTIFIC WORKFLOWS; TOTAL COMPLETION TIME;

INFORMATION MANAGEMENT;

EID: 84941359900     PISSN: 02683768     EISSN: 14333015     Source Type: Journal    
DOI: 10.1007/s00170-015-7804-9     Document Type: Article

References (46)

1. Chui M, Loffler M, Robert R (2010) The internet of things. Mckinsey Q 2:1–9
2. Barolli L, Chen X, Xhafa F (2014) Advances on cloud services and cloud computing. Concurr Comput-Pract Exp 27(8):1985–1987
3. Liu J, Pacitti E, Valduriez P, Mattoso M (2015) A survey of DataIntensive scientific workflow management. J Grid Comput 3:1–37
4. Holl S, Zimmermann O, Palmblad M, Mohammed Y, Hofmann-Apitius M (2014) A new optimization phase for scientific workflow management systems. Futur Gener Comp Syst 36:352–362
5. Gan Z, Wang J, Salomonis N, Stowe JC, Haddad GG, McCulloch AD, Zambon AC (2014) MAAMD: a workflow to standardize meta-analyses and comparison of affymetrix microarray data. BMC Bioinformatics 15(1):69
6. Zhao Y, Li Y, Lu S, Lin C (2014) Devising a cloud scientific workflow platform for big data. IEEE World Congress on Services IEEE: 393-401
7. Huang B, Li C, Yin C, Zhao X (2013) Cloud manufacturing service platform for small-and medium-sized enterprises. Int J Adv Manuf Technol 65(9-12):1261–1272
8. Lin C, Lu S, Fei X, Chebotko A, Pai D, Lai Z, Hua J (2009) A reference architecture for scientific workflow management systems and the VIEW SOA solution. IEEE Trans Serv Comput 2(1):79–92
9. Malawski M, Juve G, Deelman E, Nabrzyski J (2015) Algorithms for cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. Futur Gener Comp Syst 48:1–18
10. Fard HM, Radu P, Thomas F (2014) Multi-objective list scheduling of workflow applications in distributed computing infrastructures. J Parallel Distr Com 74(3):2152–2165
11. Hongzhao D, Dongxu L, Yanwei Z, Ying C (2005) A novel approach of networked manufacturing collaboration: fractal web-based extended enterprise. Int J Adv Manuf Technol 26(11-12):1436–1442
12. Flammia G (2001) Application service providers: challenges and opportunities. IEEE Intell Syst 16(1):22–23
13. Xu X (2012) From cloud computing to cloud manufacturing. Robot Cim-Int Manuf 28(1):75–86
14. Tao F, Cheng Y, Da Xu L, Zhang L, Li BH (2014) CCIoT-CMfg: cloud computing and Internet of things-based cloud manufacturing service system. IEEE T Ind Inform 10(2):1435–1442
15. Laili Y, Tao F, Zhang L, Sarker BR (2012) A study of optimal allocation of computing resources in cloud manufacturing systems. Int J Adv Manuf Technol 63(5-8):671–690
16. Lee J, Lapira E, Bagheri B, Kao HA (2013) Recent advances and trends in predictive manufacturing systems in big data environment. Manuf Lett 1(1):38–41
17. Barseghian D, Altintas I, Jones MB et al (2010) Workflows and extensions to the Kepler scientific workflow system to support environmental sensor data access and analysis. Ecol Inf 5(1):42–50
18. Li X, Song J, Huang R (2014) A Kepler scientific workflow to facilitate and standardize marine monitoring sensor parsing and dynamic adaption. 5th IEEE Int Conf Softw Engine Serv Sci IEEE: 1023-1026
19. Paterson T, Law A (2009) An XML transfer schema for exchange of genomic and genetic mapping data: implementation as a web service in a Taverna workflow. BMC Bioinformatics 10(1):252
20. Deelman E, Singh G, Su MH, Blythe J, Gil Y, Kesselman C, Katz DS (2005) Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci Programming-Neth 13(3):219–237
21. Fahringer T, Prodan R, Duan R, Hofer J, Nadeem F, Nerieri F, Wieczorek M (2007) Askalon: A development and grid computing environment for scientific workflows. Workflows for e-Science. Springer, London, pp 450–471
22. Von Laszewski G, Gawor J, Lane P, Rehn N, Russell M (2002) Features of the java commodity grid kit. Concurr Comput-Pract Exp 14(13-15):1045–1055
23. Kacsuk P, Sipos G (2005) Multi-grid, multi-user workflows in the P-GRADE grid portal. J Grid Comput 3(3-4):221–238
24. Guan Z, Hernandez F, Bangalore P, Gray J, Skjellum A, Velusamy V, Liu Y (2006) Grid-flow: a grid-enabled scientific workflow system with a petri-net-based interface. Concurr Comput-Pract Exp 18(10):1115–1140
25. Bubak M, Nowakowski P, Unger S (2006) K-WfGrid—knowledge-based workflow system for grid applications. Proc CGW 6:1–12
26. MTConnect Institute (2013) MTConnect Institute. http://www.mtconnect.org/. Accessed on May 27 2015
27. Wang J, Crawl D, Altintas I, Li W (2014) Big data applications using workflows for data parallel computing. Comput Sci Eng 16(4):11–21
28. Wang J, Crawl D, Altintas I (2009) Kepler + Hadoop: a general architecture facilitating data-intensive applications in scientific workflow systems. Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science ACM: 12
29. Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: cluster computing with working sets. Proceedings of the 2nd USENIX conference on Hot topics in cloud computing: 10-10
30. Djurdjanovic D, Lee J, Ni J (2003) Watchdog Agent—an infotronics-based prognostics approach for product performance degradation assessment and prediction. Adv Eng Inform 17(3):109–125
31. Wang L (2013) Directed acyclic graph. Encyclopedia of Systems Biology: 574-574
32. Yu-Kwong K, Ahmad I (1996) Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors. IEEE Trans on Par and Dist Systems 5(7):506–521
33. Rodriguez Sossa M, Buyya R (2014) Deadline based resource provisioning and scheduling algorithmfor scientific workflows on clouds, cloud computing. IEEE Trans 2(2):222–235
34. Chunlin L, Layuan L (2006) QoS based resource scheduling by computational economy in computational grid. Inf Process Lett 98(3):119–126
35. Singh S, Chana I (2015) QRSF: QoS-aware resource scheduling framework in cloud computing. J Supercomput 71(1):241–292
36. Ezzatti P, Pedemonte M, Martin A (2013) An efficient implementation of the Min-Min heuristic. Comput Oper Res 40(11):2670–2676
37. He XS, Sun XH, Von Laszewski G (2003) QoS guided min-min heuristic for grid task scheduling. J Comput Sci Technol 18(4):442–451
38. Singh M, Suri PK (2008) QPS Max-Min Min-Min: a QoS based predictive Max-Min, Min-Min switcher algorithm for Job scheduling in a grid. Inform Technol J 8:1176–1181
39. Kartal Tabak E, Barla Cambazoglu B, Aykanat C (2014) Improving the performance of independent task assignment heuristics minmin, maxmin and sufferage. IEEE Trans Parallel Distrib Syst 25(5):1244–1256
40. Casanova H, Legrand A, Zagorodnov D, Berman, F (2000) Heuristics for scheduling parameter sweep applications in grid environments. Proceedings 9th Heterogeneous Computing Workshop. IEEE: 349-363
41. Yu J, Buyya R (2006) Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms. Sci Programming-Neth 14(3-4):217–230
42. Wieczorek M, Prodan R, Fahringer T (2005) Scheduling of scientific workflows in the ASKALON grid environment. ACM Sigmod Rec 34(3):56–62
43. Guo F, Yu L, Tian S, Tian S (2014) A workflow task scheduling algorithm based on the resources' fuzzy clustering in cloud computing environment. Int J Commun Syst 28(6):1053–1067
44. Bittencourt LF, Madeira ERM (2013) Using time discretization to schedule scientific workflows in multiple cloud providers. Sixth IEEE Int Conf Cloud Comput IEEE: 123-130
45. Chauhan SS, Joshi RC (2010) A weighted mean time min-min max-min selective scheduling strategy for independent tasks on grid. 2rd IEEE Int Adv Comput Conf IEEE:4-9
46. Ahmad I, Kwok YK, Wu MY (1996) Analysis, evaluation, and comparison of algorithms for scheduling task graphs on parallel processors. Proceedings of Second International Symposium on Parallel Architectures, Algorithms, and Networks IEEE: 207-213