Preventing temporal violations in scientific workflows: Where and how

IEEE Transactions on Software Engineering

Volumn 37, Issue 6, 2011, Pages 805-825

  Liu, Xiao ^a   Yang, Yun ^a,b   Jiang, Yuanchun ^c,d   Chen, Jinjun ^a,e  

^a SWINBURNE UNIVERSITY OF TECHNOLOGY   (Australia)

^b ANHUI UNIVERSITY   (China)

^c HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^d UNIVERSITY OF PITTSBURGH   (United States)

^e UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

exception handling; reliability; software verification; statistical methods; Workflow management

Indexed keywords

DYNAMIC NATURE; EXCEPTION HANDLING; FUNCTIONAL FAILURE; FUNDAMENTAL PROBLEM; GRID AND CLOUD COMPUTING; LARGE SCALE SIMULATIONS; LOCAL RESCHEDULING; POINT SELECTION; REAL-WORLD APPLICATION; RUNTIME MONITORING; RUNTIMES; SCIENTIFIC ACTIVITY; SCIENTIFIC WORKFLOWS; SOFTWARE VERIFICATION; TEMPORAL CONSISTENCY; TEMPORAL CONSTRAINTS; TEMPORAL VERIFICATION; WORK-FLOWS; WORKFLOW MANAGEMENTS;

RELIABILITY; STATISTICAL METHODS; WORK SIMPLIFICATION;

CLOUD COMPUTING;

EID: 83555172462     PISSN: 00985589     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSE.2010.99     Document Type: Article

References (53)

1. W. M. P. Van der Aalst, K. M. V. Hee, and H. A. Reijers, "Analysis of Discrete-Time Stochastic Petri Nets", Statistica Neerlandica, vol. 54, pp. 237-255, 2000.
2. D. Ardagna and B. Pernici, "Adaptive Service Composition in Flexible Processes", IEEE Trans. Software Eng., vol. 33, no. 6, pp. 369-384, June 2007. (Pubitemid 46772854)
3. G. Bucci, L. Sassoli, and E. Vicario, "Correctness Verification and Performance Analysis of Real-Time Systems Using Stochastic Preemptive Time Petri Nets", IEEE Trans. Software Eng., vol. 31, no. 11, pp. 913-927, Nov. 2005.
4. P. A. Buhr and W. Y. R. Mok, "Advanced Exception Handling Mechanisms", IEEE Trans. Software Eng., vol. 26, no. 9, pp. 820-836, Sept. 2000.
5. F. Casati, S. Castano, M. Fugini, I. Mirbel, and B. Pernici, "Using Patterns to Design Rules in Workflows", IEEE Trans. Software Eng., vol. 26, no. 8, pp. 760-785, Aug. 2000.
6. Nat'l Meteorological Data Center, China Meteorological Data Sharing Service System, http://cdc.cma.gov. cn/index.jsp, May 2010.
7. C. Chatfield, The Analysis of Time Series: An Introduction, sixth ed., Chapman and Hall/CRC, 2004.
8. J. Chen and Y. Yang, "Multiple States Based Temporal Consistency for Dynamic Verification of Fixed-Time Constraints in Grid Workflow Systems", Concurrency and Computation: Practice and Experience, vol. 19, no. 7, pp. 965-982, 2007. (Pubitemid 46693241)
9. J. Chen and Y. Yang, "A Taxonomy of Grid Workflow Verification and Validation", Concurrency and Computation: Practice and Experience, vol. 20, no. 4, pp. 347-360, 2008. (Pubitemid 351421453)
10. J. Chen and Y. Yang, "Temporal Dependency Based Checkpoint Selection for Dynamic Verification of Fixed-Time Constraints in Grid Workflow Systems", Proc. 30th Int'l Conf. Software Eng., pp. 141-150, 2008.
11. J. Chen and Y. Yang, "Temporal Dependency Based Checkpoint Selection for Dynamic Verification of Temporal Constraints in Scientific Workflow Systems", ACM Trans. Software Eng. and Methodology, vol. 20, no. 3, article 9, 2011.
12. J. Chen and Y. Yang, "Adaptive Selection of Necessary and Sufficient Checkpoints for Dynamic Verification of Temporal Constraints in Grid Workflow Systems", ACM Trans. Autonomous and Adaptive Systems, vol. 2, no. 2, 2007.
13. K. Cooper, A. Dasgupta, K. Kennedy, C. Koelbel, and A. Mandal, "New Grid Scheduling and Rescheduling Methods in the GrADS Project", Proc. 18th Int'l Parallel and Distributed Processing Symp., pp. 199-206, Apr. 2004.
14. J. Eder, E. Panagos, and M. Rabinovich, "Time Constraints in Workflow Systems", Proc. 11th Int'l Conf. Advanced Information Systems Eng., pp. 286-300, 1999.
15. B. Fechner, U. Honig, J. Keller, and W. Schiffmann, "Fault-Tolerant Static Scheduling for Grids", Proc. IEEE Int'l Symp. Parallel and Distributed Processing, pp. 1-6, Apr. 2008.
16. I. Foster and C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure, second ed. Morgan Kaufmann, 2004.
17. Machine Learning Group, Dept. of Computer Science, Univ. of Sheffield, GA Toolkits, http://www.dcs.shef.ac.uk/ml/software. html, May 2010.
18. C. Hagen and G. Alonso, "Exception Handling in Workflow Management Systems", IEEE Trans. Software Eng., vol. 26, no. 10, pp. 943-958, Oct. 2000. (Pubitemid 32031732)
19. J. W. Han and M. Kamber, Data Mining: Concepts and Techniques, second ed. Elsevier, 2006.
20. R. Hwanga, M. Genb, and H. Katayamaa, "A Comparison of Multiprocessor Task Scheduling Algorithms with Communication Costs", J. Computers and Operations Research, vol. 35, pp. 976-993, 2008.
21. K. H. Kim, R. Buyya, and J. Kim, "Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-Enabled Clusters", Proc. Seventh IEEE Int'l Symp. Cluster Computing and the Grid, pp. 541-548, May 2007. (Pubitemid 47334594)
22. Y. Kwok and I. Ahmad, "Static Scheduling Algorithms for Allocating Directed Task Graphs to Multiprocessors", ACM Computing Surveys, vol. 31, no. 4, pp. 406-471, 1999.
23. A. M. Law and W. D. Kelton, Simulation Modelling and Analysis, fourth ed. McGraw-Hill, 2007.
24. Z. Liangzhao, B. Benatallah, A. H. H. Ngu, M. Dumas, J. Kalagnanam, and H. Chang, "QoS-Aware Middleware for Web Services Composition", IEEE Trans. Software Eng., vol. 30, no. 5, pp. 311-327, May 2004.
25. X. Liu, J. Chen, K. Liu, and Y. Yang, "Forecasting Duration Intervals of Scientific Workflow Activities Based on Time-Series Patterns", Proc. Fourth IEEE Int'l Conf. e-Science, pp. 23-30, Dec. 2008.
26. X. Liu, J. Chen, and Y. Yang, "A Probabilistic Strategy for Setting Temporal Constraints in Scientific Workflows", Proc. Sixth Int'l Conf. Business Process Management, pp. 180-195, Sept. 2008.
27. X. Liu, Z. Ni, J. Chen, and Y. Yang, "A Probabilistic Strategy for Temporal Constraint Management in Scientific Workflow Systems", Concurrency and Computation: Practice and Experience, vol. 23, no. 16, pp. 1893-1919, 2011.
28. X. Liu, Y. Yang, J. Chen, Q. Wang, and M. Li, "Achieving On-Time Delivery: A Two-Stage Probabilistic Scheduling Strategy for Software Projects", Proc. Int'l Conf. Software Process: Trustworthy Software Development Processes, 2009.
29. O. Marjanovic and M. E. Orlowska, "On Modelling and Verification of Temporal Constraints in Production Workflows", Knowledge and Information Systems, vol. 1, no. 2, pp. 157-192, 1999.
30. A. Martinez, F. J. Alfaro, J. L. Sanchez, F. J. Quiles, and J. Duato, "A New Cost-Effective Technique for QoS Support in Clusters", IEEE Trans. Parallel and Distributed Systems, vol. 18, no. 12, pp. 1714-1726, Dec. 2007. (Pubitemid 350142419)
31. M. Miller, Cloud Computing: Web-Based Applications That Change the Way You Work and Collaborate Online. Que, Aug. 2008.
32. M. Moore, "An Accurate Parallel Genetic Algorithm to Schedule Tasks on a Cluster", Parallel Computing, vol. 30, pp. 567-583, 2004.
33. S. Nadarajah and S. Kotz, "Exact Distribution of the Max/Min of Two Gaussian Random Variables", IEEE Trans. Very Large Scale Integration Systems, vol. 16, no. 2, pp. 210-212, Feb. 2008.
34. J. Oh and C. Wu, "Genetic-Algorithm-Based Real-Time Task Scheduling with Multiple Goals", J. Systems and Software, vol. 71, pp. 245-258, 2004.
35. H. Pozewaunig, J. Eder, and W. Liebhart, "ePERT: Extending PERT for Workflow Management Systems", Proc. First East-European Symp. Advances in Database and Information Systems, 1997.
36. R. Prodan and T. Fahringer, "Overhead Analysis of Scientific Workflows in Grid Environments", IEEE Trans. Parallel and Distributed Systems, vol. 19, no. 3, pp. 378-393, Mar. 2008. (Pubitemid 351344283)
37. N. Russell, W. M. P. Van der Aalst, and A. H. M. ter Hofstede, "Exception Handling Patterns in Process-Aware Information Systems", Technical Report BPM-06-04, BPM Center, 2006.
38. N. Russell, W. M. P. Van der Aalst, and A. H. M. ter Hofstede, "Workflow Exception Patterns", Proc. 18th Int'l Conf. Advanced Information Systems Eng., pp. 288-302, 2006. (Pubitemid 44071215)
39. E. A. Stout, R. W. Carey, C. M. Estes, J. M. Fisher, L. J. Lagin, D. G. Mathisen, C. A. Reynolds, and R. J. Sanchez, "CORBA-Based Distributed Software Framework for the NIF Integrated Computer Control System", Fusion Eng. and Design, vol. 83, pp. 535-538, 2008. (Pubitemid 351551529)
40. K. A. Stroud, Engineering Mathematics, sixth ed. Palgrave Macmillan, 2007.
41. D. B. Tracy, J. S. Howard, and B. Noah, "Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems", J. Parallel and Distributed Computing, vol. 61, no. 6, pp. 810-837, 2001.
42. L. Virine and M. Trumper, Project Decisions: The Art and Science. Management Concepts, Oct. 2007.
43. A. S. Wu, H. Yu, S. Y. Jin, K. Lin, and G. Schiavone, "An Incremental Genetic Algorithm Approach to Multiprocessor Scheduling", IEEE Trans. Parallel and Distributed Systems, vol. 15, no. 9, pp. 824-834, Sept. 2004.
44. J. Xu, A. Romanovsky, and B. Randell, "Concurrent Exception Handling and Resolution in Distributed Object Systems", IEEE Trans. Parallel and Distributed Systems, vol. 11, no. 10, pp. 1019-1032, Oct. 2000. (Pubitemid 32076188)
45. Y. Yang, K. Liu, J. Chen, J. Lignier, and H. Jin, "Peer-to-Peer Based Grid Workflow Runtime Environment of SwinDeW-G", Proc. Third Int'l Conf. e-Science and Grid Computing, pp. 51-58, Dec. 2007.
46. J. Yu and R. Buyya, "A Taxonomy of Workflow Management Systems for Grid Computing", J. Grid Computing, no. 3, pp. 171-200, 2005. (Pubitemid 43280301)
47. J. Yu and R. Buyya, "Scheduling Scientific Workflow Applications with Deadline and Budget Constraints Using Genetic Algorithms", Scientific Programming, vol. 14, no. 3, pp. 217-230, Dec. 2006. (Pubitemid 46474559)
48. J. Yu and R. Buyya, "Workflow Scheduling Algorithms for Grid Computing", Technical Report GRIDS-TR-2007-10, Computing and Distributed Systems Laboratory, The Univ. of Melbourne, May 2007.
49. Z. Yu and W. Shi, "An Adaptive Rescheduling Strategy for Grid Workflow Applications", Proc. IEEE Int'l Symp. Parallel and Distributed Processing, pp. 115-122, Mar. 2007.
50. D. Yuan, Y. Yang, X. Liu, and J. Chen, "A Cost-Effective Strategy for Intermediate Data Storage in Scientific Cloud Workflow Systems", Proc. 24th IEEE Int'l Parallel and Distributed Processing Symp., 2010.
51. D. Zhang and J. P. Tsai, Machine Learning Applications in Software Engineering. World Scientific, 2005.
52. H. Zhuge, T. Cheung, and H. Pung, "A Timed Workflow Process Model", J. Systems and Software, vol. 55, no. 3, pp. 231-243, 2001.
53. H. Zhuge, X. Sun, J. Liu, E. Yao, and X. Chen, "A Scalable P2P Platform for the Knowledge Grid", IEEE Trans. Knowledge and Data Eng., vol. 17, no. 12, pp. 1721-1736, Dec. 2005. (Pubitemid 43060421)