Predictable high-performance computing using feedback control and admission control

IEEE Transactions on Parallel and Distributed Systems

Volumn 23, Issue 3, 2012, Pages 396-411

  Park, Sang Min ^a   Humphrey, Marty ^a  

^a University of Virginia   (United States)

Author keywords

control theory; Multiprocessor systems; parallel systems; scheduling

Indexed keywords

ADMISSION CONTROL; ADMISSION CONTROLLERS; APPLICATION LAYERS; BATCH-SCHEDULING; FEEDBACK CONTROLLER; FORMAL CONTROLS; HIGH-PERFORMANCE COMPUTING; HIGH-PERFORMANCE COMPUTING RESOURCES; MULTIPROCESSOR SYSTEMS; PARALLEL SYSTEMS; RESOURCE RESERVATIONS; UNEXPECTED EVENTS;

CONCURRENCY CONTROL; CONTROL THEORY; CONTROLLERS; FEEDBACK CONTROL; FORECASTING; MULTIPROCESSING SYSTEMS; SCHEDULING; SCHEDULING ALGORITHMS; SYSTEM THEORY;

ACCESS CONTROL;

EID: 79551572724     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2010.100     Document Type: Article

References (40)

1. B. Plale et al., "Towards Dynamically Adaptive Weather Analysis and Forecasting in LEAD," Proc. ICCS Workshop Dynamic Data Driven Applications, May 2005.
2. SURA Coastal Ocean Observing and Prediction (SCOOP), http:// scoop.sura.org, 2010.
3. S. Manos et al., "Life or Death Decision-Making: The Medical Case for Large-Scale, On-Demand Grid Computing," CTWatch Quarterly, vol. 4, no. 1, Mar. 2008.
4. Coastal Circulation and Storm Surge Model, http://adcirc.org, 2010.
5. Open Source Lattice Boltzmann Code, http://www.openlb.org, 2010.
6. The Weather Research and Forecasting Model, http://www.wrfmodel. org, 2010.
7. BLAST: Basic Local Alignment and Search Tool, http:// www.ncbi.nlm.nih.gov/blast/, 2010.
8. Montage-an Astronomical Image Mosaic Engine, http:// montage.ipac. caltech.edu, 2010.
9. I. Foster et al., "A Distributed Resource Management Architecture That Supports Advance Reservations and Co-Allocation," Proc. Int'l Workshop Quality of Service, 1999.
10. R.J. Al-Ali et al., "Analysis and Provision of QoS for Distributed Grid Applications," J. Grid Computing, vol. 2, no. 2, pp. 163-182, June 2004.
11. W. Smith et al., "Scheduling with Advanced Reservations," Proc. IEEE Int'l Parallel and Distributed Processing Symp. (IPDPS), 2000.
12. G. Singh, C. Kesselman, and E. Deelman, "Adaptive Pricing for Resource Reservations in Shared Environments," Proc. IEEE/ACM Int'l Conf. Grid Computing, 2007.
13. P. Beckman et al., "SPRUCE: A System for Supporting Urgent High-Performance Computing," Grid-Based Problem Solving Environments, pp. 295-316, Springer Press, 2007.
14. R. Wolski et al., "The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing," J. Future Generation Computing Systems, vol. 15, nos. 5/6, pp. 757-768, Oct. 1999.
15. J. Brevik et al., "Predicting Bounds on Queuing Delay for Batch-Scheduled Parallel Machines," Proc. Conf. ACM Principles and Practices of Parallel Programming (PPoPP), Mar. 2006.
16. W. Smith et al., "Using Run-Time Predictions to Estimate Queue Wait Times and Improve Scheduler Performance," Proc. Conf. Job Scheduling Strategies for Parallel Processing, 1999.
17. Windows Server 2008 Hyper-V, www.microsoft.com/ windowsserver2008/en/us/ hyperv.aspx, 2010.
18. P. Barham et al., "Xen and the Art of Virtualization," Proc. ACM Symp. Operating Systems Principles, 2003.
19. B. Sotomayor et al., "Combining Batch Execution and Leasing Using Virtual Machines," Proc. ACM Int'l Symp. High Performance Distributed Computing (HPDC), June 2008.
20. D. Irwin et al., "Sharing Networked Resources with Brokered Leases," Proc. Usenix Technical Conf., June 2006.
21. I. Lee et al., Handbook of Real-Time and Embedded Systems. CRC Press, 2007.
22. J. Stankovic et al., Deadline Scheduling for Real-Time Systems: EDF and Related Algorithms. Kluwer Academic Publishers, 1999.
23. J. Stankovic et al., "The Spring Kernel: A New Paradigm for Real-Time Operating Systems," ACM SIGOPS Operating Systems Rev., vol. 23, no. 3, pp. 54-71, July 1989.
24. C. Lu et al., "Feedback Control Real-Time Scheduling: Frame-Work, Modeling, and Algorithms," Real-Time Systems, Special Issue on Control-Theoretical Approaches to Real-Time Computing, vol. 23, nos. 1/2, pp. 85-126, July-Sept. 2002.
25. J.L. Hellerstein et al., Feedback Control of Computing Systems. Wiley-IEEE Press, Aug. 2004.
26. K.J. Astrom and B. Wittenmark, Adaptive Control. Addison-Wesley, 1994.
27. C. Lu et al., "Feedback Utilization Control in Distributed Real-Time Systems with End-to-End Tasks," IEEE Trans. Parallel and Distributed Systems, vol. 16, no. 6, pp. 550-561, June 2005.
28. C. Lu et al., "Feedback Control Architecture and Design Methodology for Service Delay Guarantees in Web Servers," IEEE Trans. Parallel and Distributed Systems, vol. 17, no. 9, pp. 1014-1027, Sept. 2006.
29. M. Karlsson et al., "Triage: Performance Differentiation for Storage Systems Using Adaptive Control," ACM Trans. Storage, vol. 1, no. 4, pp. 457-480, Nov. 2005.
30. Y. Zhang et al., "Friendly Virtual Machines Leveraging a Feedback-Control Model for Application Adaptation," Proc. ACM/Usenix Int'l Conf. Virtual Execution Environments (VEE), 2005.
31. P. Padala et al., "Adaptive Control of Virtualized Resources in Utility Computing Environments," Proc. European Conf. Computer Systems (Eurosys), pp. 289-302, 2007.
32. J. Xu et al., "On the Use of Fuzzy Modeling in Virtualized Data Center Management," Proc. Int'l Conf. Autonomic Computing (ICAC), 2007.
33. S.-M. Park and M. Humphrey, "Feedback-Controlled Resource Sharing for Predictable eScience," Proc. IEEE/ACM Int'l Conf. High Performance Computing, Networking, Storage and Analysis (SC '08), Nov. 2008.
34. S.-M. Park and M. Humphrey, "Self-Tuning Virtual Machines for Predictable eScience," Proc. IEEE Int'l Symp. Cluster Computing and the Grid (CCGRID '09), May 2009.
35. A. Iosup et al., "The Characteristics and Performance of Groups of Jobs in Grids," Proc. Int'l European Conf. Parallel and Distributed Computing (EuroPar), 2007.
36. S. Browne et al., "A Scalable Cross-Platform Infrastructure for Application Performance Tuning Using Hardware Counters," Proc. IEEE/ACM Conf. Supercomputing, 2000.
37. A. Menon et al., "Diagnosing Performance Overheads in the Xen Virtual Machine Environment," Proc. ACM/Usenix Conf. Virtual Execution Environments, 2005.
38. J.S. Milton and J.C. Arnold, Introduction to Probability and Statistics, fourth ed. McGrawHill
39. Huang et al., "A Case for High Performance Computing with Virtual Machines," Proc. Int'l Conf. Supercomputing, 2006.
40. Youseff et al., "Paravirtualization for HPC Systems," Proc. Workshop XEN in HPC Cluster and Grid Computing Environments (XHPC), Dec. 2006.