TRACON: Interference-aware schedulingfor data-intensive applicationsin virtualized environments

IEEE Transactions on Parallel and Distributed Systems

Volumn 25, Issue 5, 2014, Pages 1349-1358

  Chiang, Ron C ^a   Huang, H Howie ^a  

^a George Washington University   (United States)

Author keywords

Cloud computing; scheduling; virtualization

Indexed keywords

CLOUD COMPUTING; CONCURRENCY CONTROL; RESOURCE ALLOCATION; SCHEDULING; VIRTUAL REALITY;

APPLICATION PERFORMANCE; DATA-INTENSIVE APPLICATION; MODELING AND CONTROL; RESOURCE UTILIZATIONS; STATISTICAL MACHINE LEARNING; VIRTUALIZATION TECHNOLOGIES; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT;

TRANSPORT AIRCRAFT;

EID: 84940268966     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2013.82     Document Type: Article

References (60)

1. H. Akaike, "A New Look at the Statistical Model Identification, " IEEE Trans. Automatic Control, vol. AC-19, no. 6, pp. 716-723, Dec. 1974.
2. M. Al-Fares, A. Loukissas, and A. Vahdat, "A Scalable, Commodity Data Center Network Architecture," SIGCOMM Computer Comm. Rev., vol. 38, pp. 63-74, Aug. 2008.
3. Amzon EC2 instance types, http://aws.amazon.com/ec2/instancetypes/, 2013.
4. D. Arthur and S. Vassilvitskii, "k-Means++: The Advantages of Careful Seeding," Proc. 18th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA '07), 2007.
5. H. Aytug, S. Bhattacharyya, G. Koehler, and J. Snowdon, "A Review of Machine Learning in Scheduling," IEEE Trans. Eng. Management, vol. 41, no. 2, pp. 165-171, May 1994.
6. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," Proc. ACM Symp. Operating Systems Principles (SOSP '03), 2003.
7. A. Beygelzimer, S. Kakade, and J. Langford, "Cover Trees for Nearest Neighbor," Proc. 23rd Int'l Conf. Machine Learning (ICML '06), 2006.
8. P. Bod-?k, R. Griffith, C. Sutton, O. Fox,M. Jordan, and D. Patterson, "Statistical Machine Learning Makes Automatic Control Practical for Internet Datacenters," Proc. Conf. Hot Topics in Cloud Computing, pp. 12-12, 2009.
9. C. Boneti, R. Gioiosa, F.J. Cazorla, and M. Valero, "A Dynamic Scheduler for Balancing HPC Applications," Proc. ACM/IEEE Conf. Supercomputing (SC '08), 2008.
10. T.D. Braun, H.J. Siegel, N. Beck, L.L. Bol-oni, A.I. Reuther, M.D. Theys, B. Yao, R.F. Freund, M. Maheswaran, J.P. Robertson, and D. Hensgen, "A Comparison Study of Static Mapping Heuristics for a Class of Meta-Tasks on Heterogeneous Computing Systems," Proc. Heterogeneous Computing Workshop (HCW), pp. 15-29, 1999.
11. S. Bucur, V. Ureche, C. Zamfir, and G. Candea, "Parallel Symbolic Execution for Automated Real-World Software Testing," Proc. Sixth Conf. Computer Systems, pp. 183-198, 2011.
12. K.P. Burnham and D.R. Anderson, Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. second ed., Springer, July 2002.
13. C. Cadar, D. Dunbar, and D. Engler, "KLEE: Unassisted and Automatic Generation of High-Coverage Tests for Complex Systems Programs," Proc. Eighth USENIX Conf. Operating Systems Design and Implementation (OSDI '08), OSDI'08, Berkeley, CA, USA, USENIX Association, pp. 209-224, 2008.
14. P. Carns, K. Harms, W. Allcock, C. Bacon, S. Lang, R. Latham, and R. Ross, "Understanding and Improving Computational Science Storage Access Through Continuous Characterization," Proc. MSST '11, pp. 1-14, May 2011.
15. E. Cecchet, V. Udayabhanu, T. Wood, and P. Shenoy, "Benchlab: An Open Testbed for Realistic Benchmarking of Web Applications," Proc. Second USENIX Conf. Web Application Development, pp. 4-4, 2011.
16. M. Charikar, C. Chekuri, T. Feder, and R. Motwani, "Incremental Clustering and Dynamic Information Retrieval," SIAM J. Computing, vol. 33, pp. 1417-1440, June 2004. (Pubitemid 40026770)
17. R.C. Chiang and H.H. Huang, "Tracon: Interference-Aware Scheduling for Data-Intensive Applications in Virtualized Environments," Proc. Int'l Conf. for High Performance Computing, Networking, Storage and Analysis, pp. 47:1, 47-12, 2011.
18. E.K.P. Chong and S.H. Zak, An Introduction to Optimization (Wiley-Interscience Series in Discrete Mathematics and Optimization). third ed., Wiley-Interscience, Feb. 2008.
19. L. Ciortea, C. Zamfir, S. Bucur, V. Chipounov, and G. Candea, "Cloud9: A Software Testing Service," SIGOPS Operating Systems Rev., vol. 43, no. 4, pp. 5-10, Jan. 2010.
20. E.G. Coffman, Computer and Job Shop Scheduling Theory. John Wiley & Sons, 1976.
21. B.F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears, "Benchmarking Cloud Serving Systems with YCSB," Proc. First ACM Symp. Cloud Computing, pp. 143-154, 2010.
22. E. Deelman and A. Chervenak, "Data Management Challenges of Data-Intensive Scientific Workflows," Proc. CCGRID '08, pp. 687-692, May 2008.
23. N.R. Draper and H. Smith, Applied Regression Analysis. John Wiley & Sons, 1981.
24. J. Du, N. Sehrawat, and W. Zwaenepoel, "Performance Profiling of Virtual Machines," Proc. Seventh ACM SIGPLAN/SIGOPS Int'l Conf. Virtual Execution Environments, pp. 3-14, 2011.
25. Faban. Faban, http://faban.org/, 2013.
26. Guillaume Pierre, WikiBench, http://www.wikibench.eu/, 2013.
27. H.H. Huang and A.S. Grimshaw, "Automated Performance Control in a Virtual Distributed Storage System," Proc. IEEE/ACM Ninth Int'l Conf. Grid Computing (GRID '08), 2008.
28. H.H. Huang, S. Li, A. Szalay, and A. Terzis, "Performance Modeling and Analysis of Flash-Based Storage Devices," Proc. IEEE Symp. Massive Storage Systems and Technologies (MSST '11), 2011.
29. O.H. Ibarra and C.E. Kim, "Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors," J. ACM, vol. 24, pp. 280-289, Apr. 1977.
30. Applied Multivariate Statistical Analysis, R.A. Johnson and D.W. Wichern, eds., Prentice-Hall, 1988.
31. J. Katcher, "Postmark: A New File System Benchmark," Network Appliance Technical Report TR3022 Oct. 1997.
32. V. Kazempour, A. Kamali, and A. Fedorova, "AASH: An Asymmetry-Aware Scheduler for Hypervisors," Proc. Sixth ACM SIGPLAN/SIGOPS Int'l Conf. Virtual Execution Environments (VEE '10), 2010.
33. H. Kim, H. Lim, J. Jeong, H. Jo, and J. Lee, "Task-Aware Virtual Machine Scheduling for I/O Performance," Proc. ACM SIGPLAN/SIGOPS Int'l Conf. Virtual Execution Environments, pp. 101-110, 2009.
34. Y. Koh, R. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu, "An Analysis of Performance Interference Effects in Virtual Environments," Proc. IEEE Int'l Symp. Performance Analysis of Systems and Software (ISPASS), 2007.
35. S. Kullback and R.A. Leibler, "On Information and Sufficiency," Ann. Math. Statistics, vol. 22, pp. 79-86, 1951.
36. S. Kundu, R. Rangaswami, K. Dutta, and M. Zhao, "Application Performance Modeling in a Virtualized Environment," Proc. IEEE 16th Int'l Symp. High Performance Computer Architecture (HPCA), pp. 1-10, 2010.
37. D. Kusic, J.O. Kephart, J.E. Hanson, N. Kandasamy, and G. Jiang, "Power and Performance Management of Virtualized Computing Environments via Lookahead Control," Cluster Computing, vol. 12, no. 1, pp. 1-15, 2009.
38. R. McDougall and J. Mauro, Solaris Internals: Solaris 10 and Open-Solaris Kernel Architecture. Prentice Hall, 2006.
39. Y. Mei, L. Liu, X. Pu, and S. Sivathanu, "Performance Measurements and Analysis of Network I/O Applications in Virtualized Cloud," Proc. IEEE Third Int'l Conf. Cloud Computing (CLOUD), pp. 59-66, 2010.
40. M.P. Mesnier, M. Wachs, R.R. Sambasivan, A.X. Zheng, and G.R. Ganger, "Modeling the Relative Fitness of Storage," Proc. ACM SIGMETRICS Int'l Conf. Measurement and Modeling of Computer Systems (SIGMETRICS '07), 2007.
41. F. Nadeem and T. Fahringer, "Predicting the Execution Time of Grid Workflow Applications through Local Learning," Proc. Conf. High Performance Computing Networking, Storage and Analysis (SC '09), 2009.
42. R. Nathuji, A. Kansal, and A. Ghaffarkhah, "Q-Clouds: Managing Performance Interference Effects for QoS-Aware Clouds," Proc. Fifth European Conf. Computer Systems (EuroSys '10), 2010.
43. P. Padala, K.-Y. Hou, K.G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, and A. Merchant, "Automated Control of Multiple Virtualized Resources," Proc. Fourth ACM European Conf. Computer systems, pp. 13-26, 2009.
44. M.L. Pinedo, Scheduling: Theory, Algorithms, and Systems. third ed., Springer, 2008.
45. P. Priore, D. De La Fuente, A. Gomez, and J. Puente, "A Review of Machine Learning in Dynamic Scheduling of Flexible Manufacturing Systems," Artificial Intelligence Eng. Design Analysis and Manufacturing, vol. 15, pp. 251-263, June 2001. (Pubitemid 32748662)
46. X. Pu, L. Liu, Y. Mei, S. Sivathanu, Y. Koh, and C. Pu, "Understanding Performance Interference of I/O Workload in Virtualized Cloud Environments," Proc. IEEE Third Int'l Conf. Cloud Computing (CLOUD), pp. 51-58, 2010.
47. H. Shan, K. Antypas, and J. Shalf, "Characterizing and Predicting the I/O Performance of HPC Applications Using a Parameterized Synthetic Benchmark," Proc. ACM/IEEE Conf. Supercomputing (SC '08), 2008.
48. W. Sobel, S. Subramanyam, A. Sucharitakul, J. Nguyen, H. Wong, A. Klepchukov, S. Patil, A. Fox, and D. Patterson, "Cloudstone: Multi-Platform, Multi-Language Benchmark and Measurement Tools for Web 2.0," Proc. The First Workshop Cloud Computing and Its Applications (CCA '08), 2008.
49. F. Song, A. YarKhan, and J. Dongarra, "Dynamic Task Scheduling for Linear Algebra Algorithms on Distributed-Memory Multicore Systems," Proc. Conf. High Performance Computing Networking, Storage and Analysis (SC '09), 2009.
50. B. Speitkamp and M. Bichler, "A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers," IEEE Trans. Services Computing, vol. 3, pp. 266-278, Oct.-Dec. 2010.
51. R. Susukita, H. Ando, M. Aoyagi, H. Honda, Y. Inadomi, K. Inoue, S. Ishizuki, Y. Kimura, H. Komatsu, M. Kurokawa, K.J. Murakami, H. Shibamura, S. Yamamura, and Y. Yu, "Performance Prediction of Large-Scale Parallell System and Application Using Macro-Level Simulation," Proc. ACM/IEEE Conf. Supercomputing (SC '08), 2008.
52. The Apache Software Foundation. Olio, http://incubator. apache.org/olio/, 2013.
53. X. Wang and M. Chen, "Cluster-Level Feedback Power Control for Performance Optimization," Proc. IEEE 14th Int'l Symp. High Performance Computer Architecture (HPCA '08), pp. 101-110, Feb. 2008.
54. X. Wang, E. Perlman, R. Burns, T. Malik, T. Budav-ari, C. Meneveau, and A. Szalay, "Jaws: Job-Aware Workload Scheduling for the Exploration of Turbulence Simulations," Proc. ACM/IEEE Int'l Conf. for High Performance Computing, Networking, Storage and Analysis (SC '10), 2010.
55. C. Weng, Z. Wang, M. Li, and X. Lu, "The Hybrid Scheduling Framework for Virtual Machine Systems," Proc. ACM SIGPLAN/SIGOPS Int'l Conf. Virtual Execution Environments, pp. 111-120, 2009.
56. Wikimedia Foundation, Wikipedia:Database Download, http://en.wikipedia. org/wiki/Wikipedia:Database-download, 2013.
57. T. Wood, L. Cherkasova, K. Ozonat, and P. Shenoy, "Profiling and Modeling Resource Usage of Virtualized Applications," Proc. Ninth ACM/IFIP/USENIX International Conference on Middleware (Middleware '08), 2008.
58. J. Xu and J.A.B. Fortes, "Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments," Proc. IEEE/ACM Int'l Conf. Green Computing and Comm. & Int'l Conf. Cyber, Physical and Social Computing, pp. 179-188, 2010.
59. Y. Zhang, W. Sun, and Y. Inoguchi, "Predicting Running Time of Grid Tasks Based on CPU Load Predictions," Proc. Seventh IEEE/ACM Int'l Conf. Grid Computing (GRID '06), 2006.
60. Q. Zhu, J. Zhu, and G. Agrawal, "Power-Aware Consolidation of Scientific Workflows in Virtualized Environments," Proc. ACM/IEEE Int'l Conf. for High Performance Computing, Networking, Storage and Analysis (SC '10), 2010.