TRACON: Interference-aware scheduling for data-intensive applications in virtualized environments

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Chiang, Ron C ^a   Huang, H Howie ^a  

^a George Washington University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PERFORMANCE; CO-LOCATED; CONTROL FRAMEWORK; DATA CENTERS; DATA-INTENSIVE APPLICATION; EVALUATION RESULTS; HIGH AVAILABILITY; INTERFERENCE EFFECTS; INTERFERENCE-AWARE; MODEL ADAPTION; MODELING AND CONTROL; NOVEL TASK; PREDICTION MODEL; RESOURCE CONSUMPTION; RESOURCE MANAGEMENT; RESOURCE MONITOR; RESOURCE UTILIZATIONS; RUNTIMES; VIDEO PROCESSING; VIRTUAL MACHINES; VIRTUALIZATIONS; VIRTUALIZED ENVIRONMENT; WEB SERVERS;

BIOINFORMATICS; COMPUTER SOFTWARE SELECTION AND EVALUATION; CONCURRENCY CONTROL; MACHINE COMPONENTS; MATHEMATICAL MODELS; RESOURCE ALLOCATION; SCHEDULING; VIRTUAL REALITY;

TRANSPORT AIRCRAFT;

EID: 83155188504     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063447     Document Type: Conference Paper

References (39)

1. Hirotugu Akaike. A New Look at the Statistical Model Identification. IEEE Transactions on Automatic Control, 19(6):716-723, 1974.
2. Mohammad Al-Fares, Alexander Loukissas, and Amin Vahdat. A scalable, commodity data center network architecture. SIGCOMM Comput. Commun. Rev., 38:63-74, August 2008.
3. Stephen F. Altschul, Warren Gish, Webb Miller, Eugene W. Myers, and David J. Lipman. Basic local alignment search tool. Journal of molecular biology, 215(3):403-410, October 1990.
4. Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. Xen and the art of virtualization. In Proceedings of the nineteenth ACM symposium on Operating systems principles, SOSP'03, pages 164-177. ACM, 2003. (Pubitemid 40929695)
5. Christian Bienia. Benchmarking Modern Multiprocessors. PhD thesis, Princeton University, January 2011.
6. Peter Bodík, Rean Griffith, Charles Sutton, O Fox, Michael Jordan, and David Patterson. Statistical machine learning makes automatic control practical for internet datacenters. In Proceedings of the 2009 conference on Hot topics in cloud computing, pages 12-12. USENIX Association, 2009.
7. Carlos Boneti, Roberto Gioiosa, Francisco J. Cazorla, and Mateo Valero. A dynamic scheduler for balancing hpc applications. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC'08, pages 41:1-41:12. IEEE Press, 2008.
8. Tracy D. Braun, Howard Jay Siegel, Noah Beck, Ladislau L. Bölóni, Albert I. Reuther, Mitchell D. Theys, Bin Yao, Richard F. Freund, Muthucumaru Maheswaran, James P. Robertson, and Debra Hensgen. A comparison study of static mapping heuristics for a class of meta-tasks on heterogeneous computing systems. In Heterogeneous Computing Workshop (HCW), pages 15 -29, 1999.
9. Kenneth P. Burnham and David R. Anderson. Model selection and multimodel inference: a practical information-theoretic approach. Springer, 2nd edition, July 2002.
10. Philip Carns, Kevin Harms, William Allcock, Charles Bacon, Samuel Lang, Robert Latham, and Robert Ross. Understanding and improving computational science storage access through continuous characterization. In Mass Storage Systems and Technologies (MSST), 2011 IEEE 27th Symposium on, pages 1 -14, May 2011.
11. Edwin K. P. Chong and Stanislaw H. Zak. An Introduction to Optimization (Wiley-Interscience Series in Discrete Mathematics and Optimization). Wiley-Interscience, 3 edition, February 2008.
12. Edward G. Coffman. Computer and Job Shop Scheduling Theory. John Wiley & Sons Inc, New York, 1976.
13. Ewa Deelman and Ann Chervenak. Data management challenges of data-intensive scientific workows. In Cluster Computing and the Grid, 2008. CCGRID'08. 8th IEEE International Symposium on, pages 687-692, May 2008.
14. Norman Richard Draper and Harry Smith. Applied Regression Analysis. John Wiley and Sons, New York, 1981.
15. H. Howie Huang and Andrew S. Grimshaw. Automated performance control in a virtual distributed storage system. In Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing, GRID'08, pages 242-249. IEEE Computer Society, 2008.
16. H. Howie Huang, Shan Li, Alex Szalay, and Andreas Terzis. Performance Modeling and Analysis of Flash-based Storage Devices. In Proceedings of the 2011 IEEE Symposium on Massive Storage Systems and Technologies (MSST'11), 2011.
17. Oscar H. Ibarra and Chul E. Kim. Heuristic algorithms for scheduling independent tasks on nonidentical processors. J. ACM, 24:280-289, April 1977.
18. Richard Arnold Johnson and Dean W. Wichern, editors. Applied multivariate statistical analysis. Prentice-Hall, Inc., Upper Saddle River, NJ, USA, 1988.
19. Jeffrey Katcher. Postmark: a new file system benchmark. Network Appliance Tech Report TR3022, October 1997.
20. Vahid Kazempour, Ali Kamali, and Alexandra Fedorova. Aash: an asymmetry-aware scheduler for hypervisors. In Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments, VEE'10, pages 85-96. ACM, 2010.
21. Younggyun Koh, Rob Knauerhase, Paul Brett, Mic Bowman, Zhihua Wen, and Calton Pu. An analysis of performance interference effects in virtual environments. In In Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 2007.
22. Sajib Kundu, Raju Rangaswami, Kaushik Dutta, and Ming Zhao. Application performance modeling in a virtualized environment. In High Performance Computer Architecture (HPCA), 2010 IEEE 16th International Symposium on, pages 1 -10, 2010.
23. Dara Kusic, Jeffrey O. Kephart, James E. Hanson, Nagarajan Kandasamy, and Guofei Jiang. Power and performance management of virtualized computing environments via lookahead control. Cluster Computing, 12(1):1-15, 2009.
24. Richard McDougall and Jim Mauro. Solaris Internals: Solaris 10 and Open Solaris Kernel Architecture. Prentice Hall, 2006.
25. Yiduo Mei, Ling Liu, Xing Pu, and S. Sivathanu. Performance measurements and analysis of network i/o applications in virtualized cloud. In Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on, pages 59 -66, 2010.
26. Michael P. Mesnier, Matthew Wachs, Raja R. Sambasivan, Alice X. Zheng, and Gregory R. Ganger. Modeling the relative fitness of storage. In Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems, SIGMETRICS'07, pages 37-48. ACM, 2007. (Pubitemid 350158071)
27. Justin Moore, Jeff Chase, Parthasarathy Ranganathan, and Ratnesh Sharma. Making scheduling \cool": temperature-aware workload placement in data centers. In Proceedings of the annual conference on USENIX Annual Technical Conference, ATEC'05, pages 5-5. USENIX Association, 2005.
28. Farrukh Nadeem and Thomas Fahringer. Predicting the execution time of grid workow applications through local learning. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC'09, pages 33:1-33:12. ACM, 2009.
29. Ripal Nathuji, Aman Kansal, and Alireza Ghaffarkhah. Q-clouds: managing performance interference effects for qos-aware clouds. In Proceedings of the 5th European conference on Computer systems, EuroSys'10, pages 237-250. ACM, 2010.
30. NIH. BLAST: Basic Local Alignment Search Tool. http://www.ncbi.nlm.nih. gov/BLAST/.
31. Xing Pu, Ling Liu, Yiduo Mei, S. Sivathanu, Younggyun Koh, and C. Pu. Understanding performance interference of i/o workload in virtualized cloud environments. In Cloud Computing (CLOUD), 2010 IEEE 3rd International Conference on, pages 51 -58, 2010.
32. Hongzhang Shan, Katie Antypas, and John Shalf. Characterizing and predicting the i/o performance of hpc applications using a parameterized synthetic benchmark. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC'08, pages 42:1-42:12. IEEE Press, 2008.
33. Fengguang Song, Asim YarKhan, and Jack Dongarra. Dynamic task scheduling for linear algebra algorithms on distributed-memory multicore systems. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, SC'09, pages 19:1-19:11. ACM, 2009.
34. Ryutaro Susukita, Hisashige Ando, Mutsumi Aoyagi, Hiroaki Honda, Yuichi Inadomi, Koji Inoue, Shigeru Ishizuki, Yasunori Kimura, Hidemi Komatsu, Motoyoshi Kurokawa, Kazuaki J. Murakami, Hidetomo Shibamura, Shuji Yamamura, and Yunqing Yu. Performance prediction of large-scale parallell system and application using macro-level simulation. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC'08, pages 20:1-20:9. IEEE Press, 2008.
35. US Environmental Protection Agency (EPA). Report to congress on server and data center energy efficiency: Public law 109-431. 2008.
36. Xiaodan Wang, Eric Perlman, Randal Burns, Tanu Malik, Tamas Budavári, Charles Meneveau, and Alexander Szalay. Jaws: Job-aware workload scheduling for the exploration of turbulence simulations. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC'10, pages 1-11. IEEE Computer Society, 2010.
37. Timothy Wood, Ludmila Cherkasova, Kivanc Ozonat, and Prashant Shenoy. Profiling and modeling resource usage of virtualized applications. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware, Middleware'08, pages 366-387. Springer-Verlag New York, Inc., 2008.
38. Yuanyuan Zhang, Wei Sun, and Yasushi Inoguchi. Predicting running time of grid tasks based on cpu load predictions. In Proceedings of the 7th IEEE/ACM International Conference on Grid Computing, GRID'06, pages 286-292. IEEE Computer Society, 2006.
39. Qian Zhu, Jiedan Zhu, and Gagan Agrawal. Power-aware consolidation of scientific workows in virtualized environments. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC'10, pages 1-12. IEEE Computer Society, 2010.