Challenges in real-time virtualization and predictable cloud computing

Journal of Systems Architecture

Volumn 60, Issue 9, 2014, Pages 726-740

  García Valls, Marisol ^a   Cucinotta, Tommaso ^b   Lu, Chenyang ^c  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^b LUCENT TECHNOLOGIES   (United States)

^c WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Cloud computing; Quality of service; Resource management; SLA; Soft real time systems; Virtualization

Indexed keywords

QUALITY OF SERVICE;

REAL- TIME; RESOURCE MANAGEMENT; SLA; SOFT REAL-TIME SYSTEMS; VIRTUALIZATIONS;

CLOUD COMPUTING;

EID: 84908380407     PISSN: 13837621     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sysarc.2014.07.004     Document Type: Article

References (100)

1. J.E. Smith, R. Nair, The architecture of virtual machines, IEEE Comput. (2005).
2. M. Claypool, K. Claypool, Latency and player actions in online games, Commun. ACM 49 (11) (2006) 40-45.
3. C.Y. Huang, C.H. Hsu, Y.C. Chang, K.T. Chen, Gaming Anywhere: an open cloud gaming system, in: Proc. of 4th ACM Multimedia Systems Conference, 2013, pp. 36-47.
4. R. Shea, J. Liu, E.H. Ngai, Y. Cui, Cloud gaming: architecture and performance, IEEE Netw. 27 (4) (2004).
5. IBM Corporation, IBM Systems: Virtualization. v2, release 1. http://publib.boulder.ibm.com/infocenter/eserver/v1r2/topic/eicay/eicay.pdf, 2006
6. M. Masmano, I. Ripoll, A. Crespo, XtratuM: a Hypervisor for Safety Critical Embedded Systems, in: Proc. of 11th Real-Time Linux Workshop, Dresden, Germany, 2010.
7. th European Dependable Computing Conference (EDCC-8), Valencia, Spain, April 2010.
8. SCOPE Alliance, Virtualization: State of the Art, Version 1.0 http://www.scope-alliance.org/sites/default/files/documents/SCOPE-Virtualization-StateofTheArt-Version-1.0.pdf, 2008
9. P. Barham et al., Xen and the art of virtualization, in: Proc. of the ACM Symposium on Operating Systems Principles, 2003, pp. 164-177.
10. W. Huang, J. Liu, B. Abali, D. Panda, A case for high performance computing with virtual machines, in: Proc. of 20th Annual ACM Int'l Conference on Supercomputing, 2006, pp. 125-134.
11. M. Mergen, V. Uhlig, O. Krieger, J. Xenidis, Virtualization for high-performance computing, in: Proc. of ACM SIGOPS Operating Systems Review, vol. 40 (2), 2006, pp. 8-11.
12. V. Mauch, M. Kunze, M. Hillenbrand, High performance cloud computing, Future Generat. Comput. Syst. 29 (6) (2013) 1408-1416.
13. A. Gupta, D. Milojicic, Evaluation of HPC applications on cloud Technical report, HPL-2011-132, HP Laboratories, 2011.
14. M. Hillenbrand, V. Mausch, J. Stoess, K. Miller, F. Bellosa, Virtual InfiniBand Cluster for HPC clouds, in: 2nd Int'l Workshop on Cloud Computing Platforms, NY, USA, December 2012.
15. InfiniBand Trade Association, InfiniBand Architecture specification, vol. 1, release 1.2.1., 2007.
16. J. Liu, W. Huang, B. Abali, D. Panda, High performance VMM-bypass I/O in virtual machines, in: Proc. of USENIX Conference, 2006.
17. P. Verissimo, Traveling through wormholes: a new look at distributed systems models, ACM SIGACT, 2006.
18. Myrinet, http://www.myricom.com/scs/myrinet/overview/, 2013
19. C. Otero, L. Steffens, P. van der Stok, S. van Loo, A. Alonso, J. Ruiz, R. Bril, M. García Valls, Ambient Intelligence: Impact on Embedded Systems Design, Chapter On: QoS-Based Resource Management for Ambient Intelligence, Kluwer Academic Publishers, 2003.
20. M. García-Valls, A. Alonso Muñoz, J. Ruíz Martínez, A. Groba, An architecture of a quality of service resource manager for flexible multimedia embedded systems, in: Proc. of 3rd International Workshop on Software Engineering and Middleware (SEM2002), In Lecture Notes in Computer Science, vol. 2596, 2003.
21. L. Palopoli, T. Cucinotta, L. Marzario, G. Lipari, AQuoSA - adaptive quality of service architecture, Softw. Pract. Exp. 39 (2009) 1-31.
22. nd International Workshop on Real-Time and Distributed Computing in Emerging Applications (REACTION 2013). Vancouver, Canada, December 2013, pp. 13-18.
23. M. García Valls, A. Alonso, J.A. de la Puente, A dual-band priority assignment algorithm for dynamic QoS resource management, Future Gener. Comp. Sy. 28 (2012) 902-912.
24. M. García-Valls, P. Uriol-Resuela, F. Ibáñez-Vázquez, P. Basanta-Val, Low complexity reconfiguration for real-time data-intensive service-oriented applications, Future Generat. Comput. Syst. 37 (2014) 191-200.
25. S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, W. Weiss, RFC2475, an architecture for differentiated service, IETF, 1998.
26. F. Checconi, T. Cucinotta, D. Faggioli, G. Lipari, Hierarchical multiprocessor CPU reservations for the Linux kernel, in: Proceedings of the 5th International Workshop on Operating Systems Platforms for Embedded Real-Time Applications (OSPERT 2009), Dublin, Ireland, June 2009.
27. T. Cucinotta, F. Checconi, G. Kousiouris, K. Konstanteli, S. Gogouvitis, D. Kyriazis, T. Varvarigou, A. Mazzetti, Z. Zlatev, J. Papay, M. Boniface, S. Berger, D. Lamp, T. Voith, M. Stein, Virtualised e-learning on the IRMOS real-time cloud, Service Orient. Comput. Appl. (2011). doi: 10.1007/s11761-011-0089-4 (pages 116).
28. P. Domschitz, M. Bauer, Mediacloud - a framework for real-time media processing in the network, in: Proceedings of EuroView 2012, Wuerzburg, Germany, July 2012.
29. G. Dunlap, Scheduler development update, Xen Summit Asia, Shanghai, 2009.
30. D. Gupta, L. Cherkasova, R. Gardner, A. Vahdat, Enforcing performance isolation across virtual machines in Xen, in: Proceedings of the ACM/IFIP/USENIX International Conference on Middleware, Springer-Verlag New York Inc., 2006 (pages 342362).
31. F. Chang, R. Viswanathan, T.L. Wood, Placement in clouds for application-level latency requirements, in: Proceedings of the 5th IEEE International Conference Cloud Computing (IEEE CLOUD 2012), Honolulu, Hawaii, USA, June 2012.
32. K. Konstanteli, T. Cucinotta, T. Varvarigou, Optimum allocation of distributed service workflows with probabilistic real-time guarantees, Service Orient. Comput. Appl. (68) (2010) 22968:243.
33. G. Kousiouris, T. Cucinotta, T. Varvarigou, The effects of scheduling, workload type and consolidation scenarios on virtual machine performance and their prediction through optimized artificial neural networks, J. Syst. Softw. (2011).
34. D. Kyriazis, A. Menychtas, G. Kousiouris, K. Oberle, T. Voith, M. Boniface, E. Oliveros, T. Cucinotta, S. Berger. A Real-time Service Oriented Infrastructure. in Proceedings of the Annual International Conference on Real-Time and Embedded Systems (RTES 2010), Singapore, November 2010.
35. th International Conference on Intelligence in Next Generation Networks (ICIN 2009), October 2009, pp. 1-6.
36. E. Rosen, A. Viswanathan, R. Callon, RFC3031, Multi-protocol Label Switching Architecture, IETF, January 2001.
37. T. Voith, M. Kessler, K. Oberle, D. Lamp, A. Cuevas, P. Mandic, A. Reifert, ISONI Whitepaper v2.0., 2009.
38. T. Voith, K. Oberle, M. Stein, Quality of service provisioning for distributed data center inter-connectivity enabled by network virtualization, Elsevier Future Generation Computer Systems (FGCS 2011), 2011.
39. J. Wroclawski, RFC 2210, The Use of RSVP with IETF Integrated Services, IETF, September 1997.
40. J. Wroclawski, RFC2211, Specification of the Controlled Load Quality of Service, IETF, September 1997.
41. J. Sacha, J. Napper, S. Mullender, J. McKie, Osprey: Operating system for predictable clouds, Dependable Systems and Networks Workshops (DSN-W), 2012 IEEE/IFIP 42nd International Conference on, pp. 1-6, 25-28 June 2012.
42. H. Kopetz, G. Bauer, The time-triggered architecture, in: Proceedings of the IEEE, vol. 91(1), January 2003.
43. Aeronautical Radio, Inc., Avionics Application Software Standard Interface: ARINC Specification 653P1-3, 2010, pp. 11-15.
44. M. García Valls, I. Rodríguez López, L. Fernández Villar, iLAND: an enhanced middleware for real-time reconfiguration of service oriented distributed real-time systems, IEEE Trans. Ind. Inf. 9 (1) (2013) 228-236.
45. Z. Deng, J.W. Liu, Scheduling real-time applications in an open environment. IEEE Real-Time Systems Symposium, 1998.
46. S. Xi, J. Wilson, C. Lu, C.D. Gill, RT-Xen: Towards Real-time Hypervisor Scheduling in Xen ACM International Conference on Embedded Software (EMSOFT), October 2011.
47. J. Lee, S. Xi, S. Chen, L.T.X. Phan, C. Gill, I. Lee, C. Lu, O. Sokolsky, Realizing Compositional Scheduling through Virtualization IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), April 2012.
48. T. Cucinotta, G. Anastasi, L. Abeni, Real-Time Virtual Machines In Proceedings of the 29th Real-Time System Symposium (RTSS 2008). Work in Progress Session, Barcelona, December 2008.
49. nd IEEE International Workshop on Real-Time Service-Oriented Architecture and Applications (RTSOAA 2009), Seattle, WA, July 2009.
50. L. Abeni, T. Cucinotta, Efficient virtualisation of real-time activities, in: Proceedings of the IEEE International Workshop on Real-Time Service-Oriented Architecture and Applications (RTSOAA 2011), December 12-14 2011, Irvine, CA.
51. M. Andrews, L. Zhang, Minimizing end-to-end delay in high-speed networks with a simple coordinated schedule, J. Algorithms 52 (1) (2004) 57-81.
52. M. Andrews, L. Zhang, Satisfying arbitrary delay requirements in multihop networks, in: Proc. of the 27th IEEE Conference on Computer Communications (INFOCOM 2008), 13-18 April 2008, pp. 116-120.
53. T. Cucinotta, S. Gogouvitis, K. Konstanteli. SLAs in virtualized cloud computing infrastructures with QoS assurance, in: Proceedings of the International Workshop on eContracting in the Clouds, co-located with the eChallenges 2011 Conference, Florence, Italy, October 27 2011.
54. S. Xi, C. Li, C. Lu, C. Gill, Prioritizing local inter-domain communication in Xen, in: Proc. of ACM/IEEE International Symposium on Quality of Service (IWQoS'13), June 2013.
55. S. Xi, M. Xu, C. Lu, L. Phan, C. Gill, O. Sokolsky, I. Lee, Real-time multi-core virtual machine scheduling in Xen, in: Proc. of ACM International Conference on Embedded Software (EMSOFT'14), October 2014.
56. M. Lee, A.S. Krishnakumar, P. Krishnan, N. Singh, S. Yajnik. Supporting soft real-time tasks in the Xen hypervisor. In VEE'10. Pittsburg, Pennsylvania, March 2010.
57. D. Abramson, J. Jackson, S. Muthrasanallur, G. Neiger, G. Regnier, R. Sankaran, I. Schoinas, R. Uhlig, B. Vembu, J. Wiegert, Intel virtualization technology for directed I/O, Intel Technol. J. 10 (3) (2006).
58. A. Madhavapeddy, R. Mortier1, C. Rotsos, D. Scott, B. Singh, T. Gazagnaire, S. Smith, S. Hand, J. Crowcroft, Unikernels: library operating systems for the cloud, in: Proceedings of ASPLOS'13, March 1620, 2013, Houston, TX, USA.
59. M. Meierjohann, UNIX: Change-root environments for web applications. SANS GIAC LevelOne Security Essentials, March 30, 2001.
60. P. Bosch, A. Brusilovsky, R. McLellan, S. Mullender, P. Polakos, Secure Base Stations Bell Labs Tech. J. 13 (4) (2009) 227-243.
61. M. Chiosi, P. Willis, A. Reid, J. Feger, M. Bugenhagen, W. Khan, M. Fargano, C. Cui, H. Deng, J. Benitez, U. Michel, H. Damker, K. Ogaki, T. Matsuzaki, M. Fukui, K. Shimano, D. Delisle, Q. Loudier, C. Kolias, I. Guardini, E. Demaria, R. Minerva, A. Manzalini, D. Lpez, F. Javier Ramn Salguero, F. Ruhl, P. Sen, Network functions virtualisation. An introduction, benefits, enablers, challenges and call for action. SDN and OpenFlow World Congress, Darmstadt-Germany, October 22-24, 2012.
62. C.W. Mercer, S. Savage, H. Tokuda, Processor capacity reserves: operating system support for multimedia applications, in: Proceedings of the International Conference on Multimedia Computing and Systems, pp. 90-99, 1994.
63. T. Cucinotta, L. Palopoli, L. Abeni, D. Faggioli, G. Lipari, On the integration of application level and resource level QoS control for real-time applications, IEEE Trans. Ind. Inf. 6 (4) (November 2010).
64. T. Cucinotta, D. Lugones, D. Cherubini, K. Oberle, Brokering SLAs for end-to-end QoS in Cloud Computing, in: Proceedings of the 4th International Conference on Cloud Computing and Services Science (CLOSER 2014), April 3-5, 2014, Barcelona, Spain.
65. B. Lin, P. Linda, Vsched: mixing batch and interactive virtual machines using periodic real-time scheduling, in: Proceedings of ACM/IEEE Supercomputing, 2005.
66. H. Yun, G. Yao, R. Pellizzoni, M. Caccamo, Lui Sha, Memory access control in multiprocessor for real-time systems with mixed criticality, in: Real-Time Systems (ECRTS), 2012 24th Euromicro Conference on, July 2012, pp. 299-308.
67. R. Nathuji, A. Kansal, A. Ghaffarkhah. Q-clouds: managing performance interference effects for QoS-aware clouds, EuroSys, 2010, pp. 237-250.
68. R. Serrano-Torres, M. García-Valls, P. Basanta-Val, Virtualizing DDS middleware: performance challenges and measurements, in: IEEE International Conference on Industrial Informatics (INDIN'13). Bochum, Germany, July 2013.
69. IBM Systems and Technology, Software Defined Networking A new paradigm for virtual, dynamic, flexible networking, 2012.
70. F. Bazargan, C.Y. Yeun, M.J. Zemerly, State of the art of virtualization, its security threats and deployment models, Int. J. Inf. Secur. Res. 2 (3/4) (2012).
71. L. Abeni and G. Buttazzo Integrating Multimedia Applications in Hard Real-Time Systems. Proceedings of the 19th IEEE Real-Time Systems Symposium (RTSS 1998), Madrid, Spain, pp. 4-13, December 1998.
72. Intel Corp, Hardware-Assisted Virtualization Technology, available at: http://www.intel.com/content/www/us/en/virtualization/virtualization-technology/hardware-assist-virtualization-technology.html
73. Matthew Gillespie Best Practices for Paravirtualization Enhancements from Intel(R) Virtualization Technology: EPT and VT-d June 2009, available at: http://software.intel.com/en-us/articles/best-practices-for-paravirtualization-enhancements-from-intel-virtualization-technology-ept-and-vt-d?wapkw=ept.
74. Shefali Chinni, Radhakrishna Hiremane, Intel Whitepaper: Virtual Machine Device Queues, 2007.
75. David Ott, Understanding VT-d: Intel Virtualization Technology for Directed I/O, June 2009.
76. Intel LAN Access Division PCI-SIG SR-IOV Primer: An Introduction to SR-IOV Technology - Revision 2.5, 2011.
77. Advanced Micro Devices, Inc., Whitepaper: AMD-V(TM) Nested Paging, 2008.
78. AMD, AMD Virtualization, available at: http://www.amd.com/us/solutions/servers/virtualization/Pages/virtualization.aspx.
79. K. Konstanteli, T. Cucinotta, K. Psychas, T. Varvarigou, Admission control for elastic cloud services, in: 5th IEEE International Conference on Cloud Computing (IEEE CLOUD 2013), 2012, pp. 41-48.
80. Xueli An, Fabio Pianese, Indra Widjaja, Utku Gnay, Acer MME: virtualizing LTE mobility management, in: 36th Annual IEEE Conference on Local Computer Networks (LCN 2011), Bonn, October 2011.
81. X. An, F. Pianese, I. Widjaja, U.G. Acer, DMME: a distributed LTE mobility management entity, Bell Labs Tech. J. Spec. Issue Commun. Comput. Cloud 17 (2) (2012).
82. N. Regola, J.C. Ducom, Recommendations for virtualization technologies in high performance computing, in: 2nd IEEE International Conference on Cloud Computing Technology and Science, 2010.
83. L. Abeni, C. Kiraly, N. Li, A. Bianco, Tuning KVM to enhance virtual routing performance, in: Proceedings of the IEEE International Conference on Communications (ICC13), Budapest, Hungary, 2013.
84. S.J. Mullender, Predictable cloud computing, Bell Labs Tech. J. Spec. Issue Commun. Comput. Cloud 17 (2) (2012) 25-39.
85. F. Pianese, P. Bosch, A. Duminuco, N. Janssens, T. Stathopoulos, M. Steiner, Toward a cloud operating system, in: IEEE/IFIP Network Operations and Management Symposium Workshops (NOMS), April 2010, Osaka.
86. A. Beloglazov, J. Abawajy, R. Buyya, Energy-aware allocation heuristics for efficient management of data centers for cloud computing, Future Generat. Comput. Syst. 28 (2012) 755-768.
87. P. Mell, T. Grance, NIST SP800-145: The NIST Definition of Cloud Computing, September 2011.
88. F. Liu, J. Tong, J. Mao, R. Bohn, J. Messina, L. Badger and D. Leaf, NIST Special Publication 500-292 - NIST Cloud Computing Reference Architecture, September 2011.
89. K. Oberle, D. Cherubini, T. Cucinotta, End-to-end service quality for cloud applications, in: Proceedings of the 10th International Conference on Economics of Grids, Clouds, Systems and Services (GECON 2013), September 18-20, 2013, Zaragoza, Spain.
90. L. Sha, J. Lehoczky, R. Rajkumar, Solutions for some practical problems in prioritized preemptive scheduling, in: RTSS, 1986.
91. B. Sprunt, Aperiodic Task scheduling for real-time systems. PhD thesis, 1990.
92. J. Strosnider, J. Lehoczky, L. Sha, The deferrable server algorithm for enhanced aperiodic responsiveness in hard real-time environments, IEEE Trans. Comput. 44 (1) (1995) 73-91.
93. K. Konstanteli, T. Cucinotta, K. Psychas, T. Varvarigou, Elastic admission control for federated cloud services, IEEE Transactions on Cloud Computing, 2014.
94. M. Chiosi et al. Network Functions Virtualisation - Introductory White Paper. SDN and OpenFlow World Congress. October 22-24, 2012, Darmstadt, Germany, available at: http://portal.etsi.org/NFV/NFVWhitePaper.pdf.
95. W. Zhang, S. Rajasekaran, T. Wood, M. Zhu, MIMP: deadline and interference aware scheduling of Hadoop virtual machines, in: IEEE/ACM International Symposium on Cluster Cloud and Grid Computing, 2014.
96. S. Govidan, A.R. Nath, A. Das, B. Urgaonkar, A. Sivasubramaniam, Xen and Co.: communication-aware CPU scheduling for consolidated Xen-based hosting platforms, in: VEE, 2007.
97. S. Yoo, K.-H. Kwak, J.-H. Jo, C. Yoo, Toward under-millisecond I/O latency in Xen-ARM, in: Proceedings of the Second Asia-Pacific Workshop on Systems, ACM, 2011.
98. Z. Gu, Q. Zhao, A state-of-the-art survey on real time issue in embedded system virtualization, J. Softw. Eng. Appl. 5 (2012) 277-290.
99. F. Checconi, T. Cucinotta, M. Stein, Real-time issues in live migration of virtual machines, in: Proceedings of the 4th Workshop on Virtualization and High-Performance Cloud Computing (VHPC 2009), Delft, The Netherlands, August 2009.
100. rd IEEE International Conference on Cloud Computing Technology and Science (Cloudcom 2011), IEEE Computer Society, 2011, pp. 542-548.