Multi-Cloud Container Orchestration for High-Performance Real-Time Online Applications

We develop a novel multi-cloud container orchestration architecture for high-performance Real-Time Online Interactive Applications (ROIA), with use cases including product configurators, multiplayer online gaming, e-learning and - training. Running the core components of ROIA, e.g., real-time 3D rendering, on a multi-cloud enables access to high-performance resources and prevents proprietary ‘vendor lock-in’. Our container orchestration facilitates: (1) strict Quality of Service (QoS) requirements, (2) secure communication between cluster nodes from different clouds, (3) automatic scalability, and (4) resource usage optimization. We improve previous work by using session slots that set a limit on the number of concurrent user sessions for a service instance without loss of QoS. Our implementation provides a vendor-independent, OpenVPN-based interconnection between cloud nodes, both Linux and Windows, possibly located in different LANs of a multi-cloud. We experimentally evaluate our orchestration approach on a Kubernetes-based cluster using a prototype of an interactive car configurator.