Experimenting SDN and Cloud Orchestration in Virtualized Testing Facilities: Performance Results and Comparison

Due to the impressive demand for communication-intensive applications deployed in the cloud, cross-layer orchestration solutions for Cloud data centers (DCs) are essential for the effective usage of both network and cloud resources while addressing service requirements and user expectations. In this regard, the software-defined networking (SDN) can play a key role thanks to programmable network control operations and to a more effective inter-working between network controllers and cloud management platforms. On the other hand, due to the relevant size of Cloud DCs, a significant evaluation of SDN-based orchestration solutions requires testing environments with proper scales, and significant level of fidelity. This paper discusses the opportunities of using virtual testbeds to carry out Cloud-related experimentations while addressing with significant scale requirements of DC infrastructures. First, we present a set of results of a test campaign we carried out using the Fed4FIRE experimental facility aiming at a comprehensive performance evaluation of an SDN-based orchestration solution for Cloud DCs. Second, we provide a comparison between virtual testbeds and other testing environments, i.e., laboratory testbeds, simulators and emulators, in terms of offered advantages, and effectiveness in experimentations. Moreover, we discuss the appropriateness and advisability of using virtualized testbeds for research on novel SDN and Cloud orchestration solutions at scale, by highlighting advantages of virtual testbeds in comparison with laboratory, simulation and emulation testing facilities in terms of effectiveness of experimentations and accuracy of results.