Software solutions for Virtual Infrastructures provisioning and management

Pascale Vicat-Blanc Primet

With the participation of Guilherme Koslovski, Fabienne Anhalt, Sbastien Soudan, Romaric Guillier, Philippe Martinez

INRIA University of Lyon pascale.primet@inria.fr

Context (1): Infrastructure as a Service

Convergence of computing and communication Expansion of cloud computing New models and tools are needed to help users & service providers to specify, configure, deploy, manage their virtual infrastructures and their applications

Context (2): Network virtualization

Decouples the physical hardware from the service level M-to-N mapping (M real resources, N virtual resources) to deliver greater resource/infrastructure utilization and flexibility Solid basement for customized network buildings Parallel networks with customized routing, traffic engineering, protocols

Tube P2P HTCP TeleP IP Game RCP IP

Parallel virtual networks, slices, or VPXI

IMG Grid UDT BIC IP CDN cuBIC IP Chat TCP IPv4 VoD IPv6

Virtualisation layer Physical layer

Lyon

Amsterdam

Berlin

Palo Alto

Genve

Tokyo

Bengalore

Benjing

Virtual Infrastructures Framework

VPXI editor VPXI admin

HIPerNet engine

HIPerNet software principle

VPXI A

VPXI B

HIPerNET engine: select, allocate, schedule nodes&channels

Virtual Infrastructures Software solutions

IT & Network resource virtualisation VPXI: Virtual Private eXecution Infrastructure VXDL: Virtual Infrastructure description Time-aware Virtual Infrastructure Allocation Security model

Scenario description
Execute a distributed application in a virtual infrastructure Application: NAS benchmark (version 3.3) MPI 7 applications: bt, cg, ep, is, lu, mg, sp Physical substrate: Grid5000 platform Steps: 1 2 3 4 Create a substrate of virtualized resources VPXIs specification VPXIs allocation and deployment Execution

G5K: large scale experimental facility (since 2005)

See https://www.grid5000.fr

Private link 10Gb/s to NL (Geysers project)

Private 10Gb/s link to JP (Petaflow project)

5000 cores, distributed over 9 sites in France Various types of servers 10 Gbps connections over RENATER network DWDM + 10GE in the core Different local network technologies

Sophia

570 users 17 laboratories involved

1) Bootstrap: virtualized substrate creation

Underlying physical ICT infrastructure

Virtualized substrate: VXspace

10

Virtual infrastructures: VPXI concept

We define a VPXI as a time-limited interconnection of virtual computing resources through a virtual private network

Application-mapping principles

12

2) VPXI specification
VXDL language Specification of virtual resources sets Specification of virtual topology Specification of time line Example: Specification of three VPXIs : Same resource set & topology, different link rates 4 virtual resources: VN 1, VN 2, VN 3, VN 4 2 virtual routers: VR 5 and VR 6 VPXI-3 VPXI-2 VPXI-1 100 Mbps 75 Mbps 50 Mbps
VN 3 VN 4

VN 1

VN 2

VR 5

VR 6

VN X VR Y VR 5 VR 6 200 Mbps 150 Mbps 100 Mbps

13

3) Allocation and creation

VXDL VXDL file VXDL file file
submit
VN 4 VN 4 VN 4

VN 1 VN 2 VN 1 VN 2 VN 1 VN 2 VR 5 VR 6 VR 5 VR 6 VR 5 VR 6 VN 3 VN 3 VN 3

HIPerNet engine

HIPerNET framework is a component-based software technology. Set of independant & replaceable modules to: Parse VXDL requests Allocate & schedule VPXIs Control of VPXIs & Virtual resources Manage users & security

4) VPXI deployment & configuration

VN 1 VN 2 VR 5 VR 6

HIPerNET framework: combines system and network virtualization provisions and configures virtual resources creates and manages VPXIs

VN 3

VN 4

HIPerNet engine

Virtualized resources
15

5) VPXI & application deployment

VN 1 VN 2 VR 5 VR 6

VXDL file
VN 3

VN 4

HIPerNet engine
VPXI deployment
VN 1 VR 5 VN 4 VN 3 VN 2 VR 6

6) Execution

Execution of NAS with different bandwidth setups

VN X VR X 100 Mbps 75 Mbps 50 Mbps

VR 5 VR 6 200 Mbps 150 Mbps 100 Mbps

Conclusions
VXDL is a powerfull language to specify flexible and personalized virtual infrastructures (VPXIs) Execution using the modular HIPerNet framework is straightforward for our users. Resource virtualisation & dynamic reconfiguration complexity is hidden. Grid5000 platform is a powerfull physical underlying infrastructure for VPXI functionalities, performances as well as scalabilitys experiments and demonstrations More features are beeing integrated in HIPerNet (security, OpenFlow interface, performance measurement, GUI) VPXI can be applied to a large variety of usages (new services test and deployment, high throughput applications) Collaboration and partnership : FP7 GEYSERS, FP7 SAIL, OrangeLabs, DocomoNTT, OpenFlow group

Annexe: Some of our references on network virtualisation

1.

2.

3.

Julien Laganier and Pascale Vicat-Blanc Primet. HIPernet: a decentralized security infrastructure for large scale grid environments. In 6th IEEE/ACM International Conference on Grid Computing (GRID 2005), November 13-14, 2005, Seattle, Washington, USA, Proceedings, pages 140-147, 2005 Fabienne Anhalt, Guilherme Koslovski, Pascale Vicat-Blanc Primet Specifying and provisioning Virtual Infrastructures with HIPerNET. International Journal of Network Management (IJNM) - special issue on Network Virtualization and its Management, 2010. Pascale Vicat-Blanc Primet, Sebastien Soudan, and Dominique Verchere. Virtualizing and scheduling optical network infrastructure for emerging IT services. Optical Networks for the Future Internet (special issue of Journal of Optical Communications and Networking (JOCN)), 1(2):A121-A132, 2009. Guilherme Koslovski, Tram Truong Huu, Johan Montagnat, and Pascale Vicat-Blanc Primet. Executing distributed applications on virtualized infrastructures specified with the VXDL language and managed by the HIPerNET framework. In First International Conference on Cloud Computing (CLOUDCOMP 2009), Munich, Germany, October 2009. Pascale Vicat-Blanc Primet, Fabienne Anhalt, and Guilherme Koslovski. Exploring the virtual infrastructure service concept in Grid'5000. In 20th ITC Specialist Seminar on Network Virtualization, Hoi An, Vietnam, May 2009. Pascale Vicat-Blanc Primet, Jean-Patrick Gelas, Olivier Mornard, Guilherme Koslovski, Vincent Roca, Lionel Giraud, Johan Montagnat, and Tram Truong Huu. A scalable security model for enabling Dynamic Virtual Private Execution Infrastructures on the Internet. In IEEE/ACM International Conference on Cluster Computing and the Grid (CCGrid2009), Shanghai, May 2009. Guilherme Koslovski, Pascale Vicat-Blanc Primet, and Andrea Schwertner Char. VXDL: Virtual Resources and Interconnection Networks Description Language. In GridNets 2008, Oct. 2008.

4.

5.

6.

7.