Communications in clouds

Adnan Faisal faisal@sce.carleton.ca 13 March 2012

Outline
Traffic in Data Centers
Traditional DC vs. Cloud DC Volume, Type, Growth of Traffic

Cloud Services by Categories Communication obstacles in Clouds

When we say Amazon has cloud, does it mean amazon has both traditional dc and cloud dc? in other words, can a cloud contain traditional data center.

Traffic in Data Centers

Data Center Classification

2 kinds of Data Centers
Cloud Data Centers: deal with cloud traffic Traditional Data Centers: deal with non-cloud traffic Difference: in the levels of virtualization, standardization, automation, and security.sure? I think cloud has less security. Cloud data centers offer increased performance, higher capacity, and greater ease of management compared with traditional data centers.
4

Workloads in Data Centers

what is meant by workload? application?

The number of workloads per installed traditional server will increase from 1.4 in 2010 to 2.0 in 2015. The number of workloads per installed cloud server will increase from 3.5 in 2010 to 7.8 in 2015. By 2014, more than 50 percent of all workloads will be processed in the cloud.
Source: Cisco global cloud index (2010-2015), 2011
5

Global Data Center Traffic Growth

Source:

Traffic Classification by Destination

In 2010, 77 percent of traffic remains within the data center, and this will decline only slightly to 76 percent by 2015.
7

Why So Much Traffic Within DC?

1. Functional separation of App Server and Storage -> All backup traffic traverse DC 2. Functional separation of App Server and Database -> Generates traffic whenever an app reads from or writes to the central DB 3. Parallel processing -> divides tasks into multiple smaller tasks and sends them to multiple servers, contributing to internal data center traffic
8

Any exception for video files?

Video files require less/no database and processing operation. Will increasing video files increase the ratio of DC-to-user traffic? The present virtualization of data centers offsets this trend. Virtualization of storage increases traffic within the data center because virtualized storage is no longer local to the server or to its rack.
We need cloud edge for reducing this intra-cloud traffic.
9

Transition of Workloads: Traditional DC -> Cloud DC

A workload can be defined as the amount of processing a server undertakes to execute an application and support a number of users interacting with the application.

10

Cloud Data Center Traffic Growth

By 2015, more than one-third of all data center traffic will be based in the cloud.

11

Global cloud traffic by End-user: Consumer vs. Business

1600 1400 Petabytes per Year 1200 1000 800 600 400 200 0 2010 2011 2012 2013 2014 2015 115 16 226 31 52 79 109 413 139 686
I guess end-users using business apps (such as ebay or amazon users) are also counted as consumer.

1503 Consumer Business 1005 Consumer Business

CAGR 2010-2015 67% 53%

Consumer: Traffic originating with or destined for personal end-users Business: Traffic originating with or destined for business end-users
12

Cloud services by App Categories

13

Cloud services App Categories

1. Basic Cloud Apps: Text communication (e.g., email) , browsing, basic file sharing, social networking, basic video/audio streaming 2. Intermediate Cloud Apps: medium file sharing, IP telephony, ERP/CRM, basic gaming, basic video chat, IP audio conference, Basic video conference, HD (720p or 1080p) video streaming 3. Advanced Cloud Apps: Advanced gaming / video chat / file sharing, HD audio/video conferencing, UHD (4320p) video
The distinctions are not quantified rather descriptive. All games do not require same response time, so classifying games to different category is not very easy.
14

Requirements by App Categories

SInce it is from cisco, I guess the values you see here are the one cisco thinks feasibile to achieve: Murray

15

Communication Obstacles in Clouds

16

Obstacle (1): WAN Communication

Reduce the cost of WAN bandwidth 2/3 of the cost -> high-end routers 1/3 of the cost -> fiber Researchers are exploring simpler routers built from commodity components with centralized control.

Intra-cloud networking technology may be a performance bottleneck as well.

17

Dorina: Is there any alternative possible architecture? Me: Yes, there is a paper related to Aneka cloud.

Cloud Communication Architecture

Router 10 GbE Top-of-rack switch

1 GbE
18

20 to 80 processing nodes on each rack

Obstacle (1): WAN Communication

1GbE in lower level of aggregation can be a performance bottleneck when the inter-node processing pattern burst packets across the interconnect (e.g., during the shuffle step of Map and Reduce) 10 GbE in aggregation link is currently (2009) too expensive ($1000 for 10 GbE/server connection) to deploy for individual servers. This cost was expected to drop to less than $200 in 2010. Lack of bandwidth is one reason why few scientists use Cloud Computing.
19

Obstacle (2): Data Transfer

Physical shipment of disk is better (fast, costeffective) when transferring large amount of data (e.g., Transferring 10TB of data from UC Berkeley to Amazon in Seattle) 1 day vs 45 days $400 vs $1500 they did not consider the ISP cost. Also, what if amazon charges a lot of money to receive physical disk? Unused Cloud computing cycles can be used for other purpose Note: Garfinkel found that avg write bandwidth to Amazon S3 from 3 sites is between 5 to 18 Mbits/second.
20

Obstacle (3): Performance loss due to VM

Murray: Why sharing IO device is only problem? How is this different than processor sharing?

Applications sharing a common I/O device, such as NIC or disk, experience loss of performance due to crosstalk effects or usable bandwidth. By crosstalk, they mean the loss of performance observed in one VM because of sharing the NIC with other VM Crosstalk is not a good word in this context. Crosstalk refers to overhearing which is not the case here. In [3], the researchers examine the NIC sharing effects across VMs on a Xen virtualized server An alternate paradigm (e.g., logical partitioning of NIC, removing IDD etc.) was described which increase the as high as 60% in some case.
the perf gain should be same when there are 5 VM comparing to when 2 VM. Morever, when there are 5 VM, the max increment of X can be five fold.
21

Conclusions
Cloud traffic will keep increasing day by day Intra-cloud traffic would dominate over intercloud traffic and cloud-to-end-user traffic Different cloud applications have different service requirements Obstacles: Data transfer, Communication cost, VM crosstalk

22

References
1. Above the Clouds: A Berkeley View of Cloud Computing, 2009 2. Cisco global cloud index (2010-2015), 2011 3. J. Lakshmi and S. K. Nandy, Modeling Architecture-OS Interactions using LQN Models, in the Proc. of the 10th International Conference on the HPC Asia, Khaosiung, Taiwan, March 2-5, 2009
23

Glossary
Gigabyte (GB) = 109 Terabyte (TB) = 1012 Petabyte (PB) = 1015 Exabyte (EB) = 1018 Zettabyte (ZB) = 1021 CAGR = Compound annual growth rate

24