BIG DATA INFRASTRUCTURE:

ISILON AND SCALE-OUT NAS

Shai Harmelin
Principle Systems Engineer

Copyright 2011 EMC Corporation. All rights reserved.

EMC Isilon Scale-Out NAS Agenda

Big Data Growth in the Enterprise
New Architecture Required: Scale-Out NAS

Isilon Solution Overview

Copyright 2011 EMC Corporation. All rights reserved.

Big Data-Enabled Applications

Collaborative

Real Time

Structured &
Unstructured

Petabyte
Scale

Act
EMC Documentum xCP

Analyze
EMC Greenplum + Hadoop

Copyright 2011 EMC Corporation. All rights reserved.

Store
EMC Isilon + Atmos

EMC Isilon Overview

Proven, global leader in Scale-Out NAS Storage solutions
Unrivaled product innovation 6th Generation
World-class products and global services

Strong ecosystem of technology partners

2200+ worldwide customers and growing
Acquired by EMC on 12/21/2010

Copyright 2011 EMC Corporation. All rights reserved.

 Copyright 2011 EMC Corporation. All rights reserved.

What is
Big Data?

Copyright 2011 EMC Corporation. All rights reserved.

Big Data is File & Unstructured Data

90
80
70
EXABYTES

60
50
40
30
20
10
0
2009

2010

2011

File Based: 60.7% CAGR

2012

2013

2014

Block Based: 21.8% CAGR

According to IDC, by 2012, 80% of all storage capacity sold will be for file-based data.

Copyright 2011 EMC Corporation. All rights reserved.

Big Data Demands New Solution

47%
Data
Growth

TOP CIO
CONCERNS

37%

System
Performance
& Scalability

CIO Survey, October 2010

Copyright 2011 EMC Corporation. All rights reserved.

Enterprises Had Deployed Scale-Up Solutions

SCALE UP
Scalability
Performance
Management
Availability
Cost

Copyright 2011 EMC Corporation. All rights reserved.

10

Enterprises are Transitioning to ScaleOut

SCALE OUT
Scalability
Performance
Management
Availability
Cost

Copyright 2011 EMC Corporation. All rights reserved.

11

Architecture

Head

Head

CPU, Memory, Throughput

OneFS
Architecture

Symmetric, Shared
Fully distributed OS

Copyright 2011 EMC Corporation. All rights reserved.

Traditional Single/Dual Controller

Controller w/shelves
Legacy single server OS

12

Scalability & Performance

Scale-up

Scale-out

OneFS

Traditional Single/Dual Controller

Scalability

Scale-out
Performance, Capacity, Both

Scale-up
Capacity only

Performance

True linear predictability

Degradation at scale

With NTAP my best day is my first day

Copyright 2011 EMC Corporation. All rights reserved.

13

Management & Economics

File Systems

Volumes

Aggregates
(~16TB)

RAID

OneFS

Traditional Single/Dual Controller

Management

1 volume, 1 file system

Single volume up to 10PB

MANY RAID, volumes, file systems

Single volume up 100TB (16TB typical)

Economics

80%+ utilization, <1FTE

Business agility
Investment protection

55-60% utilization, Multiple FTEs

Silos, limitations
Forklift upgrades

Copyright 2011 EMC Corporation. All rights reserved.

14

Isilons Scale-Out
Storage Solution
Elements
of Scale-out
(Distributed File Systems, Clustered File Systems, etc)

Unlimited Scalability

Ease of Use/Management

High Performance

High Availability

Maximum Data Protection

Enterprise Services
(Windows, Unix, Security, Authentication, etc.)

Copyright 2011 EMC Corporation. All rights reserved.

15

Isilons Scale-Out Storage Solution

Copyright 2011 EMC Corporation. All rights reserved.

16

Core InnovationValue to Customers

Isilons OneFS Scale-Out Operating System

Copyright 2011 EMC Corporation. All rights reserved.

17

Isilons Scale-Out Storage Solutions

Extending our Lead in Scale-Out Storage Market

Copyright 2011 EMC Corporation. All rights reserved.

18

Isilons Broad Range of Solutions

S-SERIES

X-SERIES
Purpose-built for hightransactional & IOPSintensive applications

NL-SERIES
A flexible solution to
accelerate high-concurrent
and sequential throughput
applications

Purpose-built for
cost-effective, large
capacity storage

Copyright 2011 EMC Corporation. All rights reserved.

19

Architecture Overview
Simple is Smart

Copyright 2011 EMC Corporation. All rights reserved.

20

Isilon IQ Network Architecture

Servers

Servers

Servers

Client/Application Layer

Copyright 2011 EMC Corporation. All rights reserved.

Standard Gigabit Ethernet

Layer

Isilon IQ Storage
Layer

Intracluster
Communication Infiniband
or GigE Layer

21

Largest and Most Scalable File System

500X More Scalable than Traditional Storage Systems
OneFS can scale from 18TB to over 15,000 TB in a
single file system
Traditional Scale-Up NAS players are limited to 2-16TB max file system
Under 60 seconds to scale with no downtime

Worlds fastest performance and capacity scaling

Copyright 2011 EMC Corporation. All rights reserved.

22

Using Software
AutoBalance

to do Work Unfit for

Automated data balancing across nodes reduces costs,

complexity and risks for scaling storage

Humans

BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL
BALANCED
EMPTY
FULL

AutoBalance migrates
content to new storage nodes
while system is
online and in production
Requires NO manual
intervention, NO
reconfiguration,
NO server or client mount
point or application changes
Eliminate Hot Spots

BALANCED
EMPTY

Copyright 2011 EMC Corporation. All rights reserved.

23

The Most Reliable Storage System

Built-in high availability clustered architecture
NetApp requires costly, redundant heads and software

With
N+2,
N+3, and
With N+1
protection,
N+4
data is protection,
100% available even if
data
is 100%
a single
drive available
or node fails
if multiple drives or nodes fail

100%

100%
FAILED

100%
100%

100%

And Isilon IQ offers the

industrys fastest drive rebuild
times

In less than an hour!

Copyright 2011 EMC Corporation. All rights reserved.

100%
100%
FAILED

100%

24

One File System for Multiple Tiers of Storage

I/Ops

MB/s

Archive

SmartPools

I/Ops

I/Ops

I/Ops

I/Ops

NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
NL Archive
Throughput
Throughput

NL Archive
Throughput
NL Archive

Copyright 2011 EMC Corporation. All rights reserved.

25

Powerful, Flexible, and Scalable Protection

Primary Use Cases:

Disaster Recovery
Business Continuance
Disk to Disk backup
Remote Archive

Block Efficient, File Specific

Leverages SnapshotIQ
Scales with Cluster

Copyright 2011 EMC Corporation. All rights reserved.

26

S-SERIES

X-SERIES

NL-SERIES

ACCELERATOR
& BACKUP
ACCELERATOR

ISILON
EX NODES

OPERATING
SYSTEM

HARDWARE

APPLICATION
SOFTWARE

The Broadest Range of Scale-Out Storage

Solutions for Big Data

Copyright 2011 EMC Corporation. All rights reserved.

27

 Copyright 2011 EMC Corporation. All rights reserved.

Back to Navigation

28

Isilon Scale-Out Storage Value

Massive

100x Larger File Systems

Unmatched

40x Higher Total Throughput

Industry-leading

and

As

Copyright 2011 EMC Corporation. All rights reserved.

1000+ Terabytes as 15 Terabytes

29

Visit us at EMC Big Data Booth

THANK YOU

Copyright 2011 EMC Corporation. All rights reserved.

30