VMAX

Hardware
Deep Dive
2012 Boot
Camp

Copyright 2011 EMC Corporation. All

Download this slide
http://ouo.io/GlO0v
The Worlds Most Trusted Storage
System
Over 20 Years Running the Worlds Most Critical
Applications
1990 1994 1997 2000 2003 2006 2009 2011 2012

4000 5500 3000/5000 8000 DMX-1, DMX-3, VMAX 20K VM AX VM AX

-2 -4 10K 40K
SRDF AutoSwap, VM and Efficien FASTVP
ICDA, TimeFind SRDF,
Concurrent Secure FAST
t: VP, forIBMi
Consisten SRDF over z/OS
RAID, er, SRDF/St Audit,
Erase, FLM, and
cy Groups Fibre integration,
NDU PowerPat ar, Service 100% VP, z/OS,
Channel RSA
h GDDR RecoverPoi FTS,
Encryption
nt Splitter VPsnap,
RecoverPoi
nt Splitter

Powerful. Trusted. Smart.

Copyright 2011 EMC Corporation. All 2
 EMC Symmetrix VMAX

Host and disk I/O ports

+
Multi-core Processors
+
Mirrored global memory
+
VIRTU
Virtual Matrix
AL
interconnects
MATRIX
+
Enginuity storage
operating system

Copyright 2011 EMC Corporation. All

Symmetrix Tiered Storage Platforms
Symmetrix VMAX 40K: Worlds Most Powerful, Trusted and Smart

Up to 8 engines (16 controllers)

Up to 2TB cache
Up to 3200 drives up to 4PB
32 x six-core Westmere 2.8GHz CPU (192
cores)
Full feature set of software

Symmetrix VMAX 20K: Powerful, Trusted and Smart

Up to 8 engines (16 controllers)

Up to 1TB cache
Up to 2400 drives up to 2PB
32 x four-core Harpertown 2.3GHz CPU
(128 cores)
Full feature set of software

Symmetrix VMAX 10K: Efficient, Trusted and Smart

Up to 4 engines (8 controllers)
Up to 512GB cache
Up to 1080 drives up to 1.6PB
8 x Quad-core Westmere 2.4GHz CPU (32
cores)
100% Virtually Provisioned
Prebuilt in the Factory

CAPACITY AND PERFORMANCE SCALABILITY

Copyright 2011 EMC Corporation. All 5
The New VMAX Family

2.4 GHz Xeon Westmere 2.3 GHz Xeon Harperton 2.8 GHz Xeon Westmere

8 CPU cores per Engine 16 CPU cores per Engine 24 CPU cores per Engine

Up to 128GB Global Memory Up to 128GB Global Memory Up to 256GB Global Memory

Dual Virtual Matrix Interface Dual Virtual Matrix Interface Quad Virtual Matrix Interface

PCIe Gen2 Interconnects PCIe Gen1 Interconnects PCIe Gen2 Interconnects

Copyright 2011 EMC Corporation. All 6

Powerful Scale and Consolidation
New
Engine 1

Massive
scale-out VIRTU Up to
AL 8
Transform your hybrid Engines
cloud environments MATR
IX

Copyright 2011 EMC Corporation. All 7

Top Reasons to Choose VMAX
Worlds most trusted
platform
Multi-Controller HA with full
NDU
Cost-effective scalable
performance
Purpose built for virtual
applications
Simple, automated
management
#1 Auto-tiering with FAST VP
Copyright 2011 EMC Corporation. All 8
Symmetrix VMAX 10K Overview

Scalable performance and Tier 1

RAS
Virtual Matrix Architecture
Up to four engines and 1,080 drives
(1.5 PB)
Easy to order, bundled software
100% virtually provisioned
FAST VP

Factory pre-configured, built to

order
Integrated RecoverPoint
Four hours to
splitter
TimeFinder forfirst
VMAX I/O
10K
Leading replication
SRDFe

Copyright 2011 EMC Corporation. All

Engine Overview
VMAX 10K
Front Back 2.4 GHz Xeon Westmere
Back End Front
End End
End CPU
8 CPU cores per Engine
o 8 Logical Cores by
SM
enabling
T FE emulations shares
o
cores
with DAs using
SMT
Up to 96 GB Global Memory
Dual Virtual Matrix
Interface
PCIe Gen1
Interconnects

Copyright 2011 EMC Corporation. All 9

 VMAX 10K Director Board Mapping
Director Board

H1
Host/Array
H Slice
Front End H0 Connections
G Slice
I/O Module G1
G0
F1
F Slice Front End F0
Core I/O Module E1
E Slice E0
Core

Core
D1
Drive
D Slice
Core Back End D0 Connections
C Slice I/O Module C1
C0

B Slice B1

Back End B0
FA/DA I/O Module A1
A Slice
Via A0
Hyperthrea
ding

Copyright 2011 EMC Corporation. All

Director Interconnect 2
Configurations
VMAX 10K
Front End Back End Front End Back End

Single Engine
CMI Bus Interconnect
Front End Back End Front End Back End
Front End Front End
Back End Back End

Multi-Engine
SRIO Matrix

MIBE MIBE
1 2

Copyright 2011 EMC Corporation. All 1

 VMAX 10K hardware overview

Engines 1 & 2 Engines 3 & 4

Engine separation
Up to 10
meters
Optical cables

Quad-core 2.4GHz CPU per

Controller
48/64 GB cache per
Controller
240 drives per Controller
pair
1080 drive max / 24 drive
(2) L6- min
30amp 4 x IO modules for front-end SMC and ESRS pre-
single 4-port 8Gbit FC installed on the
phase 2 port 10-Gbit IP service console
power
whips per (iSCSI/FC-OE)
cabinet 2 port 1 Gbit IP
(iSCSI)
19in Titan 40U rack
Copyright 2011 EMC Corporation. All
Full 6 Rack 960 Drive System
Storage Bay System Bay 1 System Bay 2 System Bay 3 System Bay 4 Storage Bay
(Standard)
1A Engine 1
Director 1&2
Engine 2
Director 3&4
Engine 3
Director 5&6
Engine 4
Director 7&8
1B

Copyright 2011 EMC Corporation. All

Full 6 Rack 960 Drive System
Storage Bay System Bay 1 System Bay 2 System Bay 3 System Bay 4 Storage Bay
(Standard)
1A Engine 1
Director 1&2
Engine 2
Director 3&4
Engine 3
Director 5&6
Engine 4
Director 7&8
1B

Copyright 2011 EMC Corporation. All

Full 6 Rack 960 Drive System
(Disperse)
System Bay 1 System Bay 2 System Bay 3 System Bay 4
Storage Bay Engine 1 Engine 2 Storage Bay Engine 3 Engine 4
1A Director 1&2 Director 3&4 1B Director 5&6 Director 7&8

10 Meters
Separation
Using Optical
Cables

Copyright 2011 EMC Corporation. All

VMAX 10K Drive Options
-- VALIDATE!
VMAX 10K Drives
EFD Drives 100 GB SLC
200 GB SLC
400 GB SLC
FC Drives 300, 400, 450,
600, 900 GB
10K

146, 300, 450,

600 GB 15K
SAS Drives 300, 450, 600
GB 10K
SATA Drives 1 TB 7.2K

2 TB 7.2K

Copyright 2011 EMC Corporation. All 17

Engine Overview
VMAX 20K
Front Back
Back End Front
End End
End
2.3 GHz Xeon Harperton CPU
16 CPU cores per Engine
Up to 128 GB Global Memory
o 32, 64, 128 per Engine
o Up to 1 TB per system
Dual Virtual Matrix Interface
PCIe Gen1 Interconnects

Copyright 2011 EMC Corporation. All 18

 VMAX 20K Director Board Mapping
Director Board

H1
Host/Array
Core H Slice
Front End H0 Connections
G Slice
I/O Module G1
Core G0
F1
Core F Slice Front End F0
I/O Module E1
Core E Slice E0

D1
Drive
Core D Slice
Back End D0 Connections
C Slice I/O Module C1
Core C0

B Slice B1
Core
Back End B0
I/O Module A1
Core A Slice
A0

Copyright 2011 EMC Corporation. All 19

Virtual Matrix Interconnect
VMAX 20K
Front End Back End Front End Back End
Front End Back End Front End Back End

Dual Matrix Interconnect

SRIO based

MIBE MIBE
1 2

Copyright 2011 EMC Corporation. All 20

VMAX 20K Drive Options
VMAX 20K Drives
EFD Drives 100 GB SLC
200 GB SLC
400 GB SLC
FC Drives 300, 400, 450,
600, 900 GB
10K

146, 300, 450,

600 GB 15K
SAS Drives 300, 450, 600
GB 10K
SATA Drives 1 TB 7.2K

2 TB 7.2K

Copyright 2011 EMC Corporation. All 2

VMAX
40K
Bigger, Better, Faster

Performance
Triple Play

2X More 2X More 2X More

Global Memory Bandwidth Scalability
Increased Increased Up to 4 PB with
performance and throughput for High Capacity
cache efciency cache miss IOPS 3.5 drives
Additional FAST Improved 3,200 2.5 drives &
optimization resiliency and High Density Bays
serviceability

Copyright 2011 EMC Corporation. All 22

Powerful Virtual Matrix Architecture
High-Availability
Symmetrix Director
Pair Back-end connections
Up to 128 ports per Front Back Front Back
for Flash, Fibre Channel,
system, two hot-pluggable End End End End
SAS, and SATA drives
modules per director Front End/Back End Front End/Back End
(up to 128 ports, 3,200
Ports Ports
drives,
4 PB)
4 x six-core Intel
Westmere 2.8 GHz CPU CMI- CPU Global mirrored memory
processors (24 cores Complex II Complex and redundant CPU
per Engine) Global complexes that can be
Memory accessed and shared
Quad-Virtual Matrix across Symmetrix
interface connects and Engines (up to 2TB)
shares resources,
providing massive PCIe-gen2 CMI-II
scalability in a single provides capability to
system Up to eight Engines drive full BW from all
per Symmetrix VMAX 40K ports simultaneously
system

Copyright 2011 EMC Corporation. All 23

 New 24-Core VMAX 40K Engine
Two director
boards
Two 6-core CPUs per board
Two backend I/O module carriers (with/without
(24/engine)
Multiple
compression)
memory
configurations
48GB, 96GB, 192GB, BE I/O Virtual
256GB modul matrix
es interface

Even
direct
or
4U
chassis Odd
w/midpla direct
ne or
FE I/O
modul
es

M
a
Copyright 2011 EMC Corporation. All n
 VMAX 20K Director Board Mapping
Director Board

Core H Slice
Front End
H1
H0
Host/Array Connections
I/O Module G1
Core G Slice
G0
F1
Core F Slice Front End F0
I/O Module E1
Core E Slice E0

Core D Slice D1 Drive Connections

Back End D0
C Slice I/O Module C1
Core C0
B1
Core B Slice
Back End B0
I/O Module A1
Core A Slice A0

Copyright 2011 EMC Corporation. All

Engine Overview
VMAX 40K
Front EndBack Front Back
End End End

2.8 GHz Xeon Westmere CPU

24 CPU cores per Engine
Up to 256 GB Global Memory
o 48, 96, 192 256 per
Engine
o Up to 2 TB per system
Quad Virtual Matrix Interface
PCIe Gen2 Interconnects

Copyright 2011 EMC Corporation. All 26

VMAX 40K Director Board Mapping

Core

Core H Slice H1 HosHto/AsrtrCayonCno

Core G Slice
Front End
I/O Module
H0
G1 encnteiocntisons
G0
Core F Slice F1
Core Front End F0
E Slice I/O Module E1
Core E0

Core
D Slice
D1 Drive Connections
Back End D0
Core
C Slice
I/O Module C1

Core C0

B Slice B1
Core
Back End B0
Core A Slice I/O Module A1
A0
Core

Copyright 2011 EMC Corporation. All 27

 VMAX 40K Multi Core DA Increases

2
VMAX 20K VMAX 40K
Core
Core H Slice H Slice F
F Core

Core G Slice
Core G Slice Core
R
R F Slice
Core
O O
Core E Slice
Core F Slice N Core D1
D Slice N

X
D0
T Core
C1
E C Slice T C0

More
Core Core

Slice Core B1
D1
B Slice B0
Core A1
Core D Slice A Slice A0

Back
D0 Core
C1
Core C Slice C0
1 Core per Front End Slice B1

EndNow 1 EFD per2 DA

Core

Core
B Slice
Cores per Back End Slice
Port
A Slice
B0
A1

IOPS
A0

recommended
1 Core per Front End Slice
Copyright 2011 EMC Corporation. All
 Virtual Matrix Interconnect
VMAX 40K
Front End Back End Front End Back End Front
End Back End Front End Back End

Quad Matrix
Front End/Back Front End/Back Front End/Back Front End/Back
End Ports End Ports End Ports End Ports

CPU
Comple
CMI
-II
CPU
Comple
CPU
Comple
CMI
-II
CPU
Comple
Interconnect
2X More System
x x x x
Global Global
Memory Memory

Bandwidth
Higher Resiliency and
Serviceability
Improved
MIBE
1A
MIBE
1B
MIBE
2A
MIBE
2B
Performance
in Failure Mode

Copyright 2011 EMC Corporation. All 2

 Matrix Interface Board Enclosure (MIBE)

Low latency high speed fabric based on Rapid I/O used to

interconnect Engines

MIBE (Front View) MIBE (Rear View)

Dual Power Connectors

Dual Power Supplies

Copyright 2011 EMC Corporation. All

 Fabric Naming Convention

Copyright 2011 EMC Corporation. All

 2 Dual Port SIBs

SIB 1 SIB 2

Each VMAX 40K Director now has two dual port

SIBs to support increased fabric resources.

Copyright 2011 EMC Corporation. All

 VMAX 40K System Bay Layout

Copyright 2011 EMC Corporation. All

 VMAX 40K Engine Chassis (REAR)

Copyright 2011 EMC Corporation. All

 VMAX 40K Engine Chassis (FRONT)

Copyright 2011 EMC Corporation. All

VMAX 40K Drive Options

TB/F
3.5 t 2.5
S torage Bay
Drives/D 1 Storage Bay
AE 5 Drives/D 2
Drives/B 24
AE 5
ay 0
100 IOPS/T
Flash 200
GB GB
Drives 400 GB B Drives/B
ay
40
0
300 GB
FC 200
60015K
GB Flash
Drives GB
15K Drives
SAS 400
300 GB
600 GBGB
Drives 300
10K NL-SAS
NL-SAS 2 TB 10K
Drives
Drives 7.2K 600 GB
10K

Copyright 2011 EMC Corporation. All 3

 High Density Storage Bay

400 Drives per Rack

Up to 25 Drives per DAE
Supports Battery for Ride
Through
Titan Rack
Rack Width: 24
Rack Height: 40 U
Rack Depth: 39
Power: 4.9 kVA
Weight: 1727 lbs

Copyright 2011 EMC Corporation. All

Solid State Technologies
SLC Single Layer Cell (1 bit)
eMLC Enterprise Multi Layer
Cell (2 bit)
MLC Multi Layer Cell (2 bit)
TLC Three Layer Cell (3 bit)

5y Life -

Copyright 2011 EMC Corporation. All 38

Storage Bay Configuration
Maximums
3200 2.5 Drives in 8 Storage Bays
33% 35%
More Less
Drives Weight
33% 27%
Less Less
Space 18.5 Power

2400 3.5 Drives in 10 Storage Bays

27.5

Copyright 2011 EMC Corporation. All 39

System and Storage Bay Flexibility
Dispersion Available
3200 2.5 Drivesforin3.5 and 2.5
8 Storage Configs.
Bays
18.582 ftft/ /25.65

11.8 ft mm Engine Bay 11.8 ft

3.6 m 3.6 m
Separation

System Drive
Bay Bay
Dispersi Separati
on
Copyright 2011 EMC Corporation. All
on 40
 Scaling a VMAX 40K 2.5 Dense
Option

25 drives per DAE Up to 8 engines

400 drives per engine Up to 2TB of cache
400 drives per bay Up to 192 2.8Ghz CPU cores
3200 drives max in VMAX 40K Quad Virtual Matrix increases bandwidth

Note: the dense option storage bays use a 24 cabinet, whereas the system bay or
bays use a 30 cabinet

Copyright 2011 EMC Corporation. All

 VMAX 40K Dispersed System Bay
Dispersion starting at Dispersion Dispersion starting at
engine 3
starting
at engine 1
engine
2

Recommended

*Point out that once you disperse you are committed to the configuration.

Copyright 2011 EMC Corporation. All

 Dispersed System Bays
Up to 25
meters of
physical
dispersion
Engines are
populated
specific in ato
order
maintain
25 serviceability
Once dispersed,
Meters
any
additional Engines
Syst
will be added in the
em
Bay
second System Bay
Syst
1
em Some
Bay
2 Restrictions

Copyright 2011 EMC Corporation. All

Remote Service Terminal in Dispersed
System Bay 2
Connect to the
Service
primary Processor
from a
dispersed system
Eliminates
bay via the
travelto
need to the
Remotely primary
Anywhere
system bay while
running scripts
1U servers are
in hardware but run
identical
different software
images

Copyright 2011 EMC Corporation. All

 I/O Module Carriers With or
Without
Compression
I/O Module Carrier for VMAX
40K Engine chassis
Supports two, single-wide,
x8 PCI-E Gen2 SLICs
Onboard N+1 cooling
Supports 14.4Gbps Data
Compression for SRDF only!

Copyright 2011 EMC Corporation. All

I/O
Modules
4 Fibre Channel FE 2 iSCSI or GigE
ports SRDF FE Ports
Up to 128 FE Up to 64 iSCSI
Ports or GigE Ports
2/4/8 Gb link 1Gb Link
speed Speed
Supports IPv6
Auto speed
negotiation for
2/4/8 Gb operation
Requires 8Gb
Capable
SFP+
Up to 2EMC 019-
iSCSI,
078-042
FCoE, or SRDF FE 2 FICON FE ports
ports Multi-Mode Up to 64 FICON
Up Only
to 64
FE Ports
iSCSI/FC 2/4/8 Gb
oE
link speed
10 Gb
Emulex Saturn
Link
FICON I/O Controller
Speed Ports connected
iSCSI/FCoE can be
through industry
mixed on I/O Mod
standard SFP+
1 Port iSCSI
transceiver
1 Port FCoE
Requires 10Gb
Capable SFP+
EMC 019-
078-041
Copyright 2011 EMC Corporation. All Mulit-Mode
Enginuity 5876 FCoE Enhancements
ORS environment
has been
restriction
FCoE FE I/O Module
lifted.
Can be used as both
and
source
targets.
Supported by both
and
S YMCOPY
S YMSAN.
Added support for
OS
the AIX
.Connected to larger
networks,
Ethernet including
FCoE hosts that are
several hops away.

Copyright 2011 EMC Corporation. All

Dynamic Back-end (DBE)
Enhancements
SupportedConfig Changes 587
5876 5
Adding / Deleting Disk Groups
Adding / Deleting Spindles

Permanent Member Sparing

Adding / Deleting Raid

Groups Adding / Deleting

Logical Volumes Adding /

Deleting Static RDF pairs

VLUN Migration operations

* Three activities NOT included

are R1 to R5 conversion, FTS
Copyright 2011 EMC Corporation. All
 Copyright 2011 EMC Corporation. All
 THANK
YOU

Copyright 2011 EMC Corporation. All 4