Demystifying Storage Networking Options: SAN vs. NAS vs.

iSCSI

Jeffrey Huxtable Storage Networking Specialist - IBM (919) 254-1535 huxtable@us.ibm.com Session 5757 Thursday, March 7, 2002

IT Storage Challenges
What storage technology and architecture to...
Improve data integrity, availability, shareability and security Data is increasingly recognized as assets Slow down storage costs to meet budget constraints
Tremendous increase in storage needs Raw storage prices are going down but data management cost is going way up

Very poor use of disk space because of fragmentation and management Scale storage to support very large Database files
Restricted by 'partitions' and server Operating System & application boundaries Distance and connectivity limitation

Enhance data management to support e-business applications Maintain performance and availability during high usage and activities

Overcome skilled resource scarcity and expense

First, there was direct-attach storage (DAS)...

Server
SCSI Fiber Channel ESCON

Shark 7133

Storage

Benefits
Each server or client has its own dedicated storage Inexpensive

Business Problem
Each server or client has its own dedicated storage
Major investment of storage is tied to server Once server is replaced, storage investment is lost Migration of data to new storage is required Underutilized storage can not be shared by other servers or clients Data in storage can not be accessed by other servers or clients Storage must be managed as individual entities Non-centralized Management & Data Protection
Windows server UNIX Server Web Server Novell Server
Desktop, Workstation, Clients

Storage

100 GBs 100 GBs 100 GBs 100 GBs 100 GBs

Storage

Storage

Storage

Storage

Business Solution
Pooled Storage on a network!
Investment Protection Storage Consolidation Data Sharing and Access Centralized Management Data Protection Disaster Tolerance
Desktop, Workstation, Clients

Windows server UNIX Server Web Server Novell Server

Storage

500 GBs

Trends - storage pooling over networks

Trends
Storage growth 75 - 150% (CAGR) driven by Internet expansion and e-business explosion
210K Terabytes shipping in 2001 800K Terabytes shipping in 2004

Industry Direction

Future for Storage

Centralized Storage on a Network

Shared Storage for Flexibility Open Standards Intelligent Storage to reduce Total Cost of Ownership
Automation (less effort) Simpler (less skill required)

Data Security

Today Architecture Storage Location Utilization Management Tools Direct-Attached Decentralized Poor: 40%-60% Many, Complex

Tomorrow Networked Centralized High:70%-90% Few (Integrated), Simple

Source: Forrester Research, Inc.

Storage Networking Alternatives

SAN
NAS Appliance
UNIX, Linux AIX,Solaris Family

Storage Fiber Channel SCSI Protocols Servers

LAN, TCP/IP
(1000,100 En)
Novell

UNIX Family

LAN / IP

(CIFS, NFS, HTTP)

File Protocols

Novell

Storage Area Network (SAN)

Linux WIN NT, 2K Family WIN 95, 98,NT, 2K Family

iSCSI Appliance

Network Attached Storage (NAS)

LAN, TCP/IP Linux

(1000,100 En)

SCSI Protocols

Coming Soon: AIX,Solaris, UNIX Family

WIN NT, 2K Family

iSCSI

Storage is Shifting from Direct to Networked Storage

Networked storage is both SAN and NAS storage solutions
$60 $50 $40 $30 $20 $10 $0 2000 2001 2002 2003 2004 2005

Total Growth 15%

NAS Growth 50% SAN Growth 41%

DAS Growth (5%)

By 2004, Industry Analysts Expect that Enterprise Customers Will Spend As Much On Storage As They Do On Servers
Source: 2H01 GMV

What is a SAN?
A Storage Area Network (SAN) is a dedicated high-speed network of directly connected storage elements designed to move large amounts of data between host independent, distributed storage devices. Ownership of the storage resources are "de-coupled" from the servers.

Local Area Network

Storage Area Network

SAN Benefits

Storage consolidation Data sharing Improved backup and recovery Disaster Tolerance Easier data management Higher availability Improved data access Flexibility for growth Security Easier migration to new technologies Automanted centralized policy-based data management

SAN Components

IBM Enterprise SAN Initiative

SAN is not just a storage initiative ... it is a reaffirmation of the importance of the customer's Digital Information. Digital Information has become the currency of e-business ... and SAN is the key to moving Digital Information from operating system islands to universal access.
Automated Services Disk & Tape Pooling Outboard Data Movement Clustering, Data Sharing Servers Fabric Devices Fibre Channel (FICON/FCP) Hubs, Switches, Gateways Storage Servers

Se rvi ce sa nd Su pp or So t lut ion s

IT Consulting Services Storage Services Testing and Verification

Exploitation

Management

Connectivity

SAN Hardware Base

IBM SAN Servers

Heterogeneous, multi-vendor server choices
Exploitation

SAN Hardware Base

(Servers & Storage)

xSeries

pSeries

Storage Area Network

NT/2K Novell

UNIX

iSeries

zSeries

IBM SAN Storage

Entry, midrange and enterprise storage choices
Exploitation

SAN Hardware Base

(Servers & Storage)

Enterprise Storage Server

FAStT700

FAStT500

FAStT200

Serial Disk

Storage Area Network

Enterprise Tape Drives, Libraries and Virtual Tape Server

SNIA Supported Solutions Forum Storage Options

IBM Ultrium LTO Tape Drives and Libraries

Storage Networking - Inside the SAN Cloud

Exploitation

Connectivity

FC SCSI

IP SSA

Protocol converter

Gateway, Router FC
FC-AL - a loop implemented as a star
Hub Any-to-any switched fabric Switches

ATM IP

Bridge SAN-WAN-SAN SAN-LAN-SAN

IBM SAN Fabric Switch Options

Entry Level

SAN Managed Hub (3534-1RU) 8 ports, 1 Gb

www.ibm.com/storage/fchub

McDATA ES-1000 (2031-L00) 8 Loop ports, 1 Gb

www.ibm.com/storage/mcdata

SAN Switch S08 (2109-S08) 8 ports, 1 Gb

www.ibm.com/storage/fcswitch

Midrange Fabric Switches

SAN Switch F16 (2109-F16) 16 ports, 2 Gb

www.ibm.com/storage/fcswitch

McDATA ES-3016/32 (2031-016/032) 16/32 ports, 1 Gb

www.ibm.com/storage/mcdata

SAN Switch S16 (2109-S16) 16 ports,1 Gb

www.ibm.com/storage/fcswitch

Enterprise High Availability Core Switches

Brocade SW 12000 (Unannounced) 64 ports, 2 Gb
www.brocade.com

McDATA ED-6064 (2032-001/064) 64 ports, 1 Gb

www.ibm.com/storage/mcdata

INRANGE FC/9000 (2042-001/128) 64/128 ports, 1 Gb

www.ibm.com/storage/inrange

Information & Infrastructure Management Software

Management

(Servers & Storage)

"Storage Tank" Tivoli SANergy Tivoli Storage Manager Tivoli Storage Network Manager StorWatch Specialist & Expert

Storage Virtualization Data sharing Data protection and migration

SAN monitoring, reporting, and automation

Tivoli Storage Manager

TSM Clients TSM Servers
Backup/Restore Archive/Retrieve Migrate/Recall

Network

Data Management Services

Backup/Recovery Archive/Retrieve Backup/Recovery API Hierarchical Storage Management

Storage Management Services

Hierarchical Storage Management Reclamation Colocation

Tivoli SANergy
File Level SAN management and sharing
LAN

Tivoli SANergy allows users on Windows NT, Windows 2000, Sun, and Linux servers to share the same data, today
SANergy is added to existing native Network File Systems Control information is transported over the LAN to Meta Data Server (MDC) Data is moved over the SAN Access control is via existing network file access security mechanisms Storage management functions such as Tivoli Storage Manager installable on Meta Data Server

Control

Host

Host
Data

MDC TSM

SAN

Tivoli Network Storage Manager

Device (Volume) Level SAN management and sharing

Centralized control and management of SANs across platforms Discovers, displays, allocates, monitors, automates, and manages SAN fabric components and disk storage resources.
Tivoli Storage Network Manager

Host

Host

Host

Virtualiization of LUNs

Switches and directors

SAN Virtualization
Storage Area Network Virtualization is separation of the native disk system function and the host use of the function

SANs break the server-centric view of storage systems

Shared physical resources Centralized allocation Establish any-to-any connectivity
Disk Systems

Servers

SANs Today

Virtualization technology takes SANs further

Eliminates server ownership of storage Increases flexibility in using storage assets Single, platform-independent management tools

Servers

SANs Tomorrow

Disk Systems

IGS and IBM Business Partner Services

Minimize Risk Accelerate Benefits
Management and Planning Installation and Testing Migration and Performance Managed Storage and Capacity on Demand
Se rv Su ices pp an or d t

So luti on s

(Servers & Storage)

Downtime Reduction Investment Protection Increased staff productivity

Supplement skills shortage

IBM TotalStorage SAN Solution Building Blocks

Create a scalable, flexible storage infrastructure with interoperability tested SAN solutions templates

Servers
UNIX, Windows, Novell, LINUX, iSeries, zSeries

SAN Fabric Components

Switches/Directors, Hubs, Gateways/Routers

Storage
Disk Control Units, Tape Drives, Tape Libraries
box Tool SAN

Software
SAN Management and SAN Exploitation

Services
Planning, Testing and Implementation, Education

What is NAS?
Network attached storage (NAS) is a LAN-attached, high-performance storage appliance that provides shared data to clients and other servers on that network.
Dedicated Open Scalable Flexible Reliable Simple Fully integrated, optimized solution system design for easy integration and migration GBs to TBs Supports multiple file protocols Redundant components and task-tuned software installation and ongoing systems management

NAS & SAN Overview

NAS
easily added to existing network uses existing IP networking skill base plug and play less expensive difficult to scale, growth requires more NAS devices handles File I/O for NFS, CIFS well good performance

NAS

IP Network

SAN
more involved network design high IT skill requirements (fibre channel) more complex install more expensive highly scalable, grows with environment handles Block I/O for required applications (DBMS) well better performance
SAN

Storage

Servers IP Network

What is IBM NAS?

Self Contained Storage Appliance
Scales from GBs to TBs

Preloaded file system (O/S) that provides heterogeneous file sharing

Windows (CIFS), Unix (NFS), Web (HTTP), Novell, FTP, AppleTalk....

LAN

Installation software
Requires minimum IT skills to maintain / install

Network Layer (TCP/IP)

Management software
Manage & Setup from remote location

File system
Pre-Loaded Pre-Configured Pre-Tuned Pre-Tested

CIFS/NFS/HTTP
Diagnostics

Diagnostic software
Predictive Failure Analysis Light Path Diagnostics Call Home Pager Alerts

RAID Controller

Fault Tolerant Features

Dual, Redundant, Hot Swap Components

Storage Array (SCSI or FC disks )

Data Protection Technology

Data Protection on Disk (RAID) Data Backup to Disk Data Backup to Tape

Management

Integrated NAS
NAS 200 5194 - Model 201 NAS 200 5194 - Model 226 NAS 300 5195 - Model 326

Unique Features
Single Engine Scales 109.2 GB to 440.4 GB 1.13 GHz Pentium Processor Tower Model Rack Conversion optional Dual Pentium Processor optional

Unique Features
Single Engine Scales 109.2 GB to 3.52 TB Dual 1.13 GHz Pentium Processor Rack Model

Unique Features
Dual Engine with Clustering / Failover Scales 109.2 GB to 6.61 TB Dual 1.13 GHz Pentium Processor Rack Model

IBM NAS Gateway

NAS 300G (Single or Dual Engine Configuration)
Offers the same benefits & characteristics of NAS
Connects to IP networks Performs as a File Server Heterogeneous file sharing Data Protection Diagnostic Capabilities Clustering & failover features

LAN
Network Layer (TCP/IP)

File system
CIFS/NFS/HTTP
Diagnostics

NAS Gateway is a NAS Appliance with one exception

NAS Gateways supports direct attachment to FC storage or connection to a storage devices across a SAN - NAS Gateways do not have any integrated disks for data storage

RAID Controller

Storage Array (SCSI or FC disks )

Management
Fibre Channel PCI Port

RAID Controller

Storage Array (SCSI or FC disks )

SAN

NAS Gateway Solution

Questions to ask when connecting remote servers to a SAN:
What are the distance considerations? Is the cost of a Fibre Channel Port (per Server) and Fibre Channel Switch/Hub cost effective? Do you need Heterogeneous file sharing/serving?

or
IP Network

NT Server Area UNIX

Network

FC Distance Limited to 100 KM Maximum Mix of UNIX NT Servers

NAS Gateway

Storage Area Network

FC Switch or Hub

IBM TotalStorage NAS 300G (Gateway)

Model 5196 - G01 Model 5196 - G26

Single Engine

Dual Engine

Unique Features
Dual 1.13 GHz Pentium Processor Single Engine

Unique Features
Dual 1.13 GHz Pentium Processor Dual Engine with Clustering / Failover

Common Features
Same functional characteristics as NAS 200 & 300 No Integrated Disk (for data) FC connection to remote FC storage FC connection to tape Rack Model Supports up to 22TB of Storage (11TB per Engine)

Gateway Connectivity Options

FAStT200 FAStT500 FAStT700

Server

IP Network
NAS Gateway

2109 2032 2042

Switches Directors

Enterprise SAN
Enterprise Storage Server

Fiber Channel
SLIC Router

Servers and Clients

Ethernet

Server

FC

SSA

iSCSI Overview
iSCSI is a new technology
Routing of SCSI protocols over the IP network

iSCSI is based on open standards. iSCSI is not a File System.

...it is a means to add JBOD or extend the reach of JBOD in the network, even across the wide area (WAN)

iSCSI is optimized for "OLTP"

On-Line Transaction Processing database access

iSCSI has several components

Devices that access storage are clients Devices that receive the storage request are targets Special drivers need to be installed in clients

IBM is the leader in iSCSI products

Two iSCSI appliances available 109GB ---> 3.52TB/appliance

Transporting Block I/O

NAS
Data Base Application

SAN
Data Base Application Block I/O Block I/O to FCP

iSCSI
Data Base Application Block I/O Block I/O to IP Initiator

Server

File API Open, R/W, Close

File I/O to IP

IP Network File Protocols (CIFS, NFS...)

FC Network SCSI Protocols

IP Network iSCSI Protocols

IP to File I/O

Storage

File I/O to Block I/O Pooled Storage

FCP to Block I/O

Target IP to Block I/O

Pooled Storage

Pooled Storage

Note: Block I/O is the SCSI Command Set used on all storage devices

Comparison of IP Storage Technologies

NAS
Redirected access to storage File I/O optimization Heterogeneous sharing of files Well-established form of storage Extensive OS support

iSCSI
Direct access to storage Block I/O optimization Individual access to data New form of storage Limited OS support today

iSCSI Technology ... Any-to-Any Connectivity

Application Hosts
Block IO Protocol

iSCSI Storage Appliance

Block IO Protocol

iSCSI Initiator Linux Software

Ethernet Connections

IP Network
iSCSI Protocol

109GB - 3.52TB

Ethernet Connection

Block IO Protocol iSCSI Initiator Windows Software

iSCSI Target Software

IBM's iSCSI Storage Solutions

IP Storage 200i
Key Points
Advantages of Pooled Storage Optimized for Database Access Familiar TCP/IP Technology - Uses existing skills Affordable Functionally Rich
Automatic Discovery via SLP Secure Remote Password Security RAS Enhancements
Model 110

IETF iSCSI Draft 0.7 Standard Currency

Model 210

SAN Solutions

Disk Storage Consolidation

Flexible Connectivity / Configuration Improve disk asset utilization Enhance manageability Non-disruptive, "just in time" storage capacity

S/390

.......................
Fibre Channel

UNIX/Intel Servers

Global Management

ESCON FICON

StorWatch Specialists Netview Extensions

SCSI

ESS
LAN

Backup and Restore

Protect data from system outage or failure

te igra M

TSM SERVER

Rec

all

CLIENT

DB

Archive and Retrieve

Move unused data to less-expensive media

ive Arch

CLIENT

TSM SERVER

ieve Retr

DB

Efficient Use of Storage

Hierarchical Storage Management (HSM) allows you to move less-frequently accessed data to less-expensive media and to delete data not accessed over a set period of time.
KUP BAC
CLIENT

TSM SERVER Tivoli Storage Manager SERVER

TO RES

RE

Migration Higher Cost

DB

Faster Access

Lower Cost Slower Access

Disaster Tolerance
Have a copy of the data at an off-site location for restoration in event of a disaster

Local Area Network

Local Area Network

WAN
Storage Area Network Storage Area Network

Tape Pooling
More efficient tape utilization Flexible Connectivity / Configuration Tape Library Manager required if multiple servers accessing
UNIX/Intel Servers
Storage Management Clients

Fibre Channel

2109 2108-G07
SCSI

Storage Management Library Management

LAN

3575

Centralized Data Management

Reduce IT staff requirements through centralized management of SAN storage
Enterprise Administration
Manufacturing
Single Server Single Server Single Server

* *
Single Server

* *

* *
Single Server

Server
Single Server

* *
Single Server

* *

Single Server

* *

* *

Development
Network Server Single Server

Marketing/Sales
Network Server Network Server

*Clients* * *
Network Server

*Clients* * *
Single Server Network Server Network Server

*Clients* * *
Network Server

*Clients* * *

Network Server

*Clients* * *

* *

Clients

* *

*Clients* * *

*Clients* * *

NAS Solutions

Three Primary NAS Solutions

Server/Storage Consolidation
Provides: Centralized management of storage Heterogeneous file sharing Optimized utilization of storage Eliminates problems of direct-attached storage

Server/Storage Consolidation
DataCenter IP Infrastructure

NAS

Backup
Protects customer data Disk to tape backup solutions from Tivoli, Veritas and Legato Disk to disk backup from snapshot software LAN-free backup for customers with SANs

Backup
Tape

NAS

Disaster Recovery
Off-site copying of mission-critical data Business continuance Mirror data between machines

Disaster Recovery

NAS
New York

NAS
Chicago

SAN/NAS Solutions

LAN Free Backup

Offload backup traffic from LAN thus improving network performance
Existing IP Network for Client/Server Communications

Heterogeneous Clients (Workstations or Servers) Storage Manager Storage Manager Storage Manager Storage Manager client client client client Control

Fibre Channel Network

SAN Fabric
Storage Manager server

Backup, Archive, HSM

Shared Storage Devices

Server-Free Backup

Offload backup traffic from application servers Utilize SAN switches to transfer data to tape
Workstations

LAN
NT Server

AIX Server

Sun Server

NAS Gateway

SAN
Data Flow

Data Flow from Disk Subsystem Directly to Management Server WITHOUT utilizing Management Clients on each Application Server

Management Server

Tape Library

Data Sharing (SANergy)

Allows heterogeneous file sharing for NT and UNIX servers Utilizes SAN for fast access to data Useful when file sizes are greater than 50 KB

Workstations

LAN

NT Server

AIX Server

Sun Server

NAS Gateway

SAN
Meta Data Controller

True File Sharing with Integrity

Tivoli File Sharing

How SANergy Works

1. The AIX server wants to access a file in enterprise storage. The server sends a request across the IP network to the MDC Controller requesting access to the file. 2. The MDC Controller looks at two things: a. Is the server eligible to access the file? b. Is another server currently accessing the file? If the answers to the questions are yes and no, respectively, the MDC Controller will send the pointers to the data location to the AIX server.
NT Linux http

(2)
(1)
AIX Sun Unix

IP
NAS

(3)

FC SAN

3. The AIX server will access the file across the SAN, taking advantage of the high-speed fibre channel links.

M - MDC Controller C - SANergy client installed

How SANergy Works

4. While the AIX server is accessing the file, the Sun server wants to access that same file. It sends a request to the MDC Controller. 5. The MDC Controller will check: a. Is the Sun server eligible to access the file? b. Is another server currently accessing the file? In this case, the answers to the questions are both yes. Since another server is already accessing the file, the Sun server will be denied access to the file.
Linux http

NT

(5)
(4)
AIX Sun Unix

IP
NAS

FC SAN

M - MDC Controller C - SANergy client installed

iSCSI Solutions

iSCSI Solutions
Server/Storage Consolidation
Client-controlled storage Can support multiple clients per device Each with its own storage

Server/Storage Consolidation
DataCenter IP Infrastructure

iSCSI

Coming Soon... Data Copy

Flashcopy-type function Point in time copy of the data residing in a client's volume

Data Copy

iSCSI

Disaster Recovery
PPRC-type function Off-site copying of mission-critical data Business continuance Mirror data between machines

Disaster Recovery

iSCSI

iSCSI

Positioning
Use iSCSI when...
Customer's application generates changes at the block level Database, Lotus Notes, Microsoft Exchange, Banking Customer only has IP networking skills Customer is an "early adopter"

Use NAS when...

Customer desires low-cost storage solution Customer only has IP networking skills Customer's application is file-based Presentation Graphics, Word Processing, web sites (Amazon.com)

Use SAN when...

Customer wants a highly scalable storage solution Customer wants to maximize performance Mission-critical servers attached directly to SAN Non-critical servers access the SAN through the gateway

Credits, Acknowledgments & Disclaimers

Copyright International Business Machines Corporation 2002 IBM Corporation PO Box 12195 Research Triangle Park NC 27709 U.S.A. 02-02 All Rights Reserved References in this presentation to IBM products or services do not imply that IBM intends to make them available in all countries in which IBM operates. All information being released represents IBM corporation's current intent, goals and/or objectives, and is subject to change or withdrawal without notice. The performance data contained herein was obtained in a controlled environment based on the use of specific data. Actual results that may be obtained in other operating environments may vary significantly. These values do not constitute a guarantee of performance. IBM, the IBM logo, and TotalStorage are trademarks of International Business Machines Corporation in the United States, other countries or both. Tivoli is a trademark of Tivoli Systems, Inc. in the United States or other countries or both. Other company, product and service names may be trademarks or service marks of other companies.