Advanced MDS SAN Management

BRKSAN-2891

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

2

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

1

Session Objectives
Cisco Fabric Manager Overview Fabric Manager Deployment Best Practices Review Install Options SAN Monitoring Details Overview of Performance Monitoring and Reporting Features

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

3

Fabric Manager Overview

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

4

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

2

Fabric Manager Evolution
Releases Representing Major FM Architecture Changes

Client and Server in a Single Application

FM Split into Client and Server

Performance Collection and Web Client

Oracle 10g Option

JBOSS, FM Standalone, HSQLDB Replaced with PostgreSQL DB

Performance Enhancements

FM 1.0 FM 1.3 December 2002 December 2003

FM 2.0 October 2004

FM 3.1 January 2007

FM 3.2 October 2007

FM 3.3 March 2008

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

5

Cisco Fabric Manager Components
Fabric Manager server
Centralized services

Fabric Manager client
Fabric topology view Fabric management
Cisco Fabric Manager Server

Device Manager client
Device specific view Device management

Web client
Historical performance reports Operational views
Cisco Fabric Manager Client (FM/DM/Web Client)

Cisco Fabric Manager Standalone
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

6

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

3

Fabric Manager Server
Centralized management services Continuous health monitoring Multiple fabric management Performance monitoring Prediction analysis Roaming user profiles Published database schema

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

7

Fabric Manager Client
Real-time fabric topology views Fabricwide configuration wizards Fibre Channel troubleshooting tools Health and configuration analysis tools

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

8

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

4

Device Manager
Standalone application communicates directly with the device over SNMP Graphical representation of the switch chassis Configure devicespecific functionality Real-time statistics

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

9

Fabric Manager Server License Package
FM Server License Provides Additional Functionality with No Further Software Installation Required
Multiple fabric management Historical performance monitoring Thresholds based on performance monitoring Performance prediction Summary and drill-down reports Continuous health and event monitoring Roaming user profiles Cisco Fabric Analyzer integration

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

10

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

5

Web Client
Requires FMS license to be fully operational Operations view Historic performance report views Thresholds based on collected performance data Prediction capabilities based on collected performance data Inventory Syslog collector Custom reports Schedule report generation
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

11

Fabric Manager Standalone: 3.2 and Later
Fabric Manager server and client run in a single process Switch events collected only while the application is running FMS license is not required, but if present, multiple fabrics can be opened in the FM client No historic performance statistics collection No Web client Optimizes host resources
Cisco Fabric Manager FM/DM Clients

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

12

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

6

FMS Architecture 3.2 and Above
Red Hat JBoss—provides clustering, load balancing, distributed deployment features, and future release of FMS plans on taking advantage of these capabilities Service Oriented Architecture (SOA)
Application built as services (J2EE) Loosely coupled software components

PostgreSQL/Oracle 10g (RDBMS)
Web Server Role-Based Access Control and Licensing Componentization of FM Server J2EE Services Discovery Event Management SME Inventory Performance Collection ACL Interfaces Users and Roles Security
RDBMS

...

Transport : Telnet, SSH, SNMP
BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

13

FM Deployment Best Practices

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

14

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

7

Fabric Manager Server (FMS) Deployment
Dedicated server
Windows 2000, Windows 2003, Windows XP, Solaris 8/10, Red Hat Enterprise Linux AS Release 4 (2.6 Kernel), VMware Server 1.0 (Windows)
Data Center/ Private Network

2 GHz or above processor with 2 GB RAM 10 GB storage Dual NIC—private/public network Management network connectivity—dedicated VLAN preferred SNMP proxy FMS server to be deployed in proximity to the MDS switches
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

Cisco Fabric Manager Server AAA Server Corporate/ Public Network

Cisco Fabric Manager Client (FM/DM/Web Client)

15

FMS Sizing Parameters
Monitoring
Discovery Configuration Events

Performance collection
Flows Errors and discards

Number of Ports Managed by an FM Sever Instance
FM1.0–FM3.1 Monitoring Only Monitoring + Performance Collection
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved.

FM3.2 PostgreSQL/ Oracle 10g 10,000 5000

FM3.3 PostgreSQL/ Oracle 10g 10,000 10,000
16

Under 1000 Under 1000
Cisco Public

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

8

FMS Deployment Scenarios
FMS Servers Recommended Based on Number of Ports Managed
Ports per Fabric Up to 5000 Ports 5001–10,000 Ports Fabric A Single FMS Server FMS Server A FMS Server B Fabric B

A fabric to be managed by a single dedicated server For fabrics spanning multiple data centers, a single instance of FMS server at one of the locations, and good network connectivity to minimize SNMP packet loss Currently FM does not support performance collection and monitoring to be split across servers
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

17

AAA
Staring with SAN-OS 3.1(1) Fabric Manager has a user database independent of the MDS users FM users can be “network-admin” or “network-operator” FM User ID is required to log into FM Client and Web Client starting with 3.1(1) Device Manager login uses switch credentials FM users can be authenticated by a AAA server, similar to how MDS switch users are authenticated by AAA MDS can be used as a proxy
BRKSAN-2891 14573_05_2008_c1

Data Center/ Private Network

Cisco Fabric Manager Server AAA Server Corporate/ Public Network

Cisco Fabric Manager Client (FM/DM/Web Client)

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

18

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

9

Fabric Manager—Communications
DM communicates directly with MDS using SNMP FM/DM perform all configuration changes in real time talking to the switch directly using SNMP FM Client talks to FM Server using Java RMI Web Client is primarily a read only tool and talks to the FM server over HTTP
BRKSAN-2891 14573_05_2008_c1

Device Manager

FM Client <-> MDS : SNMP

FM Client <-> MDS : SNMP

FM Client
FM Clie n t< ->

FM

Se

SNMP

rve

r:

J av aR MI

Web Client

Web Client <-> FM Server : HTTP

Cisco Fabric Manager Server

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

19

SNMP Proxy
In firewall situations, enable “SNMP Proxy” so that all SNMP calls to the MDS from Device Manager and Fabric Manager are tunneled via the FM Server When SNMP Proxy is enabled, software upgrade option on FM Clients working from behind the firewall will not work, as that functionality depends on FM client establishing a direct connection with the switch, and CLI output parsing
BRKSAN-2891 14573_05_2008_c1

Firewall

Device Manager

SN

MP C

alls

to M DS

FM Client SNMP Calls to MDS FM Client <-> FM Server : Java RMI

FM Client

Cisco Fabric Manager Server Also Acts as SNMP Proxy

SNMP

DM

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

20

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

10

SNMP Proxy
Firewalls require SNMP proxy
Configure “SNMP proxy” so that SNMP calls to the MDS from Device Manager and Fabric Manager are tunneled via the FM Server Configure the MDS management port to receive “SNMP” traffic only from the designated FM server— prevents unauthorized instances of Fabric Manger servers

Device Manager

SN

MP C

alls

to M DS

FM Client SNMP Calls to MDS FM Client <-> FM Server : Java RMI

FM Client

Cisco Fabric Manager Server with SNMP Proxy

BRKSAN-2891 14573_05_2008_c1

SNMP

DM

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

21

MDS/Fabric Manager—Protocols
Communication Type FM Server SSH Telnet HTTP TFTP Syslog FM Server SNMP Trap SNMP JAVA RMI FM Client SNMP JAVA RMI DM Client SNMP Trap SNMP
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

Port(s) Used 22 (TCP) 23 (TCP) 80 (TCP) 69 (UDP) 514 (UDP) 2162 (UDP) UDP (Random)/9198 TCP—SNMP Proxy 9099, 9100 (TCP) UDP (Random)/9001 TCP—SNMP Proxy Available Port 19199–19399 (TCP) Available Port 1163–1170 (UDP) UDP (Random)/9198 TCP—SNMP Proxy
22

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

11

FMS Behind a Firewall—3.1 and Earlier
Protocols and ports used for FM client and FM server to communicate
Firewall
FM Client 1
Open RMI
Use 9100 Close 9099 Open 9100

FM Server
9099 Telnet SSH TFTP Syslog HTTP 9198 SNMP SNMP TRAPS

MDS
23 22 69 514 80 161

9100 9101 9198 2162

Open 9101for Events Open SNMP Proxy

FM Client 2

Open RMI
Use 9102 Close 9099

9099

Open 9102 Open 9103for Events Open SNMP Proxy

9102 9103 9198

9198
23

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

FMS Behind a Firewall—3.2 and Above
FM Client initiates communication with FM Server on port 9099 for Java Naming Directory and Interface (JNDI) lookup FM Server directs client to 1098, JBoss directs the request to the appropriate service Ports 4444, 4445, 8009, 8092, and 8093 are used by JBoss to monitor connectivity and for JMS to send messages to the FM Client SNMP proxy uses port 9198 Web Service Port 8083 used for Web Services API, XML over HTTP HTTP port 80

Firewall
FM Server Bind Port Java RMI Port RMI Object Port Server Bind Port AJP Connector Server Bind Port Server Bind Port SNMP Proxy Web Service Port HTTP Connector

FM Server
9099 1098 4444 4445 8009 8092 8093 9198 8083 80

MDS
Telnet SSH TFTP Syslog HTTP SNMP SNMP TRAPS 23 22 69 514 80 161

2162

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

24

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

12

Aliases
Device Alias
Unique name across the entire physical fabric User-friendly name for a port WWN that can be used in all configuration commands like FCNS, Zone, FC Ping, FC Trace Route, and IVR

FC Alias/Zone Alias
Limited to a VSAN Part of the zoning configuration and limited to zone configuration

Device Aliases Are Distributed to All Switches in a Fabric Using the Coordinated Distribution Mechanism Using the Cisco Fabric Services (CFS) Recommend Using Device Aliases
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

25

Enclosure
Enclosure Names Auto Generated by FMS

Enclosures is a Fabric Manager functionality and is not supported by SAN-OS Devices with multiple HBAs may be represented as individual devices by Fabric Manager By default, enclosures names are generated by the FM Server based on the alias or WWN OUI Enclosure name provides the ability to group end devices in a single enclosure to have them represented by a single icon on the Fabric Manager topology view An enclosure name can be manually created based on the alias name, by selecting one or more rows and using the “Alias Enclosure” option
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

26

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

13

Enclosure Example—Step 1
Assign Device Aliases

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

27

Enclosure Example—Step 2
Select Alias Enclosure button on top of the End Devices table— an enclosure is generated based on the Alias name using Java Regular Expressions For more details about Java Regular Expressions, please refer to: http://java.sun.com/docs/books/tutorial/essential/regex/

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

28

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

14

Enclosure Example—Step 3
Enclosure name generated based on Alias

All Disks for Storage Represented as Single Entity in Topology Map

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

29

FM Server Trap Registration
MDS can forward events up to 10 destinations At the time of fabric discovery, FM Server registers with each MDS in the fabric as a recipient of SNMP events Device Manager can also be a recipient of SNMP events SNMP events can be forwarded to a NOC, and destinations can be configured via GUI or CLI
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

Device Manager

FM Client

Cisco Fabric Manager Server

30

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

15

FM Client—No Traps
Status Message “No Traps” Would Appear Under Two Conditions:
FM Server failed to register with the switch as the list of 10 destinations is full FM Server failed to query its IP address, this can be addressed by providing an IP address in the Web client under Admin/Configure/ Preferences/ trap.registeraddress, this a rare occurrence
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

31

Clean Up Trap List

Identify Valid Destinations and Delete Unwanted Entries from GUI/CLI

# show snmp host (config)# no snmp host 20.1.1.2 traps version v1

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

32

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

16

Manage Continuously

FM Server loads a fabric information the first time a client opens a fabric When the last client closes, FM Server closes the fabric, and any events received from the switches will be ignored For FM Server to not close the fabric information when the last client disconnects from the server, mark “Manage Continuously” next to the fabric in the Server Admin dialog Prior to release 3.2 this was called “Monitor Continuously” 3.2 and above release provides three options
Unmanage: Stop managing the fabric Manage: Keep fabric open as long as client is connected Manage Continuously: Always keep the fabric information open
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

33

FM Backup—3.1 and Before
Regular backup of FM data highly recommended List of files to backup
C:\Program Files\Cisco Systems\MDS 9000\*.properties C:\Program Files\Cisco Systems\MDS 9000\*.log C:\Program Files\Cisco Systems\MDS 9000\bin\* C:\Program Files\Cisco Systems\MDS 9000\conf\* C:\Program Files\Cisco Systems\MDS 9000\db\* C:\Program Files\Cisco Systems\MDS 9000\log\* C:\Program Files\Cisco Systems\MDS 9000\pm\* C:\Program Files\Cisco Systems\MDS 9000\reports\*

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

34

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

17

PostgreSQL DB—FMS Backup
By default, FM 3.2 and above uses PostgreSQL DB FM relies on vendor tools to backup and restore FMS database
Contents of pgbackup.bat file, under C:\Program Files\Cisco Systems\MDS 9000\bin set PGDIR=C:\Program Files\PostgreSQL\8.2. set DBNAME=dcmdb set DBUSERNAME=admin Usage Example pgbackup.bat ciscoFMSData-apr-10-2008
Provide Backup File Name to the Script PostgreSQL DB Location Do Not Change This By Default, Set to Admin Update if Needed

"%PGDIR%\bin\pg_dump.exe" -c %DBNAME% -U %DBUSERNAME% > %1%

In addition to completely restore FMS, the following files need to be backed up
C:\Program Files\Cisco Systems\MDS 9000\*.log C:\Program Files\Cisco Systems\MDS 9000\bin\* C:\Program Files\Cisco Systems\MDS 9000\conf\* C:\Program Files\Cisco Systems\MDS 9000\db\* C:\Program Files\Cisco Systems\MDS 9000\logs\* C:\Program Files\Cisco Systems\MDS 9000\pm\db\*
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

35

PostgreSQL DB—Restore
Prior to restoring FMS database, please stop the FM server
Contents of pgrestore.bat file under C:\Program Files\Cisco Systems\MDS 9000\bin set PGDIR=C:\Program Files\PostgreSQL\8.2 set DBNAME=dcmdb set DBUSERNAME=admin echo "You will delete all existing data and restore db with file %1%" echo "Please stop FMServer before db restore" set /p ans=Are you sure you want to continue? [Y/N] IF /i %ans% EQU Y ("%PGDIR%\bin\psql.exe" -U %DBUSERNAME% %DBNAME% < %1%) Usage Example pgrestore.bat ciscoFMSData-apr-10-2008
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

36

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

18

Run CLI Commands from FM
Execute Cisco SAN-OS CLI commands on multiple switches Screen output is captured from each switch and copied over to the FM Client desktop “Run CLI Commands” dialog can be accessed from the Fabric Manager Tools menu

Set Location to Save Switch Output
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

37

Installation

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

38

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

19

FM Server Install (1 of 3)
FMS (Licensed)
License is not required to have a standalone FM Server instance Cisco Fabric Manager Server License enables additional functionality Fabric Manager Standalone Customers with Cisco FMS License can open multiple fabrics

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

39

FM Server Install (2 of 3)
Device Alias—unique name across all VSANS in a fabric FC Alias—Unique name across a VSAN

1 2 1

1 Earlier releases called for “Use Device Aliases in place of FC Aliases”, with default check
mark, new install rewords the same option to “Use FC Aliases as Fabric default”, and the option is unchecked by default. Recommendation: Go with default option (Devices Aliases recommended)

2 FM 3.1 install, default admin password was set to password. With new install, no default
admin password is defined, administrator configures password as part of install.
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

40

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

20

FM Server Install (3 of 3)
Oracle 10g option offered starting with FM 3.1 Oracle 10g is not packaged with FM, and has to be installed prior to installing the FM Server Starting with 3.2(1) release, HSQLDB has been replaced with PostgreSQL as default option No significant performance difference between Oracle 10g and PostgreSQL

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

41

FM Client Install
FM Client can be installed from the Web client or using the URL
http://server-ip-address/download.do

Click on Download to Install FM Client

By default, only FMS users with “network-admin” credentials are allowed to download the FM Client To allow FMS users with “networkoperator” role to download the client, enable the property
web.allowDownload4All=true

in server.properties file located in directory C:\Program Files\Cisco Systems\MDS 9000\conf

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

42

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

21

User Login and Fabric Discovery
Starting with FM 3.1
Step 1: FM User login authentication is a separate step from fabric discovery Step 2 If FM server has open fabrics, the open fabric window is presented for user to select a fabric; if no open fabrics, then new fabric discovery window is presented 1 2

3

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

43

FMS—Multifabric Management
Ability to manage multiple fabrics simultaneously
Fabrics need to be discovered by the same FM Server instance Each Fabric topology displayed in its own tab, as shown below

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

44

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

22

SAN Monitoring

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

45

SAN Monitoring
SNMP events Syslog messages Thresholds Callhome Web client health analysis reports
Multipath Host to storage connectivity Storage to host connectivity Zone discrepancy Configuration analysis Switch health

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

46

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

23

SNMP Events
MDS has over 125+ MIBs that generate a large number of events SNMP vents are grouped by functionality that can be enabled or disabled
Trap Group Entity FRU FCC FC Domain Name Server Fabric Configuration Services (FCS) FDMI FSPF License RSCN SNMP Authentication VRRP Zone
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

Default No No No No No No No Yes No No Yes No

Recommended Yes No Yes Yes No No Yes Yes No No Yes Yes
47

Forwarding Events to NOC
MDS has over 125+ MIBs that could potentially generate a large number of events NOC operates are trained to flag hardware failures and critical failures
Working with customers Cisco has identified a subset of events that are of interest to a NOC Cisco recommends customers to implement the identified subset as a phase one approach The document Cisco MDS Event Monitoring v1.pdf details the identified events Scripts have been developed by Cisco for the most common used NOC applications—HP OpenView and IBM NetView

Syslog messages
Every release of MDS SAN-OS publishes the Syslog messages supported by that release, every effort is made to keep the Syslog messages backward compatible Syslog messages can be forwarded from MDS to any application that can parse the messages and populate a monitoring application
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

48

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

24

Syslog Messages
2200+ Syslog messages Syslog messages are published with each release of SAN-OS Syslog messages are classified into eight security levels (1—emergency, 8—debug); syslog messages from MDS can be forwarded to FM Server Syslog messages can be viewed via Web Client Non MDS Syslog messages can be forwarded to FM Server, by setting “syslog.promiscuous = true” property via the Web Client Default max rows in FM server database is set to 10K; when limit is reached, logs are copied to a log file on the server

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

49

DM—Syslog (1 of 2)
Syslog messages can be forwarded to a maximum of three syslog servers Security level (1–8) can configured per functionality/module

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

50

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

25

DM—Syslog (2 of 2)
Syslog messages can be sent to console by selecting “ConsoleEnable” Message severity level to be forwarded can be configured too

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

51

RMON—Threshold Monitoring
Device CPU, memory FC services threshold per VSAN Interfaces thresholds Default is 100, need to configured to 512 32-bit alarms—512 per box 64-bit alarms—512 per box

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

52

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

26

DM—Configured Threshold Monitors
Recommend using 64-bit counters over 32-bit counters for monitoring link counters

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

53

MDS Callhome
MDS Callhome is independent of OSM Callhome Fixed set of predefined alerts and trigger events on the switch Multiple message format options—short text, plain text, XML Up to 50 e-mail destination addresses for each destination profile Multiple message categories including system, environment, switching module hardware, supervisor module, hardware, inventory, syslog, RMON, and test

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

54

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

27

Health Analysis—Multipath
Find devices with no redundancy or inactive paths

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

55

Health Analysis—Connectivity
Storage to host Host to storage

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

56

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

28

Health Analysis—Zone Discrepancy
Not in VSAN Not in fabric Single member zone Full zone distribution off Default permit on Only initiators in zone

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

57

Health Analysis—Switch Health
In-depth switch health analysis verifies the status of all critical switches, modules, ports, and Fibre Channel services; over 40 conditions are checked

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

58

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

29

Health Analysis—Configuration Analysis
Compares the configurations of the switch to a policy file Define what functions to check and what type of checks to perform Looks for mismatched values, and missing or extra values; over 200 checks performed

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

59

Performance Collection

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

60

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

30

DM—Summary Tab
Real-time performance metrics Charting option Quick switch health Filter by VSAN

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

61

DM—Logging Real-Time Performance Data
Real-time stats greatly help with debugging Log file saved under “logs” directory as:
“switch_name_ summarylog.txt”

Logging happens only while the summary tab window is open

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

62

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

31

FM—Real Time ISL Stats

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

63

Historic Performance—Flows (1 of 4)
Flows provide important information about SAN traffic patterns (top talkers) FM Performance Collection collects flow statistics based on source destination combination Source and destination can be on different switches First generation line cards support about 1000 flows per module, second generation line cards support 2000 flows per module As flow collection is based on source and destination FCIDs, recommend persistent FCIDs enabled

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

64

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

32

Historic Performance—Flows (2 of 4)
Flow configuration is based on active zone database Flows are configured in hardware Flow statistics frame count and bytes are incremented in real time Flows cannot be reset—need to delete and add again
CLI Output of Flows Configured on an MDS

Source FCID

Destination FCID

VSAN

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

65

Historic Performance—Flows (3 of 4)
Flow Performance Collection is a two-step process, and need to be configured from the FM Client; flow configuration setup has to be repeated for each VSAN The option “Type” refers to the collection process; recommend that flows are collected both ways; FMS server is smart to consolidate the data at the time of reporting Checking the “Clear old flows on modified switches” option purges all old data related to the FCID; please select this option with careful consideration; once selected, no way to restore lost the data The option “Create flows on all cards,” gives flexibility for physical port to be moved to another module on the same switch; this option available on SAN-OS 3.1 and later
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

66

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

33

Historic Performance—Flows (4 of 4)
Second step of the Flow wizard lists all flows for the VSAN Manually remove flows of not interest Finish configures the selected flows on the corresponding MDS switches and FM Server FM Server need to be restarted for it to pick the new flow configurations
BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

67

Performance Data Collection
FM Server collects flow information once every 5 minutes; this interval cannot be changed Performance data collected every 5 minutes is saved in flat files with an “rrd” extension under the… pm\db directory Every hour a background process consolidates the data to the database To limit the size of database, performance data collected is retained for a finite period time; the length of data retention can be configured to customers needs; longer retention periods of data will require larger disk space; default configurations are:
5 minute interval samples for 48 hours 30 minutes samples for 14 days 120 minute samples for 2 months 1-day samples for 300 days

Using default retention periods, each flow takes 115 KB of disk space By default ISL interfaces statistics are also collected once every 5 minutes; the time interval can be modified to as low as once every 30 seconds
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

68

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

34

Database Sizing
To limit the size of database, performance data collected is retained for a finite period time FM Server collects flow information once every 5 minutes; this interval cannot be changed ISL statistics can be configured to collect in 30 second intervals; default, once every 5 minutes Configure data retention periods based on need; longer retention periods of data will require larger disk space; default configurations are:
5 minute interval samples for 48 hours 30 minutes samples for 14 days 120 minute samples for 2 months 1-day samples for 300 days

Performance data collected every 5 minutes is saved in flat files with an “rrd” extension under the…pm\db directory Every hour a background process consolidates the data to the database Using default retention periods, each flow takes 115 KB of disk space
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

69

FMS Performance Monitoring—Summary
SAN summary Link utilization summary Drill down

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

70

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

35

Performance Monitoring—Flows
Top talkers Clicking on the flow generates chart

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

71

Performance Prediction
Based on past data, and acceptable threshold utilization percentage, predict future traffic growths

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

72

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

36

FMS—Threshold
Configure threshold monitoring based on absolute values or based on past performance (week/month/year)

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

73

Custom Reporting
Customized report configuration On demand/scheduled report generation

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

74

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

37

FMS Server—Fabric Monitoring
Events, syslog messages being forwarded to FM server? Performance collection problems?

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

75

FMS—MIB OID Monitoring
FM server provides an ability to poll on any MIB OID once every 5 minutes In Web Client, under Admin/Configure/Others, select Add, and provide the OID to be polled for Can be configured for all switches in a fabric, or select switches

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

76

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

38

FM Server Properties
File located “MDS 9000”; default windows location
C:\Program Files\Cisco Systems\MDS 9000\server.properties

Changes require Fabric Manger Server restart Make backup copy prior to making any changes Changes can be made from Web Client

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

77

Key Takeaways
Cisco Fabric Manager deployment Switch and fabric health analysis tools SAN monitoring Performance collection FMS reporting

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

78

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

39

Q and A

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

79

Recommended Reading
Continue your Cisco Live learning experience with further reading from Cisco Press Check the Recommended Reading flyer for suggested books

Available Onsite at the Cisco Company Store
BRKSAN-2891 14573_05_2008_c1 © 2008 Cisco Systems, Inc. All rights reserved. Cisco Public

80

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

40

Complete Your Online Session Evaluation
Give us your feedback and you could win fabulous prizes. Winners announced daily. Receive 20 Passport points for each session evaluation you complete. Complete your session evaluation online now (open a browser through our wireless network to access our portal) or visit one of the Internet stations throughout the Convention Center.
Don’t forget to activate your Cisco Live virtual account for access to all session material on-demand and return for our live virtual event in October 2008. Go to the Collaboration Zone in World of Solutions or visit www.cisco-live.com.

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

81

BRKSAN-2891 14573_05_2008_c1

© 2008 Cisco Systems, Inc. All rights reserved.

Cisco Public

82

© 2006, Cisco Systems, Inc. All rights reserved. Presentation_ID.scr

41

Sign up to vote on this title
UsefulNot useful