Evaluating the Performance of VM/SP Systems with SAS
Peter L. Jobusch, SAS Institute Inc.
This report describes a system of SAS programs for first level analysis of CP Monitor data collected by the VM/SP operating system. This self-contained system calculates a complete range of standard performance variables and archives them for further SAS based capacity planning analysis. Before discussing specific examples of how SAS can be used to evaluate the performance of a VM/SP computer system, let us see what data are available from which we may extract performance information. CP monitor data VM/SP Release 2 trace table recording CP accounting records VM Realtime Monitor (SMART, 5796-PNA) CPWATCH, etc. on the Waterloo tape A description of CP monitor data is in Appendix C "VM/sP Monitor Tape Format and Content" of the IBM V M I S P ~ System Programmer's Guide. Appendix C is particularly useful because it describes the data fields and gives a cross reference between the variable name in the DSECT and the name of the CP variable stored in the records. In the IBM VMISP: Dota Areas and Control Block Logic the DSECTS describing the records are listed. CP Monitor data collection can be controlled in two ways. The SYSMON macro in the DMKSYS file establishes the default parameters for automatic monitoring, and the CP MONITOR command can ,be used by a privileged user to dynamically alter the classes of data being collected, and to manually control the data collection process. The SYSMON macro is documented in the IBM VM/SP: Planning and System Generation Guide while th.e IBM VM/SP: System Programmer's Guide and the IBM VM/SP: Operator's Guide document Use of the MONITOR command. Copyright 1982 by SAS Institute Inc. All rights reserved. Printed in the United States of America. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, or otherwise, without the prior written permission of the publisher, SAS Institute Inc. SAS is the registered trademark of SAS Institute Inc., Cary, North Carolina, USA. SAS/GRAPHTM is a trademark of SAS Institute Inc. 27 The CP Trace Table Recording Facility is a new feature of VM/SP Release 2. The facility, using the CPTRAP command, creates a spool file of selected entries from the CP trace table, and records written throu9h special interfaces to this facility in both CP and from virtual machines. While it is designed primarily as a diagnostic tool to assist Field Engineering and system programmers in problem determination, the contents of the trace table could be used for detailed analysis of specific performance problems as well. The trace table recording facility J the CPTRAP command which controls the data collection, and the CMS TRAPRED command to display the data for problem determination purposes are documented in the IBM VM/SP: System Programmer's Guide and the IBM VM/SP: Operator's Guide. At the opposite end of the spectrum from the tremendous detail available from trace table recording are the global views of the system recorded in the CP accounting data. While the accounting records do not contain enough detail for direct use in performance tuning, they do serve as a source of information on average system loads useful for projecting future growth. The primary source of information about CP accounting files is the IBM VM/SP: System Programmer's Guide. A fourth source of performance data are the records produced by the VM Realtime Monitor (an IUP available from IBM, more popularly known as SMART). While SMART's emphasis is on realtime performance problem diagnosis, it can produce automatic hardcopy output of summary displays, and can spool a display to a virtual reader for offline problem analysis. Because SMART runs in a virtual machine and uses the DIAGNOSE command to examine real storage it can collect data not available in the CP monitor records. Finally J do not overlook software on the SHARE tape from the University of Waterloo. In situations where other data sou rces are inadequate there may be a program on the tape which could be used as distributed, or serve as a model for locally developed software to meet special needs. A good example of software available from this source is the CPWATCH real time monitor. While all of the above can provide valuable data to our performance evaluation activity, we will concentrate on the reduction of CP monitor data. CP monitor data contains the information needed for normal analysis, and can be collected easily and with little overhead. The raw data are, however, useless without a good deal of processing because of the volume of data collected and the need for combining data from several record types across a time interval in order to produce meaningful information. There are a number of important factors favoring the use of SAS as the tool to choose for YM/SP performance a n a ~ y s i s . First, SAS is a very high level language with both the power to process the relatively complicated CP Monitor data formats and a large library of procedures for statistical analysis, graphic presentation of results, and time-series forecasting. Second, SAS has become the standard language for performance analysis of MVS based systems, facilitating the pooling of information in mixed-SCP environments. And finally, beginning with release 79.6 of CMS SAS, a library of VM/SP performance analysis software is supplied with the system. The availability of first level performance measu rement software in SAS gives the VM user community a base from which to build flexible tools for detailed performance evaluation and capacity planning systems tuned to local needs. The high level, self-documenting, nature of the SAS language offers not only improved productivity for the individual performance analyst, but also facilitates the interchange of programs among users. Appendix A contains examples of the reports available from the programs distributed as part of CMS SAS. These are briefly described below: The first report is a simple summary page, produced during the first phase of data reduction by the MONDATA SAS program. It displays various fields from the CP Monitor header records and record counts for the different types of records found in the input file. The second report is produced by PROC MEANS a'nd shows a number of descriptive statistics for each variable in the SAS data set CURR.MONDATA1. These same variables are also stored in CURR.MONAVGEO, averaged on a 10 minute interval throughout the sampling period. The MONTREND data library (MONTREND.MEANS, MONTREND.MAXIMA, and MONTREND.MINIMA) contains the daily means. maxima, and minima for this same set of variables. 1. SAS uses the notation ODname.Membername to refer to specific SAS data sets, I n the OS version of SAS, the DOname refers to the DO statement defining the SAS data library, a di rectly accessed OS data set that may contain severai logical SAS data sets, or members. In eMS SAS, DDname refer:; to the CMS filetype of the files in a SAS data library, and the Membername is the CMS filename. For example, SAS would refer to the eMS file MARY SMITH as SMITH.MARY. 28 The next report summarizes resource utilization by userid. The information shown in the report is saved in the SAS file CURR,MONUSER. PROC SORT can be used in conjunction with PROC PRINT to produce this report sorted by any variable. The report of 1/0 activity in the system is produced by a SAS DATA step, MONIO SAS. This information is saved in the CURR.MONIO data set. Next is an example of the type of cross-tabulation which can be generated with two SAS statements. This report shows a breakdown of privileged instruction use for each userid active during the collection of class 5 CP Monitor records. The plots which follow illustrate the type of output one can produce on either line printers or (with SAS/GRAPHUI!) on any of a variety of presentation quality graphics devices. The CP Monitor analysis software included with CMS SAS is not intended to be a total performance analysis and capacity planning package. The SAS prog rams on the distribution tape are a combination of a complete system for first level analysis and examples of more detailed analysis programs. The strength of this software is its providing ready access to the full range of standard performance data from SAS which allows the performance analyst to develop tools to fit local needs, merging data from a variety of sources to create an integrated system. Because of space limitations this paper is a greatly reduced version of the material distributed at SUGI. To receive a copy of all 43 pages of the handout materials contact the Technical Support division of SAS Institute.
g \/I II) e
" o , " "- .
! o)C'O ., Q. E
<n
,
, , ,
!
! , ;:; ,
i!i h , g
, . " Hi f ,
f , , .
, ;
:: r ;
g ; , ! , , ! g i i g
, g
3
Ii n ; . .... !i
:;::::?;
;;::0
i!: r ; ,
- - - . . .
!;
filii
i ...... 1:S OJ .. _ _ .... I g i is , ,
ii ",
,
. :5",
j
go:_
"'''''',''''' a> N 'lM/370 MO,.ITOfI; ('I"TA COLLECTED F<m 4341-02 SERIAL 999999 FROM 10/11/82 09:00:00 THRU 11:00:00 OBS USEAtO TOTAL '" . " WKING MAX P'" PAG' PGOE'I MAX NON- SPOOL S
or "" CPU RATIO sn WK!Nr. RfAIlS WA I TFS SlOTS PGIlFIi SPOOL lOS ACT CPU STOR PAGE I/O .. "'" AIiAll '" SLOTS lOS WAIT \lAIT WAIT WAIT LOCK WAIT , 0 ,. , " " 0 0 " " 0 0 '" , 0 0 , 0 0 1000.91
0.0 0 0.' 0.0 , U 591110 '.1 30 , " , , , , A , , , v , A , A " , , , , , , , V A , USER I 0 \/M/370 MONITOR 0A1A COLI EC1EO FOR 11341-02 SERIAL 999999 fROM 10/11/82 lHRU 17:00:00 lABlE Of U51::RItI BY OrcOOE USER I 0 OPCOOE PRIVilEGED OPI::RA1l0N CODE FREQUENCYI PtRCENl r ROW PCT I COL PeT ISSt( IISK I HOY IS1CKC ISPkA I LPS\/ ITIO IHIO !STell ILCll I
I g:gg I g:gg I 8:8g I I 8:88 I I I I 28:86 I 28:86 I ________ J ___ __ __ __ 0.00 .L __ __ __ 1 . __ )()()()()()(X)( t 0 I 0 I 0 I 21 I 0 I 0 I 0 I 0 I 0 I 0 I I 8:88 I 8:88 I 8:88 1108:3g I 8:88 I 8:88 I 8:8g I I 8:88 I 8:88 I I 0.00 I 0.00 I 0.00 t 100.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I ---------.. --------... -----.. -_ ... _-------.. --------... --------"--------.o.--------.o.--------.o.--------.o.--------.o. )()()()O()OO( t 824 I 0 lot 0 I 0 I 261 I 0 I 0 I 0 I 0 I I 2.37 I 0.00 I 0.00 I 0.00 I 0.00 I 0.75 I 0.00 I 0.00 I 0.00 I 0.00 I I 7).94 I 0.00 I 0.00 I 0.00 I 0.00 I I 0.00 I 0.00 I 0.00 I 0.00 I I 3.92 I 0.00 I 0.00 I 0.00 I 0.00 I 6.98 I 0.00 I 0.00 I 0.00 I 0.00 I ---------.--------... --------.o.--------.o.--------... --------+ ________ .o. ________ + ________ .o. ________ ... ________ + )()()()O()OO( I 1929 I 0 I 1 I 0 I 0 I 0 I 0 I 0 I 2 I 2 I I I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.01 I 0.01 I I 9'.74 I 0.00 I 0.05 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.10 I 0.10 I I 9.18 I 0.00 I 3.1l I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.54 I 0.49 I ---------+--------... --------.o.--------.o.--------... --------+ ________ .o. ________ .o. ________ .o. ________ .o. ________ + )()O(X)O(XX f 122B I 0 I 1 I 0 I 26 I 3 I 609 I 0 I 0 I 0 I I 3.53 I 0.00 I 0.00 I 0.00 I 0.07 I 0.01 I 1.15 I 0.00 I 0.00 I 0.00 I I I 8:88 I I I I 8:6g I I I 8:88 J 8:88 I _________ h _______ ... ________ ... ________ .o. ________ ... ________ + ________ .o. ________ .o. ________ .o. ________ .o. ________ + XXXXXKXX I 0 I 0 I 0 I 0 I 0 I 0 I 81 I 0 I 0 I 0 I I 0.00 I 0.00 1 0.00 I 0.00 I 0.00 I 0.00 I 0.23 I 0.00 I 0.00 I 0.00 I I 8:88 I 8:88 I I 8:38 I 8:88 I 8:88 I I I 8:g8 I 8:88 I ---------.--------.o.--------... --------.o.--------... --------+ ________ .o. ________ .o. ________ .o. ________ .o. ________ + )()()OOOO()( I 74 I , I 0 I 0 I 0 I 307 I 151 I 0 I 1 I 1 I I 0.21 I 0.00 I 0.00 I 0.00 I 0.00 I 0.88 I 1.01 I 0.00 I 0.00 I 0.00 I I 10.07 I I 0.00 I 0.00 I 0.00 I 41.71 I 41.76 I 0.00 I 0.14 I 0.14 I r 0.35 I lO.OO I 0.00 r 0.00 I 0.00 I 8.22 r 3.89 t 0.00 I 0.27 I 0.25 I ---------+--------+--------... --------.o.--------.o.--------+ ________ .o. ________ .o. ________ ... ________ .o. ________ + JOOOOOO<X I 0.08 I 0.08 I 0.08 1 0.08 1 0.08 I 0.08 1 I 0.08 I 0.08 I 0.08 I I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 100.00 I 0.00 I 0.00 I 0.00 I I 0.00 r 0.00 I G.oo I 0.00 I 0.00 I 0.00 I 0.96 I 0.00 I 0.00 I 0.00 I ---------+--------+--------+--------+--------.o.--------+ ________ + ________ .o. ________ .o. ________ + ________ + JOOOOOO<X I 0 I 0 I 0 I 0 I 0 I 3 I 2 I 0 I 0 I 16 I I 0.00 I o.ou I o.uo I 0.00 I 0.00 I G.Ol I 0.01 I 0.00 I 0.00 I 0.05 I I 0.00 I 0.00 I 0.00 I 0.00 I 0.00 I 111.29 I 9.52 I 0.00 I 0.00 I 76.19 I I 0.00 I 0.00 I G.oo I 0.00 I 0.00 I G.08 I 0.02 I 0.00 I 0.00 I 3.95 I ---------+--------.o.--------+--------+--------.o.--------+ ________ ... ________ + ________ + ________ .o. ________ TOTAL 21013 5 32 21 176 3737 9029 2 370 1105 60.40 0.01 0.09 0.G6 0.51 10.74 25.95 0.01 1.06 1.16 TOTAL " 0.06 " 0.06 1085 3. 12 1934
1867 5.31 " 0.23 '" l.l1 " 0.25 " 0.06 \/M/310 MOIUTOR DATA COLLECTED FOR 4341-02 SERIAL 999999 FROM 10/11/82 09:00:00 THRU 11:00:00 I I + 1 80.00 + I ! 70.00 ... I I 60.00 + I I 50.00 ... I ! + i I , 30.00 + I i 20.00 + I , i 10.00 + i I I 0.00 + $ s s
s
PLOT or ACTlVE+TOD SYMBOL USED IS. PLOl Of LOCCEO"TOO SYMBOL USED IS $ $ $$ $ $$ $ $$ $ $$ $ $$ $ . .... .. .
.. eo.
Ss - --------------+-----------------------------.o.---------____________________ + _____________________________ .o. _____ _ 9:00 12:00 15:00 18:00 TIME OF DAY 31 VM/310 DATA COLLECTW fOR 1i341-o:i! SERIAL 999999 fROM 10/11/82 09:00:00 THRU 17:()0:0() PERCENTAGE BAR CHART MIDPOlliT QISEC AVG SECS IN 111+El BETIIEEN D.OOl 0.004
0.010 0.015 0.025
0.060 0.100 0.150
0.400 0.600 1.000 1.')00 500 4.000 5.000 10.000 15.000 I I ,. j I .. .... .. 1_ .. .. .. ... , , ........... _ ............... ** ........................ . 1_ ... .. .. .. 1 .. ........ .. _ ......... .. I .. ... .. 1 .. - , I""" I .. , , I I , I ----+---+---+---+---+---+---+---+---+---+---+---+--- 6 e 10 14 16 Ie PERCENTAGE fR[Q CUM. PERCENT CUH. o o o , .. '" '" " " " " "
32.85 58.58 76.51 8r .OJ 93.1(; 97.07 99.16 100.00 100.00 100.00 100.00 100.00 100.00 Effect of Total CPU Utilization and Paging Rate on VM Resource Availability AAl
1.00 .E --------------------------------------------100000 CPU Util. .33 Pages/SeCOnd Data Collected 10/11/82 32 Number of eMS Users Each Weekday ............ 120 to. o. o. 4. 2. 1 2 3 8 7 B 9 10 13 15 18 17 20 21 22 23 24 27 28 29 30 DAV f-------- Septellbel" ---------1 MONTH LEGEND: USERS eMS User Load Throughout the Day 9: 00 11: 00 13: 00 15: 00 17: 00 Time of OillY LEGEND: USERS -- Active -- Logged On 33