Está en la página 1de 28

CHAPTER 3

Stress Tester: A Toolkit


for Bank-by-Bank Analysis
with Accounting Data
MARTIN IHK

S tress testing is a useful and increasingly popular, yet sometimes misunderstood, method of analyzing the resilience of nancial systems to ad-
verse events. This chapter aims to help demystify stress tests and illustrate their strengths and weaknesses. Using an Excel-based exercise with
institution-by-institution data, readers are walked through stress testing for credit risk, interest rate and exchange rate risks, liquidity risk, and
contagion risk and are guided in the design of stress testing scenarios. The chapter also describes the links between stress testing and other analyti-
cal tools, such as nancial soundness indicators and supervisory early-warning systems. Furthermore, it includes surveys of stress testing practices
in central banks and the IMF.

METHOD SUMMARY
Overview The Stress Tester 3.0 is a basic yet exible model for implementing bank-by-bank stress tests for a set of risks. It covers basic
solvency and liquidity risks, contagion, reverse stress testing, and links between stress tests and early-warning systems.
Application The method can be applied to a wide variety of banking systems but is particularly appropriate for small, noncomplex bank-
ing systems.
Nature of approach Basic balance sheet shocks, combined with basic contagion analysis.
Data requirements Accounting information on capital, loans, and risk-weighted assets.
Supervisory data on classied loans and provisions.
Strengths Easy to use, exible (institutions, shocks, assumptions can be easily added), transparent (all assumptions are in one sheet),
and covers a relatively wide range of risks.
Weaknesses Numerous assumptions are required. The mechanism for generating the shocks (e.g., historical scenario and macroeco-
nomic model) is left unspecied.
Reliability and comparability of results depend on quality of input data (which includes, e.g., accounting data on nonper-
forming loans and provisions).
Tool The spreadsheet macro (Stress Tester 3.0) is available in the toolkit, which is on the companion CD or at www.elibrary.imf
.org/stress-test-toolkit.

The subject of this chapter and the accompanying Excel file strengths and weaknesses of stress testing, using concrete
are system-oriented stress tests carried out on bank-by-bank examples. Readers will familiarize themselves with how com-
data.1 The chapter and the accompanying file aim to illustrate mon types of stress tests can be implemented in practice, in

Th is chapter is an abridged and updated version of IMF Working Paper 07/59 (ihk, 2007a). The author would like to thank R. Sean Craig, Dale Gray,
Plamen Iossifov, Peter Chunnan Liao, Thomas Lutton, Christiane Nickel, Nada Oulidi, Richard Podpiera, Leah Sahely, Graham Slack, and participants in
a regional conference on financial stability issues at Sinaia, Romania, and in seminars at the IMF, the World Bank, the Central Bank of Russia, and the
Central Bank of Trinidad and Tobago for helpful comments on the working paper; Matthew Jones and Miguel Segoviano for insights on stress testing
methodologies; and Roland Straub for help with the overview of stress tests.
1
We concentrate on banks, even though the impact of risks in nonbank financial institutions is also discussed.
18 Stress Tester

a small and noncomplex banking system. They should gain introduced in the subsequent sections, we include specific
an understanding of how the various potential shocks can be references to the file. To distinguish references to tables in the
fitted together and how stress testing complements other Excel file from those in this chapter, the Excel table names
analytical tools, such as financial soundness indicators (FSIs) start with a capital letter A H (denoting the order of the
and supervisory early-warning systems. They should also learn spreadsheet) followed by a number (denoting the order of
how to interpret the results of stress tests. the table within the spreadsheet). For instance, Table A2 de-
As the title indicates, this chapter is about applying stress notes the second table in the first Excel spreadsheet.
tests to actual data. It devotes relatively little space to general
discussions of what stress testing is. There is already a plethora
of studies that provide a general introduction to stress testing, 1. OVERVIEW OF THE FILE AND OF
discussing its nature and purpose. For example, Blaschke and THE STRESS TESTING PROCESS
others (2001), Jones, Hilbers, and Slack (2004), ihk (2004,
2005), and IMF and World Bank (2005) provide a general Stress testing can be thought of as a process that includes
introduction to stress testing. In contrast, relatively little is (1) identifying specific vulnerabilities or areas of concern;
available in terms of practical technical guidance on how to (2) constructing a scenario; (3) mapping the outputs of the
actually implement stress tests for financial systems, using con- scenario into a form that is usable for an analysis of financial
crete data as examples. This study and the accompanying Ex- institutions balance sheets and income statements; (4) per-
cel file are an attempt to fill that gap. forming the numerical analysis; (5) considering any second-
As the title also suggests, this is an introduction, not a com- round effects; and (6) summarizing and interpreting the re-
prehensive stress testing cookbook. The chapter covers basic sults ( Jones, Hilbers, and Slack, 2004; IMF and World Bank,
versions of the most common stress tests. Depending on the 2005). The aim of this exercise is to illustrate the stages of this
sophistication of the fi nancial system and the type of its process. It will also illustrate that these stages are not neces-
exposures, it may be necessary to elaborate on these basic ver- sarily sequential, as some modification or review of each com-
sions of tests (e.g., by estimating econometrically some rela- ponent of the process may be needed as work progresses.
tionships that are only assumed in this file) and perhaps include The stress testing exercise is performed on the banking
also tests for other risks (e.g., asset price risks or commodity system in a fictional country named Bankistan. Given that
risks) if financial institutions have material exposures to those confidentiality restrictions do not allow the IMF to pass on
risks. The accompanying file can be developed in a modular individual bank data, we refer to a fictional country rather
fashion, with additional modules capturing additional risks than an actual one. The exercise is modeled on stress tests con-
or elaborating on the existing ones. The final part of this chap- ducted in a number of Financial Sector Assessment Program
ter provides an overview of the main extensions that could (FSAP) missions, and the input data were created to make the
be considered. exercise realistic. However, compared with typical FSAP stress
One of the key messages of this chapter is that assumptions tests, the exercise was simplified significantly to make it suit-
matter and that they particularly matter in stress testing. The able for a short workshop that would give an overview of the
chapter calls for transparency in presenting stress testing FSAP stress tests (see IMF and World Bank, 2003). It is a ver-
assumptions and for assessing robustness of results to the sion that could be used for a noncomplex banking system. For
assumptions. To highlight the importance of assumptions larger systems characterized by complex financial institutions
in stress testing, this chapter uses boldface for references and markets, more elaborate tests may be necessary.
to assumptions used in the accompanying Excel file. To To understand how to design stress testing shocks and
achieve transparency in the Excel file itself, assumptions are scenarios, it is important to have a good understanding of the
highlighted (in blue and green) and grouped in one worksheet. structure of the financial system and the overall environment
The remainder of this chapter is structured as follows. Sec- in which the system operates. Box 3.1 therefore provides short
tion 1 provides an overview of the general issues one needs to briefing information on the macroeconomic and macro-
address when carrying out stress tests and describes the design prudential situation in Bankistan.
of the accompanying Excel file. It also introduces the general
setting of the fictional economy described by the Excel file.
A. How to operate Stress Tester 3.0:
Section 2 discusses the input data. Sections 37 discuss the
A quick guide to the accompanying le
stress tests for the individual risk factors, namely, credit risk
(Section 3), interest rate risk (Section 4), foreign exchange risk This section introduces the accompanying Excel file, Stress
(Section 5), interbank contagion risk (Section 6), and liquidity Tester 3.0.xls. Working with the file requires relatively little
risk (Section 7). Section 8 shows how to create scenarios from prior knowledge. Users should be proficient in operating stan-
the individual risk factors, how to present the results, and how dard Excel files. Knowledge of intermediate macroeconomics
to link the results to supervisory early-warning systems. Sec- is useful for understanding the linkages between the financial
tion 9 concludes and discusses possible extensions. sector and the broader macroeconomic framework.
The accompanying Excel file, Stress Tester 3.0.xls, consti- The file can be viewed as a module belonging to a broader
tutes an essential part of this chapter. For each of the concepts stress testing framework (Figure 3.1). Such a framework would
Martin ihk 19

Box 3.1. Background Information on Bankistans Economy and Banking Sector

The economic environment in which banks are operating in Bankistan is challenging, with increasing macroeconomic imbalances,
inappropriate macroeconomic policies, and deep uncertainty fueled by political tensions. Real activity is sharply contracting, and ination
has almost doubled to 65 percent.
Unsustainable scal imbalances and loose monetary conditions were key to the deteriorating situation in Bankistan. The government
decit more than doubled in 2005, and a sharp increase in central bank nancing of the government has signicantly accelerated money
growth.
The policy response to the deteriorating situation has been inappropriate. Expansionary monetary policy measures (e.g., a lowering of
reserve requirements) have induced a further easing of liquidity conditions. The ensuing excess liquidity induced a drop in treasury bill
rates from 60 percent to below 15 percent. This means that together with an ination rate of 65 percent, real interest rates are sharply nega-
tive. (Note: This is used for assessing interest rate risk.)
The ocial exchange rate of the Bankistan currency, Bankistan dollar (B$), is xed at 55 B$/US$. However, the black market exchange
rate has depreciated in recent months from about 60 B$/US$ to about 85 B$/US$. (Note: This is important information for assessing foreign
exchange risk.)
The deteriorating macroeconomic environment has put considerable strain on the nancial condition of the banking system. Even
though the system has proved so far to be remarkably resilient, some banks have been weakened considerably and are prone to further
deterioration in light of the signicant risks. Reported high- capital adequacy ratios were found to be overstated because of insucient
provisioning. (Note: This information is used for the assessment of asset quality.) In addition, asset quality has deteriorated. The ratio of
gross nonperforming loans (NPLs) to total loans has increased from 15 percent at end-2009 to 20 percent at end-2010. (Note: This informa-
tion will be used for assessing credit risk.)
The banking system of Bankistan consists of 12 banks. Three of them are state owned (with code names SB1 to SB3), 5 are domestic pri-
vately owned banks (DB1 to DB5), and 4 are foreign owned (FB1 to FB4). The banking system, and particularly the state- owned banks, have
been plagued by a large stock of NPLs and weak provisioning practices. Data on the structure and per formance of the 12 banks are pro-
vided in the Data sheet of the accompanying Excel le. An assessment of Bankistans compliance with the Basel Core Principles for Bank-
ing Supervision (BCP) suggests that even though existing loan classication and provisioning rules in Bankistan are broadly adequate, they
are not well implemented in practice, and banks are underprovisioned.

External shocks

Macroeconomic model Satellite model


Links external shocks to Links the macroeconomic
macroeconomic variables (e.g., variables to banks asset quality
GDP, interest rates, exchange rate). (ideally bank-by-bank).

Balance sheet implementation


Maps the shocks into bank-by-bank
results.

Feedback
effects?
Impacts
(e.g., in terms of capital
injection needed).

Source: Author.

Figure 3.1 Stress Testing Framework

typically include a model characterizing linkages among key macroeconomic forecasts) including dozens of estimated or
macroeconomic variables, such as GDP, interest rates, the calibrated relationships are often used for this purpose (if
exchange rate, and other variables. Medium-scale macro- such models are not available, vector autoregression or vector
economic models (e.g., those used by a central bank for error-correction models can be estimated). Given that such
20 Stress Tester

TABLE 3.1
Stress Tester 3.0: Description of the Worksheets
Worksheet Description
Read Me Basic information, acknowledgments, and explanation of the workbook.
Data Six tables. Input data as compiled by the National Bank of Bankistan (NBB). The data were collected in March 2011 and
generally relate to end-December 2010, unless noted otherwise. Table A1 contains basic nancial statement data. Table A2
contains other relevant data, including more detailed breakdowns, results of bottom-up stress tests reported by individual
banks, and GDP number (for calculating ratios). The next two tables include key ratios based on the input data. Speci cally,
Table A3 contains the nancial soundness indicators, and Table A4 characterizes the structure of the banking sector. The
following two tables show how the nancial soundness indicators can be combined into institution-by-institution
rankings, using a simple early warning system calibrated by the NBB (see the Assumptions sheet). Specically, Table A5
provides the rankings, and Table A6 converts them into probabilities of default.
Assumptions One table. Table B puts together all the assumptions. This worksheet also contains several charts allowing the user to see how
changes in the assumptions aect the results.
Credit Risk Two tables. Table C1 summarizes the reported data on asset quality. Table C2 shows the credit risk stress test. It consists of
four components: (i) a correction for underprovisioning of NPLs; (ii) an aggregate NPL shock; (iii) a sectoral shock, allowing
dierent shocks to dierent sectors; and (iv) a shock for credit concentration risk (large exposures).
Interest Risk Two tables. Table D1 sorts assets and liabilities into three time-to-repricing buckets, using the input data provided by the
NBB. Table D2 shows the corresponding interest rate stress test. The test itself consists of two components: (i) ow impact
from a gap between interest-sensitive assets and liabilities; and (ii) stock impact resulting from the repricing of bonds.
FX Risk Two tables. Table E1 contains information on the foreign exchange exposure of the banks and the direct exchange rate risk
shock. Table E2 shows a basic calculation of the indirect foreign exchange shock (using FX loans to approximate impact
on credit quality).
Interbank Three tables. Table F1 is a matrix of net interbank exposures. Table F2 uses the interbank exposure data to show pure
interbank contagion, i.e., to illustrate what happens to the other banks when one bank fails to repay its obligations in
the interbank market. Table F3 shows a macro contagion exercise, in which banks failures to repay obligations in the
interbank market are not assumed, but rather a result of the macro shocks modeled in the sheet Scenarios.

models generally do not include financial sector variables, All data in the file relate to end-2010, unless indicated
the stress testing framework can also include a satellite model otherwise, and are expressed in millions of Bankistan dollars
that maps (a subset of) the macroeconomic variables into (B$), except for ratios (shown in percent).
financial sector variables, in particular asset quality. Such a The file contains the following eleven worksheets: Read
satellite model can be built on data on individual banks over Me, Data, Assumptions, Credit Risk, Interest Risk, Foreign
a period of time: using panel data techniques, asset quality in Exchange (FX) Risk, Interbank, Liquidity, Scenarios, Reverse,
individual banks can be explained as a function of individ- and Bottom Up. Table 3.1 contains a description of the indi-
ual bank variables and system-level variables. Together with vidual worksheets.
the macroeconomic model, the satellite model can be used to To differentiate the various types of cells (input data,
map assumed external shocks (e.g., a slowdown in world numerical assumptions, and formulas), different colors are
GDP) into bank-by-bank asset quality shocks. used in the file. The following color coding is used:
We focus on calculating the bank-by-bank impacts result- Yellow denotes data reported by the National Bank
ing from external shocks and expressing the impacts in terms of Bankistan (NBB). The yellow cells are found only
of variables such as capital adequacy or capital injection as a in the Data worksheet. When a new set of data arrives
percentage of GDP. We spend relatively little time discuss- from the NBB, the contents of the yellow cells should
ing the broader macroeconomic framework or possible feed- be replaced with the new data, and all the results are
back effects to the broader economy. The cells that contain recalculated automatically.
sizes of shocks and numerical assumptions in this file can be Blue denotes the assumed sizes of the shocks to risk
thought of as interfaces between this module and the other factors, for example, an increase in interest rates. The
modules of the stress testing framework. The cells that con- blue cells are found only in the Assumptions worksheet.
tain results (e.g., capital injections as a percentage of GDP) The users can change the values of these factors in the
can be viewed as interfaces to a module analyzing the feed- Assumptions worksheet and observe the impact of
back effects. these changes on the stress test results.
The modular design has the advantage that as a user becomes Green denotes numerical assumptions (parameters)
more experienced in stress testing or as more data become of the stress test. Like the blue cells, the green cells
available for analysis, additional modules can be added or devel- are found only in the Assumptions worksheet. As
oped. Incorporating, for example, the underlying econometric with the blue cells, the users can change the values
calculations in Excel would make the resulting file too big and of these factors in the Assumptions worksheet and
unwieldy (it also may not be possible because the economet- observe the impact of these changes on the stress test
ric tools in Excel are more limited than in other packages). results.
Martin ihk 21

No background. Cells that have no background and realistic or including more institutions in the system.2 Not
generally normal black font contain formulas linked all the developments need to take place in the same file: users
to the yellow, green, and blue cells. If the values of the can think about some of the blue or green cells as interfaces
blue or green calls are changed (or if new input data between this tool (module) and other tools (modules), such
are entered in the yellow cells), the results of the stress as macroeconomic models that provide scenarios. Those can
tests are recalculated automatically. provide inputs that feed into this stress testing tool. The main
Yellow stripes indicate consistency checks. These cells advantage of Excel-based tools, such as this one, is the rela-
contain sums or other functions of the input data. tive ease with which they can be adapted and extended. For
Those would normally also come from the authorities longer-term usage, it may be useful to develop the file into a
as hard numbers but are calculated in this file to avoid program, for example, in Microsoft Access. Th is may reduce
inconsistencies. the flexibility for regular users, but it may, among other
Green/white stripes denote numerical assumptions things, allow development of the fi le from the current one-
imported from the Assumptions sheet. Under normal period snapshot to a multiperiod framework.
circumstances, it is expected that the user will leave
these cells (each of which contains a link to the As-
B. Top-down or bottom-up?
sumptions sheet) unchanged and will carry out the
changes in the corresponding green cells in the As- There are two main approaches to translating macroeconomic
sumptions sheet. However, if users want to see the shocks and scenarios into financial sector variables: the bot-
impact of changes in an assumption directly in the tom-up approach, where the impact is estimated using data
corresponding sheet (e.g., for credit risk assumptions on individual portfolios, and the top-down approach, where
in the Credit Risk worksheet), they can do so by chang- the impact is estimated using aggregated data.3 Among cen-
ing the value of the green/white cell rather than going tral banks Financial Stability Reports (FSRs), reports by the
back to the Assumptions sheet. Of course, users need Bank of England and Norges Bank can be used as examples
to be aware that if they save these changes, it will re- of FSRs that rely more on top-down approaches to stress test-
sult in overwriting the original links in the file and ing, whereas reports by the Austrian National Bank and
some of the links between the Assumptions sheet Czech National Bank are examples of stress tests using more
and the results in the Scenarios sheet may be broken. bottom-up approaches, even though in all these cases, the
However, if they do not save those changes and reports in fact combine elements from both approaches.
afterward return to the original template, they will The disadvantage of a top-down approach is that apply-
be able to use the file again in its original form. ing the tests only to aggregated data could overlook the con-
Blue/white stripes denote numerical assumptions im- centration of exposures at the level of individual institutions
ported from the Assumptions sheet. Like the green/ and linkages among the institutions. This approach may
white stripe cells, these cells allow the user to change therefore overlook the risk that failures in a few weak institu-
the values of assumed shocks directly in the individ- tions can spread to the rest of the system. The bottom-up
ual worksheets without going back to the Assump- approach should be able to capture the concentration of risks
tions sheet. However, these changes should be used and contagion and therefore should lead generally to more
with caution to avoid breaking the links in the file; precise results, but it may be hampered by insufficient data
changes in the shock sizes should primarily be done and by calculation complexities. Having detailed informa-
in the Assumptions sheet. tion on exposures of individual banks to individual borrowers
In addition to explanations in the Read Me sheet, many of should in principle lead to more accurate results than using
the cells in the stress testing file contain comments explain- more aggregated data, but, especially for large and complex
ing the calculations carried out in these cells. financial systems, it may lead to insurmountable computa-
All assumptions and shock parameters are in the Assump- tional problems. Most macroprudential stress tests therefore
tions sheet. This is the sheet that a regular user would use the try to combine the advantages and minimize the disadvan-
most, changing the assumptions (in green) and shock sizes tages of the bottom-up and top-down approaches.
(in blue) and observing the results. Given that a summary This chapter and the accompanying Excel file focus on the
presentation of the stress test results is provided in the As- bottom-up implementation of stress tests in a relatively small,
sumptions sheet in charts, the user can change the assumptions noncomplex banking system. The spreadsheet illustrates why
and directly see the impacts in a graphical form. If the user
wants to examine the overall stress test results in a tabular
form, the results are available in the Scenarios and other
sheets. 2
Including more institutions requires adding columns (and some rows
Expert users who have become familiar with the file are in the Interbank worksheet), copying the relevant links in other work-
sheets, and checking summation formulas for the peer groups and the
invited to suggest improvements in the file or to develop the system.
file further themselves. Such developments can include new 3
For a longer discussion of this distinction, see, e.g., ihk (2004), Jones,
types of risks, making the modeling of the existing risks more Hilbers, and Slack (2004), and IMF and World Bank (2005).
22 Stress Tester

using institution-by-institution data is important: a relatively Capital. Using capital as a measure of impact has a
minor change in the distribution of risks among banks can clear motivation. If a risk has a material impact on sol-
result in substantial changes in the overall impacts. The spread- vency, it has an impact on capital. Also, commercial
sheet also illustrates how the bottom-up approach can be banks capital is part of the Other Items Net in mone-
complemented by a top-down approach. For example, a model tary surveys, so expressing impacts in terms of capital
estimated on aggregate data can be used to identify how a could be used to directly link stress tests to other parts
combination of shocks to macroeconomic variables can trans- of the financial programming framework (even though
late into an increase in nonperforming loans. Stress Tester 3.0 it is only a small part of the possible feedback effects
can then be used to calculate how this aggregate impact in- from the financial sector to the macroeconomy, as dis-
fluences individual banks and the system as a whole. cussed in Section 8.C). The disadvantage of using im-
Although much of the Excel file illustrates a centralized pact in terms of capital is that it is just a number in B$
approach to bank-by-bank stress testing, where all the calcu- that needs to be compared with something else to give
lations are done in one center (e.g., at the central bank or a the reader an idea about the impact on soundness (e.g.,
supervisory agency or by an IMF expert), the Bottom Up dividing it by risk-weighted assets) and on the macro-
worksheet illustrates an alternative, more decentralized economic framework (e.g., dividing it by GDP). None-
approach. The approach often used in advanced-economy theless, it is a key mea sure, and the accompanying
FSAPs is to involve banks themselves in carry ing out the Excel file illustrates the presentation of stress testing
stress testing calculations. The advantage of the decentral- impact in terms of capital.
ized approach is that it can provide a richer, more detailed Capitalization. The advantage of capitalization mea-
modeling, using a wider set of data and leveraging on the sures (capital or equity to assets or capital to risk-
expertise and calculation capacity of banks risk management.4 weighted assets) is that capital adequacy is a commonly
The disadvantage is that the decentralized calculations may recognized soundness indicator. Compared with capi-
not sufficiently reflect contagion effects among banks, so just tal, this mea sure is scaled, so it allows comparison
adding up the results for individual banks may not be a good among institutions of different size. For this reason,
proxy for the systemic impacts. Also, if the calculations are the accompanying Excel file uses capitalization as a
complex and done by many institutions, it may be a major key indicator of impact. The disadvantage of this mea-
challenge to ensure that all banks implement the assumed sure is that a change in capitalization does not by it-
shocks or scenarios in a consistent fashion. In comparison, self indicate macroeconomic relevance of the calculated
the centralized stress tests discussed in this chapter are less impacts. It therefore needs to be accompanied by other
refined (for reasons of computational complexity and data measures.
availability), but they (1) are more focused on linkages to mac- Capital injection needed (e.g., as a percentage of GDP).
roeconomic factors; (2) can better integrate credit and market This indicator provides a direct link to the macro-
risks; (3) are implemented consistently across institutions; economy. It provides an upper bound on the poten-
(4) can better analyze correlation across institutions (interport- tial fiscal costs of bank failures associated with the
folio correlation); and (5) can analyze network effects (con- assumed stressful scenario. The accompanying Excel
tagion). Therefore, even if the decentralized calculations are file illustrates the use of capital injection.
carried out, it is important to complement them with the Profits. In a normal, nonstressful situation (baseline
centralized calculations along the lines discussed in this scenario), banks would typically create profits. When
chapter. carry ing out stress tests, it is important to bear in
mind that we are evaluating impacts against such a
baseline, as banks would normally use profits as the
C. Presenting stress test results:
first line of defense before dipping into capital. Express-
What variables can be stressed?
ing shocks only in terms of capital may result in over-
For a variable to be used to measure the impacts of the stress estimating the actual impacts if banks were profitable
tests, it should have two key properties: (1) it should be possible in the baseline. The accompanying Excel fi le allows
to interpret the variable as a measure of financial soundness profits to be taken into account. More specifically, it
of the system in question; and (2) it can be credibly linked to indicates the profit buffer that banks would have
the risk factors. Of the various variables that have been used available in the baseline. The profit buffer is based on
in the literature so far, each has advantages and disadvantages, the average annual profits over the last 10 years, but the
which should be clear to the reader and user. Here is a list of fi le also allows the user to run a separate test for
the commonly used variables: the impact of an autonomous shock affecting profits
(one can think about autonomous shocks to net inter-
4
est income, e.g., related to an increase in competition
ihk and Hemnek (2005) provide a more detailed discussion of such
decentralized stress tests. Hoggarth, Logan, and Zicchino (2005)
from abroad; alternatively, this can be viewed as a
discuss how such stress tests were carried out in the case of the United measure of the risks not reflected in the other shocks
Kingdom. specified in the stress testing scenario). However, to
Martin ihk 23

reflect the views of some observers that it is better to tests, namely, in terms of liquidity indicators. The
be prudent and disregard profits, it shows them as a accompanying Excel file illustrates this presentation.
separate item rather than directly deducting the im- Ratings and probabilities of default (PDs). Ratings and
pacts from profits. PDs provide a useful way of combining solvency and
Profitability (return on equity, assets, or risk-weighted liquidity risks. By definition, ratings try to combine
assets). Compared with profits, these mea sures are various solvency and liquidity risks into a single mea-
scaled by bank size, thus allowing comparison among sure. We can use the system designed for ratings and
banks of different size. The accompanying Excel file see how changes in the various variables translate into
shows the profit buffers as ratios to the risk-weighted changes in ratings. If we have a model linking ratings
assets, to make them comparable with the impact and probabilities of default, we can also calculate how
shown in terms of risk-weighted assets. a stressful scenario influences PDs. The accompany-
Net interest income and other components of profits. ing Excel file illustrates this presentation.
Sometimes it can be useful to stress test separately This list is far from complete. It is possible to calculate and
individual components of profits. For example, net in- present stress test impacts in terms of other variables that cap-
terest income is likely to have a more direct relationship ture soundness of financial institutions and can be credibly
to interest rates and may therefore be more amenable linked to the development of risk factors. For example, instead
to econometric analysis. However, such an approach of the accounting-based data discussed earlier, it is possible to
provides only a partial picture of the economic value present the impact of a stressful scenario in terms of market-
of a bank and its resilience to adverse events. based indicators of financial sector soundness, such as relative
z-scores. The z-score has become a popular measure prices of securities issued by financial securities, the distance
of bank soundness (e.g., Boyd and Runkle, 1993; or to default for banks stocks,6 or credit default swap premia (for
Hesse and ihk, 2007). Its popularity stems from a review, see, e.g., ihk, 2007b). One of the advantages of the
the fact that it is related to the probability of a banks market-based indicators is that they are usually available on a
insolvency, that is, the probability that the value of much more frequent basis than accounting data. However,
its assets becomes lower than the value of the debt. The one of their major disadvantages is the absence in many coun-
z-score can be summarized as z = (k + R)/X, where k is tries of sufficiently deep markets from which such indicators
equity capital as percentage of assets, R is average af- can be derived (e.g., bank stocks are not traded, or the market
tertax return as percentage on assets, and X is stan- for such stocks is illiquid). There have been some attempts to
dard deviation of the aftertax return on assets, as a link market-based indicators, such as distance to default, to
proxy for return volatility. The z-score measures the macroeconomic variables (see, e.g., IMF, 2005), but work on
number of standard deviations a return realization using such relationships for stress tests has been limited so far.
has to fall in order to deplete equity, assuming nor-
mality of returns. A higher z-score therefore implies
D. How are the results presented
a lower probability of insolvency risk. The accompa-
in Stress Tester 3.0?
nying Excel file illustrates this presentation.5
Loan losses. Stress tests presented by staff from Norges Each stress test conducted in this exercise aims to address
Bank (e.g., Evjen and others, 2005) and the Bank of two main questions: (1) Which banks could withstand the
England (e.g., Bunn, Cunningham, and Drehmann, assumed shocks and which ones would fail? (2) What are the
2005) are just two examples of presenting stress test- associated potential costs for the government given the fail-
ing results in terms of loan losses. Although this ap- ure of banks in times of stress?
proach has its advantages (in particular, it is easier to A commonly used approach to assessing question (1), as
implement in top-down calculations than measures mentioned in the previous section, is to look at banks capital
calculating losses to capital), its drawback is that it adequacy ratio (CAR). According to the original Basel Agree-
does not take into account banks buffers (profits and ment, a bank has to hold a minimum CAR, defined as total
capital) against those losses. It may underestimate the regulatory capital to risk-weighted assets (RWA), of 8 percent.
overall impact if losses are concentrated in weak In our example, given that Bankistan as an emerging market
institutions. country faces more risks than an industrial country, it is ap-
Liquidity indicators. For liquidity stress tests, the im- propriate to require from banks a higher CAR. On the basis of
pacts have to be measured differently than for solvency these considerations, Bankistans supervisors use a minimum
CAR of 10 percent. Whenever the CAR of a bank in Bankistan
falls below 10 percent, its owners are obliged to inject capital
5
The fi le also shows the z-scores for the peer groups of banks, using a
similar methodology as used by some authors to translate bank-by-bank
6
distance to default mea sures to a portfolio distance to default (e.g., Distance to default is in effect an implementation of the z-score for
IMF, 2005a). These calculations need to be treated with a degree of banks with stocks listed in liquid equity markets. Distance to default
caution, given that they overlook issues related to contagion (see, e.g., uses stock price data to estimate the volatility in the economic capital of
ihk, 2007b). the bank (see, e.g., Danmarks Nationalbank, 2004).
24 Stress Tester

in order to stay in business.7 If they fail to do so, the bank will If q = 0, that is, the capital injection is not used for an in-
be closed and its banking license withdrawn. A CAR below 0 crease in RWA (at least immediately), and if we substitute for
means that a bank has negative capital and is insolvent.8 W the 10 percent value used in Bankistan, we can calculate the
Stress Tester 3.0 allows profits to be taken into account, capital injection as I = 0.1*RWA  C. The values of the param-
whichas explained earlieris important because shocks al- eters W and q are assumed. The stress test fi le enables us to
ways take place over time and therefore need to be compared change the values of the two parameters in the appropriate
with a baseline scenario. The Scenarios sheet indicates the green cells (B71 and B72 in the worksheet Assumptions). We
profit buffer that banks would have available in the baseline can see that if W is lower than 10 percent, the necessary capital
scenario. We refer to annual profits, which is consistent with the injection is lower, and vice versa. If RWA increase as a result
fact that we evaluate the shocks in a horizon of one year (see of the increase in capital (i.e., if q > 0), the necessary capital
the interest rate shock). The value of the profit buffer is based injection is higher (but the impact of changes in q is generally
on the average annual profits over the last 10 years, but the file rather small).
also allows the user to run a separate test for the impact of
an autonomous shock affecting profits or net interest income.
Take, for instance, autonomous shocks to net interest income,
2. UNDERSTANDING AND
for example, related to an increase in competition from abroad; ANALYZING THE INPUT DATA
alternatively, this can be viewed as a measure of the risks not The Data sheet summarizes the input data (Tables A1 and A2),
reflected in the other shocks specified in the stress testing sce- as reported by the NBB. It also shows key ratios (Tables A3
nario. However, to reflect the views of some papers that it is and A4) and illustrates how these ratios can be used in an off-
more prudent to disregard profits and measure shocks directly site supervisory assessment system (Tables A5 and A6).
against capital (e.g., Blaschke and others, 2001), the file shows
the profit buffers as a separate item rather than directly deduct-
ing the impacts from profits. For some banks, the profit buf- A. Coverage of stress tests
fer is nonexistent or negative (they have been creating losses). In the Excel file, the stress tests cover all 12 commercial banks
An assessment of question (2) requires consideration of the in the country. An overview of FSAP stress tests suggests that
following question: if bank owners fail to inject new capital, only a minority of FSAPs have covered all banks in a country.
how much capital would the government need to inject in Most FSAPs have covered only a subsample of large banks,
order to bring the CAR up to 10 percent again? For state-owned accounting for a substantial majority (generally 70 80 per-
banks, it is obvious that the government would have to inject cent) of the banking systems total assets. Including all banks
capital to keep banks operating. For private-owned banks, rather than a subsample has the obvious advantage of being
asking this question assumes that the government has an im- more comprehensive. For this reason, this approach is also
plicit or explicit guarantee for the banking sector, which may often favored by supervisors, who are expected to supervise
or may not be the case. If it is, an answer to this question can all institutions, not only the larger ones. However, for some-
be found from the following accounting relationship: one interested primarily in macroprudential issues (e.g., a
C +I central bank not involved in microprudential supervision),
= , it may be sufficient to include only the systemically important
RWA + qI
institutions (that is why some authors, such as Jones, Hilbers,
where C is the banks existing total regulatory capital, RWA and Slack [2004] refer to this type of stress testing as system-
are its existing risk-weighted assets, I is the capital injection, oriented stress testing rather than systemwide stress testing).
q is the percentage of the capital injection that is immediately Excluding the other institutions may be practical for reasons
used to increase risk-weighted assets, and W is the regulatory of computational complexity.9
minimum CAR ( W = 10 percent in the case of Bankistan). The Stress Tester illustrates a basic peer group analysis.
From the above equation, we can express the necessary To do that, the 12 banks in Bankistan are grouped into three
capital injection as follows: peer groups according to their ownership: state-owned banks
 RWA  C (SB1 to SB3), domestic privately owned banks (DB1 to DB5),
I= if C <  RWA; and foreign-owned banks (FB1 to FB4). This is just one pos-
1 q
=0 otherwise sible grouping. Depending on the analytical purpose, the

9
A practical complication with the system-oriented stress tests is the fact
7
The 10 percent minimum capital adequacy requirement is just an as- that the systemic relevance of an institution is established only after, not
sumption in Stress Tester 3.0, contained in the B71 cell of the Assump- before, the stress tests. As a practical shortcut, many FSAPs and other
tions worksheet. The reader can change it, for example, to 8 percent and authors use a mea sure of size (e.g., total assets) as a first approximation
see in the relevant chart in the Assumptions worksheet how the capital for systemic importance. It is a good proxy in most cases, but in some it
injection (in percentage of GDP) declines. can miss institutions that are small but have large potential for impact
8
Total capital may differ in general from regulatory capital; in this work- on other institutions, for example, through exposures in the interbank
book, we use for simplicity the same numbers, but the fi le is set up in a market. In Section VI, we provide a mea sure of systemic importance
way that allows for differences between equity and regulatory capital. that takes the contagion effects into account.
Martin ihk 25

banks in Bankistan can be grouped into other groups, for We can then run a basic stress test for what would happen if
example, by their size (e.g., large, medium, and small) or finan- a certain percentage of loans to the nonbank financial sector
cial performance (e.g., strong and weak). became nonperforming. Second, it can be incorporated as part
In the Bankistan example, foreign banks are present only of the large exposures tests. If we have data on the largest expo-
through locally incorporated subsidiaries. In practice, foreign sures of banks to nonbank financial institutions, we can run a
banks may also be present through branches. The difference test on what would happen to banks solvency should their
from a stress testing perspective is that branches typically do largest counterparties in the nonbank financial sector fail.
not have their own capital against which the impact of shocks
could be shown (and comparing the impacts with the parent
B. Balance sheets, income statements,
institutions capital would overlook risks faced by the same
and other input data
institution in other countries). However, if there are separately
available data on assets, liabilities, incomes, expenses, and other Data availability is a key determinant of the quality of a stress
input data indicated in the Data worksheet, most of the stan- test. The purpose of Tables A1 and A2 in the Data worksheet
dard tests can be performed on the branches of foreign banks is to illustrate what data are typically needed for carrying out
as well. The main practical difference, then, is that the impacts a set of stress tests. These are not the minimum requirements
have to be expressed in terms of a different variable than capi- it is possible to do very rudimentary stress tests with even less
tal or capital adequacy (e.g., in terms of profits). data, as discussed in Box 3.2. However, these are the types of
Mirroring the practice of FSAPs and central banks FSRs, data that one usually looks for when doing a basic stress test.
this chapter focuses on stress tests for banks and banking Throughout the sheet, as well as the file, the first data col-
systems. In most countries, banks tend to dominate the finan- umn shows aggregated data for the whole banking system, the
cial system and are key to assessing systemic risk. Some FSAPs next 3 columns show the aggregated data for the three peer
and FSRs contained explicit stress tests of insurance compa- groups of banks (state banks, private domestic banks, and
nies and pension funds. Stress testing pension funds and in- foreign banks), and the remaining 12 columns show the data
surance companies themselves can be a rather complex task. for the individual banks.
Some of the insurance sector risks, such as market risk, li- The input data presented in the top part of the Data work-
quidity risk, or credit risk, can be modeled similarly to the sheet (Table A1) form a set of balance sheets and income
banking stress tests. Modeling of other risks, especially some statements. To keep the exercise straightforward and trans-
of those stemming from the liabilities side (e.g., catastrophe parent, the aggregated data and the peer group data can be
risk), is beyond the scope of this study. calculated as sums of the bank-by-bank data. This means that
The impact of failures in nonbank financial institutions we disregard interbank exposures for the time being. Th is
can be assessed as part of the credit risk. The accompanying assumption is relaxed later on, in the analysis of interbank
Excel file allows for two ways of incorporating such an analy- contagion risk (Section 6).
sis. First, it can be incorporated as part of the sectoral credit Table A2 in the Data worksheet lists again for the
risk, with nonbank financial institutions as one of the sectors. system in aggregate, for the peer groups, and for individual

Box 3.2. Stress Testing When Some Input Data Are Unavailable

It may happen that some of the input data in Stress Tester 3.0such as those on nonperforming loans, net open positions, and time to
repricingare not available, for example, owing to weak reporting systems or legal restrictions on data sharing. A rudimentary version of
the stress tests can still be performed with the basic nancial statements, provided that they are available for a number of periods. Those
tests can be based on the observed relationships among the risk factors, the various items of the income statement, and the balance sheet.
For example, even when no data are available on repricing buckets of assets and liabilities and bond portfolios in banks, a rudimentary
stress test for interest rate risk could be based on the net interest income on banks income statements. In par ticular, past data on individ-
ual banks net interest income over time can be regressed on interest rates and other potential variables to estimate how banks net inter-
est income responded to changes in interest rates, and the estimated slope coecient(s) can be used to translate a change in interest rates
into the impact in terms of prots (and potentially capital). Similarly, provisions for loan losses from the income statement can be regressed
on the risk factors and other explanatory variables to analyze the impact on banks protability. If longtime series are not available to carry
out such regressions, the slope coecients can be calibrated based on expert information or experience from other countries.
Even if the individual items of the nancial statements are not available, reduced-form stress tests can still be carried out if there are
reliable time series data. For example, one needs just capital, asset, and return data on individual banks over time to calculate the z-score,
as a proxy for individual bank soundness, discussed in Section 2.C. The z-scores for individual banks can be regressed on a range of macro-
economic variables (e.g., real GDP growth rate, interest rate, and exchange rate) and bank-level variables (e.g., asset size or loan-to-asset
ratio). The slope coecients from this regression can then be used to map a macroeconomic scenario into the z-scores, to approximate the
impact of macroeconomic stress on individual bank soundness. (A similar approach can also be used with distance to default data or other
market-based indicators of individual institution soundness.) The main challenge in this type of approach is how to aggregate the bank-by-
bank soundness data into a systemwide indicator (an issue that is discussed in more detail in ihk, 2007b).
26 Stress Tester

banks other key input data that are used for the stress test for analyzing liquidity, using them as proxy for time
calculations. Such data are on the following: (1) regulatory to repricing may lead to misleading results (typically
capital and risk-weighted assets (to be able to express the stress overstating the interest rate risk).
test impacts in terms of capital adequacy); (2) asset quality Additional data may be needed for stress tests for other
and structure of lending by sector and by size of borrower; risks not covered in this file. For example, to carry out stress
(3) provisioning and collateral (for the credit risk calculation); tests for equity price risk and commodity price risk, data on
(4) structure of assets, liabilities, and off-balance-sheet items net open positions in equities and in commodities would be
by time to repricing; (5) the structure of the bond portfolio needed (the mechanics of the test would be similar to the di-
(for the interest rate risk calculation); (6) net open positions rect foreign exchange solvency test). Also, breakdowns of as-
in foreign exchange and lending in foreign currency (for the sets and liabilities by residual maturity/time to repricing and
foreign exchange solvency risk calculation); (7) average profits currency would be needed to perform stress tests separately
and standard deviation of profits over time (to have a measure for foreign currency.
of baseline profitability); (8) liquidity structure of assets and
liabilities (for liquidity risk calculation); and (9) bank-to-bank
C. Indicators of nancial sector
uncollateralized exposures, presented in matrix form (for the
soundness and structure
interbank solvency contagion risk).
Most of the data in Table A2 usually are available to bank Table A3 contains a set of core FSIs and other important ratios
supervisors through standard regulatory returns. However, characterizing Bankistans banking sector and its components.
several issues need to be mentioned: These ratios can be used to provide a summary picture of the
Stress tests analyze the economic position (net worth) soundness of the financial sector and its components (peer
of banks. In principle, this should be aligned with the groups and individual banks) in Bankistan. For more on the
reported data on capital, but in practice, there may definitions and compilation of FSIs, see IMF (2004).
be important differences between the calculated eco- Table A3 also includes, at the bottom, individual banks
nomic net worth of a bank and the reported regulatory z-scores. The z-score is defined as z = (k + R)/X, where k is eq-
data on capital. Th is may be the case, for example, uity capital as a percentage of assets, R is average aftertax re-
when some assets are overvalued in banks balance turn as percentage on assets, and X is standard deviation of
sheets or when regulators accept as capital some lia- the aftertax return on assets, as a proxy for return volatility. As
bilities that, in fact, are not capital (e.g., some long- mentioned earlier, z-scores have become popular as measures
term loans). The person carrying out stress tests should of bank soundness, because they are directly linked to the prob-
first try to adjust the input data for such biases. In the ability of a banks insolvency. The table also shows the z-scores
file, we show one example of such adjustments, namely, for the peer groups of banks (for a discussion on the calcula-
when banks underprovision their nonperforming tion of z-scores for groups of banks, see, e.g., ihk, 2007b).
loans. Another example (not shown in the file) might Table A4 characterizes the structure of the banking sector
be when banks do not mark to market some bonds in Bankistan, showing the shares of the peer groups and the
that they are holding in their portfolios. individual banks in total assets, loans, deposits, and capital.
The input data should reflect not only assets and liabil- It shows that the share of foreign-owned banks is relatively
ities but also off-balance-sheet positions. For example, high about 55 percent in terms of assets and 83 percent in
the net open positions in foreign currency should reflect terms of capital (reflecting their higher capitalization). It also
the delta equivalents of foreign exchange options. shows the total assets as a ratio to GDP, to indicate the size of
Data on bank-to-bank exposures may be difficult to the banking system relative to the Bankistan economy. The
collect in many countries. In those cases, approximate GDP figure is used again later, to put into macroeconomic
calculations using less data (e.g., only data on each perspective the capital injection needed to get all banks to
banks exposure to the rest of the system as a whole) comply with the minimum capital adequacy requirement.
can be used to at least broadly assess the associated
risks, even though such methods may result in over-
D. Ratings and probabilities of default
looking some exposures in the system.
For interest rate risk calculations, data on time to Tables A5 and A6 show how banking sector ratios can be com-
repricing are crucial. For example, from an interest rate bined into institution-by-institution rankings, using a supervi-
risk perspective, a 20-year mortgage loan with an in- sory early-warning system.10 Such systems (e.g., Sahajwala
terest rate that can change every 6 months should be and Van den Bergh, 2000) are very common in supervisory
treated the same as a 6-month fi xed-rate loan, not as
a 20-year loan. However, getting data on time to re- 10
The early-warning system does not have to comprise only ratios. Inclu-
pricing may be difficult to obtain in some cases. In sion of variables in the early-warning system should reflect their power
to identify weak banks. One variable that in some cases has good dis-
many countries, banks report instead a breakdown of criminatory power is deposit rates: high deposit rates in a bank can in-
assets by maturity or by residual maturity. Although dicate that it has difficulty retaining depositors, a potential sign of
data on maturity or residual maturity are important problems (Kraft and Galac, 2007).
Martin ihk 27

agencies, and they are used typically for assessing sound- in column E of the Assumptions worksheet) to derive an over-
ness of banks in baseline conditions; we will show in this all ranking for a bank. Similar off-site ranking systems are
exercise that they can be also used for assessing soundness in used by supervisors to identify banks that deserve increased
stressful conditions. One caveat needs to be borne in mind, attention (Sahajwala and Van den Bergh, 2000).
however, namely, that these early-warning systems typi- Underlying each ranking system is a more or less explicit
cally treat each bank separately and do not look at contagion link to probability of default (or probability of technical in-
among banks an issue that will be analyzed as part of the solvency, that is, probability that the capital adequacy ratio
stress test exercise presented here. declines below the regulatory minimum). Table A6 illustrates
Table A5 provides the rankings, based on the off-site super- this by converting the rankings into probabilities of default,
visory ranking system of the NBB, characterized in rows using a step function illustrated in Figure 3.2 and described
322 of the Assumptions sheet. The system has three thresh- in the case of Bankistan rows 6 and 22 of the Assumptions
olds (columns B, C, and D in the Assumptions sheet) for each worksheet: according to NBBs estimates, a bank with a rating
indicator, determining a numerical ranking for each of the of 1 has a 0.1 percent probability of default in a given year; a
indicators (with 1 indicating the best ranking and 4 the worst bank rated 2 fails with a 1 percent probability; a bank rated
ranking). The rankings for the individual variables are 3 has a 5 percent probability of default, and a bank rated 4
weighted (using weights established by the NBB and provided has a 30 percent probability of default in the coming year.
How are the parameters of such step functions derived? In
some cases, they are based on expert estimates. In other cases,
central banks or supervisory agencies attempt to back-test
30
Probability of default (%)

such systems to see whether they actually identify institutions


that fail (or institutions that need interventions). When the
step function is reestimated, the new parameters should be
entered in row 22.
Figure 3.3 provides an illustration of such back-testing in
the case of two variables (capital adequacy and gross nonper-
5

forming loans to total loans) and one threshold per variable.


The dots represent observations of banks, and the two bigger
1

0 5 8 15 boxes indicate two banks that have actually failed. The super-
Capital adequacy ratio (%) visory ranking system attempts to single out the failed banks
Source: Author, based on the default settings in the Assumptions sheet.
(i.e., the bigger boxes), minimizing the signal-to-noise ratio
for the estimate. If we want to capture all failed banks in
Figure 3.2 Step Function (Example) Figure 3.3 (i.e., eliminate Type I errors), the early-warning

Weak banks NPL threshold


Nonperforming loans to total loans (%)

CAR threshold
(NPL)

Strong banks

Capital adequacy ratio (%)


(CAR)
Source: Author.

Figure 3.3 Back-Testing a Supervisory Early-Warning System (example)


28 Stress Tester

Box 3.3. Linking Credit Risk and Macroeconomic Models

A number of papers have attempted to link credit risk to macroeconomic variables using econometric models. For example, Pesola (2005)
presents an econometric study of macroeconomic determinants of credit risk and other sources of banking fragility and distress in the
Nordic countries, Belgium, Germany, Greece, Spain, and the United Kingdom from the early 1980s to 2002. An even broader cross-country
analysis is presented in IMF (2003). For Austria, Boss (2002) and Boss and others (2004) provide estimates of the relationship between mac-
roeconomic variables and credit risk. For Finland, Virolainen (2004) develops a macroeconomic credit risk model, estimating the probabil-
ity of default in various industries as a function of a range of macroeconomic variables. For Norway, the Norges Bank has single-equation
models for household debt and house prices and a model of corporate bankruptcies based on annual accounts for all Norwegian enter-
prises (Eklund, Larsen, and Berhardsen, 2003). For Hong Kong SAR, several studies are available on the topic, employing both single-
equation aggregate estimates and panels using bank-by-bank data (Shu, 2002; Peng and others, 2003; and Gerlach, Peng, and Shu, 2004).
For the Czech Republic, Babouek and Janar (2005) estimate a vector autoregression model with nonperforming loans and a set of mac-
roeconomic variables.
Similar models are also common in FSAP missions. For example, the technical note from the Spain FSAP includes an estimate of a
regression explaining nonperforming loans on an aggregate level with nancial sector indicators and a set of macroeconomic indica-
tors (IMF, 2006).
Several issues need to be considered when interpreting the macroeconomic models of credit risk. In par ticular, the literature is domi-
nated by linear statistical models. The linear approximation may be reasonable when shocks are small, but nonlinearities are likely to be
important for large shocks: doubling the size of the shock may more than double its impact. Indeed, microlevel credit risk models often
nd a nonlinear relationship between the scale of shocks and the likelihood of default; for macroeconomic shocks, Drehmann (2005) also
reports a nonlinear link to credit risk. Moreover, the models are subject to the Lucas critique (Lucas, 1976), because their parameters or
functional forms may become unstable, especially if exposed to a major stress. As an extreme example, when considering a scenario that
involves depegging in a country with a currency board regime, models estimated on past data are likely to say very little about the impact
of the exchange rate change on credit risk. In such a situation, other approaches, such as calibration that uses parameters based on experi-
ence from other countries, may be more appropriate.

system characterized by the CAR threshold and the NPL The Credit Risk worksheet contains calculations relating
threshold shown in the figure allows a decrease in the per- to the credit risk of banks, that is, the risk that banks bor-
centage of banks misclassified as failures (i.e., Type II errors) rowers will default on their contractual obligations. Table
from 88 percent (15/17, if we do not have any prior informa- C1 in the worksheet Credit Risk summarizes the reported
tion) to 33 percent (1/3, for the northwest subset identified data for asset quality. Table C2 is used for the credit risk
by the two thresholds). That is a major improvement in fore- stress tests. It includes four different types of credit shocks,
cast precision. labeled 1, 2, 3, and 4.

3. CREDIT RISK A. Credit Shock 1 (adjustment


for underprovisioning)
Lending is the core of the traditional banking business. In
most banking systems, credit risk is the key type of risk. At The purpose of the first part of the credit risk calculation is to
the same time, it is the type of risk where existing models are make the point that stress testing should focus on the under-
most in need of strengthening. lying economic value (net worth) of the bank. The economic
There are three basic groups of approaches to modeling value may differ in general from the banks reported regulatory
credit risk as part of stress tests. First, there are mechanical capital. For example, as part of reported capital, some banks
approaches (typically used if there are insufficient data or if may include items that, in fact, are not capital and should be
shocks are different from past ones). Second, there are ap- treated rather as something else (e.g., long-term loan). Or they
proaches based on loan performance data (e.g., probabilities of can overstate some assets, resulting in overstated capital. Be-
default, losses given default, nonperforming loans, and provi- cause all the stress testing calculations relate to the economic
sions) and regressions (e.g., single equation, structural, and value of the bank, the stress testing analyst needs to first
vector auto regression). Third, there are approaches based on adjust the reported data to get a better picture of the starting
corporate sector data (e.g., leverage or interest coverage) and (baseline) economic situation of the bank. Credit Shock 1
possibly on household sector data (even though such data are shows an example of such an adjustment.11
typically much more difficult to collect than corporate sec-
tor data). 11
In a strict sense, therefore, this is just a starting point adjustment, not a
The exposition in this section and in the accompanying file part of stress tests themselves. In a broader sense, however, it is a stress
starts with the basic mechanical approaches. We then present test that shows how the reported data would change if the reporting
system changed to one that reflected more closely the economic value of
how these can be extended into more realistic approaches. In a bank. Of course, if the reporting system already reflects the economic
particular, Box 3.3 discusses the links between credit risk and value, there is no adjustment, and one can proceed directly to Credit
macroeconomic risk. Shock 2 and beyond.
Martin ihk 29

In Credit Shock 1, we assess what would happen if banks often necessary to resort to simplifying assumptions. As a
corrected their currently insufficient provisioning to fully rule of thumb, using the existing NPLs is correct if the exist-
meet the existing provisioning requirements. As mentioned ing bad loans are a good proxy for the quality of a banks risk
earlier, a BCP assessment suggested that the current loan management and therefore of the risk faced by the bank go-
classification and provisioning standards in Bankistan are ing forward. Conversely, using the existing performing loans
broadly adequate but not well enforced. The regulations pre- can be justified by the fact that performing loans are those
scribe the following loan provisioning rules: 1 percent general loans that may go bad, that is, be shifted into the NPL cat-
provision for pass loans, 3 percent general provision for special egory, and therefore indicate the potential for credit risk. Using
mention loans, 20 percent specific provision for substandard performing loans as a basis may be warranted if there has
loans, 50 percent specific provision for doubtful loans, and been a structural change in the economy (and therefore the
100 percent for loss loans. Reflecting the fact that it is very past NPL ratios are of limited guidance in assessing future
difficult to foreclose collateral in Bankistan, the test assumes credit risks). For example, in a number of emerging markets
that the actual value of the collateral is only 25 percent of in Central and Eastern Europe in the early 2000s, there was
the reported values (i.e., we assume a 75 percent haircut a marked shift from corporate lending to household lending,
on the value of the collateral). with very different qualities and parameters. Using past NPLs
as a basis for the bank-by-bank increases in such a situation
might lead to misleading results.
B. Credit Shock 2 (increase in NPLs)
The importance of the bank-by-bank distribution of NPL
If Credit Shock 1 is a starting point adjustment, then Credit increases can be illustrated in the Credit Risk sheet. For ex-
Shock 2 can be seen as the first real stress test. It models a ample, in the default settings, NPLs increase by 25 percent in
general decline in asset quality, affecting all banks propor- each bank (i.e., cell B46 in the Credit Risk sheet has a value
tionately. It is assumed that NPLs increase by a certain per- of 25, and cells B48 and B49 have the values of 1 and 0, re-
centage, the default values being 25 percent of the existing spectively).12 The total volume of additional NPLs in the
stock of NPLs. This means that a bank would have to under- system (cell B50) is B$2,206 million and the state-owned
take additional provisioning by 25 percent for each of the three banks postshock capital is B$ 437 million (cell C53). If we
groups that constitute NPLs (substandard, doubtful, and loss instead make the increase in NPLs proportional to the exist-
loans). The increased provisioning requirements will reduce ing performing loans (i.e., we make cells B48 and B49 equal
the value of the RWA as well as the capital. As regards the 0 and 1, respectively) and make the overall volume of addi-
impact on the RWA, a common assumption is that the full tional NPLs the same (which we can achieve by using the
increase in NPLs is subtracted from RWA. However, the im- Tools/Goal Seek function, setting the value of B50 back to
pact on RWA may be smaller if the affected assets have a B$2,206 million by changing the values of B46), the increase
weight of less than one in the RWA. Typically, precise infor- in NPLs has to be about 4.3 percent of performing loans,
mation of the distribution of NPLs across risk categories is and the state-owned banks postshock capital is B$ 296 bil-
not available. Nonetheless, a green cell (B40) in the Assump- lion (cell C53), that is, smaller than if the increase in NPLs is
tions worksheet allows the user to change the assumed weight proportional to the stock of NPLs. So, if we are concerned
from 100 percent to a smaller number (say, 80 percent) and about the fiscal costs of the state-owned banks, the distribu-
observe the impact of this assumption on the results. tion of credit risks and buffers is important.
The initial assumption in Credit Shock 2 is that the in-
crease in NPLs in individual banks is proportional to the
C. Credit Shock 3 (sectoral shocks)
existing NPLs in these banks. In other words, banks that had
more NPLs in the past are assumed to have more new NPLs As an illustration of how bank-by-bank credit risk can be
as a result of the shock. Th is is the most straightforward cal- modeled in a more realistic fashion, the stress testing file also
culation, but there are alternative approaches. For example, includes sectoral shocks (see the bottom part of Table C2).
the new NPLs can be proportional to the overall stock of This exercise allows the user to select different shocks to eco-
loans or to the stock of new performing loans. The green cells nomic sectors and observe how each bank would be affected,
in this part of the worksheet allow the relaxation of this as- depending on the relative sizes of the banks credit exposures
sumption and choose the weight of the existing NPLs and to these sectors. The case shown in the fi le as a starting ex-
performing loans in determining the bank-by-bank increases ample models a terrorist attack scenario, increasing credit risk
in NPLs. in the tourism and trade sectors. The calibration of the sec-
Whether to use existing NPLs or existing performing loans toral shocks can be based on a historical scenario (e.g., a con-
as a basis for assessing future credit risk is an open question. crete example of a terrorist attack in Bankistan or in a
It is an empirical question thatif there are sufficient empiri- neighboring country) or on empirical models explaining, based
cal data can and should be decided empirically, by testing on past data, default rates in different sectors as a function of
for the factors explaining bank-by-bank changes in NPLs
(see Box 3.3 for a discussion of this issue). In the absence of 12
These values originate in cells B35, B37, and B38 of the Assumptions
reliable or sufficiently detailed empirical data, however, it is worksheet.
30 Stress Tester

macroeconomic and other explanatory variables. The B43B49 how net interest income will be affected by a given change in
cells in the Assumptions worksheet can then be seen as an interest rates. It sorts assets and liabilities into three time-to-
interface between the econometric model (or historical sce- repricing buckets (due in less than 3 months, due in 3 to 6
nario) and the balance sheet implementation calculated in months, due in 6 to 12 months).13
Stress Tester 3.0. The bottom part of the calculation, in Table D2, shows
The definitions of sectors may be adapted depending on the impact of interest rate changes on the value of bonds held
the country and the analyzed topic. For example, the other by the commercial banks. The calculations assume that the
sector may be broken down into a number of subsectors. Al- bonds are marked-to-market, that is, changes in their mar-
ternatively, instead of using the main economic activity of the ket value have a direct impact on the capitalization of the
counterparty as the defining feature, sectors can be defined by banks. The impact of an interest rate change on the market
the nature of the counterparty. For example, the sectors can value is approximated using the duration of the bonds held
be households (residents/nonresidents), nonfinancial enter- by the banks. The data on duration are given to us by the NBB,
prises (residents/nonresidents), nonbank financial institutions, which calculated it using more detailed data on the parameters
and government (domestic/foreign). of the bonds and the structure of their holdings by banks
The increase in NPLs is assumed to be proportional to the see the formula for duration in the Financial Soundness Indi-
particu lar banks credit exposure to a sector, approximated cators Compilation Guide (IMF, 2004).
by the banks total loans to that sector. Along the lines of the The direct impact of higher nominal interest rates on capi-
discussion in the previous subsection, it is possible to envisage tal and capital adequacy is typically negative, resulting from
that the increases reflect the banks existing NPLs or total the fact that financial institutions operate with a duration gap
loans to each sector and relax this assumption accordingly. between their assets and liabilities. Duration of assets (liabil-
ities), DA (D L ), is defined as the weighted average, term-to-
maturity of an assets (liabilitys) cash flow, the weights being
D. Credit Shock 4 (concentration risk)
the present value of each future cash flow as a percentage of
Stress Tester 3.0 incorporates a block at the end of Table C2 the assets (liabilitys) full price.14 Duration approximates the
that allows testing for the failure of the largest counterparties elasticity of the market values of assets and liabilities to the
of individual banks. The user can change the assumed num- respective rates of return:
ber of failures per institution and the assumed provisioning
 A(rA ) DA rA L(rL ) DA  rL
rate for those failures. If supervisors have data on banks expo-  ,  , (3.1)
A(rA ) (1+ rA ) L(rL ) (1+ rL )
sures to nonbank financial institutions (NBFIs), this type of
test can also be used to model the credit impact on banks of where A(rA) and L(rL ) are market values of assets and liabili-
failures of the largest NBFIs. ties of the financial system, and rA and rL are annual interest
rates of assets and liabilities.15 Differentiating the capital ad-
equacy ratio with respect to the interest rate on assets and
4. INTEREST RATE RISK substituting from equation (3.1), we obtain
The interest rate shock in the Interest Risk worksheet tests
[C(rA ,rL ) / ARW (rA )] (L / ARW )  1+ rA rL 
for direct interest rate risk. Direct interest rate risk is the risk  DA  DL
rA 1+ rA  1+ rL rA 
incurred by a financial institution when the interest rate sen-
sitivities of its assets and liabilities are mismatched. In addi- ARW C
1
tion, the financial institution is also exposed to indirect interest ARW C
 . (3.2)
rate risk, resulting from the impact of interest rate changes A C
1
on borrowers creditworthiness and ability to repay. The indi- A C
rect interest rate risk is a part of credit risk. We discuss how
to account for the interest raterelated credit risk in the sec-
tion devoted to designing scenarios involving several shocks
13
(Section 8). Th is is a crude breakdown; for more precise calculations, more maturity
brackets are used, especially for the very short periods but also for lon-
ger periods.
14
A. Direct interest rate risk See the Financial Soundness Indicators Compilation Guide (IMF, 2004,
paragraph 3.52) for a formula. In practice, the calculation of the dura-
The direct interest rate risk calculation in Stress Tester 3.0 tion of total assets and total liabilities of a financial system is a difficult
computational task, and various simplifications are used (e.g., duration
consists of two parts, reflecting, respectively, flow and stock is computed for groups of assets and liabilities with common features
impacts of interest rate changes. The upper part, in Table D1, and aggregated across such groups; or duration is replaced by residual
works with the repricing gap information from the Data work- maturity and time to repricing).
15
sheet. It calculates the changes in interest income and interest See, for example, Bierwag (1987). The results are first-order approxima-
tions; for large changes in interest rates, second derivative terms need to
expenses resulting from the gap between the flow of inter- be included to account for convexity of portfolios. Alternatively, the
est on the holdings of assets and liabilities in each bucket. elasticity of bond prices to interest rate changes can be empirically esti-
The gap in each time band or time-to-repricing bucket shows mated using past data.
Martin ihk 31

Assuming that the risk-weighted assets move proportionately 5. FOREIGN EXCHANGE RISK
to total assets, that is, ) ARW /A RW = ) A/A, equation (3.2)
can be simplified into The foreign exchange risk is the risk that exchange rate changes
affect the local currency value of financial institutions assets,
[C(rA ,rL ) /ARW (rA )] (L /ARW ) liabilities, and off-balance-sheet items. The foreign exchange
 GAPD , (3.3)
rA 1+ rA risk is composed of three types: the direct solvency risk (re-
where GAPD is the duration gap, defined as16 sulting from banks net open positions in foreign currency
and those in local currency that are indexed to exchange rates);
1+ rA rL the indirect solvency risk (resulting from the impact of foreign
GAPD = DA  DL . (3.4)
1+ rL rA exchange positions taken by borrowers on their creditworthi-
Most financial institutions, and banks in particular, operate ness and ability to repay and thereby on fi nancial institu-
by transforming short-term, low-interest-rate liabilities into tions); and the foreign exchange liquidity risk (resulting from
long-term, higher-interest-rate assets. This means that DA > DL, liquidity mismatches in foreign currency). In this section, we
rA > rL, and GAP D > 0. Thus, an increase in interest rates has a will focus on the direct solvency risk, and we will discuss
negative impact on the institutions net worth and capitaliza- implementation of the indirect solvency risk; we relegate the
tion, leading to increased financial sector vulnerability. foreign exchange liquidity risk to the section dealing with the
In the Bankistan example illustrated in Stress Tester 3.0, liquidity stress test.18
only two bonds are available to banks. Both of them are The foreign exchange shock in the FX Risk worksheet is
government-issued bonds. The Assumptions worksheet shows composed of two parts. The first part, shown in Table E1, tests
the key parameters of these bonds (in rows 5759) and calcu- direct foreign exchange rate risk. The second part, shown in
lates their duration, using the Duration function in Excel Table E2, shows the impact of the change in the nominal ex-
(see cells H58 and H59).17 change rate on banks through changes in the credit risk.

B. Indirect interest rate risk A. Direct foreign exchange risk

The indirect effects, related to the interest-risk nexus, work Table E1 in the FX Risk worksheet tests direct foreign exchange
in the same direction. An increase in nominal interest rates rate risk based on the net open position in foreign exchange
to the extent that it increases real interest rates and makes it at end-2010. This figure is calculated by the NBB, using the
more difficult for borrowers to repay their debts and to obtain methodology described in the Financial Soundness Indicators
new creditis likely to have a negative effect on the credit Compilation Guide (IMF, 2004), and is copied to Table E1
risk of the financial institutions borrowers. Other things be- using a link to the Data worksheet.
ing equal, higher risk eventually translates into higher losses The direct exchange rate risk can be assessed using the net
and a decline in the financial institutions net worth. The open position in foreign exchange, one of the core FSIs,
exact impact depends on factors such as the borrowers earn- defined in IMF (2004). The direct exchange rate risk is argu-
ings in relation to interest and principal expenses, loan loss ably the easiest part of stress tests to implement. To illustrate
provisions, and the degree of collateralization of the loans. this test, let F denote the net open position in foreign exchange,
Country case studies find a positive relationship between higher C the capital, A RW the risk-weighted assets (all in domestic
interest rates and nonperforming loans or loan losses. currency units), and e the exchange rate in units of foreign
The basic calculation does not cover the impact of nomi- currency per unit of domestic currency. A depreciation (de-
nal interest rate changes on real interest rates and thereby on cline) in the exchange rate leads to a proportional decline in
borrowers creditworthiness and ability to repay. The impact the domestic currency value of the net open position, that is,
size depends mostly on the corporate sectors leverage and ) e/e = )F/F (for F | 0). Let us assume that this translates
exposure to the real estate market (which is also likely to be directly into a decline in capital, that is, )C/)F = 1.19 The
influenced by changes in interest rates). In order to assess this impact of the exchange rate shock on the ratio of capital to
type of risk, one would usually need to estimate the impact of risk-weighted assets would then be
changes in interest rates on nonperforming loans, using a re- F  ARW F
[C(e)/ARW (e)] ARW  C
gression model. In our example, the joint impact of changes  e C e
in interest rates and in credit quality can be simulated using e ARW 2
the worksheet Scenarios. 1 F C   ARW C 
  1  C A  , (3.5)
e c ARW RW

16 18
If the interest rates for assets and liabilities move simultaneously, the The direct and indirect solvency risks in foreign exchange are often also
duration gap can be approximated as a difference of the two durations, referred to as exchange rate risks.
DA  DL . 19
An alternative, and arguably more realistic, approach is to deduct the
17
Excel also has a Price function, which can also be used to implement impact first from profits (if any) and then from capital. See Section 1 for
this calculation. a more detailed discussion of this issue.
32 Stress Tester

which uses the fact that )C/)e = )F/)e = F/e. The symbol % repay of the corporate sector. A change in the exchange rate
means that the equation is only approximate for larger than influences the corporate sector in two main ways: first, it
infinitesimal changes. Equation (3.1) can be rewritten as changes its competitiveness relative to the foreign corporate
sector; second, it influences the corporate balance sheets
e F C  ARW C 
[C(e)/ARW (e)]   1  C A  . (3.6) directly via fi rms net open positions in foreign currencies
e C ARW RW
(for instance, companies can borrow massively in foreign
The term ) A RW /)C can have values from 0 to 1, reflecting currencies).
the degree of co-movement of capital and the risk-weighted The indirect foreign exchange risk seems to be very impor-
assets.20 In the special case of ) ARW /)C = 0, that is, if the tant. FSAP missions generally have not been able to collect
risk-weighted assets do not change, the change in the capital comprehensive data on the corporate sectors foreign exchange
adequacy ratio equals the exchange rate shock times the ex- exposure, but those FSAP missions that analyzed the corpo-
posure, measured as a product of the net open position to rate sector in detail generally found that the banking sectors
capital (F/C) and capital adequacy (C/A RW ), both of which indirect exchange rate risk was more important than its di-
are core FSIs as defined by IMF (2004). This is sometimes rect one. The indirect foreign exchange rate risk appears to
used as a shorthand calculation of the direct exchange rate be particularly substantial in countries with closely managed
stress test. It should be noted that equation (3.6) holds only exchange rate pegs.
as a linear approximation, which works well in nonsophisti- To illustrate the significance of the indirect risk in overall
cated financial systems. However, if financial institutions banking sector risk, let us denote the corporate sectors debt,
have large positions in foreign exchange options, the rela- equity, and open foreign exchange position as Dc(e), Ec(e),
tionship between the exchange rate change and the impact and Fc(e), respectively.22 Let us assume that, similar to the
on capital can become highly nonlinear. In such cases, stress case of banks net open position, a percentage change in the
tests based on detailed decomposition of financial institu- exchange rate will translate into the same percentage change
tions open positions are a superior analytical tool.21 in the domestic currency value of the net open position,
In Stress Tester 3.0, a depreciation of the Bankistan dol- which will in turn lead to an equivalent change in the corpo-
lar against the U.S. dollar from the official exchange rate of rate sectors equity, that is, )Ec/)e = )Fc/)e = F/e. The impact
55 B$/US$ to the currently prevailing parallel market rate of of the exchange rate on the corporate leverage (Dc/Ec) is then
85 B$/US$ is assumed (at constant cross-exchange rates to given by
the U.S. dollar). Information on the banks foreign exchange
Dc Fc F
exposure is provided in Table E1. A depreciation will benefit Ec  Dc c
[Dc (e)/Ec (e)] Ec e e 1 Fc  Dc Dc 
banks that have a long (positive) open position in foreign    . (3.7)
e Ec 2 e Ec  Ec Ec 
currency and hurt banks that have a short (negative) position
in foreign currency. Thus, if the corporate sector is short in foreign exchange, a
Only a very limited number of banks have short positions; depreciation (decline) in the exchange rate would lead to an
therefore, the direct depreciation effects are very smallsome increase in its leverage. Corporate leverage typically is posi-
banks would even gain from a depreciation. Given that most tively correlated with the share of banks nonperforming loans
central banks impose limits on foreign exchange positions to in total loans (denoted as NPL/TL), that is, )(NPL/TL)/)(Dc /
capital, this result is not unusual. For most banking systems, Ec) = a > 0.23 The impact of a change in the exchange rate on
the direct foreign exchange solvency risk is rather small. Banks the NPL/TL ratio can then be expressed as
net open positions in foreign exchange are typically under close
(NPL/TL)  a[Dc (e) /Ec (e)]
scrutiny from banks risk managers and supervisors. Banks in
some countries have explicit limits on these positions as a per- e Fc  Dc Dc 
  a  . (3.8)
centage of the banks capital (the ceilings typically being in the e Ec  Ec Ec 
range of 1020 percent of capital). In other countries, this is
In the special case when )Dc /)Ec = 0, the change in the
addressed by including the net open positions in the capital
NPL/TL ratio would equal the exchange rate change times
adequacy calculation. In general, the open positions tend to be
the respective FSI (the net open position), times the pa ram-
rather small, and consequently the direct impact of an exchange
eter a, which can be estimated empirically, as shown, for
rate depreciation (or appreciation) tends to be rather small.
example, in IMF (2003) or Boss and others (2004). To find
the impact on capital adequacy, we can assume, as has been
B. Indirect foreign exchange risk
Besides direct depreciation effects, a change in the exchange 22
Given the practical difficulties involved in obtaining empirical data on
rate would also influence the creditworthiness and ability to open positions in the household sector, we refer here for simplicity only
to the corporate sector, even though the theoretical analysis would be
essentially the same even if we included the household sector.
20
Empirically, ) A RW /)C could be estimated by a regression. 23
IMF (2003) shows that for a panel of 47 countries, a 10 percentage
21
As a general point, stress tests should include all relevant off-balance- point rise in the corporate leverage was associated with a 1.1 percentage
sheet items. point rise in the ratio of NPLs to total loans after a one-year lag.
Martin ihk 33

done in some FSAP missions, that the credit shock moves the Interbank worksheet, which presents a basic calculation
some of the previously performing loans into the nonper- of the interbank contagion risk.24
forming category. By differentiating C/A RW with respect to In this section, we focus on contagion through insolven-
NPL/TL, and substituting for NPL/TL from equation (3.8), cies. There is also, potentially very important, the risk of li-
we obtain quidity contagion through bank runs triggered by a run on
another bank. A basic model of liquidity contagion is shown
e TL  C ARW  as part of the liquidity risk (Section 7). The principle of hav-
(C /ARW )  1
e ARW  A RW C
ing a matrix of bank-to-bank exposures is the same in all
Fc  Dc Dc  the contagion tests, but the specification of the matrix is dif-
 a  , (3.9)
Ec  Ec Ec
ferent for a liquidity test.
We focus here on contagion within the (domestic) bank-
where we assume (as several FSAP missions have done) that ing system. The Bankistan banking system includes foreign-
provisions are expressed as a fi xed percentage (U) of non- owned banks, but we do not study cross-border exposures
performing loans and that they are deducted directly from and cross-border contagion. In principle, the same frame-
capital. work would have to be applied, but the definition of system
The incorporation of the indirect effect makes the analy- would have to be wider to include the foreign banks. For
sis of foreign exchange rate risk more complex and depen- simplicity (and because obtaining good bank-by-bank data
dent on additional assumptions or regression analysis. One on cross-border exposures is not trivial in practice), we focus
of the reasons adding to the complexity of the indirect ex- here on interbank exposures in the domestic market. We
change rate stress test is the fact that it includes the effects have to be at least aware, however, that in addition to the
on stocks as well as on flows. The calculation of the indirect domestic exposures, there may also be important cross-border
effect as per equation (3.9) would need to reflect the impact exposures and the related risk of contagion.
of exchange rate changes on the net present value of the The upper panel in the Interbank worksheet (Table F1)
corporate sector, which means to take into account changes derives a matrix of interbank exposures for the banks in
in the net present value of future earnings. For example, in Bankistan. The first panel shows the matrix of net interbank
export-oriented companies, a depreciation could be expected credits, in which each cell shows, for the bank in the column
generally to increase their future earnings. In terms of the (i.e., for the bank listed in the same column in row 4), its net
net present value, the effect would be essentially equivalent credit to the bank in the row (i.e., the bank listed in the same
to the impact of a long position in foreign currency. How- row in column A). For example, the value of 70 in cell I11
ever, it may be more practical to calculate the impact on means that the bank in column I (i.e., DB1) has an outstand-
flows, by estimating the elasticity of earnings to interest and ing net credit to the bank in row 11 (i.e., SB2) in the amount
principal expenses (an encouraged FSI) with respect to the of B$70 million. A corresponding entry of 70 in cell G13
exchange rate and then to estimate the relationship between confirms this by showing that the bank in column G (i.e.,
this FSI and the NPL/TL ratio. Alternatively, it would be SB2) has an outstanding negative net credit of B$70 million
useful to compile an indicator mea suring the corporate sec- to the bank in row 13 (i.e., DB1), that is, it has a net borrow-
tors flow exposure, for example, a ratio of foreign exchange ing of the same amount. The matrix is obtained by netting
earnings to total earnings or (ideally) a ratio of earnings in out the gross figures in the interbank lending table reported
foreign exchange to interest and principal expenses in for- in the Data worksheet, that is, reported by the NBB. In this
eign exchange. matrix, positive figures mean that the bank in the column is
Table E2 in the FX Risk worksheet shows the impact of a net creditor of the bank in the row, whereas negative figures
the change in the nominal exchange rate on banks through mean that the bank in the column is a net borrower of the
changes in the credit risk. The impact is approximated here bank in the row. The diagonal cells are left empty, because
by assuming that the change in the NPLs is proportional to the focus of this exercise is on exposures between each bank
the volume of foreign exchange loans in a bank. The idea and the other banks.
behind this assumption is that a depreciation would increase To facilitate further calculation, the matrix of net interbank
the domestic currency value of these loans, which would make credit is converted into the matrix of net interbank expo-
it more difficult for the borrowers to repayfor example, be- sures. This is done by stripping the matrix of net creditors
cause some of the loans are extended to borrowers with lim- by focusing on the positive numbers (because those are the
ited access to foreign currency. banks exposed to interbank credit risk). The other cells in the

6. INTERBANK SOLVENCY 24
In a real stress testing exercise, we would have to start from the very
beginning with balance sheets that include the interbank exposures.
CONTAGION RISK Th is would make the aggregation of the bank-by-bank data more cum-
bersome (we would have to net out the bank-to-bank exposures). For
We have so far assumed that there is no contagion among simplicity, this exercise starts without the interbank exposures, which
banks in the event of a failure. This assumption is relaxed in are added only later.
34 Stress Tester

table are left empty. For example, the value of 70 in cell I26 had substantial net credit outstanding with respect to DB1 or
means that the bank in column I (i.e., DB1) has an outstand- DB2. However, as illustrated in rows 73113, this is not the
ing net exposure to the bank in row 26 (i.e., SB2) in the amount case: the banks that are creditors to SB3 and DB1 have expo-
of B$70 million. The corresponding cell, G28, is empty: the sures to SB3 and DB1 that are well below their capital.
bank in column G (i.e., SB2) has no net exposure to the bank Rows 73 85 start the second iteration by inverting the
in row 28 (i.e., DB1), because SB2 is a net borrower with table of the failed banks from the first iteration. This is to
respect to DB1 and therefore has no direct credit exposure illustrate that in the second iteration, the banks that were
to DB1. exposed to contagion in the first iteration become the source
of further contagion.25 Rows 8899 show the capital after the
second iteration, which generally equals the capital after
A. Pure interbank contagion
the first iteration, but for failures in SB1, SB2, FB1, and FB3
The middle panel in the Interbank worksheet (Table F2) pro- (i.e., in rows 88, 89, 96, and 98), the second iteration capital
vides a calculation of the pure interbank contagion exercise. of the bank in the column is lowered by the amount of expo-
The exercise shows what would happen with the capital of the sure of this bank to the bank that failed in the first round.
bank in the column if the bank in the row failed and defaulted This is highlighted in rows 101112, which show the change
on all its interbank borrowing. This is actually a series of 12 in capital between the first and second iterations: capital is
separate stress tests, one in each row, showing for each bank lower for stress tests in rows 101, 102, 109, and 111, because
what would be the direct impact of its failure on the capital of the corresponding banks (SB1, SB2, FB1, and FB3) cause
each of the other banks. The stress test is run in several itera- additional bank failures in the second iteration.
tions, as the contagion-induced failures (first iteration) can Rows 115126 show that the third iteration is not needed
induce failures in other banks (second iteration), which can in this case, as none of the banks are affected enough to fail
lead to further failures (third iteration), and so on. in the second round. If such failure occurred, the third
The first part of Table F2 shows, in each row, the post- round (and any subsequent round) could be implemented in
shock capital of the individual banks in the column after the the same way as the second round.
assumed failure of the bank in the row. For example, row 49 To present the results in terms of capital adequacy, the
shows in columns F to Q what would be the postshock capi- worksheet uses an assumption on the risk weight of the in-
tal of banks SB1 to FB4 if bank SB3 failed. The results in terbank loans that become unpaid. Reflecting the typical
row 49 suggest that none of the banks would have a negative Basel weight for interbank loans, this assumption is set at 20
postshock capital as a direct result of SB3s failure. percent but can be changed by changing the value of the
The next part of Table F2 shows which banks fail as a B77 cell in the Assumptions worksheet.
result of the first iteration (1 denotes a newly failed bank; The pure interbank contagion test could be interpreted
all others have zeros). The table shows that two banks would as a measure of systemic importance of individual banks: the
fail as a result of failures in other banks, namely, that DB1 bigger the decline in the systems capital (or capital adequacy
can fail as a result of failures in SB2 or FB3 (see cells I62 and ratio), the more systemically important is the bank whose
I71) and DB2 can fail as a result of failures in SB1, SB2, FB1, default is assumed. In our example, FB2 is the systemically
and FB3 (see cells J61, J62, J69, and J71). most important bank, using this criterion, because assuming
We are assuming for simplicity that if a banks capital stays its failure yields the lowest postshock systemic capital (B$3,570
positive after an iteration, the bank does not fail and remains million in the cell B138) and postcontagion CAR (9.7 percent
able to repay all its interbank obligations; if its capital becomes in the cell B152). This test (or rather set of tests) is useful, but
negative, it fails and does not repay its obligations. The calcula- it does not take into account the different likelihood of failures
tion can be made more realistic by estimating a more complex in different banks, an issue that is addressed by the macro
mapping between the capital adequacy ratio and the banks interbank contagion test.26
probability of failure (rows 6 and 22 in the Assumptions work-
sheet contain an example of such a mapping). Such mapping is
25
likely to indicate a wider scope for interbank contagion than The calculation can be implemented without the inversion, but invert-
ing makes calculations easier, because one can use the SUMPRODUCT
the introductory calculation presented here; however, the cal- function. Also, the inversion highlights the nature of the calculation: in
culations would be based on similar techniques. the second iteration, we look at the failed creditors from the previous
To keep the calculations straightforward, we assume here iteration and analyze who are their creditors. Given that the exposure
that the impact of shocks is deducted directly from capital. table has creditors in columns and borrowers in rows, going from the
first iteration to the second one requires inverting either the matrix of
It is not complicated, however, to extend the file to take into exposures or the table with results from the first iteration. In this imple-
account banks profits. mentation, we chose the latter approach.
The second iteration needs to be calculated only for the 26
Pure interbank contagion tests are more common in the literature. For
failures in SB1, SB2, FB1, and FB3, because these are the only example, Sveriges Riksbank presents its results regularly in its Financial
Stability Report (for the methodology, see Blvarg and Niemander 2002).
banks whose failures lead to failures in other banks (namely, Macro interbank contagion tests are less common but are presented for
DB1 or DB2). The failures in DB1 and DB2 could lead, in the example by Elsinger, Lehar, and Summer (2003) for Austria and by
second iteration, to failures in other banks if the other banks ihk, Hemnek, and Hlavek (2007) for the Czech Republic.
Martin ihk 35

Aggregate Impact on Failure of Matrix of


stress test each banks individual interbank
shock capital ratio banks exposures

Aggregate Additional
impacts for bank failures
stress test triggered by
output contagion
Source: Author.

Figure 3.4 Macro Interbank Contagion

B. Macro interbank contagion banks (perhaps more than one) fail. For the default settings
for Bankistan, for example, the first iteration of the macro
The lower table in the Interbank worksheet (Table F3) shows contagion test involves a simultaneous failure of two banks
a macro interbank contagion test. In this case, we model (SB2 and SB3), resulting in a second-iteration failure of three
the case when bank failures are triggered by macroeconomic other banks (SB1, DB1, and DB2), leading to a third-iteration
developments, in particular by the scenario that is already failure of DB4. The process stops at the third iteration, which
modeled in the Scenario sheet (Figure 3.4). The starting point does not lead to additional failures.
for the macro interbank contagion is therefore the postshock
values of capital and risk-weighted assets for each bank from
the Scenarios sheet.27 For the failed banks (SB2 and SB3 for
the default settings in the spreadsheet), we run an interbank 7. LIQUIDITY TESTS AND
contagion exercise using the matrix of net interbank expo- LIQUIDITY CONTAGION
sures. Then we search for banks that fail in this first iteration. Testing for liquidity risks is less common than testing for
If there were no new failures, the contagion exercise would risks to solvency in central banks stability reports and in
stop here. In our example, however, there are three new fail- IMF work. This mostly reflects the fact that modeling liquid-
ures: SB1, DB1, and DB2. We therefore run a second itera- ity risks is more complex. First, to properly model liquidity
tion, looking at the impact of these additional failures on fluctuations in banks, one needs to have very detailed, high-
other banks. We find that they lead to one additional fail- frequency data, such that are typically used by commercial
ure, namely, in DB4. If this failure led to other new failures, banks themselves in their liquidity management models.
we would need to run a fourth iteration. However, in this Second, to model the impact of large liquidity shocks, one
particu lar case, the contagion-induced failure of DB4 does
needs to consider the broader liquidity management frame-
not lead to other failures, and the process stops at the third
work, in particular the lender-of-last-resort function of many
iteration.
central banks.
What is the key difference between the pure and the At the same time, testing for liquidity risks is important.
macro contagion tests? The pure contagion test assumes In the last two decades, much of the attention in risk man-
that a failure occurs in a single bank, for example, for some agement and prudential supervision was on capital, partly
internal reason (e.g., because of a large fraud in the bank); it in relation to the efforts to standardize capital adequacy re-
does not distinguish the relative likelihood of the failure of quirements across countries. In the process, relatively less
various banks. This is what the macro contagion test does. attention has been paid to cash flows and analysis of liquid-
It analyzes situations when all banks are weakened at the ity (e.g., Goodhart, 2006). Analyzing the response of liquid-
same time by a common external (typically macroeconomic) ity to stress is an important undertaking, because liquidity
shock, which affects each bank differently depending on its
is how a stressful situation often manifests itself in the
exposures to the various risk factors and makes some of the
short run.
The presentation of the stress test impact is different from
27
The calculations in the Scenarios sheet disregarded these contagion ef-
the solvency tests discussed so far. The impact is shown for each
fects, so the calculation in Table F3 of the Interbank sheet can be seen bank in terms of the number of days it would be able to sur-
as an extension of the calculation in the Scenarios sheet. vive a liquidity drain without resorting to liquidity from outside
36 Stress Tester

2500
Basic liquidity test (proportional withdrawals)
2000

Liquidity available (B$ million)


1500

1000 Day 1
500 Day 2
Day 3
0
Day 4
500 SB1 SB2 SB3 DB1 DB2 DB3 DB4 DB5 FB1 FB2 FB3 FB4
Day 5
1000

1500

2000

1000
Flight to safety/contagion test
0
Liquidity available (B$ million)

SB1 SB2 SB3 DB1 DB2 DB3 DB4 DB5 FB1 FB2 FB3 FB4
1000
Day 1
2000 Day 2
Day 3
3000
Day 4
4000 Day 5

5000

6000
Source: Authors calculations, using Stress Tester 3.0.

Figure 3.5 Results of Liquidity Stress Tests

(i.e., from other banks or the central bank).28 This is a relatively Table G2 models liquidity contagion, where the liquidity
narrow approach to liquidity stress testing, but it is one that drain starts in the smallest or weakest banks and proceeds to
allows for an introductory exposition without going into the larger or stronger banks. The test allows for three possi-
details. ble mea sures of bank safety: (1) total assets; (2) total assets,
The Stress Tester 3.0 file contains two basic examples of with a premium for state ownership; and (3) preshock rating.
liquidity tests. The Liquidity worksheet contains these two ex- In the first case, depositors perceive bank safety as linked to
amples in two tables. Figure 3.5 shows the results of these two the size of the bank, approximated by total assets. In the sec-
tests for the default values contained in the spreadsheet. ond case, they also perceive state-owned banks as being safer
Table G1 models a liquidity drain that affects all banks in than privately owned banks (because of an explicit or implicit
the system proportionally to their volumes of demand and government guarantee in the former case). In the third case,
time deposits. The worksheet allows the user to change as- depositors perceptions of bank safety are correlated with the
sumptions on the percentage of demand deposits and time banks recent financial performance.30 Table G2 also com-
deposits that get withdrawn each day and on the percentage bines the liquidity impact of government default with a bank
of liquid assets and other assets that banks can convert to run. It allows users to change the assumption on the percent-
cash each day.29 age of the government bonds that are in default.

28
As a rule of thumb, supervisors often see five days as an important thresh-
8. SCENARIOS
old for a banks ability to withstand a liquidity run. After five days or The Scenarios worksheet illustrates, in Tables H1H4, how
less, banks are likely to close for a weekend or a holiday, providing some
breathing time for bank management and supervisors to regroup, assess
shocks to the various risk factors can be combined into a
the situation, and decide on mea sures and public announcements to
30
make. Th is rule of thumb has been partly diluted with the growth of Liquidity contagion can also be thought of in terms of a similar expo-
direct banking. sure matrix as used in the solvency contagion, except that instead of net
29
Another useful distinction in many cases is between domestic and foreign uncollateralized interbank exposures, the value of the cell in the matrix
exchange deposits (and assets). It is possible to extend the fi le to assume for liquidity contagion would be the difference between bank is and bank
different withdrawal rates by currency of denomination. js mea sure of bank safety.
Martin ihk 37

single scenario. The main reason for using scenarios rather 25


than single-factor shocks is that in the macroeconomic con-
20
text, changes in several risk factors are typically interrelated.
For example, a large increase in nominal interest rates can

Capital adequacy ratio (%)


15
lead to an increase in real interest rates, which can (perhaps
with a lag) contribute to an increase in NPLs. If this is the 10
case, banks will be hit not only by the direct impact of the 5
nominal increase in interest rates but also by the indirect
impact through credit risk. 0
The purpose of this worksheet is for the users to see how 5
different combinations of the shocks affect the capital ade-
quacy of the system. For simplicity of presentation, the work- 10
sheet contains only formulas linked to the other worksheets,
15
namely, Credit Risk for credit risk, Interest Risk for the in-

All

SBs

DBs

FBs
terest rate risk, FX Risk for the direct and indirect foreign
exchange solvency risk, Interbank for interbank contagion,
40
and Liquidity for liquidity risk. When a number of different
30
specifications of a stress test are available, Stress Tester 3.0

Capital adequacy ratio (%)


allows the user to specify which of the alternative specifi- 20
cations is being considered in the overall scenario. These 10
choices are assumptions that can be made in cells B69B75 0
of the Assumptions worksheet (a summary of the chosen 10
scenario is then shown on top of Table H in the Scenarios 20
worksheet). 30
The Scenarios worksheet adds up the impacts of the se-
40
lected shocks to arrive at an aggregate impact. Two issues are
50
important in considering whether the impacts can be added
SB1

SB2

SB3

DB1

DB2

DB3

DB4

DB5

FB1

FB2

FB3

FB4
up. First, the calculations need to take into account concen-
tration of risks in institutions. Simply adding up aggregate Baseline Aftershocks Aftershocks and contagion
losses caused by individual shocks could overlook situations
when risks are concentrated in an institution or a group of Source: Stress Tester 3.0.xls, Assumptions worksheet, based on default values of
shocks and assumptions.
institutions. Stress Tester 3.0 addresses this issue by calculat-
ing the impacts bank by bank. This allows us to see whether Figure 3.6 Impact of Stress on Capital Adequacy Ratios
some banks are hit by the selected combination of shocks
much harder than others (indeed, they are). Second, it is not
trivial to combine solvency and liquidity risks. Stress Tester indicates values after the shocks and after taking into ac-
3.0 illustrates how this can be done. It uses the NBBs super- count the subsequent contagion among banks. The preshock
visory early-warning system to combine the changes in sol- (baseline) CAR values are taken from the Data worksheet,
vency and liquidity (and other measures) to identify the whereas the values corresponding to the stressful scenario are
change in the supervisory rating and the implied change in taken from the Scenarios worksheet.
probability of default. There are some limitations to this ap- The worksheet also compares the overall impact with the
proach (in particular, the PDs cannot be easily aggregated for banks profits. Although we have so far assumed that the im-
the system as a whole), but it provides a useful illustration. pacts are deducted directly from capital, in reality banks could
As a basic presentational approach, the Scenarios work- use profits as their first line of defense. Table H in the Scenar-
sheet shows the impacts of the scenarios in terms of the capi- ios worksheet shows for comparison, for each bank, what its
tal adequacy and decomposes the overall impact into the profits were in the past. It also allows the user to assume (in
individual risk factors (in percentage points of the CAR ra- the appropriate green cell) an autonomous shock to net inter-
tio). The charts in the Assumptions worksheet allow the user est income.
to immediately and graphically see the results of the various
assumptions on the outcome in terms of changes in capital
A. Designing consistent scenarios
adequacy ratios. For illustration, we reproduce these charts
here as Figure 3.6. The values shown in these charts represent How can one design consistent scenarios?31 In general, there
the default sizes of shocks and starting assumptions in the are two ways of asking questions about exposures in the
accompanying fi le. Dark blue indicates the baseline (pre- fi nancial system. The fi rst way is to ask, for a given level of
shock) values of the capital adequacy ratio, medium blue
indicates the corresponding postshock values, and light blue 31
For more details, see ihk (2004, 2005).
38 Stress Tester

CAR = 0% Shock to risk


factor 2
CAR = 8%

CAR = 10%

B
C
Shock to risk
factor 1

CAR = 0%

CAR = 8%
p = 1%
p = 5% CAR = 10%
p = 2%

Source: Author.

Figure 3.7 Worst Case Approach versus Threshold Approach

plausibility, which scenario has the worst impact on the sys- shocks with this level of plausibility that have the worst im-
tem (the worst case approach). The second way is to ask, for pact on the portfolio. Th is means searching for the point
a given impact on the system, what is the most plausible com- on the largest ellipse that lies as far northeast as possible. In
bination of shocks that would need to occur to have that Figure 3.7, this is point A.
impact (threshold approach). In Stress Tester, the threshold The threshold approach starts with selecting the threshold,
approach, also called reverse stress testing, is illustrated in that is, the diagonal line; it then searches for the most plau-
the Reverse worksheet. sible (i.e., smallest) shocks reaching this threshold. Th is is
Figure 3.7 shows the process of scenario selection under straightforward if there is only one risk factor; if there are
the worst case approach and the threshold approach, for a two risk factors, one needs to take into account the correlation
simplified case when there are only two risk factors (e.g., between the risk factors. For the specific correlation pattern
changes in interest rates and exchange rates). Each ellipse in Figure 3.7, selecting a threshold of zero capital adequacy
depicts the set of combinations of the two risk factors with would lead again to the combination of shocks correspond-
the same probability of occurrence. The shape of the ellipse ing to point A.
represents the correlation between the two factors, and its Establishing the plausibility level of a scenario can be dif-
size represents the level of plausibility (the larger the ellipse, ficult in practice, given that the scenario should be a low-
the smaller the plausibility). The diagonal lines depict com- probability tail event. For risk factors with good time series
binations of the risk factors leading to the same overall im- of historical data (in particular, for market risks), the natural
pact, mea sured here by a change in the systems CAR. The starting point is to base the scenarios on the past volatility
impact increases with the size of the shocks to the risk fac- and covariance patterns. Calibrating the shocks is particularly
tors, so the CAR decreases in the northeast direction. The straightforward for single-factor stress tests: an exchange rate
diagonal lines do not have to be straight; they are depicted shock can be based on 3 standard deviations of past exchange
here as such only for simplicity. Figure 3.7 illustrates that rate changes (corresponding roughly to a 1 percent confi-
the worst case approach and the threshold approach are dence level). With multiple risk factors, one needs also to
two essentially equivalent ways of analyzing the same look at the covariance statistics of the variables or use sto-
problem.32 chastic simulations based on macroeconomic models. Such
The worst case approach starts with selecting a level of plau- calculations are subject to a number of caveats. In particular,
sibility (e.g., 1 percent) and searching for the combination of models can break down for large shocks. Nonetheless, the
models, if used cautiously, can help to find a first-cut ap-
32
To some readers, these two approaches may resemble the dual tasks of proximation of stress test scenarios (see Box 3.4 for an addi-
microeconomics. tional discussion of choosing the right scenario).
Martin ihk 39

Box 3.4. Picking the Right Scenario

In discussions on designing stress tests, too much is often made of establishing the right scenario. Of course, it is important, at least in
theory, for scenarios to be internally consistent, as highlighted, for example, by Jones, Hilbers, and Slack (2004) or by Figure 3.7 in this chap-
ter. In practice, assessing such consistency is tricky, because the scenarios are also supposed to be exceptional (but plausible).
How to address this challenge? One approach is to choose a concrete extreme historical scenario (e.g., the East Asian crisis of 1997) and
calculate what would be the impact of repeating such a scenario (or an adaptation of such scenario) in the present situation of the banking
system. The main advantage is that historical scenarios are easy to communicate and to implement. Also, they are plausible, because such
a situation actually happened. Their main disadvantage is that past crises may not be good models for future crises. Also, the probability
level of the past historical scenario may be unclear.
Another approach, used by some FSAPs and central bank FSRs, is to use an existing macroeconomic model (e.g., a model used by the
central bank for macroeconomic forecasts and policy analysis) as a basis for stochastic simulations showing the distribution of the key risk
factors in the case of shocks to the models exogenous variables. The challenge of this approach often arises from the fact that such mac-
roeconomic models typically do not include a measure of credit risk (e.g., nonperforming loans to total loans or another measure of asset
quality). Therefore, this approach usually involves estimating a satellite model that links a measure of credit risk to the variables from the
macroeconomic model. Unlike the macroeconomic model, the satellite model can be estimated (and generally should be, if adequate data
are available) on individual bank (and even individual borrower) data. The estimates from the satellite model can then be used for the bal-
ance sheet implementation.
Yet another, and perhaps more direct, approach can be to plot the existing observations of the various risk factors (in a similar fash-
ion as shown, for two risk factors, in Figure 3.7) against a measure of soundness (e.g., capital adequacy ratio) and use this to identify the
most stressful combinations of risk factors (in terms of Figure 3.7, this would mean identifying the points lying the most toward the
northeast).
In sum, there is a range of methods, each with its advantages and disadvantages. Picking a scenario that is stressful and tells an interest-
ing and consistent story is important. However, in most cases, identifying the right scenario is close to impossible. Much more important
than ne-tuning scenarios is (1) being transparent about the underlying assumptions of the scenarios; (2) being transparent about the
sensitivity of the results to those assumptions; and (3) showing how results with the same assumptions change over time. Showing results
over time allows making judgments about the developments in the overall pool of risks and in the structure of risks faced by a nancial
system.

B. Linking stress tests to rankings and and light blue indicates the corresponding values in situations
probabilities of default of stress. The values of the baseline are taken from the Data
worksheet, whereas the values corresponding to the stressful
The Scenarios sheet also illustrates the links between the scenario are taken from the Scenarios worksheet. The values
stress tests and the supervisory early-warning system. It fol- shown in the charts reproduced here reflect the default sizes
lows the same approach as the illustration shown in the Data of shocks and starting assumptions in the accompanying file.
worksheet, but it is derived from the bank-by-bank data after Figure 3.10 shows another form of presentation of stress
the shocks rather than those before the shocks. Specifically, testing results. It captures the impact of stress on the banks
Table H2 provides the postshock FSIs and other ratios for z-scores. As indicated earlier, the z-score has become a pop-
individual banks. These can be compared with the corre-
ular measure of bank soundness, because it is directly related
sponding preshock ratios, shown in Table A3 (in the Data to the probability of a banks insolvency. Figure 3.10 illustrates
worksheet). how the banks z-scores decline as a result of the assumed
Table H3 converts these ratios into postshock ratings of impacts, generally mirroring the decline in banks probabili-
the individual banks, using the same step functions that ties of default, shown in Figure 3.9 (one needs to bear in mind
were applied in Table A5 to the preshock ratios. In both cases, that higher z-scores correspond to lower probabilities of
the step function reflects the off-site supervisory assessment default). If the user changes the key sizes of shocks and as-
model and is specified in the Assumptions worksheet (rows sumptions in the accompanying Excel file, the charts in the
322). Table H3 also provides averages (weighted by banks file will change automatically.
total assets) for the three peer groups and for the banking
system as a whole.
Table H4 converts the postshock ratings into postshock
C. Modeling the feedback eects
probabilities of default for each bank. These can be compared
with the preshock probabilities of default, shown in Table The stress test calculations presented here focus on the im-
A6 in the Data worksheet. pacts of shocks arising from the macroeconomic environment
The charts in the Assumptions worksheet, reproducedinthis and affecting the financial sector. From a macroeconomic
chapter as Figure 3.8 and Figure 3.9, illustrate such compari- perspective, an important issue is whether the shocks in the
sons. Dark blue indicates the baseline values of the indicators financial sector can have feedback effects affecting the macro-
(ratings in Figure 3.8 and probabilities of default in Figure 3.9), economic environment.
40 Stress Tester

4 The practical problem in modeling the feedback effects is


that there are too many. One direct effect that can be incor-
porated easily into the financial programming framework
employed by the IMF is an impact on capital on Other Items
3
Average rating

Net in the monetary survey and thereby on other macro-


economic variables.
However, this is just one of many potential impacts. In
2 some cases, the effects depend on the behavior of the institu-
tions in situations of stress. For example, if banks attempt to
sell off certain types of assets (e.g., real estate) in situations of
stress, they may bring down the asset prices, with repercussion
1 effects for other sectors (e.g., household consumption). Also,
All

SBs

DBs

FBs
bank failures triggered by stress may result in a credit crunch.
In the accompanying Excel example, we approximate the
4 potential macroeconomic impacts by the capital injection
needed to bring all banks to the minimum required capital
adequacy ratio. This indicator does not capture all the po-
3 tential macroeconomic effects, but it is a useful broad indi-
Average rating

cator of potential fiscal costs associated with averting failures


in the banking system. It is an upper-bound estimate of such
costs. The public sector will most likely inject capital into
2
state-owned banks, but it is less clear whether (and if so, how
much) it will inject into the other banks, which are privately
owned (it is generally more likely to do so for larger banks
1 that are considered too big to fail). For this reason, the
SB1

SB2

SB3

DB1

DB2

DB3

DB4

DB5

FB1

FB2

FB3

FB4

charts and results in the file show a breakdown of the neces-


sary capital injection by ownership. The charts are included
Baseline Stress in the Assumptions worksheet and are reproduced here as
Figure 3.11. The values shown in the figure reflect the de-
Source: Stress Tester 3.0.xls, Assumptions worksheet, based on default values of
shocks and assumptions.
fault sizes of shocks and default assumptions in the accom-
panying file.
Figure 3.8 Impact of Stress on Supervisory Ratings

9. CONCLUSION
It is difficult to really understand stress testing without going
through actual stress testing calculations. This chapter enables
readers to do just that: working with the accompanying Excel
30 file, they can change the assumptions and observe changes in
results.
25 Stress tests are complementary to other tools for financial
Probability of default (%)

stability analysis, and the exercise illustrates this complemen-


20
tarity. In particular, it illustrates that stress tests are comple-
15 mentary to the FSIs, which allow for benchmarking, that
is, for a baseline assessment of the financial system under no
10 stress. FSIs can also be used to describe the impact of stress on
a system. Stress tests are also complementary to the supervisory
5 early-warning system, an example of which was shown as well.
The early-warning system traditionally is used to calculate rat-
0
ings and probabilities of default in the baseline scenario, but
SB1

SB2

SB3

DB1

DB2

DB3

DB4

DB5

FB1

FB2

FB3

FB4

as shown in Stress Tester 3.0, it can also be used to produce


ratings and probabilities of default in a stressful scenario. Stress
Baseline Stress tests are complementary also to other tools, such as assessments
of compliance with regulatory standards and codes, and assess-
Source: Stress Tester 3.0.xls, Assumptions worksheet, based on default values of
shocks and assumptions.
ment of the broader financial stability framework.
The exercise highlights several challenges. The basic chal-
Figure 3.9 Impact of Stress on Banks Probabilities of Default lenge is that stress testing is data intensive. It deals with low-
Martin ihk 41

35
30
25
20
15
10

Z-score
5
0
5
10
15
20
25
30
SB1

SB2

SB3

DB1

DB2

DB3

DB4

DB5

FB1

FB2

FB3

FB4
Baseline Stress

Source: Stress Tester 3.0.xls, Assumptions worksheet, based on default values of shocks and assumptions.

Figure 3.10 Impact of Stress on Banks z-Scores

2 good guide for the future. For example, a change in borrower


1.8 characteristics may leave credit more vulnerable to interest
Capital injection (% GDP)

1.6 rate risk. Another challenge is that the impact of shocks is dis-
1.4 tributed over time. It takes time for asset quality to deteriorate
1.2 and for that deterioration to have an impact. A crisis evolves
1 over a period of time, sometimes several years. Modeling stress-
0.8 ful scenarios therefore has to take the time dimension into
0.6 account, and it is important to clarify what the benchmark
0.4 scenario is against which the stressful one is being compared.
0.2 Finally, mitigating measures can be taken by participants and
0 authorities, especially when looking at longer time periods.
All

SBs

DBs

FBs

These measures and the feedback effects play an important


1.4 role over time, and they make the stress testing calculations
Capital injection (% GDP)

1.2 more complex.


1 Two main steps can be taken to address these challenges
0.8 in stress tests. The first is to keep assumptions transparent and
0.6
be clear on the sensitivity of the results to the assumptions. The
0.4
accompanying stress testing file is trying to do that. All as-
sumptions are brought into one place and highlighted. Users
0.2
can experiment with the assumptions to see the impact of
0
the changes on the results. The second step is to present stress
DB1

DB2

DB3

DB4

DB5
SB1

SB2

SB3

FB1

FB2

FB3

FB4

test results over time. Presenting results over time helps to say
Source: Stress Tester 3.0.xls, Assumptions worksheet, based on default values of whether the overall pool of risks has changed or whether the
shocks and assumptions.
structure of risks has changed. Most financial stability re-
Figure 3.11 Capital Injections Needed to Bring Banks to Minimum
ports still do not provide results over time, which makes in-
Capital Adequacy terpretation of the presented results more difficult for readers
(ihk, 2006). The Stress Tester 3.0 exercise is based on a one-
period snapshot, but the idea behind the exercise is that it is
probability events, implying that there will always be a lack of run repeatedly, replacing the input data (in yellow) by data
data and a need for simplifying assumptions. The main thing from other periods.
an analyst should do is to be transparent about the nature of The idea behind the accompanying fi le is that it can be
the assumptions. To make things more complicated, nonlin- developed in a modular fashion, with additional modules cap-
earities are likely to kick in for the large shocks that are being turing additional risks or elaborating on the existing ones.
contemplated in stress tests. Also, macroeconomic and other One can think about Stress Tester 3.0 as a module in a broader
models tend to break down in crises. Past crises may not be a stress testing tool kit and about the cells with assumptions as
42 Stress Tester

interfaces between this module and other modules. The fol- REFERENCES
lowing extensions are particularly worth considering:
Avesani, Renzo G., Kexue Liu, Alin Mirestean, and Jean Salvati,
2006, Review and Implementation of Credit Risk Models of
Credit risk macro nexus. Credit risk is the main source of
the Financial Sector Assessment Program, IMF Working Paper
risk in most financial systems. At the same time, it is the part 06/134 (Washington: International Monetary Fund). Available
where this exercise is perhaps the most simplified. Ideally, we via the Internet: http://www.imf.org/external/pubs/cat/longres
would need to have more detailed data on loan exposures .aspx?sk=19111.0
and loan performance by economic sector and also data on the Babouek, Ivan, and Martin Janar, 2005, Effects of Macroeco-
financial soundness of the corporate and household sectors. nomic Shocks to the Quality of the Aggregate Loan Portfolio,
Time series of historical data ideally should be used to estab- Czech National Bank Working Paper 1/2005 (Prague: Czech Na-
lish linkages between macroeconomic variables and loan tional Bank). Available via the Internet: http://www.cnb.cz/www
performance (or, in the absence of reliable time series, esti- .cnb.cz/en/research/cnb_wp/download/cnbwp_2005_01.pdf
Bierwag, Gerald O., 1987, Duration Analysis: Managing Interest
mates from other countries could be used). The calculations
Rate Risk (Cambridge; MA: Ballinger).
presented in this exercise try to convey the gist of the credit Blaschke, Winfrid, Matthew T. Jones, Giovanni Majnoni, and
risk stress test, without going into technical details. Soledad Martinez Peria, 2001, Stress Testing of Financial Sys-
tems: An Overview of Issues, Methodologies, and FSAP Expe-
Credit VaR models. Developed country commercial banks riences, IMF Working Paper 01/88 (Washington: International
and some banks in medium-income countries are using value- Monetary Fund). Available via the Internet: http://www.imf.org
at-risk (VaR) models as a basis for stress testing for credit /external/pubs/ft/wp/2004/wp04127.pdf
risk. There is a range of these models, all of which share the Blvarg, M., and P. Niemander, 2002, Inter-bank Exposures and
purpose of determining the probability distribution of the Systemic Risk, Sveriges Riksbank Economic Review 2/2002
(Sweden: Sveriges Riskbank).
losses on a portfolio of loans and other debt instruments.
Boss, Michael, 2002, A Macroeconomic Credit Risk Model for Stress
Being able to compute the loss distribution of a portfolio Testing the Austrian Credit Portfolio, Financial Stability Report
allows the determination of the economic capital required by No. 4 (Vienna: Oesterreichische Nationalbank). Available via the
credit operations. Implementing VaR tests for credit risk on Internet: http://www.oenb.at/en/presse_pub/period _pub/finanz
the macroprudential level is more complex than for market markt/finanzmarktstabilita /financial _stability_report _4.jsp
risk VaR models, because (1) fewer banks use them; and (2) the , Gerald Krenn, Markus Schwaiger, and Wolfgang Wegs-
risk factors and their parametrization are likely to differ across chaider, 2004, Stress Testing the Austrian Banking System,
banks, making comparability and aggregation more difficult. sterreichisches Bankarchiv 11/04, pp. 84152 (Vienna: Oester-
Nonetheless, implementing credit risk models on a macro- reichische Nationalbank). Available via the Internet: http://www
.oenb .at /de /img /artikel _9 _841852 _boss _et _al _11 _tcm14
prudential level is possible and can provide a useful bench-
-27296.pdf
mark for credit risk evaluation, as illustrated in Avesani and Boyd, John H., and David E. Runkle, 1993, Size and Performance
others (2006) on the CreditRisk+ model. Indeed, some recent of Banking Firms, Journal of Monetary Economics, Vol. 31, No. 3,
FSAPs have made use of these approaches. pp. 47 67.
Bunn, Philip, Alastair Cunningham, and Mathias Drehmann,
Stress testing based on factor models. This includes (1) port- 2005, Stress Testing as a Tool for Assessing Systemic Risks,
folio risk management models using structural credit risk Financial Stability Review, June, pp. 11626 (London: Bank of
models of obligors assets and risky debt based on domestic England). Available via the Internet: http://www.bankofengland
and international factor models, such as the portfolio man- .co.uk /publications/Pages/fsr/2005/fsr18.aspx
ihk, Martin, 2004, Stress Testing: A Review of Key Concepts,
ager models, CreditMetrics, and the default and conditional
CNB Research Policy Note 2/2004 (Prague: Czech National
probability of default models (e.g., Segoviano and Padilla, Bank). Available via the Internet: http://www.cnb.cz /en /pdf
2006); and (2) Merton-type structural models of banks, which /IRPN_2 _2004.pdf
calibrate risk-adjusted balance sheets and implied assets of , 2005, Stress Testing of Banking Systems, Finance a
banks, which are then linked to domestic and international vr/Czech Journal of Economics and Finance, Vol. 55, No. 910,
factor models. Stress testing can then analyze how changes pp. 418 40.
in key international and domestic factors drive individual , 2006, How Do Central Banks Write on Financial Stabil-
bank risk and systemic risk). ity? IMF Working Paper 06/163 (Washington: International
Monetary Fund). Available via the Internet: www.imf.org/exter
nal/pubs/ft/wp/2006/wp06163.pdf
Other risk factors. Depending on the sophistication of
, 2007a, Introduction to Applied Stress Testing, IMF
the financial system and the type of its exposures, it may be Working Paper 07/59 (Washington: International Monetary
necessary to perform stress tests for other risk factors. These Fund). Available via the Internet: http://www.imf.org /external
might include asset price shocks (including, e.g., shocks to /pubs/ft/wp/2007/wp0759.pdf
real estate prices) and shocks to commodity prices (espe- , 2007b, Systemic Loss: A Mea sure of Financial Stability,
cially in developing economies with significant exposures to Finance a vr/Czech Journal of Economics and Finance, Vol. 57,
commodities). No. 12, pp. 526. Available via the Internet: http://journal.fsv
.cuni.cz/storage/1073_fau _1_2 _07_00000000005.pdf
Martin ihk 43

, and Jaroslav Hemnek, 2005, Stress Testing the Czech , 2005a, European Financial Integration, Stability and Super-
Banking System: Where Are We? Where Are We Going? CNB vision, IMF Country Report 05/266, pp. 113 46 (Washington,
Research Policy Note 2/2005. Available via the Internet: www August). Available via the Internet: http://www.imf.org/external
.cnb.cz /en /research /research _publications/irpn /download /rpn /np/sta /fsi/eng/guide/index.htm
_2 _2005.pdf , 2005b, Financial Sector Assessment: A Handbook (Washing-
, and Michal Hlavek, 2007, New Approaches to Stress ton, September). Available via the Internet: http://www.imf.org
Testing the Czech Banking Sector, Finance a vr/Czech Journal /external/pubs/ft/fsa /eng/index.htm
of Economics and Finance, Vol. 57, No. 12, pp. 4159. Available , 2006, Spain: FSAP: Technical NoteStress Testing Meth-
via the Internet: http://journal.fsv.cuni.cz/storage/6 _fau _1_2 odology and Results, IMF Country Report 06/216 (Washing-
_07_00000000041.pdf ton: International Monetary Fund). Available via the Internet:
Danmarks Nationalbank, 2004, Market-Based Risk Mea sures for http://www.imf.org/external/pubs/ft/scr/2006/cr06216.pdf
Banks, Financial Stability (Copenhagen, July). Available via the International Monetary Fund and the World Bank, 2003, Ana-
Internet: https://www.nationalbanken.dk /DNUK /FinanceStab lytical Tools of the FSAP, IMF and World Bank Policy Paper
.nsf/side/Publications_about_financial_stability!OpenDocument (Washington, February). Available via the Internet: http://www
Drehmann, Mathias, 2005, A Market Based Macro Stress Test for .imf.org/external/np/fsap/2003/022403a.pdf
the Corporate Credit Exposures of U.K. Banks (London: Bank Jones, Matthew T., Paul Hilbers, and Graham Slack, 2004, Stress
of England). Available via the Internet: http://www.bis.org/bcbs Testing Financial Systems: What to Do When the Governor
/events/rtf05Drehmann.pdf Calls, IMF Working Paper 04/127 (Washington: International
Eklund, Trond, Kai Larsen, and Eivind Berhardsen, 2003, Model Monetary Fund). Available via the Internet: http://www.imf.org
for Analysing Credit Risk in the Enterprise Sector, Economic /external/pubs/ft/wp/2004/wp04127.pdf
Bulletin Q3 01 (Oslo: Norges Bank). Available via the Internet: Kraft, Evan, and Tomislav Galac, 2007, Deposit Interest Rates,
http://www.norges -bank .no /english /publications /economic Asset Risk and Bank Failure in Croatia, Journal of Financial
_bulletin/2001-03/eklund-larsen.pdf Stability, Vol. 2, No. 4, pp. 33755.
Elsinger, Helmut, Alfred Lehar, and Martin Summer, 2003, Risk Lucas, Robert E., 1976, Econometric Policy Evaluation: A Critique,
Assessment for Banking Systems, 14th Annual Utah Winter Carnegie-Rochester Conference Series on Public Policy, Vol. 1, No. 1,
Finance Conference Paper; EFA 2003 Annual Conference Paper pp. 19 46.
No. 437. Peng, Wensheng, Kitty Lai, Frank Leung, and Chang Shu, 2003,
Evjen, Snorre, Arild J. Lund, Kjersti Haare Morka, Kjell B. Nordal, The Impact of Interest Rate Shocks on the Performance of the
and Ingvild Svendsen, 2005, Monetary and Financial Stability Banking Sector, Hong Kong Monetary Authority Research
in Norway: What Can We Learn from Macroeconomic Stress Memorandum (Hong Kong SAR, May). Available via the Inter-
Tests? in Investigating the Relationship between the Financial net: http://www.info.gov.hk /hkma /eng/research/RM07-2003
and Real Economy, BIS Papers, No. 22, pp. 40930. Available via .pdf
the Internet: http://www.bis.org/publ/bppdf/bispap22u.pdf Pesola, Jarmo, 2005, Banking Fragility and Distress: An Economet-
Gerlach, Stefan, Wensheng Peng, and Chang Shu, 2004, Macro- ric Study of Macroeconomic Determinants, Research Discus-
economic Conditions and Banking Performance in Hong Kong: sion Papers No. 13 (Helsinki: Bank of Finland). Available via the
A Panel Data Study, Hong Kong Monetary Authority Research Internet: http://www.bof.fi/eng/6 _julkaisut/6.1_SPn _julkaisut
Memorandum (Hong Kong SAR, April). Available via the /6.1.5_Keskustelualoitteita /0513netti.pdf
Internet: http://www.info.gov.hk/hkma/eng/research/RM_macro Sahajwala, Ranjana, and Paul Van den Bergh, 2000, Supervisory
_and _banking.pdf Risk Assessment and Early Warning Systems, BCBS Working
Goodhart, Charles, 2006, A Framework for Assessing Financial Paper No. 4 (Basel: Basel Committee on Banking Supervision).
Stability? Journal of Banking and Finance, Vol. 30, No. 12, pp. Available via the Internet: http://www.bis.org /publ/bcbs _wp4
341522. .pdf
Hesse, Heiko, and Martin ihk, 2007, Cooperative Banks and Segoviano, Miguel A., and Pablo Padilla, 2006, Portfolio Credit
Financial Stability, IMF Working Paper No. 07/02 (Washing- Risk and Macroeconomic Shocks: Applications to Stress Testing
ton: International Monetary Fund). Available via the Internet: under Data-Restricted Environments, IMF Working Paper
http://www.imf.org/external/pubs/ft/wp/2007/wp0702.pdf 06/283 (Washington: International Monetary Fund). Available
Hoggarth, Glenn, Andrew Logan, and Lea Zicchino, 2005, Macro via the Internet: http://www.imf.org/external/pubs/ft/wp/2006
Stress Tests of U.K. Banks, in Investigating the Relationship /wp06283.pdf
between the Financial and Real Economy, BIS Papers, No. 22, Shu, Chang, 2002, The Impact of Macroeconomic Environment
pp. 392 408. Available via the Internet: http://www.bis.org/publ on the Asset Quality of Hong Kongs Banking Sector, Hong
/bppdf/bispap22.htm Kong Monetary Authority Research Memorandum (Hong Kong
International Monetary Fund, 2003, Financial Soundness SAR, December). Available via the Internet: http://www.info
IndicatorsBackground Paper, IMF Policy Paper (Washington, .gov.hk /hkma /eng/research/index.htm
May 14). Available via the Internet: http://www.imf.org/external Virolainen, Kimmo, 2004, Macro Stress Testing with a Macro-
/np/sta /fsi/eng/2003/051403bp.pdf economic Credit Risk Model for Finland, Discussion Paper
, 2004, Financial Soundness Indicators Compilation Guide 18/2004 (Helsinki: Bank of Finland). Available via the Internet:
(Washington, July). Available via the Internet: http://www.imf http://www.suomenpankki.fi/en/julkaisut/tutkimukset/keskuste
.org/external/np/sta /fsi/eng /guide/index.htm lualoitteet/Pages/default.aspx?year=2004

También podría gustarte