Documentos de Académico
Documentos de Profesional
Documentos de Cultura
Sue Myburgh
School of Communication, International Studies and Languages
University of South Australia
Australia
St Bernard’s Road, Magill SA 5072
Email: sue.myburgh@unisa.edu.au
Abstract
The question of how to measure Knowledge Management (KM) is a fraught
one, with several layers of problems, which can be roughly categorised into
two areas. Firstly, there is the question of what will be measured – knowledge
in people’s heads or creation of new knowledge? If knowledge itself is not the
object of management effort, then it need not be measured; should we
measure instead the effort of KM itself – the systems and procedures that are
put into place to enable KM? Or, if KM is a means to an end, what are the
ends? The ends are may be competitive advantage as expressed in
innovation, increased profit or development of intellectual capital.
The second major problem is concerned with how these attributes, actions
and characteristics can be measured. Knowledge itself is intangible and
ineffable; increased profit presents few problems as it can be expressed in
numerical financial terms. There are in addition a range of different
methodologies than can be used to ensure that the results have integrity.
The issue becomes more complex when we place KM in the context of the
present ‘Information’ or ‘Knowledge’ economy. The foundation of
industrialized economies has shifted from natural resources to intellectual
assets. What does this mean, and how is the new economy different?
Introduction
KM is widely viewed as a technique which will enable the continued survival
and success of an organisation, against competitors and the characteristics of
the environment. Knowledge Management (KM) is thus related to how
businesses can succeed in the Knowledge Economy (KE). Many enterprises
feel as a result that the knowledge of their employees is their most valuable
asset. They may be right, but valuing such assets, and managing them
appropriately, remains a challenge.
1
As knowledge and knowledge production are culturally defined, the ways in
which knowledge can be valued and assessed are associated with culture.
Every market system is affected by social and political realities, as economics
is a matter of culture, and culture a matter of economy. KM must be located
and contextualised within the prevailing economic model. It is problematic to
develop an economic or business model of policy and practice which ignores
the diverse, kinetic, and multidimensional cultural dimension. Neither culture
nor economics can be accepted as a set of privileged, unexamined and
accepted traditions.
While national cultures and industries are affected by and involved in the
processes of global cultural commodification – for example, eco-tourism – no
unique culture should be lost. The realities of global capitalism affect the
development of economic policy; however, simultaneously there is an urge to
recover, restore and preserve non-commodified and non-economic cultural
heritage.
Much classic economic theory simply does not apply in the global, networked
world, and therefore a new economic theory is called for, as knowledge plays
a central role as the primary factor for growth and competitiveness.
Knowledge Economy
The importance of information and knowledge and their use to organisations
is indicated by the emphasis placed by investors on intellectual capital1. The
footnote can be viewed in Print Preview. For the last three decades there has
been much discussion of the emerging ‘post-industrialist’ economy, now
known as the ‘Information’ or ‘Knowledge’ economy. These terms are used to
imply that new models of exchange and reward are developing in the market
place, as the means of production and distribution of goods and services
change. One focus of study in economics is how political and social
institutions interact with markets and technology to form an economy. This all
changes in a networked, global economy, where multinationals are key
players.
2
economy based on these will be fundamentally different from an industrialised
one.
The issue of measuring KM is viewed here from three perspectives: firstly, the
issue of what should be measured; secondly, the issue of how it can be
measured; and associated with these points, whether ‘measurement’ as a
notion is a useful one, or whether wider social, cultural and moral obligations
should be considered.
3
Evaluating Information and knowledge
Knowledge is an organic and intangible entity, ever-changing and virtually
impossible to measure, except perhaps in relative, rather than absolute, ways,
or by a philosophical examination of the truth it represents. The value and
importance of knowledge depends on its uses and applications, as much as
its truthfulness or integrity.
One of the central aims of KM is often given as capturing the ‘tacit’ knowledge
of the organisation, and making it ‘explicit’. As noted, at best, this can be only
partially achieved, as all knowledge cannot be converted into information, if
one follows the definitions given above – namely that knowledge is what is
contained by an individual, and information is that part of knowledge which is
able to be shared. Even important knowledge cannot be conveyed in its
entirety – consider the difference between the outcomes achieved by a chef
and a novice cook following the same recipe – even where the same
information is available.
In spite of this, we rely on the information itself, and not necessarily its
facilitating mechanisms, to assist our decision making and to guide our
actions. As individuals and as organisations, we need information – the right
information, in the right amount, at the right time – and at the right cost.
4
of certain actions, developments or products. Another way of assessing the
value of information is to distinguish between the results of informed actions
and the results of uninformed actions, or no action. We believe that it is
preferable to have an educated, informed population, than an illiterate and
ignorant one - whether in countries or in organisations.
Some ways of defining information offer ways of evaluating it. One of these is
seeing information as a commodity in economic terms. As Mayon-White
(1996) states, “The commodification of information is a silent and nearly
invisible revolution. As information sets grow in size and quality they acquire
the characteristics of a commodity which can be bought and sold.” Broadbent
and Lofgren (1991) suggest the cost-benefit analysis of particular products
and services, and this can be used to complement a qualitative performance
evaluation. The cost-benefit should identify the financial costs and benefits
and alternative ways of providing a product/service, or the costs and benefits
of not providing a certain product/service. They also provide a very detailed
analysis of two methods for qualitative evaluation: Critical Success Factors
and Priority and Performance evaluation.
The greatest value that information has is both subjective and qualitative, and
this fluctuates. Information is what economists call an ‘experience good’ – it
has to be experienced in order to be valued. However, because there are
wide variations in perceptions of use, and because relevance is a subjective
element located in individual contexts of time and space, no one piece of
information or knowledge can ever be accurately costed, particularly in
advance. Its value can, in the long run, be best appreciated by items such as
increased productivity, ease of doing work, as well as benefits such as the
continued survival and success of the enterprise.
Knowledge Management
Gupta, Pike and Roos (2002) note that “KM processes are meta-processes
which cannot be uniformly observed like physical processes and differ
according to their means of creation, nature, recording, transmission and
mode of use”. Because knowledge is related to people, KM varies widely
according to the social and organizational culture in which it is located. This
adds extra obstacles: firstly, KM implementations and strategies are seldom
similar because people are so different; secondly, different measurement
techniques are required at different stages of KM implementation, as
suggested by the American Productivity and Quality Center (APQC). This is a
5
useful approach, as it allows clarification of the unique version of KM to
mature within a specific organisation.
It has been noted that KM measurement is neither well defined nor executed.
Ruggles (1998), quoted by Swaak et al., reports the results of a study of 431
U.S. and European organisations conducted in 1997 by Ernst & Young Centre
for Business Innovation. “Only 4% of the organisations indicate that
measurement in relation to knowledge management is performed well or
excellently” (Ruggles, 1998, p.81 in Swaak, 1999).
How are the results of KM determined? Can one measure the capability of an
organisation to develop and manage knowledge assets? Some writers, such
as Sharp (2003), suggest measurement of features as distinct as email
volume and human capital effectiveness (the revenue and profit generated by
each employee). Other, perhaps more ‘concrete’, knowledge-related items
include patents, inventions, computer programs, publications and the like.
There are many less tangible aspects, however, that are nonetheless worthy
of consideration, such as collaboration, a sense of history and context,
effective judgment, the role and value of the relations between knowledge and
business processes.
6
What to measure in Knowledge Management
It is logical to assume that when one sets out to measure something, one
understands the distinctiveness of what it is that one wishes to measure,
before the measuring tools can be selected. It is not possible to measure
volume with a thermometer.
Competitive advantage
This is a concept frequently mentioned as the most important objective of KM,
although there is some lack of clarity about what is actually meant.
Competitive advantage exists in the extent to which organisations are able to
develop, manage and use their intellectual capital. The term is used to
describe increased profits as well as increased market share, and is
sometimes even related to quality.
Innovation and intellectual capital are both strongly associated with the
outcome of competitive advantage.
Innovation
Innovation is an important component of competitive advantage. That there is
a connection between innovation and knowledge is obvious. The term is also
strongly correlated with creativity, and in the organisational environment it
means several things, including the development of new and competitive
products and services, as well as developing new procedures and processes
that enhance organisational capacity and increase market share.
7
measure. Intellectual capital and knowledge management are sometimes
used almost interchangeably.
Knowledge capital is associated with the worth of the people who possess the
accumulated knowledge about an organisation, and is clearly associated with
human capital. The collective knowledge of an organisation, its intellectual
capital, is embedded in the personal skills, experience and brainpower of its
employees, as well as in its processes, policies, electronic databases and
other information repositories.
Intellectual property
It is expensive to create information – to take data and add knowledge and
produce something that is helpful to others, and to preserve it in a document
and communicate to others. While production of a document costs money, it
is much cheaper than the cost of producing the information which it contains.
This has both an individual and corporate cost, which is often undervalued.
Human capital expects to be provided with a reasonable expectation of a
return on the investment of intellectual skills, as well as the use of such
equipment as is necessary to support such productivity. Financing intellectual
property as property, and exerting property rights of ownership on it is
predicated on the notion that independent workers, researchers and
entrepreneurs gather and process information, and then anticipate that they
will be able to gain financial compensation for their labour on an open market,
where the public and other organisations are seen as consumers.
Financial advantage
There are several ways in which KM is seen as potentially improving the
financial situation of enterprises related both to reduced costs and increased
8
profit, including through revenue enhancements, returns on investment (ROI),
and cost savings. Some of these might be clearly identified through standard
accounting procedures. However, it is not common to measure returns on KM
investments, largely because there is a lack of knowledge of how to do so.
Speed
This includes faster responsiveness of service delivery, faster development
times, response times, accelerated organisational competencies, reduction of
time spent in support activities and in the time spent getting goods to market.
Productivity
This is often associated with speed, and includes both the efficiency and
effectiveness of staff, as well as increased production of goods and services
as tangible outcomes.
Methods of measurement
Generally speaking, there are two classes of collecting and analyzing data:
quantitative and qualitative. While measurement is an important component
of each, the ways in which data is gathered and analysed, and the kind of
information and knowledge that can be derived and understood, differ in each
case.
9
While it is beyond the scope of this paper to examine each of these classes of
methodology in detail, it should be noted that neither is ‘pure’ – that most
research involves elements of each. This is an important aspect to note when
measuring KM. KM is a multidisciplinary field and, as noted, there are a
range of dimensions, each of which is equally important if one is seeking to
establish, justify and perpetuate a KM strategy. So many different aspects
are measured and each aspect will require a different approach and different
measurement techniques.
Measuring intangibles
In particular, we notice in KM that there is a tension between the quantitative
and qualitative research methodologies as the ultimate aim of KM is to
increase profit, which is, of course, something that can be measured
numerically. However, the nature of knowledge, and indeed KM as a whole,
presents a problem as not only are both knowledge and information
intangible, but so are many of their benefits. Intangibles are a source of
invisible advantage – and are often taken into account by investors. These
include employees, ideas, know-how, relationships systems, and work
processes.
The disciplines and methods of how to account for and safeguard knowledge
assets are either non-existent or at most rudimentary. There is a need to re-
engineer traditional accounting and management reporting processes, as
standard financial models fail to represent the dynamics of knowledge.
Bontis et al. have noted that four measurement systems currently popular:
Human resource accounting; Economic value added; Balanced scorecard;
and Intellectual capital. One notices immediately however that this kind of
listing serves to confuse rather than clarify, as it is a mix of items to be
measured and ways in which measurement can be undertaken. Of these,
probably the most attention is paid to evaluating the development of
knowledge or intellectual capital (I use the terms interchangeably here).
Quantitative approaches
Broadly speaking, there are two ways of measuring intellectual capital. The
first is a component-by-component evaluation, e.g. patents and market share.
The second method is to measure the value of intellectual assets in financial
terms at organisational level – e.g. shareholder value. In essence, the value
of intangible assets equals a company’s ability to outperform an average
competitor that has similar tangible assets.
As Sharp notes, “Ultimately the measures that matter are the ones that can be
combined with financials, that is, those that go to the bottom line” (Sharp,
2003, 33). Various models have been developed, and these include Sveiby
10
(1997): The Intangible Asset Monitor; Kaplan and Norton (1992): The
Balanced Scorecard; and Edvinsson and Malone (1997): the Skandia Value
Scheme. Then there is Tobin’s q, which compares the market value of an
asset with its replacement cost, and Swaak (1999) has developed a system
known as KnowMe, which measures both investments and result of
knowledge management in an organisation. The APQC suggests that
intangibles can be measured by determining proxies to represent them. Their
procedure is that multiple measures should be used to maximize validity and
reliability, and these are then benchmarked against the competition.
…the annual returns realized on knowledge capital can be isolated after paying a "rental" for
the financial capital and then subtracting that amount from profits as reported by the
accountants.
What remains is what economists call an "economic profit" and what some
consultants call the "economic value-added." It can also be known as the
"knowledge value-added" because it accounts for those missing elements that
represent everything not shown on a conventional balance sheet.
Others use the Key Performance Indicators (KPIs), which can include items
such as the number of best practices, employee satisfaction, the time it takes
to create new knowledge, the proportion of employees making new idea
suggestions and network building. While there are advantages with this
approach from the point of view of offering statistics that might impress senior
managers, there are some problems. Firstly, it will be noted that it is difficult
to provide numerical values for some of these indicators; secondly, any one of
them on their own does not mean much, indicating that a holistic and inclusive
approach is necessary.
A disadvantage of the objective and quantitative ‘multiple indicator approach’ is that a huge
number of indicators seem to be needed to get a clear picture of an organisation. Moreover,
from a knowledge-centred point of view, it is doubtful whether the indicators cover knowledge
development and utilization in an organisation. In addition, the ‘multiple indicator approach
does not set standardized instruments, but instead provides frameworks that should guide the
selection of indicators” and there is often overlap (Swaak et al., 1999)
11
Qualitative approaches
A good example of a qualitative approach is Sveiby’s Collaboration Climate
Index (CCI). Here an intangible quality - a good collaborative climate – is
measured, as it is believed that such a climate will enhance knowledge
sharing and therefore the development of intellectual capital. What is
interesting about the qualitative approach is not so much what is measured,
as we have already established that much of knowledge (and indeed
information) management is concerned with measuring intangible values, but
the variety of techniques and methodologies that are used in this mode. This
may include:
When to measure
Another consideration is deciding when to measure, as this might determine
what will be measured. The APQC has developed an interesting approach
which is interesting to follow. In general, many KM strategies are seen as
starting with a knowledge audit, which essentially measures what is there,
including the existing intellectual capital of the organisation, as well as its
capacity to increase this and use knowledge. Most knowledge audits use a
combination of approaches, including measuring knowledge bases,
questionnaires and SNA. Sources and flows of knowledge can then be
mapped.
12
to isolate the impact of an particular actions or expenditures in KM. While it
might be easy to identify to what extent the organisation is achieving success,
the issue then becomes identifying which parts of a KM strategy are
contributing to this outcome, as distinct from other variables. Increasingly, as
noted, the ways in knowledge is managed in the organisation should, if the
KM strategy is successful, become transparent and integrated, making
measurement difficult.
Conclusions
It was noted at the beginning of this paper that there is a relationship between
knowledge and culture, and culture and economy. It was also noted that KM
is a strategy that has developed in a late capitalist, globalised economy, as
organisations struggle to survive and remain successful in a turbulent,
competitive environment. The paradox is also noted that the more successful
a KM strategy is, the more it becomes part of the culture of the organisation
and, arguably, the environment outside of the organisation. The question was
asked: can KM assume a different position within this globalised economy,
which emphasizes values of cultures and knowledges other than those
associated with the globalised economy? Is it possible, through its emphasis
on people and intangible assets, to demonstrate a different and arguably
more equitable approach to such issues? This would seem to be an
important question to answer in a world where some multinational companies
have more power and freedom than many nations.
Many of these ideas are embodied in the idea of social capital, which is a
phrase which refers to the institutions, relationship and norms that shape the
quality and quantity of society’s interactions. Social capital is understood to
play an important role in fostering the social networks and information
exchange needed to achieve collective action – and sustaining a social and
institutional environment that is ready to adapt and change.
13
certain types of knowledge, and thus the communities who share it. ‘Social
capital’ as a term can be too easily translated into financial and economic
advantage, as the phrase itself indicates. Communities that are parochial or
isolated for various reasons might in fact detract from the positive outcomes
imagined through the development of social capital.
Ultimately, it is the people who create, develop and use knowledges who will
need to ascertain how best this can be shared for mutual advantage. This is
a position that demands inclusivity – of both ambiguity and diversity.
Developing knowledge or intellectual capital cannot rely on developing only
certain types of intellectual capital that might have a present, but transient,
value in the marketplace. This suggests that there is not one globalised ‘true’
knowledge, and that other forms of knowledge creation should be examined.
Bibliography
American Productivity and Quality Center. (2001). Measurement for
knowledge management. [Online].
http://www.apqc.org/free/articles/dispArticle.cfm?ProductID=1307
Bontis, Nick et al. (1999). The knowledge toolbox: a review of the tools
available to measure and manage intangible resources. In: European
management journal, Vol. 17 (4).
Bourdieu, Pierre. (1993). The field of cultural production: essays on art and
literature. Ed. by Randal Johnson. New York: Columbia University.
Broadbent, Marianne & Lofgren, Hans (1991) Priorities, performance and
benefits: an exploratory study of library and information units. Melbourne:
Centre for International Research on Communication and Information
Technologies & Australian Council of Libraries and Information Services.
Edvinsson, L. and M. Malone. (1997). Intellectual capital: realizing your
company’s true value by finding its hidden brainpower. New York: Harper
Collins.
Gupta, O., S. Pike and G. Roos. (2002). Evaluating intellectual capital and
measuring knowledge management effectiveness. London: Intellectual
Capital Services. [Online].
http://www.intcap.com/ICS_Article_2002_Measuring_KM_Effectiveness.pdf
Iske, Paul, Mounib Mekhilef. (2003). European knowledge management
guidelines for measuring. Draft version 2.0. Amsterdam: CEN ISSS.
Mayon-White, Bill. (1996). Information’s real value. In: Information strategy,
Vol 2(4). http://www.info-strategy.com/vol2/no4/inva_pn1.html
Orna, Elizabeth. (1990). Practical information policies: how to manage
information flows in organizations. London: Ashgate Publ. Co.
14
Sharp, Duane. (2003). Knowledge management today: challenges and
opportunities. In: Information systems management, Spring: 32 – 37.
Southon, Gray and Ross Todd. (1999). Knowledge management: a social
perspective. Paper presented at KNOW ’99, Sydney.
Strassmann, Paul A. (1996). The value of computers, information and
knowledge. http://www.strassmann.com/pubs/cik/cik-value.shtml
Strassmann, Paul A. (2000). How e-business affects knowledge capital.
[Online]. http://www.strassmann.com/pubs/km/2000-11.php
Sveiby, K. (1997). The new organizational wealth: managing and measuring
knowledge based assets. San Francisco: Berrett-Koehler Pub.
Swaak, Janine et al. (1999). Measuring knowledge management
investments and results: two business cases. Enschede: Telematica Instituut.
Taylor, Chris. (1997). Business information: what’s it really worth? [Online]
http://www.info-strategy.com/bi_pn1.htm
Woldring, E. (2001). Strategies to measure the value of special libraries.
Presented at 9th Specials, Health and Law Libraries Conference. [Online].
http://www.alia.org.au/conferences/shllc/2001/papers/woldring.html
15