Está en la página 1de 12

1

What are (everyday) computer systems


good at... and not so good at?
Good at Not so good at
Rule-based systems: doing what
the programmer wants them to do
Dealing with noisy data
Dealing with unknown environment
data
Massive parallelism
Fault tolerance
Adapting to circumstances
2
Biological Inspiration
Humans & animals are able to react adaptively to changes
in their external and internal environment, and they use
their nervous system to perform these behaviours.

An appropriate model/simulation of the nervous system
should be able to produce similar responses and
behaviours in artificial systems.

The nervous system is build by relatively simple units, the
neurons, so copying their behavior and functionality
should be the solution.
3
Artificial Neural network: information processing paradigm inspired by
biological nervous systems, such as our brain.

KEY POINTS:
Structure: large number of highly interconnected processing elements
(neurons) working together.
Like people, they learn from experience (by example).
Neural networks are configured for a specific application, such as pattern
recognition or data classification, through a learning process.
In a biological system, learning involves adjustments to the synaptic
connections between neurons.
same for artificial neural networks (ANNs).

Where can neural network systems help??
when we can't formulate an algorithmic solution.
when we can get lots of examples of the behavior we require.
learning from experience:
when we need to pick out the structure from existing data.
4
Learning in biological systems
Learning = learning by adaptation
The young animal learns that the green fruits are sour, while the
yellowish/reddish ones are sweet. The learning happens by
adapting the fruit picking behavior.
Learning as optimization
The objective of adapting the responses on the basis of the
information received from the environment is to achieve a better
state. E.g., the animal likes to eat many energy rich, juicy fruits
that make its stomach full, and makes it feel happy.

In other words, the objective of learning in biological organisms
is to optimise the amount of available resources, happiness, or in
general to achieve a closer to optimal state.
5

Learning principle for artificial neural networks??
6
A Biological Neuron


Inputs: dendrites

Processing: soma

Outputs: axons

Synapses: electrochemical
contact between neurons
7
8
From Human Neurons to Artificial Neurons

We conduct these neural networks by first trying to deduce the
essential features of neurons and their interconnections. We then
typically program a computer to simulate these features.
The neuron model
9
A simple neuron
A simple neuron:

An artificial neuron is a device with many inputs and one output. The
neuron has two modes of operation; the training mode and the using
mode.

10
w
1j
w
2j
w
3j
w
ij
y
1
y
2
y
3
y
i

O
Perceptron:

Each neuron has a threshold value
Each neuron has weighted inputs from other neurons
The input signals form a weighted sum
If the activation level exceeds the threshold, the neuron
fires
In mathematical terms, the neuron fires if and only if;
X1W1 + X2W2 + X3W3 + ... > T


Perceptron -> McCulloch and Pitts model (MCP)
11
The network:
An artificial neural network is composed of many artificial
neurons that are grouped in layers. The objective of the neural
network is to transform the inputs into meaningful outputs.
Note the three layers: input, intermediate (called the hidden
layer) and output.
Input Layer Hidden Layer Output Layer
12