SOFM Network- Operates in 2 phase
1- Training Phase.
• Input data is fed to neurons in output layer that are
assigned with weights.
• Each output unit competes a similarity score by ED
measure and each other.
• The output unit which is close to input sample by similarity,
is chosen as the winning unit and its connection weights
Click to Edit are adjusted by a learning factor.
• Thus the best matching output unit whose weights are
adjusted are moved close to input sample and a
topological feature map is formed.
• This process in repeated until the map does not change.
2- Mapping Phase - test samples are classified
www.acharya.ac.in
Module -5
Artificial Neural Networks
Introduction
• ANN imitate the human brain( constitutes a mass
neuron).
• Neuron are processing units which receive
Click to Edit
information, process it and then transmit data to other
neurons.
• ANN is a learning mechanism that models a human
brain
ANN - Model
Each neuron is modelled as computing unit called as Node
● Node does complex
calculations.
● Operates in parallel
that learns from
Click to Edit
observations
Applications of ANN
● NLP, Pattern, Face, Speech
Character Recognition.
● Stock Prediction
● Text Processing, Computer
Vision etc.
PERCEPTRON AND LEARNING
THEORY
Linear Binary Classifier used for Supervised Learning
Steps
1. Inputs from other from
Click to Edit
neurons.
2. Weight and Bias.
3. Net Sum.
4. Activation Function
Perceptron Algorithm
Click to Edit
Problem
Consider a perceptron to represent the Boolean function AND with the initial weights w,
=0.3, w, =-0.2, learning rate alpha = 0.2 and bias Theta = 0.4.
The activation function used here is the Step function f(x) which gives the output value as
binary ,i.e., O or 1. If value of f(x) is greater than or equal to 0, it outputs 1o r else it outputs
0.
Design a perceptron that performs the Boolean function AND and update the weights until
Click to Edit
the Boolean function gives the desired output.
Click to Edit
Click to Edit
Click to Edit
Click to Edit
XOR Problem
Click to Edit
Click to Edit
Gradient Descent
Click to Edit
Types on ANN
Click to Edit
Fully connected neural network
Click to Edit
Multilayer Perceptron
Click to Edit
Feed Back Neural Network
Click to Edit
Multi Layer Perceptron
Consider learning in a Multi layer Perceptron. The given MLP
consists of an input layer , one hidden layer and an output layer.
Train the MLP by updating the weights and biases in the network
Click to Edit
X1 X2 X3 X4 O(Desired)
1 1 0 1 1
Input: Input vector (x, Xy ., *)
Output: Y
Learning rate: 0.8
Assign random weights and biases for every connection in
Click to Edit the network in the range [-0.5, +0.5].
Step 1: Forward Propagation[Epoch -1]
1. Calculate Input and Output in the lnput Layer.
Output at each input node
Click to Edit
2: Calculate Net input & Output in the Hidden Layer and
Output Layer (x0 {Bias} = 1)
Net input Activation function at x6 & x5
Click to Edit
3. Estimate error at the node of Output layer
Error at Output layer
Click to Edit
● Back propagation is required to reduce error of 0.581 .
● By updating the weights and bias in hidden layers
Step 2: Backward Propogation
1. Calculate the Error at each node.
Output layer error caculation
Click to Edit
Hidden layer error caculation
Click to Edit
2: Update the weight
Click to Edit
Click to Edit
Update the Baises
Click to Edit
[Epoch -2] Step 1 : Forward Propogation
Click to Edit
Error = 1 - 0.474 = 0.526
Error is reduced by 0.055: 0.581 - 0.526.
Click to Edit
Radial Basis Function NN(RFNN)
• Is a Multi layer perceptron
• One input, hidden and output layer
● Hidden layer uses a non-linear radial basis function as
activation function.
Click to Edit
❖ converts input parameters into high dimensional
space(derive feature vector)
❖ then fed to linearly separate problem
● Useful for interpolation , function approximation , time series
prediction , classification and system control
RBFNN
Click to Edit
RBFNN
Click to Edit
RBNFF Algorithms
Click to Edit
Click to Edit
Click to Edit
Click to Edit
Click to Edit
RBFNN- generally trained to determine
following parameters
• The number of neurons in the hidden layer.
• The center of each hidden layer RBF neuron.
Click to Edit • The radius or variance of each RBF neuron.
• The weights assigned from the hidden layer to
output layer for summation functions.
RBFF- approaches to determine the
centres of the Hidden Layer
• Random selection of fixed cluster centers
• Self - organised selection of centres using
k-means clustering.
Click to Edit
• Supervised selection of centers.
Self Organizing Feature Map
➔ Feed Forward Neural Networks by Dr Teuvo
Kohonene(1982)
➔ Adaptive Learning Network
➔ Unsupervised learning model - clusters data by
mapping in high-dimensional into two dimensional
Click to Edit
map.
➔ Model learns to clusters or self organize a high
dimensional data without knowing the class
membership of input data - self organizing
nodes(feature map).
Network Architecture and
Operations
Click to Edit
SOLVED PROBLEM
Click to Edit
Click to Edit
Click to Edit
Click to Edit
Click to Edit
Classification result - SOFM
1. (1,0,1,0) – > Unit -1
2. (1,0,0,0) → Unit -1
Click to Edit 3. (1,1,1,1) → Unit-2
4. (0,1,1,0) → Unit-2
SOFM Algorithm
Click to Edit
Click to Edit THANK YOU
