Digital Image Processing
Image Enhancement
(Spatial Filtering 2)
Course Website: http://www.comp.dit.ie/bmacnamee
2
of
30
Contents
In this lecture we will look at more spatial
filtering techniques
Spatial filtering refresher
Sharpening filters
1st derivative filters
2nd derivative filters
Combining filtering techniques
3
of
30
Spatial Filtering Refresher
Origin
Simple 3*3
Neighbourhood
3*3 Filter
Image f (x, y)
Original Image
Pixels
Filter
eprocessed = v*e +
r*a + s*b + t*c +
u*d + w*f +
x*g + y*h + z*i
The above is repeated for every pixel in the
original image to generate the smoothed image
4
of
30
Sharpening Spatial Filters
Previously we have looked at smoothing
filters which remove fine detail
Sharpening spatial filters seek to highlight
fine detail
Remove blurring from images
Highlight edges
Sharpening filters are based on spatial
differentiation
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
5
of
30
Spatial Differentiation
Differentiation measures the rate of change of
a function
Lets consider a simple 1 dimensional
example
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
6
of
30
Spatial Differentiation
A
B
7
of
30
1st Derivative
The formula for the 1st derivative of a
function is as follows:
f
f ( x 1) f ( x)
x
Its just the difference between subsequent
values and measures the rate of change of
the function
8
of
30
1st Derivative (cont)
5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7
0 -1 -1 -1 -1 0 0 6 -6 0 0 0 1 2 -2 -1 0 0 0 7 0 0 0
9
of
30
2nd Derivative
The formula for the 2nd derivative of a
function is as follows:
f
f ( x 1) f ( x 1) 2 f ( x)
2
x
2
Simply takes into account the values both
before and after the current value
10
of
30
2nd Derivative (cont)
5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7
-1 0 0 0 0 1 0 6
-12
6 0 0 1 1 -4 1 1 0 0 7 -7 0 0
11
of
30
Using Second Derivatives For Image
Enhancement
The 2nd derivative is more useful for image
enhancement than the 1st derivative
Stronger response to fine detail
Simpler implementation
We will come back to the 1st order derivative
later on
The first sharpening filter we will look at is
the Laplacian
Isotropic
One of the simplest sharpening filters
We will look at a digital implementation
12
of
30
The Laplacian
The Laplacian is defined as follows:
f f
f 2 2
x y
where the partial 1st order derivative in the x
direction is defined as follows:
2
f
f ( x 1, y ) f ( x 1, y ) 2 f ( x, y )
2
x
and in the y direction as follows:
2
f
f ( x, y 1) f ( x, y 1) 2 f ( x, y )
2
y
2
13
of
30
The Laplacian (cont)
So, the Laplacian can be given as follows:
f [ f ( x 1, y ) f ( x 1, y )
f ( x, y 1) f ( x, y 1)]
4 f ( x, y )
2
We can easily build a filter based on this
0
-4
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
14
of
30
The Laplacian (cont)
Applying the Laplacian to an image we get a
new image that highlights edges and other
discontinuities
Original
Image
Laplacian
Filtered Image
Laplacian
Filtered Image
Scaled for Display
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
15
of
30
But That Is Not Very Enhanced!
The result of a Laplacian filtering
is not an enhanced image
We have to do more work in
order to get our final image
Subtract the Laplacian result
from the original image to
generate our final sharpened
enhanced image
g ( x, y ) f ( x, y ) f
2
Laplacian
Filtered Image
Scaled for Display
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
16
of
30
Laplacian Image Enhancement
Original
Image
=
Laplacian
Filtered Image
Sharpened
Image
In the final sharpened image edges and fine
detail are much more obvious
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
17
of
30
Laplacian Image Enhancement
18
of
30
Simplified Image Enhancement
The entire enhancement can be combined
into a single filtering operation
g ( x, y ) f ( x, y ) f
f ( x, y ) [ f ( x 1, y ) f ( x 1, y )
f ( x, y 1) f ( x, y 1)
4 f ( x, y )]
5 f ( x, y ) f ( x 1, y ) f ( x 1, y )
f ( x, y 1) f ( x, y 1)
2
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
19
of
30
Simplified Image Enhancement (cont)
This gives us a new filter which does the
whole job for us in one step
0
-1
-1
-1
-1
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
20
of
30
Simplified Image Enhancement (cont)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
21
of
30
Variants On The Simple Laplacian
There are lots of slightly different versions of
the Laplacian that can be used:
0
-4
Simple
Laplacian
-8
-1
-1
-1
-1
-1
-1
-1
-1
Variant of
Laplacian
22
of
30
Simple Convolution Tool In Java
A great tool for testing out different filters
From the book Image Processing tools in
Java
Available from webCT later on today
To launch: java ConvolutionTool Moon.jpg
23
of
30
1st Derivative Filtering
Implementing 1st derivative filters is difficult in
practice
For a function f(x, y) the gradient of f at
coordinates (x, y) is given as the column
vector:
f
Gx x
f
f
Gy
24
of
30
1st Derivative Filtering (cont)
The magnitude of this vector is given by:
f mag (f )
G G
2
x
2
y
f
f
x
y
2
For practical reasons this can be simplified as:
f G x G y
25
of
30
1st Derivative Filtering (cont)
There is some debate as to how best to
calculate these gradients but we will use:
f z7 2 z8 z9 z1 2 z 2 z3
z3 2 z6 z9 z1 2 z 4 z7
which is based on these coordinates
z1
z2
z3
z4
z5
z6
z7
z8
z9
26
of
30
Sobel Operators
Based on the previous equations we can
derive the Sobel Operators
-1
-2
-1
-1
-2
-1
To filter an image it is filtered using both
operators the results of which are added
together
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
27
of
30
Sobel Example
An image of a
contact lens which
is enhanced in
order to make
defects (at four
and five oclock in
the image) more
obvious
Sobel filters are typically used for edge
detection
28
of
30
1st & 2nd Derivatives
Comparing the 1st and 2nd derivatives we
can conclude the following:
1st order derivatives generally produce thicker
edges
2nd order derivatives have a stronger
response to fine detail e.g. thin lines
1st order derivatives have stronger response
to grey level step
2nd order derivatives produce a double
response at step changes in grey level
29
of
30
Summary
In this lecture we looked at:
Sharpening filters
1st derivative filters
2nd derivative filters
Combining filtering techniques
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
30
of
30
Combining Spatial Enhancement
Methods
Successful image
enhancement is typically
not achieved using a single
operation
Rather we combine a range
of techniques in order to
achieve a final result
This example will focus on
enhancing the bone scan to
the right
Combining Spatial Enhancement
Methods (cont)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
31
of
30
(a)
Laplacian filter
bone scan (a)
of
(b)
Sharpened version of
bone scan achieved
(c)
by subtracting (a)
Sobel filter of bone
and (b)
scan (a)
(d)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
32
of
30
Combining Spatial Enhancement
Methods (cont)
The product of (c)
and (e) which will be
used as a mask
(e)
Result of applying a
power-law trans. to
Sharpened image (g)
which is sum of (a)
(g)
and (f)
Image (d) smoothed with
a 5*5 averaging filter
(f)
(h)
Images taken from Gonzalez & Woods, Digital Image Processing (2002)
33
of
30
Combining Spatial Enhancement
Methods (cont)
Compare the original and final images
