Documentos de Académico
Documentos de Profesional
Documentos de Cultura
IMAGE REGISTRATION
ISAN-DSP GROUP
Course Syllabus
Date and Time : MW 11.00-12.00 EN 4510, LAB1 TU17-20, LAB2 TH17-20
Assessments:
Attendance & Homework
5%
Lab and Homework
35%
Midterm
30%
Final
30%
Grading:
85-100% A, 75-85% B+, 70-75% B, 65-70% C+, 60-65% C,
55-60% D+, 50-55% D, 0-50% F
References:
1. Rafael C. Gonzalez and Richard E. Woods, Digital Image Processing,
Addison Wesley, 1992.
2. Anil K. Jain, Fundamentals of Digital Image Processing,
Prentice-Hall, Inc., 1989.
3. William K. Pratt, Digital Image Processing, 2nd Edition,
Wiley & Sons, Inc., 1991.
ISAN-DSP GROUP
Course Outline
1. Introduction
2. Digital Image Fundamentals
3. Image Transforms
4. Image Enhancement
5. Image Segmentation
6. Image Compression
7. Image Morphology
ISAN-DSP GROUP
Chapter 1
Introduction to Image Processing
ISAN-DSP GROUP
3.
4.
5.
ISAN-DSP GROUP
Digital Image
Digital image = a multidimensional
array of numbers (such as intensity image)
or vectors (such as color image)
10
9
15
32
10 16 28
65 70 56 43
6 26703756
32 99
54 96 67
25 6013 902296
21 54 47 42
15 8587 853943
54 65 65 39
32 65 87
78
67
92
99
ISAN-DSP GROUP
ISAN-DSP GROUP
ISAN-DSP GROUP
2.
The iris diaphragm controls amount of light that enters the eye.
3.
4. Blind spot is the region of emergence of the optic nerve from the eye.
ISAN-DSP GROUP
ISAN-DSP GROUP
ISAN-DSP GROUP
ISAN-DSP GROUP
Intensity
Position
ISAN-DSP GROUP
A
Intensity
Position
In area A, brightness perceived is darker while in area B is
brighter. This phenomenon is called Mach Band Effect.
ISAN-DSP GROUP
Simultaneous contrast. All small squares have exactly the same intensity
but they appear progressively darker as background becomes lighter.
ISAN-DSP GROUP
Image plane
y,Y
x,X
(X,Y,Z)
z,Z
Lens center
(x,y)
(x,y,z) = Camera coordinate system
= focal length
x
X
Z
y
Y
Eq. 1.1
ISAN-DSP GROUP
x
c y
z
X
Z
Y
Z
Z
Z
Eq. 1.2
Since on the image plane z is always zero, z=0, we consider only (x,y)
while z is neglected.
ISAN-DSP GROUP
X
Cartesian w Y
coordinate
Z
kX
kY
Homogeneous w
h
coordinate
kZ
k
k = nonzero constant
ISAN-DSP GROUP
1
0
P
0
0 0
1 0
0 1
0 1
0
0
1
0
c h Pw h
0
0
1
0
0
0
0
1
1
0
0
0
kX
kX
kY
kY
kZ
kZ
k (Z )
Eq. 1.3
ISAN-DSP GROUP
From homogeneous
coordinate
ch
kX
kY
kZ
k (Z )
X
kX
k
(
Z
c kY
k (Z )
Z
kZ
k
(
Z
x
y
ISAN-DSP GROUP
wh P 1ch where
1
0
P 1
0
0 0 0
1 0 0
0 1 0
0 1 1
Eq. 1.4
ISAN-DSP GROUP
kx0
ky
ch 0
0
kx0
ky
wh P 1ch 0
0
or
x0
w y0 ???
0
ISAN-DSP GROUP
We get
kx0
ky
ch 0
kz
wh P 1ch
kx0
ky0
kz
k(z )
x0
X
y 0
or w Y
Z z
Eq. 1.5
ISAN-DSP GROUP
Z
z
Z
Eq. 1.6
x0
X ( Z )
y0
Y ( Z )
Eq. 1.7
ISAN-DSP GROUP
Image plane
y,Y
x,X
(X3,Y3,Z3)
(X2,Y2,Z2)
(X1,Y1,Z1)
z,Z
Lens center
(x,y)
ISAN-DSP GROUP
(x1,y1)
Left lens
center
(x2,y2)
right lens
center
Optical axis
ISAN-DSP GROUP
(x2,y2)
Plane of
constant Z
ISAN-DSP GROUP
x1
X 1 ( Z1 ) and
x2
X 2 ( Z 2 )
Z1 Z 2
X 2 X1 B
4. From 1, 2 and 3, we get
x1
X 1 ( Z ) and
Solving Z yields
x2
X 1 B ( Z )
B
x2 x1
ISAN-DSP GROUP
ISAN-DSP GROUP
2. Scaling
3. Rotating
ISAN-DSP GROUP
(X
,Y
,
Z)
(X+X0,Y+Y0,Z+Z0)
(X,Y,Z)
X * 1
*
Y 0
Z* 0
0
1
0
0
0
0
1
0
X0
Y0
Z0
X
Y
Z
1
ISAN-DSP GROUP
(X
,
Y0 ,
Z0 )
(0,0,0)
Z * Z Z0
X * 1
*
Y 0
Z* 0
1 0
0
1
0
0
0 X0
0 Y0
1 Z0
0
1
X
Y
Z
1
X
The object still stays at the same position. Only the frame is moved.
ISAN-DSP GROUP
Z * Sz Z
e
f
a
A
d
g
b
B
Y * S yY
X * Sx
* 0
Y
Z* 0
1 0
0
Sy
0
0
0
0
Sz
0
0
0
X
Y
Z
1
ISAN-DSP GROUP
0
0
0
1
1
1
X=X
Note : In this case the object is moved. Only y and z
are changed while x stills the same.
ISAN-DSP GROUP
Z
Y
x
0
X * 1
*
Y 0 cos x
Z * 0 sin x
0
1 0
0
sin x
cos x
0
0
0
X=X
Note : In this case the object is not moved. The frame
is rotated instead.
X
Y
Z
1
ISAN-DSP GROUP
Z * sin y 0 cos y 0 Z
0
0
0
1
1
1
Y= Y
X
ISAN-DSP GROUP
Y= Y
X
Z
Z * sin y 0 cos y 0 Z
y
0
0
0
1
1
1
X
Note : In this case the object is not moved. The frame
is rotated instead.
ISAN-DSP GROUP
0
0
Y
z
z
Z
Z* 0
0
1 0 Z
0
0
0
1
1
1
Y
X
Note : In this case the object is moved. Only x and y
are changed while z stills the same.
ISAN-DSP GROUP
Z= Z
Z*
0
0
1 0 Z
0
0
0
1
1
1
Y
z
X
Note : In this case the object is not moved. The frame
is rotated instead.
ISAN-DSP GROUP
Ca
me
ra
C
Answer:
S y o o rd
st e
m inate 1. Transform the world coordinate to
the camera coordinate
2. Perform the perspective transformation
x
y
Y
ISAN-DSP GROUP
(x,y)
Lens center
(X,Y,Z)
ISAN-DSP GROUP
Z
x
w0 1
1. Translate* by w0
2. Pan the camera*
(rotate about Z-axis)
2
y
Gimbal center
ISAN-DSP GROUP
Rotate by
Pan ( z)
and Tilt ( x)
Translate to the
gimbal center w0
ISAN-DSP GROUP
x
w1 1
1. Translate* by w1
Gimbal center
ISAN-DSP GROUP
ch P R T wh
World coordinate
Perspective tr.
Rotate by
Pan ( z),
Tilt ( x),
Twist ( y)
Translate to
the image
plane center w1