Documentos de Académico
Documentos de Profesional
Documentos de Cultura
Abstract. Local adaptive lters for image restoration (denoising and deblurring),
enhancement and target location local are described. The lters work in the do-
main of an orthogonal transform ( DFT, DCT or other transforms) in a moving
window and nonlinearly modify the transform coecients to obtain an estimate of
the central pixel of the window. A framework for the lter design for multi compo-
nent images is presented and experimental results in denoising, enhancement and
deblurring monochrome and color images and in target location are provided. Also
discussed is lter implementation for the window size of 3 3 pixels in a form
of 5 channel convolution with masks implementing local mean and 4 directional
Laplacians: horizontal, vertical and two (45 ) diagonal.
Keywords: Image restoration, Image enhancement, Target location, Adaptive
lters, Transforms
1 INTRODUCTION
Local adaptive linear lters for image restoration and target location that are
the subject of the present paper implement the idea of space (time)-frequency
signal representation that dates back to 40-th ( [1]) though it has not became
practical (at least in image processing) until 80-th ([2]) when the computer
technology provided computers with an appropriate speed and memory size.
The lters work in a moving window in the domain of an orthogonal transform
and, in each position of the window, nonlinearly modify the signal transform
coecients to obtain an estimate of the central pixel of the window.
Image processing in transform domain rather than in signal domain sug-
gests certain advantages in terms of the convenience of incorporating a priory
knowledge on images into the design of processing algorithms and in terms of
computational expenses. The transfer from signal domain into the transform
domain is especially promising if it is applied locally rather than globally.
In this paper, we overview basic ideas for the lter design and implemen-
tation, justify using for this purpose Discrete Cosine Transform and present
experimental results in denoising and deblurring monochrome and color im-
ages and in target location. We then discuss using other than DCT orthogo-
nal transforms such as Walsh-Hadamard and Haar transforms and show also
that, for the window size 3 3 pixels, ltering in DCT transform domain
is equivalent to 5 channel convolutions with masks implementing local mean
and 4 directional Laplacians: vertical, horizontal and 45 diagonal ones.
2 Leonid Yaroslavsky
2 MULTI COMPONENT LOCAL ADAPTIVE
FILTERS
2.1 Optimal local adaptive lters
For the design of an optimal lter one should formulate an optimization
criterion. The design of local adaptive lters is based upon local criteria that
evaluate image processing quality for each particular image sample as an
average, over a certain neighborhood of the pixel, of a certain loss function
that measures deviation of the estimation of each pixel in the neighborhood
from its true value([2,4{7]). In what follows we assume that images to be
processed are multi component and represented by their components such as
R, G, andn (Bc) components
o n (cof) color
o images.
Let an ;n and ban ;n are samples of ideal image components and
1 2 1 2
nates fn1; n2 g that belong to the neighborhood and let LOSS(a(nc);n ; ba(nc);n ) 1 2 1 2
is a loss function that describes residual degradation of image samples after
the processing. Then, for multi component images, the local criterion can be
expressed in the following form:
X
C X
AVLOSS (k ; k ) = AVimsys (AVobj (
1 2 LOC(akc ;k ; n ; n )
( )
1 2 1 2
c=1 fn1 ;n2 g
LOSS(anc ;n ; banc ;n )))
( )
1 2
( )
1 2
(1)
where AVimsys (:) denotes operation of averaging over realizations of imaging
system sensor's noise and AVobj (:) denotes averaging over unknown param-
eters of the image (such as imaged objects' position, orientation, size) that
arenot known before the processing. The design of optimal local adaptive
n (c) iso aimed at nding a mapping
lters n (ofc) theo set of observed image samples
bn ;n to the set of estimations ban ;n that provides minimum to the
1 2 1 2
criterion for each pixel of the image. For multi component images, if the
neighborhood is dened as a spatial one
jk n j M ; jk n2 j M2 ; 8 c (2)
LOC(n ; n ; c; akc :k ) = 10;; ifotherwise
1 2
( )
1 2 :
1 1 1 2
image fragment b(k ;k ) within the window over the chosen orthogonal trans-
1 2
form T.
n (k ;k )o of the obtained spectral coecients by the lter coe-
2. Multiplication
cients r ;r ; : 1
1
2
2
b(rk11;r;k2;
2)
= r(k1 ;r1 ;k2 ;2 ) r(k1 ;r1 ;k2 ;2 ) . (5)
n o transformation T 1 of the output signal spectral coecients
3. Inverse
br ;r ; to obtain an estimated value of the central pixel of the window.
k
( 1
1
;k )
2
2
Here, subscripts (r1 ; r2; ) are corresponding indices in the transform domain.
With this approach, the synthesis of local adaptive ltersn is(kreduced
;k o to the
determination of (2M1 + 1) (2M2 + 1) C lter coecients r ;r ; . For the
)
1
1
2
2
AVLOSS (k ; k ) ( 1 2
)
XX
C
= AVimsys AVobj jrk1 ;r;k2 ;2 ) r(k1 ;r1 ;k2 ;2 )
( 1
rk1 ;r;k2 ;
( 1
j
2) 2
(6)
r1 ;r2 =1
n o
By minimizing AVLOSS (k1 ; k2 ) with respect to r(k;r;k;) one can nd that 1
1
2
2
the optimal values of the coecients of the lter that minimize the ltration
error as dened by Eq.(4) may be found from the following equation:
n ?o
AVimsys AVobj rk;r;k; rk;r;k; ( 1 2) ( 1 2)
k ;k
r ;r ; =
( 1 2) n o 1 2 1 2
(7)
1 2
AVimsys AVobj jrk;r;k; j ( 1
1 2
2) 2
with ? denoting complex conjugate. The design of the local adaptive lter of
Eq.(7) is therefore reduced to an estimation of local power spectrum of the
input image fragment and its mutual local spectrum with the 'ideal' image.
spectral coecients of the realization of the noise interference. Then one can
obtain from Eq.(7) that optimal restoration lter coecients are dened as:
r(k1 1;r;k2 ;
2)
= jrk;r;k; j jrk;r;k; j
( 1
1 2
2) 2 ( 1
1 2
2) 2
(10)
rk;r;k; AVimsys AVobj jrk;r;k; j
( 1
1 2
2) ( 1
1 2
2) 2
where AVobj denotes averaging over such variations of the useful object(s)
as object position, size, shape, etc.
Another useful criterion for image enhancement is the criterion of signal
spectrum restoration ([12]) that requires restoration of power spectrum of
the object signal. For this criterion, the following obvious lter results:
0 k ;k 1 =
AV
1 2
obj jr ;r ; j ( 1 2) 2
rk;r;k; = @ k ;k A
1 2
( 1 2)
(12)
1 2
jr ;r ; j
( 1
1 2
2) 2
r(k1 1;r;k2 ;
2)
= ; (13)
AVimsys AVobj jrk;r;k; j ( 1
1 2
2) 2
?
where (rk;r;k;) is complex conjugate to the spectrum of the target signal,
1
1
2
2
Fig. 1. Comparison of local DFT and DCT spectra shown in coordinates of spectral
index (vertical) versus signal sample index (horizontal) for a test chirp signal.
Fig. 2. Comparison of local DFT and DCT spectra for an electro cardiogram test
signal.
ried out by one or another smoothing the observed spectrum of the fragment
being processed. The estimation of the spectrum of "ideal" image fragments
in the case of additive signal-independent noise can then be carried out using
the relationship:
jrk;r;k; j jrk;r;k; j '
( 1 2) 2 ( 1 2) 2
1
n 2 1 2
o
max 0; AVimgsys AVobj jrk;r;k; j ( 1
1 2
2) 2
AVimgsys jrk;r;k; j
( 1
1 2
2) 2
; (14)
Local adaptive ltering 9
As a zero order approximation, one can use the observed power spectrum
jr(k;r;k;) j2 as an estimate of the averaged one AVimgsys AVobj jr(k;r;k;) j2 . In
1
1
2
2
1
1
2
2
this way we arrive at the following implementation of lters for image de-
noising and deblurring:
8 k ;k
< j r ;r ; j jr ;r ; j
k ;k
if rk;r;k; 6= 0 ;
( 1 2) 2 ( 1 2) 2
2)
r(k1 ;r1 ;k2 ; = (19)
jrk;r;k; j + jrk;r;k; j
( 1
1 2
2) 2 ( 1
1 2
2) 2
10 Leonid Yaroslavsky
Fig. 4. Upper row: initial piece-wise constant and noisy test images (standard devi-
ation of noise is 20 in the range 0-255). Bottom row: image ltered by the rejective
lter of Eq. (16) with window size is 7 7 pixels , r1 ;r2 ; = 1, thr = 20 and a
map of local lter transparency. Pixel gray level on this map is proportional to the
number of signal spectral components that are preserved by the lter.
Fig. 7. Blind image restoration: initial (left) and restored (right) images. Filtering
was performed with the lter of Eq. (17) in the window 7 7 pixels with P =
0:75; G = 2 and thrr = 50; thrg = 30; and thrb = 60:
Fig. 8. Single component image enhancement by lter of Eq. (17) in the window
15 15 pixels with P = 0:5, thr = 15 and G = 3: initial (left) and ltered (right)
images
Local adaptive ltering 13
The result of localization (marked with a cross) Target (highlighted)
40 40
20
20
0
0
20
20
Fig. 10. Arrais of 8 8 basis functions of (from left to right) 2-D DCT, Walsh-
Hadamard and Haar Transforms of the order 8.
Further natural modications are shaping the Laplacian's masks DCT 00,
DCT 20, DCT 02, DCT 220, and DCT 221 by an appropriate window function
and a directional smoothing the convolution results. The shaping may help to
reduce artifacts associated with the rectangle sampling raster. The directional
smoothing may provide better denoising capability than the simple element-
wise thresholding.
Local adaptive ltering 17
7 CONCLUSION
We have described local adaptive lters for image restoration, enhancement
and target location that work in a moving window in the domain of the
DCT and other transforms, outlined the lter design and implementation
and demonstrated their applications for processing 1-dimensional signals,
monochrome and color images. We also have shown that ltering in the DCT
domain by the local adaptive ltering in the window 3x3 is equivalent to
image convolutions with uniform aperture and horizontal, vertical and two
diagonal (45) 3 3 Laplacians.
References
1. Gabor D. (1946), Theory of Communication, J. Inst. Elec. Eng.,93: 429-457
2. Yaroslavsky L. (1987) Digital signal processing in optics and holography, Radio
i Svyaz', Moscow (in Russian)
3. Vitkus R. Yu., Yaroslavsky L.P.(1988) Adaptive Linear Filters for Image Pro-
cessing, In: V.I. Siforov, L.P. Yaroslavsky (Eds.) Adaptive Methods for Image
Processing, Nauka Publ.,Moscow: 6-35. (In Russian)
4. Yaroslavsky L. P. (1991) Linear and rank adaptive lters for image processing.
In L. Dimitrov and E. Wenger, (Eds) Digital Image Processing and Computer
Graphics. Theory and Applications, Oldenburg, Wien{Mnchen: R., pp. 374,
1991
5. L.P. Yaroslavsky (1996) Local Adaptive Filters for Image Restoration and En-
hancement. In: M.-O. Berger, R. Deriche, I. Herlin, J. Jare, J.-M. Morel (Eds.)
12-th Int. Conf. on Analysis and Optimization of Systems. Images, Wavelets
and PDE's, Paris, June 26-28, 1996, Springer Verlag, Lecture Notes in Control
and Information Sciences, 219, 31-39.
6. Yaroslavsky L. (1996) Local Adaptive Image restoration and Enhancement with
the Use of DFT and DCT in a Running Window. In: Unser A., Aldroubi A.,
Laine A.F. (Eds.) Wavelet Applications in Signal and Image Processing IV,
SPIE vol. 2825, 2-11.
7. Yaroslavsky L. and Eden M. (1996), Fundamentals of Digital Optics,
Birkhauser, Boston
8. Yaroslavsky L.P. (1993), The Theory of Optimal Methods for Localization of
Objects in Pictures, In: E. Wolf (Ed.) Progress in Optics, v.XXXII, Elsevier
Science Publishers, Amsterdam
9. Yaroslavsky L. (1997) Nonlinear adaptive image processing in transform do-
main,In: 1977 IEEE Workshop on Nonlinear Signal and Image Processing, Sept.
7-11, 1997, Grand Hotel, Mckinac Island, Michigan, USA
10. Yaroslavsky L., Marom E. (1997), Nonlinearity optimization in nonlinear joint
transform correlators, Applied Optics, 36, July: 1-7.
11. Vitkus R. Y. and Yaroslavsky L.P. (1987) Recursive Algorithms for Local Adap-
tive Linear Filtration. In: L.P. Yaroslavskii, A. Rosenfeld and W. Wilhelmi
(Eds.) Mathematical Research, Academy Verlag, Berlin, 34-39
12. Pratt W. K. (1978), Digital Image Processing, Wiley, N. Y.
13. Donoho D.L. and Johnstone I.M (1994) Ideal spatial adaptation by wavelet
shrinkage, Biometrica, 81(3): 425-455