Documentos de Académico
Documentos de Profesional
Documentos de Cultura
A Minor Project Report Submitted in Partial Fulfillment of the Requirements for the Degree of
Department of Electrical Engineering Electronics & Communication Engineering Program Institute of Technology, Nirma University Ahmedabad-382481 November 2011
CERTIFICATE
This is to certify that the Minor Project Report entitled Pseudo Color Image Processing submitted by Jaydip Fadadu (Roll No. 08BEC024) and Kuldip Gor ( Roll No. 08BEC030) as the partial fulfillment of the requirements for the award of the degree of Bachelor of Technology in Electronics & Communication Engineering, Institute of Technology, Nirma University is the record of work carried out by his/her under my supervision and guidance. The work submitted in our opinion has reached a level required for being accepted for the examination.
Date:
ACKNOWLEDGEMENT
It gives us great pleasure in expressing thanks and profound gratitude to we like to give our special thanks to our Faculty Guide, Prof Tanish Zaveri, Professor, Department of Electronics & Communication Engineering, Institute of Technology, Nirma University, Ahmedabad for his valuable guidance and continual encouragement throughout the Minor Project. We are heartily thankful to him for his regular suggestions and the clarity of the concepts of the topic that helped us a lot during this project. We are also thankful to Prof A. S. Ranade, HOD, Department of Electronics & Communication Engineering, Institute of Technology, Nirma University, Ahmedabad for his continual kind words of encouragement and motivation throughout the Minor Project. We are also thankful to Dr K Kotecha, Director, Institute of Technology for his kind support in all respect during our work. We are thankful to all faculty members of Department of Electronics & Communication Engineering, Institute of Technology, Nirma University, Ahmedabad for their special attention and suggestions towards the project work. The friends, who always bear and motivate us throughout this course, we are thankful to them.
ABSTRACT
Human eye can distinguish only a limited number of gray scale value but can distinguish between thousands of color. So it is clear that human can extract more amount of information from the colored image than that of the gray image. So pseudo coloring is very useful in improving the visibility of an image. Certain application like buggage scanning at airport or in medical field or in night vision camera works in the band of X ray and infrared so the images produced by this techniques always gives gray image. At the same time the proper inspection of this all images is very crucial and critical. So coloring of those images is very important. Moreover color should be applied in such a way that it improves the visibility of image in optimal way for that particular application. The project discusses various techniques of pseudo coloring for images of above mentioned applications.
Index
Chapter No. Title Acknowledgement Abstract Index List of Figures List of Tables Nomenclature 1 Introduction 1.1 Introduction 1.2 1.3 1.4 2 3 Necessity of project Objective of project Contents of the report Page No. i Ii iii iv v vi 1 1 1 2 3 4 7 8 8 9 9
Classification of Pseudo Coloring Technique Pseudo Coloring of Night Vision Images 3.1 False Color Fusion and Color Enhancement 3.2 3.3 3.4 Color Based Clustering Using Hill Climbing Cluster Recognization Color Transferring
Pseudo Coloring of x-ray Images of Medical & 11 Luggage scanning @ Air-port 4.1 Simple Process of Pseudo Coloring 11 4.2 4.3 Various Coloring Techniques 12 Proposed Method based on Look Up Table 18 designed from Warm Color Scale 23 Evaluation Parameters Conclusions 24
References
25
LIST OF FIGURES
Fig. No. Title Page No. 1 2 3 4 5 6 7 8 9 10 11 12 13 14
Block Diagram Of Color Transfer Method Results of Night Vision Color Image Simple Block Diagram of Pseudo coloring The HOT color Scale R,G and B v/s I for HOT coloring The JET color Scale R,G and B v/s I for JET coloring R,G and B v/s I for HSI coloring The HSI color Scale based on Concave Part(solid part of Fig. 8) The HSI color Scale based on Convex Part(solid part of Fig. 8) The RAINBOW color Scale R,G and B v/s I for RAINBOW coloring Simulation Results of various Coloring Methods
7 10 11 12 13 13 13 14 14 14 15 15 16
Detailed Block Diagram of Proposed Method based on Look Up 18 Table designed from Warm Color Scale
15 16 17
The WARM color scale R,G and B v/s I for WARM coloring
20 20
Simulation Results of Proposed method based on Look up table 21 created as per warm color scale
LIST OF TABLES
1
23
NOMENCLATURE
Vis IR Visible Image Infrared Image Mean kth cluster in source images Standard deviation of kth cluster in source images Mean of nth target image Standard deviation of nth target image Q Similarity matrix
Chapter 1 Introduction
1.1 Introduction
Pseudo-color image processing assigns color to grayscale images. This is useful because the human eye can distinguish between millions of colors but relatively few shades of gray. Pseudo-coloring has many applications on images from devices capturing light outside the visible spectrum, for example, infrared and X-rays. A pseudo-color image is derived from a grey scale image by mapping each pixel value to a color according to a table or function. The table or the function is decided in such a way that it enhances the visibility optimally for a particular application. To achieve that objective various color scales are defined in the literature. The color scales are defined in different color spaces like RGB or HSI etc. before performing the actual color assigning the gray scale image is enhanced by performing certain operations on it. The project discusses the various techniques of enhancing the image and performing pseudo coloring on it to enhance the visibility.
intelligent surveillance systems for security. These systems are designed to provide enhanced image with better perceptual quality in adverse environmental conditions. The most common night-time imagery systems capture images in two spectral bands, near infrared (NIR) and visual, thus providing complementary information of the observed scene which enables the observer to perceive more complete picture of the scene with a larger degree of situational awareness. A fused image combines all the salient information from the source images which is more suitable for human/ machine perception. Image fusion is an effective way of reducing the volume of information while at the same time it preserves all the useful information from the source images. The rapid development in the technology of night vision (NV) systems has led to a growing interest in the natural color display of night vision imagery. As human visual system is more sensitive to color information, efficient color transfer methods are required to enhance color image which has several benefits over gray image. The color transfer methods improve feature contrast, allowing better scene recognition and object detection which is useful in surveillance, reconnaissance, and security applications.
Chapter 2
1) Spectrum-based maps, where color scales are designed by having the hue sequence
range from violet, via indigo, blue, green, yellow, and orange, to red, following the color order of the visible spectrum. Since the human visual system has different sensitivities to different wavelengths, researchers such as Clarke and Leonard indicated that spectrum-based color scales were not perceived to possess a color order that corresponds to the natural order of grayscale in the image.
the unexpected results. One particular reason was that they used the CIELUV model to adjust the final colors which might not have been appropriate to model the perceived uniformity. Another reason was that the perceived change in color due to its surrounding was not taken into consideration. Shi et al designed a uniform color scale by visually setting up its color series to run from inherently dark colors to inherently light colors; i.e., from black through blue, magenta, red, yellow to white, then further adjusting the colors to make them equally spaced. The color scales were evaluated by comparing them to the grayscale. The authors indicated that the contrast sensitivity has been improved after applying their uniform scale, but they failed to demonstrate any significant outcome.
which may yield less naturalistic results for images containing regions that differ significantly in their content. Gang and Huang presented a multi-scale color image fusion using contourlet transform and expectation maximization (EM) where the color transfer is implemented in YUV color space. A new linear color space ICbCr was proposed by Xu and Li in especially for multiband night vision imagery to transfer the color distribution of the target image to the source NV images.
Chapter 3
NV image is obtained. Color based clustering is performed on the colormap in the LAB color space using hill climbing algorithm. The association between each cluster and a natural color image in the target color look-up table is carried out automatically utilizing a nearest neighbour criteria based on a color similarity metric. The color components in each index within a cluster of the colormap are modified by statistics matching with the corresponding natural color image. The natural colored nightvision image is produced from the new colormap. Finally, the natural colored NV image is transformed to HSV color space and the enhanced gray image is substituted in the value (V) component to generate the final output of the proposed method. The subsequent subsections of this section describe the detailed explanation of the major steps of method [3].
seeds for the K-means segmentation. Thus, local maxima are found for clusters in the 3D color histogram of the colormap in the LAB color space. The entries of the colormap are then associated with the detected local maxima to generate several coherent clusters in the LAB colormap.
Where
Is used for the measure of the distance between Kth cluster and nth image.
Kth cluster is associated with nth natural image. deviation of kth cluster in source images. deviation of nth target image.
and and
indicates the mean and standard indicates the mean and standard
Chapter 4
X-Ray Image
Contrast Stretch
Color Conversion
A. X-ray Image: It is the simple black and white image taken by x-ray camera. Each pixel of the image has information i.e. intensity of which value varies from 0 to 255. Processing is done on this image. B. Contrast stretch This process increases the difference between maximum and minimum intensity. In most of the methods simple linear stretch is applied. C. Salt & Pepper Noise Removal After contrast stretching, Salt and pepper noise is removed. It is done by applying various filters. In most of the cases median filter is applied. At the end of this block we get enhanced gray image with more information regarding weapons in case of luggage scanning or fractures in case of medical images. D. Color Conversion It is the process of converting enhanced gray scale image into color image. Various methods for color conversion are available [1][2][5]. We have studied 4 basic methods: i. ii. iii. iv. Hot Jet HSI Rainbow
Fig.4 The HOT color Scale In fig. 3 RGB values versus gray value is shown for HOT coloring. That plot shows the variation of R,G and B with respect to I.
2. JET It is RGB based linear color map. It ranges from Blue to Red, passing through Cyan, Yellow and Orange as shown in fig.4. In fig. 5 RGB values versus gray value is shown for JET coloring. This color map can be obtained by converting this plot into simple mathematical formulas.
3. HSI It is Histogram based non-linear color mapping. The colors of the various components in the scene are assigned based on the values of the raw image. Pixel ranges are selected from the datas histogram and automatically given certain colors. For example, four gray-level regions were created, the chances of the low density threat being present would be greatest in the first two regions. Blue will be used as background and other easy-to-remember basic colors like red and green are applied to the other pixels in each bin. The output image would have four hues, which vary as a function of the gray intensity value of each pixel.
4. Rainbow It can be considered as a special case of Sine/Cosine transform. 3 color transfer functions are used for rainbow map. All the functions are periodic in the sense that they get peak in particular color interval. Rainbow based color map and RGBs relation with I are shown in following figures.
4.3 Proposed Method based on Look Up Table designed from Warm Color Scale
This method is specially designed for pseudo coloring in x-ray images for weapon detection and medical. In fig. 14 a detailed block diagram is shown.
Fig. 14 Detailed Block Diagram of Proposed Method based on Look Up Table designed from Warm Color Scale
Initially Look Up Table is created based on WARM color scale. Warm color scale is explained in [1][2][5]. A simple x-ray image is passed through various blocks to enhance the information regarding fractures/cracks or weapons in case of medical or weapon detection @ airport respectively. Pseudo coloring on this enhanced gray image is done based on the Look Up Table prepared earlier as per warm color scale.
Explanation of the above block diagram: [1]. X-Ray Image It is the simple black and white image taken by x-ray camera. It may be the image of any body part taken for medical use or may be image of weapon detection @ air-port. Each pixel of the image has information i.e. intensity of which value varies from 0 to 255. Processing is done on this image. [2]. Adaptive Histogram Equalization It is the process of enhancing the contrast of images by transforming the values in the intensity image I. Unlike simple histogram equalization it operates on small data regions (tiles), rather than the entire image. Each tile's contrast is enhanced, so that the histogram of the output region approximately matches the specified histogram. The neighboring tiles are then combined using bilinear interpolation in order to eliminate artificially induced boundaries. The contrast, especially in homogeneous areas, can be limited in order to avoid amplifying the noise which might be present in the image. In this proposed method tile size is taken as 16 x 16. [3]. Contrast Stretch using Intensity Adjust By this block linear intensity contrast stretch is applied. It increases the difference between maximum and minimum intensity. MATLAB inbuilt function imadjust is used for this function. [4]. Noise Removal Using 2D-Median Filter. At the end of the contrast stretching we get the image which may have few unwanted noise dots. It should be removed for false detection. This can be removed by filter. In this proposed method 2 dimensional median filter is used. It is the filter which takes the median of given square block. Here we have taken 3 x 3 block.
[5]. Enhanced Gray Scale Image This is the final gray scale image i.e. enhanced image having more information than original one. Now the coloring is done on this image. [6]. Warm color scale This is non-liner color scale. It varies from Dark Blue to Light Yellow through Magenta and Orange as shown in fig. 15. The distances of adjacent colors on this scale are perceivably equal. A 256-step scale as seen in Fig. 11 was developed. For any intensity I(i) and I(i+1) the correspondence (R, G, B)(i) < (R, G, B)(i+1). This law is followed throughout the color scale. Respective relation of R,G and B with I is shown in fig. 16.
[7]. Look Up Table It is a simple table which gives the corresponding R, G and B values for given intensity I. It is designed based on the Warm Color Scale which is already explained earlier.
[8]. Color Conversion using Look Up Table Color Conversion i.e. I to (R,G,B) is done based on the look up table created earlier. The coloring is done on enhanced gray scale image. It is just a simple assignment of (R,G,B) as per the value of intensity of that pixel.
[9]. Enhanced Color Image This is the final color image having more, clear information regarding fracture or cracks in medical images or weapons in luggage scanning @ airport.
Fig. 17 Simulation Results of Proposed method based on Look up table created as per warm color scale
Chapter 5
where G is the number of gray levels in the images histogram (which can be 255 for a typical 8-bit image) and p(i) is the normalized frequency of occurrence for each gray level, i.e., the histogram of the image. The entropy of colored image is computed for each band in RGB color space and average of the entropy of the three bands is considered for evaluation. Colorfulness metric is an efficient metric for calculating colorfulness of images and it is described in [4]. Larger the color variations in the image, higher is the colorfulness metric. The proposed algorithm is compared with the standard statistics matching method proposed by Toet. The simulation results of proposed algorithm are shown in Figure 17 and the simulation results of other coloring techniques are shown in figure 13. It is observed that proposed method provides more informative appearance compared to other method [1] and [5] as shown in Figure 13 and Figure 17. Hence the cracks in medical image and weapons in luggage scanning the scene can be easily distinguished. Their comparison with other techniques using parameters like entropy and colorfullness metric are shown in table 1.
ENTROPY
NO
1 2 3 4 5 6
HOT
0.9734 0.6764 0.7389 0.7643 0.6358 1.5171
JET
3.607 3.5149 3.6231 3.8605 3.5244 3.6661
HIS
5.4859 5.5525 5.5841 5.5473 5.7071 5.4594
RAINBOW PROPOSED
6.4439 6.4578 6.5618 6.443 6.9876 5.9877 5.772 5.5401 5.5839 5.5479 5.6924 5.7758
COLORFULLNESS METRIC
HOT
1 2 3 4 5 6 165.82 159.18 171.64 185.31 156.77 210.2
JET
0.8937 0.8947 0.9241 0.9396 0.811 1.073
HIS
0.989 0.9973 0.8892 0.9736 0.7456 0.8602
RAINBOW PROPOSED
0.3512 0.3512 0.3512 0.3512 0.3512 0.3512 76.3414 73.7114 73.7709 81.549 78.3135 87.2228
CONCLUSION
Thus in this report we presented efficient method for pseudo coloring of grayscale images. Here we discussed the pseudo coloring of two different types of images. The first is Night vision infrared image and second is X ray images. Night vision images are used in army and nevy applications while the X ray images are used at air ports as well as in medical. Thus we can see that it is very crucial that the image should be visibly best as possible. So that personnel can extract information as much as possible. So we apply color to those images in this project. We can see that the colored images are far better to analyze than the gray images. Moreover same method cannot be applied to two different type of the field. So we used two very different methods to for night vision images and X ray images. For night vision images we try to apply natural color to images so that soldiers can relate the image to the surround environment and looks familiar. So we prepared the database using natural reference image and applied color transfer using that. In x ray we used the applied the standard color scales defined in the literature and applied. We also developed a color look up table for coloring and we observe that in this method we obtained the best result. In future we still find the another method for colorization. The pre-processing on the grayscale images is very crucial and more enhancing algorithms can be applied to obtain still better results.
References
[1]. Andreas Koschan and Mongi Abidi, "Digital Color Image Processing," A John Willy & Sons, INC., Publication, Hoboken, New Jersey. [2]. Rafael C. Gonzalez and Rechard E. Woods, Digital Image Processing Prentice Hall, New Jersey. [3]. Tanish Zaveri, Mukesh Zaveri, Ishit Makwana and Harshit Mehta, An Optimized Region-based Color Transfer Method for Night Vision Application. [4]. [5]. Toet. Natural color mapping for multiband nightvision imagenary. Information Fusion, vol. 4(3), pp. 155-166, 2003. Besma R. Abidi, Senior Member, IEEE, Yue Zheng, Andrei V. Gribok, and Mo ngi A. Abidi, Member, IEEE. Improving Weapon Detection in Single Energy X-Ray Images Through Pseudocoloring Ieee transactions on systems, man, and cyberneticspart c: applications and Reviews, vol. 36, no. 6, pp. 784-796, November 2006.