Documentos de Académico
Documentos de Profesional
Documentos de Cultura
Ankur Jain 01D05007 Pranshu Sharma 01005026 Prashant Baronia 01D05005 Swapnil Zarekar 01D05001
Introduction
Problem Statement : Given an image, to identify it as a face and/or extract face images from it. To retrieve the similar images (based on a heuristic) from the given database of face images.
Approach
Similar to Content Based Image Retrieval (CBIR). Neural Networks and Self Organizing Maps (SOMs). Principal Component Analysis (PCA). Relevance feed back.
Stages of Face Recognition (1) face location detection (2) feature extraction (3) facial image classification Approaches of Feature Extraction (1) local feature : eyes, nose, mouth information easily affected by irrelevant information . (2) global feature : extract feature from whole image .
PCA
Main assumption of PCA approach:
Face space forms a cluster in image space. PCA gives suitable representation.
Eigenfaces (1)
Calculation of Eigenfaces
(1) Calculate average face : v.
(2) Collect difference between training images and average face in matrix A (M by N), where M is the number of pixels and N is the number of images.
C AAT
What to do?
Eigenfaces (2)
Calculation of Eigenvectors of C
If the number of data points is smaller than the dimension (N<M), then there will be only N-1 meaningful eigenvectors. Instead of directly calculating the eigenvectors of C, we can calculate the eigenvalues and the corresponding eigenvectors of a much smaller matrix L (N by N).
L AT A
if i are the eigenvectors of L then A i are the eigenvectors for C.
The eigenvectors are in the descent order of the corresponding eigenvalues.
u aii
i
ai u i
T
Eigenfaces (4)
Experiment and Results Data used here are from the ORL database of faces. Facial images of 16 persons each with 10 views are used. - Training set contains 167 images. - Test set contains 163 images. First three eigenfaces :
0.8 0.6 0.4 0 50 100 150 number of eigenfaces validation set training set
What is SOM ?
TS-SOM :- Tree structure self-organizing maps Competitive learning ANN Each unit of map receives identical inputs Units compete for selection Modification of selected node and its neighbors
Training of SOM
Randomly initialized Selection based on some query parameter On selection a node and its neighbors are modified Degree of modification reduces with each iteration
Algorithm
Calculate weight vector for first level. Initialize weight vectors of other levels. Calculate centroid associated to each node as mean of closest training samples. Iterate to the next level.
Relevance Feedback
System content based retrieval. Point of human intervention User analysis of system output. User selects most relevant Query iterated if output not satisfactory
Future Work
Face Detection in motion pictures. Detailed study of the proposed system assuming PCA assumptions not to be true. Investigate whether eigenfaces is a good solution for this problem by comparing with other feature extraction techniques such as DCT
References
Navarrete P. and Ruiz-del-Solar J. (2002), Interactive Face Retrieval using Self-Organizing Maps, 2002 Int. Joint Conf. on Neural Networks IJCNN 2002, May 12-17, Honolulu, USA. A tutorial on Principal Components Analysis, By Lindsay I Smith. Eigenfaces for Recognition, Turk, M. and Pentland A., (1991) Journal of Cognitive Neuroscience, Vol. 3, No. 1, pp. 71-86. Ruiz-del-Solar, J., and Navarrete, P. (2002). Towards a Generalized Eigenspace-based Face Recognition Framework, 4th Int. Workshop on Statistical Techniques in Pattern Recognition, August 6-9, Windsor, Canada. Simulating Neural Networks by James A. Freeman. Artificial Intelligence by Neil J. Nielsson.