JAGANS COLLEGE OF ENGINEERING & TECHNOLOGY CHAVATAPALEM,NELLORE

A SEMINAR REPORT ON

BLUE EYES
SUBMITTED BY

T.VAMSI VARDAN REDDY

(Regd.No:093E1A1214) UNDER THE VALUABLE GUIDANCE OF

Mr. KIRANKUMAR REDDY,M.Tech

LECTURER

CONTENTS

ABSTRACT INTRODUCTION TECHNOLOGY TYPES OF EYETRACKING TECHNIQUES DESIGN APPLICATIONS CONCLUSION

ABSTRACT
The Blue eyes is a hands-off, unobtrusive, human computer interface that can be used to track a users actions and to allow him to interact with the computer environment. The aim of this technology is to give the computers the human power and develop its perceptual abilities so as to understand the users state of mind and give him the necessary feed back .It can be applied to replace the explicit manual commands with implicit ones like eye-gaze. It makes the computers more attentive to the users needs by making them concentrate on the users behavior. The compelling force behind the evolution of this technology is mans desire to endow the computer with emotional intelligence, because studies have proved that emotions play a vital role in logical thinking and decision-making, and the computer axiom makes it clear that computers that can emulate human emotions are more likely to give a logical output. It is deemed that the best way for computers to really help humans is to become a part of the physical human world. The technology uses portable systems that are made of an integrated circuitry of different type of sensors and are made compatible with the computer environment. Because of its sensor enabled vigilance and sensitivity, it finds a wide range of applications in medicine, security, etc.

INTRODUCTION:
Imagine one fine morning you walk on to your computer room and switch on your computer, and then it tells you Hey friend! Good Morning! You seem to be in a bad mood today. And then it opens your mail box and shows you some of the mails and tries to cheer you. It seems to be a fiction, but it will be the life lead in the very near future. Is it possible to create such a computer which can interact with us, as we interact with each other? This incredible idea which seems to be the pinnacle of personification has been brought to reality by the fast evolving technology called BLUE EYES.

The basic idea behind this technology is to give the computer the human power. Humans have highly developed cognitive abilities to perceive, integrate, and interpret visual, auditory, and touch information. We also have some perceptual abilities with which we can understand each others feelings. For example we can understand ones emotional state by analyzing his facial expression. If we add these perceptual abilities of human to computers it would enable computers to work together with human beings as intimate partners. The Blue Eyes technology aims at creating computational devices with the sort of perceptual abilities that people take for granted.

TECHNOLOGY:
Blue Eyes uses sensing technology embedded with video cameras, microphones and other sensors to track, identify and observe a users actions and to extract key information, such as where the user is looking and what the user is saying verbally and gesture. Biometric sensors that can measure body temperature, blood pressure, muscle tension, and other physiological signals associated with emotion, are also embedded. These clues are analyzed to determine the users physical, emotional, or informational state which in turn can be used to help make the user more productive by performing expected actions or

by providing expected information. Blue Eyes can also take facial measurements, it can determine if a person is smiling or frowning, and perhaps if it identifies a frown it might play happy music. It will make computing to move from explicit commands to implicit ones. The technology uses BLUETOOTH wireless technology to sense (see) the users actions and hence it has been named Blue eyes. Blue Eyes system provides technical means for monitoring and recording human-operators physiological condition. The key features of the system are: visual attention monitoring (eye motility analysis) physiological condition monitoring (pulse rate, blood oxygenation) operators position detection (standing, lying) wireless data acquisition using Bluetooth technology physiological data, operators voice and overall view of the control room recording recorded data playback

The system is then programmed in such a way so as to take multiple inputs (from the various sensor devices) analyze them and give the output according to the various combinations.

SENSING TECHNOLOGY:
This technology mainly employs gaze tracking system which is a remote human-computer interface that can be used to track a users gaze point or allow an operator to interact with their environment using only their eyes. The eyes are the main elements of ones face that give an insight to ones feelings. So knowledge of the eye parts is essential to understand the design and working of the technology. The ocular features in the order that light strikes are as follows: Cornea, which is a small transparent area in the outer covering of the eye. Pupil, which is a hole that is surrounded by the iris, the color in our eyes. The iris expand or contract in response to light

The iris is small and the pupil large in dim or dark light and vice-versa in bright light. In dim light it is best to take in as much light as possible, whereas in bright light it is best to take in less light so as not to damage fragile structures inside the eye. Interestingly, the pupil/iris combination also changes in response to psychological factors.

Taking into account these features and their response to light under various conditions, different types of eye tracking methods have been designed. Eye trackers measure the angle of reflection of the eye to calculate the gaze position on the screen in time and x-y coordinates.

TYPES OF EYE TRACKING TECHNIQUES: Single photon emission computed tomography:

SPECT is a nuclear tommographic technology that uses a gamma camera to acquire multiple 2-D images from multiple angles. In order to monitor and capture the detail of the very rapid eye movements the video camera should run at a minimum frequency of 1250 Hz.

Optical imaging:
This technique uses infrared transmitters and receivers to measure the amount of light reflected by blood from the eye parts. Since oxygenated and deoxygenated blood reflects light by different amounts, we can study which areas are more active (i.e., those that have more oxygenated blood) It also has the advantage that it is extremely safe.

Artificial neural networks:

Artificial neural networks(ANNs) is an electronic system with adaptive abilities designed to give different outputs based on the flow of different inputs through the networks.Thus it generalizes patterns from the eye tracking data in order to help in analysis of emotions. ANNs are modeled after the biological neural networks and thus have the ability to generalise from the previous patterns they have learned unlike other rule based systems.

WORKING:
The technology is designed taking into account the five most common emotions namely fear,anger,sadness,joy and surprise.These emotions are once again classified into two types namely the negative valence emotions i.e unpleasant emotions and positive valence emotions i.e pleasant emotions. The output from the Eye tracking devices is made to caliberate a tabular scale horizontally ranging from -1 to +1 and vertically ranging from 0 to -4.

Each output of the tabular form is connected to a bulb and depending upon the calibration the respective bulb glows to indicate its corresponding emotion. To ensure the correctness it is compared with the outputs of the other sensor systems which are as follows:1. VISUAL SENSOR: It captures facial features through a video camera .These are compared against a database of stored face templates to identify the predominant emotion.

2. AUDIO SENSOR: This tracks the voice of a person if at all he/she speaks and depending upon the vibrations, variations in the pitch etc.,decides the emotion. 3. BIOMETRIC SENSOR: This measures the physiological factors like blood pressure,temperature,muscle tension etc., These factors support data analysing and processing.

DESIGN:
The system consists of a portable measuring unit and a central analytical system. The mobile device is integrated with Bluetooth module providing wireless interface between the operator-worn sensors and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side provide necessary data personalization so that different people can use a single sensor device. Data Acquisition Unit (DAU) is a mobile part of the Blue Eyes system. Its main task is to fetch the physiological data from the sensor and to send it to the central system to be processed. To accomplish the task the device must manage wireless Bluetooth connections. Communication with the operator is carried on using a simple 5-key keyboard, a small LCD display and a beeper. When an exceptional situation is detected the device uses them to notify the operator.

Voice data is transferred using a small headset, interfaced to the DAU with standard minijack plugs.

APPLICATIONS:
Blue Eyes detects movements of the retina and frequency of eye blinks. Using this technology, an alarm system an alarm system can be created and fitted on the inside of a car which uses an infrared camera that watches the eyes, and if the system does not detect the eyeballs, it assumes the driver has fallen asleep and an alarm is sounded. The system would also log the drivers retina signature and when the same driver returns to the drivers seat, it would make adjustments to the mirror and seating position accordingly So you could sit in your car and it would adjust the seat, the mirrors, and the climate control to your taste.

Based on this technology a device, called Secure Pad, and has been designed for a major health-care provider to track the activities of doctors and other personnel at large medical facilities. The device will ultimately benefit patients by enhancing the security and accountability of medical facilities. For example, the device will know who has accessed a drug locker and what drugs were removed. It will also allow doctors to access confidential medical information without carrying around paper charts, which can be misplaced or read by unauthorized personnel.

This gives a scope to develop a device a device which can used such that when a doctor wearing the device enters a patients room, the patients medical records will automatically appear on a wall monitor when the doctor looks at it. When he looks away, or another person enters the room, the records will disappear. For added it can be made interchangeable; when a wearer removes the badge from her body, the device automatically deactivates, its slate wiped clean until the next person puts it on.

This technology can be used to design expression glasses which can determine the the wearers level of interest or confusion by measuring the movement of muscles around the eyes. This data is then transmitted to a computer which sounds a alarm. This can be of great use in the corporate sector to give the employees the necessary relaxation when needed.

 The awesome and unnerving fact about it this technology is that it presents a scope to replace the mouse with the eyegaze.One can then click on a choice merely with ones eyes. Ordinary household devices such as telephones, refrigerators, and ovens will then get activated when we look at them and do their jobs. It could also eliminate the need to remember PINs and passwords. One can sit down at a computer and it would automatically configure itself to his preferences. The ability of this technology-based-system to store information electronically can be used meticulously in crime detection. These systems installed in places like museums can be programmed to automatically detect irregularities such as someone holding a weapon, and sound an alarm. Using these technology electronic devices could be designed to recognize and control other devices and transfer the control to some other alternate devices in case of failure.

CONCLUSION:
Beyond the question of whether this technology will ever work effectively, there is a larger question: Do we really want our computers to know how we feel? In a world where we are already under constant bombardment by electronically generated words, images, and sounds, do we want machines making smiley faces, shedding crocodile tears, or giving us pep talks? For many people, the answer is probably no. This technology also raises serious concerns about privacy. If computers were capable of reading and recording our emotions, that information could easily be misused by inquisitive employers or prying marketers Blue eyes technology if designed sensibly and shrewdly, could be useful in improving human-computer relations. But if its crudely doneif computers be-come too intrusive, for example, or if they misread the users emotional state and respond in inappropriate waysit could be counterproductive. So the future of this technology not only lies in the successful integration of the various sensor devices but also in making it non-intrusive and accurate.