BLUE EYES TECHNOLOGY

Abstract— Human error is still one of the most frequent Acquisition Unit are to maintain Bluetooth connections, to get
causes of catastrophes and ecological disasters. The main information from the sensor and sending it over the wireless
reason is that the monitoring systems concern on the state connection, to deliver the alarm messages sent from the
of the processes whereas human contribution to the Central System Unit to the operator and handle personalized
overall performance of the system is left unsupervised. ID cards.
Since the control instruments are automated to a large Central System Unit maintains the other side of the
extent, a human – operator becomes a passive observer of Bluetooth connection, buffers incoming sensor data, performs
the supervised system, which results in weariness and on-line data analysis, records the conclusions for further
vigilance drop. This, he may not notice important changes exploration and provides visualization interface.
of indications causing financial or ecological consequences
and a threat to human life. It therefore is crucial to assure
that the operator’s Conscious brain is involved in an active
system supervising over the whole work time period. It is
possible to measure indirectly the level of the operator’s
conscious brain involvement using eye motility analysis
.Although there are capable sensors available on the
market, a complex solution enabling transformation,
analysis and reasoning based on measured signals still
does not exist. In large control rooms, wiring the operator
to the central system is a serious limitation of his mobility
and disables his operation. Utilization of wireless
technology becomes essential.

Keywords— Blue eyes, software, hardware, CSU (central

system unit), mouse.

I. INTRODUCTION II. PERFORMANCE REQUIREMENTS

The Blue eyes system provides technical means for
monitoring and recording the Operator’s basic physiological
parameters. The most important parameter is saccadic activity,
which enables the system to monitor the status of the
operator’s visual attention along with head acceleration, which
accompanies large displacement of the visual axis .Complex
industrial environment can create a danger of exposing the
operator to toxic substances, which can affect his cardiac,
circulatory and pulmonary systems..The The Blue eyes system
checks above parameters against abnormal values and triggers
user-defined alarms when necessary. Quite often in an
emergency situation operators speak to themselves expressing
their surprise or stating verbally the problem.. This helps to
reconstruct the course of operators’ work and provides data
for long-term analysis. Blue Eyes consists of a mobile
measuring device and a central analytical system.
The mobile device is integrated with Bluetooth module
providing wireless interface between sensors worn by the
operator and the central unit. ID cards assigned to each of the
operators and adequate user profiles on the central unit side
Provide necessary data personalization so different people can
use a single mobile device. The tasks of the mobile Data
The portable nature of the mobile unit results in a number of
performance requirements. As the device is intended to run on
batteries, low power consumption is the most important
constraint. Moreover, it is necessary to assure proper timing
while receiving and transmitting sensor signals.. Finally the
use of standard and inexpensive IC does will keep the price of
the device at relatively low level. The priority of the central
unit is to provide real-time buffering and incoming sensor
signals and semi-real-time processing of the data, which
requires speed-optimizes filtering and reasoning algorithms.
III. SYSTEM OVERVIEWS
Blue eyes system monitors the status of the operator’s visual
attention through measurement of saccadic activity. These
system checks parameters like heart bitrates and blood
oxygenation against abnormal and triggers user defined
alarms.
So the system consists of
 Mobile measuring device (DAU)
 Central System Unit (CSU)
Figure2. System overview
IV. THE HARDWARE
4.1. DATA ACQUISITION UNIT:-
Data Acquisition Unit is a mobile part of the Blue eyes
system. Its main task is to fetch the physiological data from
the sensor and to send it to the central system to be processed.
The Data Acquisition Unit comprises several hardware
modules:
1. Atmel 89C52 microcontroller system core
2. Bluetooth module (based on ROK101008)
3 .HD44780 - small LCD display
4.24C16 - I2C EEPROM
5 .MC145483 – 13bit PCM codec
6. Jazz Multi sensor interface
7. Beeper and LED indicators
Hardware specification
Microcontrollers (e.g. Atmel 8952 microcontroller) can be
used as the core of the Data Acquisition Unit since it is a well-
established industrial standard and provides necessary
functionalities) at a low price. The Bluetooth module supports
synchronous voice data transmission .The codec reduces the
microcontroller’s tasks and lessens the amount of data being
sent over the UART. The Bluetooth module performs voice
data compression, which results in smaller bandwidth
utilization and better sound quality. Communication between
the Bluetooth module and the microcontroller is carried on
using standard UART interface.
The speed of the UART is set to115200 bps in order to assure
that the entire sensor data is delivered in time to the central
system. The alphanumeric LCD display gives more
information of incoming events and helps the operator enter
PIN code. The LED indicators show the result of built-in-self-
test, power level and the state of wireless connection the
simple keyboard is used to react to incoming events and to
enter PIN code while performing authorization procedure. The
ID card interface helps connect the operator’s personal
identification card to the DAU. After inserting the card
authorization procedure starts. The operator’s unique
identifier enables the supervising system to distinguish
different operators
4.2. CENTRAL SYSTEM UNIT
Central System Unit hardware is the second peer of the
wireless connection. The box contains a Bluetooth module
and a PCM codec for voice data transmission.
The module is interfaced to a PC using a parallel, serial and
USB cable. The audio data is accessible through standard
mini-jack sockets to program operator's personal ID cards we
developed a simple programming device.
V. THE SOFTWARE
Blue Eyes software's main task is to look after working
operators' physiological condition. To assure instant reaction
on the operators' condition change the software performs real
time buffering of the incoming data, real-time physiological
data analysis and alarm triggering.
The Blue Eyes software comprises several functional modules
System core facilitates the transfers flow between other
system modules.
The System Core fundamental are single-producer-multi-
consumer thread safe queues.
Parts:
Connection Manager is responsible for managing the
wireless communication between the mobile Data Acquisition
Units and the central system.
Data Analysis module performs the analysis of the raw
sensor data in order to obtain information about the operator’s
physiological condition.
Visualization module provides a user interface for the
supervisors. It enables them to watch each of the working
operator’s physiological condition along with a preview of
selected video source and related sound stream.
VI. IMPLEMENTATION OF BLUE EYES
Functional design
During the functional design phase we used UML standard
use case notation, which shows the functions the system offers
to particular users. Blue Eyes has three groups of users:
operators, supervisors and system administrators. Operator is
a person whose physiological parameters are supervised. The
operator wears the DAU. The only functions offered to that
user are authorization in the system and receiving alarm alerts.
Such limited functionality assures the device does not disturb
the work of the operator
Authorization – the function is used when the operator’s duty
starts. After inserting his personal ID card into the mobile
device and entering proper PIN code the device will start
listening for incoming Bluetooth connections. Once the
connection has been established and authorization process has
succeeded central system starts monitoring the operator’s
physiological parameters. The authorization process shall be
repeated after reinserting the ID card. It is not, however,
required on reestablishing Bluetooth connection. Receiving
alerts – the function supplies the operator with the information
about the most important alerts regarding his or his co-
workers’ condition and mobile device state. Alarms are
signaled by using a beeper, earphone providing central system
sound feedback and a small alphanumeric LCD display, which
shows more detailed information. Supervisor is a person
responsible for analyzing operators’ condition and
performance.
During the on-line browsing it is possible to watch a list of
currently working operators and the status of their mobile
devices. Selecting one of the operators enables the supervisor
to check the operator’s current physiological condition (e.g. a
pie chart showing active brain involvement) and a history of
alarms regarding the operator. All new incoming alerts are
displayed immediately so that the supervisor is able to react
fast. However, the presence of the human supervisor is not
necessary since the system is equipped with reasoning
algorithms and can trigger user-defined actions. During off-
line browsing it is possible to reconstruct the course of the
operator’s duty with all the physiological parameters, audio
and video data. A comprehensive data analysis can be
performed enabling the supervisor to draw conclusions on
operator’s overall performance and competency System
administrator is a user that maintains the system. The
administrator delivers tools for adding new operators to the
database, defining alarm conditions, configuring logging tools
and creating new analyzer modules.
While registering new operators the administrator enters
appropriate data to the system database and programs his
personal ID card.
Defining alarm conditions – the function enables setting up
user-defined alarm conditions by writing condition-action
rules Designing new analyzer modules-based on earlier
recorded data the administrator can create new analyzer
module that can recognize other behaviors than those which
are built-in the system. The new modules are created using
decision tree induction algorithm. The administrator names
the new behavior to be recognized and points the data
associated with it. The results received from the new modules
can be used in alarm conditions. Monitoring setup enables the
administrator to choose the parameters to monitor as well as
the algorithms of the desired accuracy to compute parameter
values. Logger setup provides tools for selecting the
parameters to be recorded. For audio data sampling frequency
can be chosen. As regards the video signal, a delay between
storing consecutive frames can be set.
Database maintenance – here the administrator can remove
old or “uninteresting” data from the database. The
uninteresting data is suggested by the built-in reasoning
system.

VII. EMOTION COMPUTING

There are two aspects of affective computing: giving the

computer the ability to detect emotions and giving the
computer the ability to express emotions. An adaptive, smart X. SENTIC MOUSE
computer system has been driving our efforts to detect a
person’s emotional state. It is a modified computer mouse that includes a directional
An important element of incorporating emotion into pressure sensor for aiding in recognition of emotional valence
computing is for productivity for a computer user.
Figure7. Senetic mouse

VIII. TYPES OF MOTIONAL SENSORS:

For Hand:
 Emotion Mouse
 Sentic Mouse
For Eyes:
1.ExpressionGlasses
2.MagicPointing
3.Eye Tracking
For Voice:
 Artificial Intelligence
 Speech Recognition XI. EXPRESSION GLASSES

IX. EMOTION MOUSE
One proposed, non invasive method for gaining user
information through touch is via a computer input device, the
mouse. This then allows the user to relate the cardiac rhythm,
the body temperature, electrical conductivity of the skin and
other physiological attributes with the mood. This has led to
the creation of the “Emotion Mouse”.
A wearable device which allows any viewer to visualize the
confusion and interest levels of the wearer. Other recent
developments in relatedtechnology is the attempt to learn the
needs of the user just by following the interaction between the
user and the computer in order to know what he/she is
interested in at any given moment.

The device can measure heart rate temperature galvanic skin

response and minute bodily movements and matches them
with six emotional states: happiness, surprise, anger, fear,
sadness and disgust. The mouse includes a set of sensors
including infrared detectors and temperature-sensitive chips.

Figure: Emotion mouse

 XII. MAGIC POINTING
This work explores a new direction in utilizing eye gaze for
computer input. Gaze tracking has long been considered as an
alternative or potentially superior pointing method for
computer input. We believe that many fundamental
limitations exist with traditional gaze pointing. In particular, it
is unnatural to overload a perceptual channel such as vision
with a motor control task. We therefore propose an
Alternative approach, dubbed MAGIC (Manual and Gaze
Input Cascaded) pointing. With such an approach, pointing
appears to the user to be a manual task used for fine
manipulation and selection.
However, a large portion of the cursor movement is
eliminated by warping the cursor to the eye gaze area, which
encompasses the target. Two specific MAGIC pointing
techniques, one conservative and one liberal, were designed,
analyzed, and implemented with an eye tracker we developed.
They were then tested in a pilot study. Pointing and possibly
faster speed than manual pointing. In our view, there are two
fundamental shortcomings to the existing gaze pointing
techniques, regardless of the maturity of eye tracking
technology.
XIII. EYE TRACKING
Since the goal of this work is to explore MAGIC pointing as a
user interface technique, we started out by purchasing a
commercial eye tracker after a market survey. In comparison
to the system reported in early studies this system is much
more compact and reliable. However, we felt that it was still
not robust enough for a variety of people with different eye
characteristics, such as pupil brightness and correction
glasses. We hence chose to develop and use our own eye
tracking system.
XIV. ARTIFICIAL INTELLIGENT
Artificial intelligence (AI) involves two basic ideas. First, it
involves studying the thought processes of human beings.
Second, it deals with representing those processes via
machines (like computers, robots, etc).
AI is behavior of a machine, which, if performed by a human
being, would be called intelligent. It makes machines smarter
and more useful, and is less expensive than natural
intelligence.
Natural language processing (NLP) refers to artificial
intelligence methods of communicating with a computer in a
natural language like English. The main objective of a NLP
program is to understand input and initiate action stores all the
digital values in a buffer area. This digital information,
representing the spoken word, is now accessed by the CPU to
process it further. The normal speech has a frequency range of
200 Hz to 7 kHz. Recognizing a telephone call is more
difficult as it has bandwidth limitation of300 Hz to3.3 kHz.
XV.SPEECH RECOGNITION
The user speaks to the computer through a microphone,
which, in used; a simple system may contain a minimum of
three filters. The more the number of filters used, the higher
the probability of accurate recognition. Presently, switched
capacitor digital filters are used because these can be custom-
built in integrated circuit form. These are smaller and cheaper
than active filters using operational amplifiers.
The filter output is then fed to the ADC to translate the was a need for a piece of software to establish and test
analogue signal into digital word. The ADC samples the filter Bluetooth connections. Hence created a tool called Blue
outputs many times a second. Each sample represents Dentist. The tool provides support for controlling the currently
different amplitude of the signal .Evenly spaced vertical lines connected Bluetooth device. Its functions are: Local device
represent the amplitude of the audio filter output at the instant management and connection management).
of sampling. Each value is then converted to a binary number
proportional to the amplitude of the sample. A central
processor unit (CPU) controls the input circuits that are fed by
the ADCS. A large RAM (random access memory) stores all
the digital values in a buffer area. This digital information,
representing the spoken word, is now accessed by the CPU to
process it further. The normal speech has a frequency range of
200 Hz to 7 kHz.
Recognizing a telephone call is more difficult as it has
bandwidth limitation of 300 Hz to3.3 kHz. The binary
representation of each of these words becomes a template or
standard, against which the future words are compared. These
templates are stored in the memory. Once the storing process
is completed, the system can go into its active mode and is
capable of identifying spoken words. As each word is spoken,
it is converted into binary equivalent and stored in RAM. The
computer then starts searching and compares the binary input To test the possibilities and performance of the remaining
pattern with the templates. T is to be noted that even if the parts of the Project Kit. Blue Capture was created. The tool
same speaker talks the same text, there are always slight supports capturing video data from various sources and
variations in amplitude or loudness of the signal, pitch, storing the data in the MS SQL Server database. Additionally,
frequency difference, time gap, etc. Due to this reason, there is the application performs sound recording.
never a perfect match between the template and binary input After filtering and removing insignificant fragments the audio
word. data is stored in the database. Finally, the program plays the
The pattern matching process therefore uses statistical recorded audiovisual stream. They used the software to
techniques and is designed to look for the best fit. The values measure database system performance and to optimize some
of binary input words are subtracted from the corresponding of the SQL queries
values in the templates. If both the values are same, the
difference is zero and there is perfect match. If not, the
subtraction produces some difference or error. The smaller the
error, the better the match. When the best match occurs, the
word is identified and displayed on the screen or used in some
other manner. The search process takes a considerable amount
of time, as the CPU has to make many comparisons before
recognition occurs. This necessitates use of very high-speed
processors.
A large RAM is also required as even though a spoken word
may last only a few hundred milliseconds, but the same is
translated into many thousands of digital words. It is
important to note that alignment of words and templates are to
be matched correctly in time, before computing the similarity
score. This process, termed as dynamic time warping,
recognizes that different speakers pronounce the same words
at different speeds as well as elongate different parts of the
same word. This is important for the speaker-independent
recognizers

XVI.TOOLS USED TO DEVELOP BLUE EYES:
In creating the hardware part of the DAU a development
board was built, which enabled to mount, connect and test
various peripheral devices cooperating with the
microcontroller. During the implementation of the DAU there
Also a simple tool for recording Jazz Multisensory
measurements was introduced. The program reads the data
using a parallel port and writes it to a file. To program the
operator’s personal ID card we use a standard parallel port, as
the EEPROMs and the port are both TTL-compliant. A simple
dialog-based application helps to accomplish the task.
XVII. THE SIMPLE USER INTERST TRACKER
Computers would have been much more powerful, had they
gained perceptual and sensory abilities of the living beings on
the earth. What needs to be developed is an intimate
relationship between the computer and the humans. And the
Simple User Interest Tracker (SUITOR) is a revolutionary
approach in this direction.
By observing the Webpage at bedizen is browsing, the
SUITOR can help by fetching more information at his
desktop. By simply noticing where the user’s eyes focus on
the computer screen, the SUITOR can be more precise in
determining topic of interest. It can even deliver relevant
information to a handheld device. The success lies in how
much the suitor can be intimate to the user.
Flicker and his colleagues have created some new techniques
for tracking a person's eyes and have incorporated this gaze-
tracking technology into two prototypes. One, called SUITOR
(Simple User Interest Tracker), fills a scrolling ticker on a
computer screen with information related to the user's current
task. SUITOR knows where you are looking, what
applications you are running, and what Web pages you may
be browsing.
SUMMARY
The Blue Eyes system is developed because of the need for a
real-time monitoring system for a human operator. The
approach is innovative since it helps supervise the operator
not the process, as it is in presently available solutions. We
hope the system in its commercial release will help avoid
potential threats resulting from human errors, such as
weariness, oversight, tiredness or temporal indisposition.
However, the prototype developed is a good estimation of the
possibilities of the final product. The use of a miniature
CMOS camera integrated into the eye movement sensor will
enable the system to calculate the point of gaze and observe
what the operator is actually looking at.
Introducing voice recognition algorithm will facilitate the
communication between the operator and the central system
and simplify authorization process. Despite considering in the
report only the operators working in control rooms, our
solution may well be applied to everyday life situations.
Assuming the operator is a driver and the supervised process
is car driving it is possible to build a simpler embedded on-
line system, which will only monitor conscious brain
involvement and warn when necessary.
As in this case the logging module is redundant, and the
Bluetooth technology is becoming more and more popular, the
commercial implementation of such a system would be
relatively inexpensive. The final thing is to explain the name
of our system. Blue Eyes emphasizes the foundations of the
project – Bluetooth technology and the movements of the
eyes. Bluetooth provides reliable wireless communication
whereas the eye movements enable us to obtain a lot of
interesting and important information
XV. APPLICATION OF
BLUE- EYE TECHNOLOGY
• Blue Eyes is developing ways for computers to
anticipate users' wants by gathering video data on
eye movement and facial expression. The first
practical use for the research turns out to be
snooping on shoppers.
• Another application would be in the automobile
industry. By simply touching a computer input
device such as a mouse, the computer system is
designed to be able to determine a person's emotional
state. For cars, it could be useful to help with critical
decisions like: "I know you want to get into the fast
lane, but I'm afraid I can't do that. Your too upset
right now" and therefore assist in driving safely.
• Current interfaces between computers and humans
can present information vividly, but have no sense of
whether that information is ever viewed or
understood.
• Using stereo-vision techniques, we are able to detect,
track, and identify users robustly and in real time.
This information can make spoken language
interface more bust, by selecting the acoustic
information from a visually-localized source.
XVI. CONCLUSIONS
The nineties witnessed quantum leaps interface designing for
improved man machine interactions. The BLUE EYES
technology ensures a convenient way of simplifying the life
by providing more delicate and user friendly facilities in
computing devices.
Instead of using cumbersome modules to gather information
about the user, it will be better to use smaller and less
intrusive units. Ordinary household devices such as
televisions, refrigerators, and ovens may be able to do their
jobs when we look at them and speak to them. It is only a
technological forecast.
XVII.DISADVANTAGES
1. Does not predict nor interfere with operators
thoughts
2. Cannot force directly the operator to work
 REFERENCES
[1] Joseph j.carr & john m.brown,”introduction to blue
eyestechnology”,published in IEEE spectrum magazine.

[2] A.jajszczyk,”automatically switched blue eyes

networks:Benefits and Requirement,”IEEE blue toooth.feb
2005,vol 3,no1,pp.

[3] A .Banerjee, ”Generalized multi protocol label switching:

an over view of computer enhancements and recovery
techniques,”IEEE” commun. Magvol39
.
[4] J.jones, L.ong, and m.lazer,”creating and intelligent
technology network /worldwide nteroperability
demonstration.”IEEEcomm un .mag.,vol 42.

[5] Blue Eyes Technology, Computer Edge,Oct.2002,pages

23-27.