Department of Electrical and Computer Engineering

He Zhou
Hui Zheng
William Mai
Xiang Guo


Advisor: Professor Patrick Kelly
ASLLENGE
Midway Design review
Dec 2 2011
Department of Electrical and Computer Engineering
Outline
Project Overview
MDR Specifications
Project Progress
Software Implementation
Hardware Implementation
Design Spec
Team Roles
Timeline
Q/A

Department of Electrical and Computer Engineering
Project Overview
Department of Electrical and Computer Engineering
Project Progress
MDR goals reached:
Hand tracking
Some gestures recognition
Basic GUI functional
A internal testing database
Functioning microcontroller
Department of Electrical and Computer Engineering
System Requirements (Revised)
Motion Tracking:
Track upper human body
Recognize different human gesture
Translate ASL to English word
Microcontroller:
Accurate A/D conversion
Reliable communication with chosen output interface
Graphical User Interface:
Real-time operation
Display text feedback
Cost
Below $500.


Department of Electrical and Computer Engineering
Software Design Flow
Department of Electrical and Computer Engineering
GUI Design Progress
Achieved Goals
Created a User Interface window
Display translated text
Display skeletal image

Future Goals/Expandable
3D Avatar
Voice recognition
Tutorial
Department of Electrical and Computer Engineering
Test Database of body parts
Created a hierarchical tree data structure
Nodes contain information including:
Area of tracking
Location of next motion
word associated with it
Department of Electrical and Computer Engineering
Hardware Implementation
Increasing the resistance
of the flex sensor with
bend
Analog signal input to an
Arduino Mega 2560
The Arduino Mega 2560
works as an AD converter
PC captures the signal via
USB or Bluetooth

9
Flex Sensor Glove
Arduino Mega 2560
Department of Electrical and Computer Engineering
More detail for Implementation
Impedance buffet with relation
at
Digital number display on the
Ardunio software is equal to

Experimental result is almost
linear from 0 to 5 volts




Arduino reading

R1
-
+
Flex Sensor
Vin
Vout
R2
0
500
1000
1500
0 2 4 6 8
D
i
g
i
t
a
l

N
u
m
b
e
r

Input Volatge to Anolaog
Pin(V)
Experimental
Result
Impedance Buffer
Department of Electrical and Computer Engineering
Cost of Major Components

Name of
Component

Flex
Sensor

Arduino
Mega 2560

A Pair of
Gloves

Kinect
Sensor

Bluetooth
Module

Quantities

10

1

1

1

1

Unit Price

$12

$56

$10

$150


$20

Total Price

$356
11
Department of Electrical and Computer Engineering
Team Roles
He Zhou(CSE): test and integrate software
prototype
Hui Zheng(CSE): database development and
programming
William Mai (EE): build microcontroller to detect
finger and palm movements
Xiang (EE): build Arduino board, overall testing,
building ASL database, and website
administration
12
Department of Electrical and Computer Engineering
CDR Deliverables
Complete and expand basic databases for both
finger tracking and upper body tracking.
Complete the finger tracking module.
Build a fully functioning system prototype.

Department of Electrical and Computer Engineering
Timeline
10/16/2011 12/5/2011 1/24/2012 3/14/2012 5/3/2012
PDR
Purchase Parts
Planning
GUI
Interface with the Sensors
Build Finger Sensors
Build Test Database
Prototype 1
MileStone MDR Deliverables
System Integration
Winter Break
Expand Database
Prototype 2
MileStone CDR Deliverables
Alpha Testing
Update
Beta Testing
Spring Break
Finalize Project
MileStone FRP Deliverables
14
Department of Electrical and Computer Engineering

Q&A

15