Professional Documents
Culture Documents
Aims at creating computational machines that have perceptual and sensory ability. Use camera and microphone to identify user actions and emotions
BLUE in the term stands for Bluetooth, which enables reliable wireless communication EYES , because the eye movement enables us to obtain a lot of interesting and important information.
To build a machine that can understand your emotions A pc that can listen, talk or scream Verify your identity, feels your presence and interact with you.
TECHNOLGIES USED
Emotion Mouse Manual And Gaze Input Cascaded (MAGIC) Artificial Intelligent Speech Recognition Simple User Interest Tracker (SUITOR) The eye movement Sensor
5
EMOTION MOUSE
Simplest way
People spend approximately 1/3 of their total computer time touching input device Physiological data is obtained and emotional state is determined A user model will be built that reflects the personality of user.
MAGIC POINTING
Reduce the cursor movement needed for target selection Click on the target with a regular manual input device Two magic pointing techniques
Liberal Conservative
7
APPROACHES
LIBERAL APPROACH To warp the cursor to every new object user looks at
CONSERVATIVE APPROACH Does not warp the cursor target until the manual input device has been actuated
8
Input words are scanned and matched against internally stored words Identification causes some action to be taken User speaks to the computer through microphone Filtered and fed to ADC and then stored in RAM pattern matching is designed to look for the best fit because of variations in loudness, pitch, frequency difference, time gap etc.
9
SUITOR
Help by fetching more information at desktop Notice where the users eyes focus on the screen Fills a scrolling ticker on a computer screen with information related to users task Ex. If reading headline ,pops up the story in the browser window
10
A personal area network for linking all the operators and the supervising system Two major units - DAU (data acquisition unit ) - CSU (central system unit )
11
DAU
The DAU consists of the following components ATMEL 8952 microcontroller BLUE TOOTH MODULE supports synchronous voice data transmission central system sound feedback microcontroller (115200 bps) ALPHAUNUMERIC LCD display LED indicators ID CARD interface
12
DAU - features
Data Acquisition Unit
Atmel 89C52 microcontroller Jazz Multisensor
Lightweight Runs
Bluetooth
on batteries - low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization Voice transmission using hardware PCM codec
13
CSU COMPONENTS
CONNECTION MANAGER main task to perform low-level blue tooth communication
DATA ANALYSIS MODULE performs the analysis of the raw sensor data
DATA LOGGER MODULE provides support for storing the monitored data.
14
Csu features
Connection management Data processing Data recording Access verification System maintenance
15
Bluetooth
multisensors
16
Future improvements
DAU small CMOS camera to monitor the operators point of gaze single PCB (SMD technology) low voltage ICs CSU data mining algorithms advanced database encryption using
17
Data security
Only registered mobile devices can connect to the system Bluetooth connection authentication & encryption Access rights restrictions Personal and physiological data encryption
18
applications
In retailing record and interpret customer movements In automobile industry In video games Power station Flight control centres o Operating theatres
19
PONG
A Robot
20
CONCLUSION
user
friendly
Gap between the electronic and physical world is reduced The computers can be run using implicit commands instead of the explicit commands
22