SIXTH SENSE TECHNOLOGY

Everyone is aware of their five basic senses, seeing, feeling, smelling, hearing and
tasting. What everyone is not so well aware of is their sixth sense, that sense of
otherworldliness, a connection to something more and greater than their physical senses
are able to perceive.
This is the entrance to the world of the unseen encounter, the unheard communication,
the unfelt touch of someone from the spiritual world trying to make a connection with
someone in the physical body.

TED (Technology, Entertainment, Design) is a working prototype of a multifunctional device that

can become part of our lives in five years to ten. Set named “sixth sense― consists of a
camera (it captures the movement of hands), the projector (it produces the image on any surface),
the mobile phone (it is in your pocket and need only to communicate with the abstract database
server) and four fingers on which to detect movements, wearing colorful caps, perceived by the
camera.

Sixth Sense Technology is a mini-projector coupled with a camera and a cellphone—which acts as
the computer and connected to the Cloud, all the information stored on the web. Sixth Sense can
also obey hand gestures. The camera recognizes objects around a person instantly, with the micro-
projector overlaying the information on any surface, including the object itself or hand. Also can
access or manipulate the information using fingers. make a call by Extend hand on front of the
projector and numbers will appear for to click.

know the time by Draw a circle on wrist and a watch will appear. take a photo by Just make a
square with fingers, highlighting what want to frame, and the system will make the photo—which
can later organize with the others using own hands over the air.and The device has a huge number
of applications , it is portable and easily to carry as can wear it in neck. The drawing application
lets user draw on any surface by observing the movement of index finger. Mapping can also be done
anywhere with the features of zooming in or zooming out. The camera also helps user to take
pictures of the scene is viewing and later can arrange them on any surface. Some of the more
practical uses are reading a newspaper. reading a newspaper and viewing videos instead of the
photos in the paper. Or live sports updates while reading the newspaper. The device can also tell
arrival, departure or delay time of air plane on tickets. For book lovers it is nothing less than a
blessing. Open any book and find the Amazon ratings of the book. To add to it, pick any page and
the device gives additional information on the text, comments and lot more add on feature

Sixth Sense allows people to use the internet without a screen or a keyboard
It can turn any surface into a touch screen
It is made with store-bought components
“The software program processes the video stream data captured by the camera and tracks the
locations of the colored markers [that you wear on your fingers] usingsimple computer-vision

techniques

simple computer-vision techniques―

(http://www.pranavmistry.com/projects/six...htm#ABOUT)
According to a number of sources, graduate students at MIT have been working on this
for the past four months “day and night―

Just a few things it can do…

“The device recognizes items in stores, and then gathers and projects information
about products to the user. It also is able to provide quick signals to let users know what
the best products are based on their needs.―
Â
“Another amazing feature is the device’s ability to look at an airplane ticket and
let the user know whether the flight is delayed or on time. It is also able to recognize
books (based on an image or RFID) in a book store and then project reader reviews or
author information from the Internet onto blank pages.―

“The device can also recognize articles in newspapers, retrieve the latest related
stories or video from the Internet and then display them on pages for the user. Say
goodbye to your dictionary and encyclopedia.―

http://gadgets.tmcnet.com/topics/gadgets...ns-any.htm

Cost of Sixth Sense

$350 dollars
The interesting thing here is that Sixth Sense can never really be more expensive than
its individual components
Purpose of Sixth Sense
I believe Sixth Sense’s purpose would be to allow K-12 students and teachers to
interact with information on a level not experienced before
In my opinion, at least initially, its purpose would be to motivate…motivate…motivate
Educational Use
Engagement
Research
Collaboration
Cost-effectiveness

Engagement
Teachers may find that Sixth Sense, because of its unique ability to work with many of
Gardner’s multiple intelligences, will be a catalyst for students who might otherwise
remain unengaged in learning.
Sixth Sense uses the visual, kinesthetic, intrapersonal and interpersonal among others.
If this technology does nothing else, the idea that students can simply use their hands to
draw images on walls and take pictures with their hands will be (at least initially) quite
motivating

Research
Sixth Sense will give new meaning to “looking something up.―
Since we are essentially talking about the internet, students will be given the opportunity
to portably research the world.
They can all go on a virtual field trip and project the images on their own desks, for
example.
Collaboration
Students will be given an opportunity through this technology to feel more connected to
others.
Although there does seem to be the sense that individuals could walk through life wired
and lonely, I like to think the classroom would serve as the environment in which
students and teachers using Sixth Sense would want to share.
Not only could the sharing take place in the classroom, I suppose since the users are
connected online, sharing could take place around the world.
Cost-effectiveness
As mentioned earlier, this product currently costs only $350. From an educator’s
stand point, this is minimum given the amount of money spent on textbooks, computer
labs and LCD projectors.
For educator’s, Sixth Sense would be a way to put technology (literally) into each
student’s hands, because of its size and its cost.
Anticipated Time Frame
According to a number of sources, the MIT students already have a patent on Sixth
Sense. Still it is unclear as to when this device might actually become available for
general purchasing.
Microsoft Surface does currently exist (which is similar in theory). But Microsoft’s
product is not portable like Sixth Sense
Even if it came out next week, as educators we may need to wait some time in order to
learn of the dangers that are sure to exist with the product.
Advantages of Sixth Sense
Portable
Inexpensive
“Cool―
Multi-sensory
Connectedness between the world and information
Critical thinking skills would be somewhat vital here…allowing teachers a fantastic
opportunity for interdisciplinary study with critical thinking components
Future Implications
Students could become too wired…and the element of collaboration I envision might be
completely erased by how the individual interacts
Availability of inappropriate information (how does this differ from current computer
labs....this information is literally at students’ fingertips.)
The technology will cost more because it is packaged and marketed…and they can
charge more
What type of signal is needed..and might there be issues with getting signals in schools
Getting Started
My new thing is getting people to “play― with the technology
No pressure
Give them time
Allow students and teachers to play with this together
Offer support in the initial weeks/months of use
Let Opinion Leaders emerge from their experience
Start small!

Relevant Issues from Rogers (2003)

Opinion Leaders are key
Consider the length of time of the innovation-decision period
Think about homophily and heterophily when planning Sixth Sense expansion in a
second and third school/classroom
Realize that in most cases, “individuals depend mainly on the communicated
experience of others much like themselves who have already adopted a new idea―
(p. 331). My guinea pigs better be the right ones

Sixth Sense is a wearable gestural interface that augments the physical world around us
with digital information and lets us use natural hand gestures to interact with that
information.
It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the
MIT Media Lab.
SixthSense bridges the gap by bringing intangible, digital information out into the
tangible world, and allowing us to interact with this information via natural hand
SixthSense comprises a pocket projector, a mirror and a camera. The hardware
components are coupled in a pendant like mobile wearable device

COMPONENTS
The hardware components are coupled in a pendant like mobile wearable device.
Camera
Projector
Mirror
Mobile Component
Color Markers

Camera
Captures an object in view and tracks the user’s hand gestures
It sends the data to smart phone
It acts as a digital eye, connecting you to the world of digital information

Projector
The projector projects visual information enabling surfaces and physical objects to be
used as interfaces
The project itself contains a battery inside, with 3 hours of battery life.
A tiny LED projector displays data sent from the smart phone on any surface in
view–object, wall, or person.

Mirror

The usage of the mirror is significant as the projector dangles pointing downwards from
the neck.

Smart Phone
A Web-enabled smart phone in the user’s pocket processes the video data
Other software searches the Web and interprets the hand gestures

Color Markers
It is at the tip of the user’s fingers .
Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam
recognize gestures
The movements and arrangements of these makers are interpreted into gestures that
act as interaction instructions for the projected application interfaces.

HOW IT WORKS
The hardware that makes Sixth Sense work is a pendant like mobile wearable interface
It has a camera, a mirror and a projector and is connected wirelessly to a bluetooth
smart phone that can slip comfortably into one’s pocket
The camera recognizes individuals, images, pictures, gestures one makes with their
hands
Information is sent to the Smartphone for processing
The downward-facing projector projects the output image on to the mirror
Mirror reflects image on to the desired surface
Thus, digital information is freed from its confines and placed in the physical world

Make a call
You can use the Sixth Sense to project a keypad onto your hand, then use that virtual
keypad to make a call.

Call up a map
With the map application we can call up the map of our choice and then use thumbs and
index fingers to navigate the map

Check the time

Draw a circle on your wrist to get a virtual watch that gives you the correct time

Create multimedia reading experiences

Sixth Sense can be programmed to project related videos onto newspaper articles you
are reading
Drawing application
The drawing application lets the user

draw on any surface by tracking the fingertip movements of the user’s index finger

Zooming features
The user can zoom in or zoom out using intuitive hand movements

Get product information

Sixth Sense uses image recognition or marker technology to recognize products we pick
up, then feeds us information on those products

Get book information

The system can project Amazon ratings on that book, as well as reviews and other
relevant information

Get flight updates

The system will recognize your boarding pass and let you know whether your flight is on
time and if the gate has changed.

Feed information on people

The system will project relevant information about a person such as what they do, where
they work, and so on.

Take pictures
If you fashion your index fingers and thumbs into a square ("framing" gesture), the
system will snap a photo.
After taking the desired number of photos, we can project them onto a surface, and use
gestures to sort through the photos, and organize and resize them.
 CONCLUSION
Sixth Sense recognizes the objects around us, displaying information automatically and
letting us to access it in any way we need
The Sixth Sense prototype implements several applications that demonstrate the
usefulness, viability and flexibility of the system
Allowing us to interact with this information via natural hand gestures
The potential of becoming the ultimate "transparent" user interface for accessing
information about everything around us
http://www.seminarprojects.com/Thread-si...logy--7186 and
http://www.seminarprojects.com/Thread-si...e-computer for getting more information
about sixth sense technology

Basically, Sixth Sense is a mini-projector coupled with a camera and a cellphone—which acts as the computer
and your connection to the Cloud, all the information stored on the web. Sixth Sense can also obey hand
gestures, like in the infamous Minority Report.

However, instead of requiring you to be in front of a big screen like Tom Cruise, Sixth Sense can do its magic—
and a lot more—everywhere, even while you are jumping hysteric over Oprah's sofa.

The camera recognizes objects around you instantly, with the micro-projector overlaying the information on any
surface, including the object itself or your hand. Then, you can access or manipulate the information using your
fingers. Need to make a call? Extend your hand on front of the projector and numbers will appear for you to click.
Need to know the time? Draw a circle on your wrist and a watch will appear. Want to take a photo? Just make a
square with your fingers, highlighting what you want to frame, and the system will make the photo—which you
can later organize with the others using your own hands over the air.

But those are just novelty applications. The true power of Sixth Sense lies on its potential to connect the real
world with the Internet, and overlaying the information on the world itself. Imagine you are at the supermarket,
thinking about what brand of soap is better. Or maybe what wine you should get for tonight's dinner. Just look at
objects, hold them on your hands, and Sixth Sense will show you if it's good or bad, or if it fits your preferences or
not.

Now take this to every aspect of your everyday life. You can be in a taxi going to the airport, and just by taking
out your boarding pass, Sixth Sense will grab real time information about your flight and display it over the ticket.
You won't need to do any action. Just hold it in front of your and it will work.

The key here is that Sixth Sense recognizes the objects around you, displaying information automatically and
letting you access it in any way you want, in the simplest way possible.

Clearly, this has the potential of becoming the ultimate "transparent" user interface for accessing information
about everything around us. If they can get rid of the colored finger caps and it ever goes beyond the initial
development phase, that is. But as it is now, it may change the way we interact with the real world and truly give
everyone complete awareness of the environment around us.

Or just make a few people look like dorks. It can go either way, really. Whatever it is, I want to try it.

Sixth Sense Technology will Revolutionize the World

SCIENCE | July 26, 2009 | Share

All of us are aware of the five basic senses – seeing, feeling, smelling, tasting and hearing.
But there is also another sense called the sixth sense. It is basically a connection to something
greater than what their physical senses are able to perceive. To a layman, it would be
something supernatural. Some might just consider it to be a superstition or something
psychological. But the invention of sixth sense technology has completely shocked the world.
Although it is not widely known as of now but the time is not far when this technology will
change our perception of the world.

Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the sixth sense
technology. He invented ‘ Sixth Sense / WUW ( Wear UR World) ‘ which is a wearable
gestural , user friendly interface which links the physical world around us with digital
information and uses hand gestures to interact with them. He is a PhD student at MIT and he
won the ‘Invention of the Year 2009 ‘- by Popular Science. The device sees what we see but
it lets out information that we want to know while viewing the object. It can project
information on any surface, be it a wall, table or any other object and uses hand / arm
movements to help us interact with the projected information. The device brings us closer to
reality and assists us in making right decisions by providing the relevant information,
thereby, making the entire world a computer.

The Sixth Sense prototype consists of a pocket projector, mirror and a camera. The device is
pendant shaped like mobile wearing devices. Both the projector and the camera are connected
to the mobile computing device in the user’s pocket. The projector projects visual
information enabling surfaces, walls and physical objects around us to be used as interfaces;
while the camera recognizes and tracks user’s hand gestures and physical objects using
computer-vision based techniques. The software program processes the video stream data
captured by the camera and tracks the locations of the colored markers (visual tracking
fiducials) at the tip of the user’s fingers using simple computer-vision techniques. It also
supports multi touch and multi user interaction.

The device has a huge number of applications. Firstly, it is portable and easily to carry as you
can wear it in your neck. The drawing application lets user draw on any surface by observing
the movement of index finger. Mapping can also be done anywhere with the features of
zooming in or zooming out. The camera also helps user to take pictures of the scene he is
viewing and later he can arrange them on any surface. That’s not it. Some of the more
practical uses are reading a newspaper. Imagine reading a newspaper and viewing videos
instead of the photos in the paper. Or live sports updates while reading the newspaper. The
device can also tell you arrival, departure or delay time of your air plane on your tickets. For
book lovers it is nothing less than a blessing. Open any book and you will find the Amazon
ratings of the book. To add to it, pick any page and the device gives additional information on
the text, comments and lot more add on features. While picking up any good at the grocery
store, the user can get to know whether the product is eco friendly or not. To know the time,
all one has to do is to just gesture drawing circle on the wrist and there appears a wrist watch.
The device serves the purpose of a computer plus saves time spent on searching information.
Currently the prototype of the device costs around $350 to build. Still more work is being
done on the device and when fully developed, it will definitely revolutionize the world.