Click here to preview the new Fast Company

Want to try out the new FastCompany.com?

If you’d like to return to the previous design, click the yellow button on the lower left corner.

SixthSense's Pranav Mistry Uses Cameras to Read Gestures

Pranav Mistry
Research Assistant, MIT Media Lab
Cambridge, Massachusetts

Mistry, 29, invented SixthSense, a platform that uses a small camera to read and follow users' gestures.

"In computing, everything happens inside this rectangular screen. I want to get the pixels out, paint the world, and allow us to interact with it. The system can turn anything into an interactive surface, from a table in Starbucks to the palm of your hand. There are endless consumer applications, but what excites me is how this can help people. A man who cannot speak communicates with sign language, but the average person doesn't know that language. SixthSense, if equipped with speakers, can recognize the gestures and form the words — it will speak for him. We are giving him a sixth sense that he was missing."

Add New Comment

1 Comments

  • R R Dasgupta

    I had come to learn about Pranav's awesome innovation through a video of his TED Talk in India. Truly outstanding work, I was most excited when he talked about open-sourcing the technology. I don't seem to have found a place where this has been done. This technology ouught to scale. It has tremendous application possibilities in India - in education, in defence, in social work, in ideation and in Innovation itself. So I would be really happy if Pranav and his team can tell us how to access the software and what it takes to point a finger at the world.