SixthSense's Pranav Mistry Uses Cameras to Read Gestures

Pranav Mistry
Research Assistant, MIT Media Lab
Cambridge, Massachusetts

Mistry, 29, invented SixthSense, a platform that uses a small camera to read and follow users' gestures.

"In computing, everything happens inside this rectangular screen. I want to get the pixels out, paint the world, and allow us to interact with it. The system can turn anything into an interactive surface, from a table in Starbucks to the palm of your hand. There are endless consumer applications, but what excites me is how this can help people. A man who cannot speak communicates with sign language, but the average person doesn't know that language. SixthSense, if equipped with speakers, can recognize the gestures and form the words — it will speak for him. We are giving him a sixth sense that he was missing."

Add New Comment


  • R R Dasgupta

    I had come to learn about Pranav's awesome innovation through a video of his TED Talk in India. Truly outstanding work, I was most excited when he talked about open-sourcing the technology. I don't seem to have found a place where this has been done. This technology ouught to scale. It has tremendous application possibilities in India - in education, in defence, in social work, in ideation and in Innovation itself. So I would be really happy if Pranav and his team can tell us how to access the software and what it takes to point a finger at the world.