indian it geek develops digital 'sixth sense' - touch screen gestures

The brain behind this device is 28-year-old Indian-
Born Pranav Mistry, a researcher at MIT's Media Lab.
"Sixth Sense" device (MIT patent)
Includes pocket projectors, mirrors, and Web cameras bundled in a wearable pendantlike mobile.
The projector can turn anything into a touch screen. The webcam (and colour-coded finger-
Gloves on index finger and thumb)
The movement of the user's hand can be identified, which makes the gesture-commands.
For example, the square frame gesture will prompt the device to click on the photo.
The device can also identify the book the user selects from the bookstore-
Recognition by image recognition or radio frequency-
And project information, such as Amazon's rating.
The system can also design a keyboard to type, detect goods on food shelves and compare online prices.
Newspapers can prompt devices to search for news video clips (
The device's smartphone uses an Internet connection to retrieve information).
The user can also stop by any surface or wall to browse the photos she took.
The device allows the user to draw icons or symbols in the air using the index finger and recognize them as interactive instructions.
Drawing the "@" symbol, for example, will allow the user to check his/her mail.
"The possibilities are huge, but it's a work in progress," Mistry acknowledged in a telephone chat from the United States.
The device costs about $350 (
About Rs 17,500)to build.
Mistry admits that his concept falls roughly within the category of "wearable computing. -
He pointed out that mobile phones belong to the same category.
But he explained that traditionally, information is limited to paper, or digital information on the screen. -
They don't communicate.
The Sixth Sense device fills this gap, "bringing intangible digital information into a tangible world and allowing us to interact with this information through natural gestures ".
Mistry says you can even use this device to teach games like football or table tennis (
In addition to graffiti, hiking, mountain climbing, listening to ghazals, and even watching Tom and Jerry, one of Mistry's hobbies.
"Your imagination is the only limit," he added . ".
Mistry receives about 500 emails a day about his concept, of which "about 400 emails from Indians ".
"Many of the CEOs of small Indian companies, including some pharmaceutical companies in Hyderabad, have shown interest in my project," he said . " But declined to give their names.
"I don't understand how the company works, but I want to make cheaper prototypes for India.
India, which he "will definitely return", is the focus of his interests.
Mistry was born in Gujarat, where he studied computer engineering and later received a master's degree in design from IIT in Mumbai.
He has been studying at MIT to help him get closer to his childhood dreams and integrate the flexibility of the digital world with the physical world.
"We need to realize our dreams," he said . "
He should know that he has always dreamed of bringing meaningful computing to the public.
For example, he believes that India should use the power of technology instead of giving every villager a computer that is difficult to operate.
He also believes that Indians do not need to learn how to use the keyboard, mouse, etc.
One of his early projects, "Sandesh", addressed the communication needs of these people.
A new system using public switched telephone network and simple interaction is proposed.
Sandesh contains a message-
Receiving units in villages and kiosks in cities with visual assistance.
It uses print or sound-
Media that convey information.
His other project called "Akshar" is basically an attempt to establish a mechanism for entering Indian scripts in digital devices such as mobile phones, kiosks, interactive TVs or personal computers.
"I use this to talk to my mother," Mistry said . " He explained that the data input method for Indian languages such as Hindi and bharatti is usually not a keyboard-
Friendly, complex input using QWERTY keyboard.