Smart-watches without an additional "iron" on the sound will be able to understand what the user is doing
Researchers from Carnegie Mellon University have developed a technology that allows smart clocks to identify tapes, creaks and movement sounds near the user. This will make it possible to bring the interaction with portable devices to a fundamentally new level. In order for the device to learn to distinguish a number of bioacoustic signals, it is only necessary to install a special software update that extends the functionality of the accelerometer, which already exists in the clock.
This functionality opens the possibility of the emergence of a new class of applications that use recognizable sounds to manage the smart clock. There is also the possibility of interacting with other objects through the Internet of things.
By tracking the vibrations that occur when a user holds objects or uses them, a smart clock will be able to recognize both objects and actions.
For example, the clock will help the user to tune the guitar, displaying the notes played by the guitarist, allowing to find the correct sound of each string.
The clock will hear what the user is doing with his hands, and it is through the hands that people most often interact with objects.
The new technology was called ViBand and was developed by graduate students of the Interface Group of the Future Institute for Human Computer Collaboration of the Carnegie Mellon University Gérard Laput and Robert Xiao. Consultant was a specialist in human-computer interaction, assistant professor Chris Harrison (Chris Harrison). Their work was presented at a symposium in Tokyo, the theme of which was user interfaces and technologies for computer technology.
Usually the smart clock accelerometer is used to determine that the user raises his hand. In this case, the device screen is activated. In some cases, this sensor is used to count the steps.
To accomplish these tasks, the accelerometer is only required to perform measurements 100 times per minute. But when the researchers reached the accelerometer frequency of 4000 (4 kilohertz), they found that the accelerometer is able to work as a perceiving vibration of the microphone. He is able to perceive both sounds coming through the air, and bioacoustic signals, as he touches the body.
Chris Harrison explains that ViBand is not just a way to manage a smart clock. It expands the possibilities of what the user is able to do with his hand. This is a powerful interface, which is always at the user's fingertips, but directly on the hand.
A watch with ViBand support can feel the movement of the forearm, palm and back of the hand. They also recognize finger movement, creaking and other movements. Such hours will be known if the user holds various mechanical and electronic tools, including an electric toothbrush, electric drill or other tools. After all, every movement of the body or activity is accompanied by a characteristic bioacoustic signal for it.
To increase the frequency of the accelerometer, the research team developed a customized core of the smart-clock operating system. And this is the only modification that is necessary to get hours of new functionality.
The team also developed several demonstration features of ViBand. Among them, a software solution that uses hand movements in the area around the clock to control the application on a portable device. Such gestures can be used for remote control of devices, including lighting, televisions or other devices connected via the Internet of things.
It has also been shown that the new development can be used in applications that notify about actions with objects - monitoring of cooking or providing a visual response when tuning the guitar.
And finally, so-called vibration discs can be recognized. Small objects produce low-pitched sounds, which also contain certain information. The vibrotag of the office door, for example, can transmit information about the time spent in the office or other contact information.
Based on sciencedaily.com
The article is based on materials .
Comments
Post a Comment