Hokkaido University Research Profiles

Japanese
Information and Communication

Gesture Recognition System Using Ultrasound

A system that can recognize gestures, including the internal state of the human body, based on the response to ultrasonic waves propagated in the human body.

We are developing a method of recognizing gestures, including the internal condition of the human body, such as the amount of force applied to an object, by transmitting ultrasonic waves to the human body using microphones and speakers in smartwatches or other devices and analyzing the responses.

Content of research

Our gesture recognition system uses a method called active acoustic sensing, which sends out sound waves and analyzes the state of the object using the returned response. This method enables gesture recognition including the internal condition of the human body, such as the amount of force applied, which has been difficult to recognize with conventional accelerometers. It is intended to use this method in a wearable computing environment, and it is unique in that it can simultaneously acquire both externally visible gestures and internal gestures using microphones and speakers that are installed in many devices. For example, we envision that our method can be applied to gesture operations when both hands are occupied in a wearable environment, and to the lifelog of the amount of force applied under stress or other situations.

  • System configuration of the proposed method

  • Implemented devices

  • The amount of force applied and the frequency change

Potential for social implementation

  • ・User interface
  • ・Lifelog

Appealing points to industry and local governments

The Laboratory of Intelligent Information Systems aims to realize higher-performance technologies through challenges to real-world problems such as wearable computing, human-computer interaction, high-precision indoor position measurement, and visible light communication.

2022/5/27Released