Hokkaido University Research Profiles

Japanese
Information and Communication

Communication Robot System

Social space recognition system using dialogue activity and attention guidance system and multiple robots

By calculating the level of activity of a dialogue between people, a robot can recognize the intensity of that dialogue space and adapt its behavior to the context. Furthermore, by applying this mechanism to the behavior of multiple robots, it will become possible to guide the user's attention.

Content of research

Our dialogue activity calculation system calculates the real-time activity level using information such as the distance between the interactants, voice data, and body movements. By using this activity level, the robot can determine whether it is allowed to enter the dialogue space or interrupt the dialogue, and can take contextually adaptive actions. Furthermore, by having multiple robots act in a way that increases the dialogue activity level for each other's actions, the user's attention (e.g., gaze) can easily be guided. Such a system for generating robot behavior using the level of dialogue activity has not been included in conventional research on social robots, and can be applied to robots at reception desks and home robots for households.

  • Fig. 1 Calculation of dialogue activity between two people using mobile terminals and visualization of dialogue space

  • Fig. 2 Interruption of dialogue by a robot using the dialogue activity level

  • Fig. 3 Eye guidance by joint gazing of multiple robots

Potential for social implementation

  • ・A receptionist robot that can respond to foreign nationals
  • ・Cooperative work support by multiple robots
  • ・Intelligent home robot systems for households
  • ・Entertainment Robot System Intended to Attract Customers

Appealing points to industry and local governments

With the advent of the Internet of Things (IoT), the Human-Computer Interaction Laboratory aims to explore the interaction mechanisms between humans and intelligent systems such as robots and agents, which will become increasingly important in the future. We also aim to realize interactive systems used in these mechanisms from both software and hardware perspectives.

2022/5/27Released