Content of research

We have succeeded in establishing associations and similarities between different media, and developed an associative search scheme that takes ambiguity of multimedia information into consideration (fused search). We have also realized a new search engine and interface by quickly introducing modeling of personal preferences through user networks and visualization of similarities in preferences through user interfaces (personal adaptive search). Use of the search engine and interface enables a completely new search that effectively utilizes the polysemy and ambiguity inherent in multimedia contents.

Potential for social implementation

• ・Big data analysis, marketing based on large quantities of data, multimedia database construction, image/music/video search

Appealing points to industry and local governments

In the Laboratory of Media Dynamics, we are working to elucidate the mechanisms of human audiovisual recognition and realize state-of-the-art recognition theory, restoration algorithms and next-generation coding schemes based on these mechanisms. By building on these results, we aim to realize next-generation multimedia systems that can recognize images, music and video in the same way as people do.