Digital Museum

In museums, digital technology can be used to tell the background information about their exhibits. In this project, we aim to realize exhibits that merges the exhibits itself and their context, totally support the museum experience, and digital technology for the museum.

On-Site AR Exhibition System

On-Site AR Exhibition System” is an iOS application to interactively exhibit the past scenery of a certain place by superimposing it onto the current scenery shown on iPad.

Digital Diorama

"Digital Diorama" system is a novel mixed reality museum exhibition system to convey background information related to the exhibit intuitively.

Time-leaping Seat

The Time-leaping Seat enhances a static exhibit toward time axis by 3-D recording visitors and exhibits at museums.

Digital Display Case

This system displays a virtual exhibited object while keeping the interface of conventional display case and effectively conveys background information about the exhibits.

Mob scene filter

Mob Scene Filter aims to prevent identifying an individual from others by changing one’s facial textures and the arrangement of the facial regions and their sizes.

Guidance Field

Guidance Field guides users to arrive at and gaze at pre-defined targets in virtual environments.


"Life Log Infrastructure for Food" project is a cooperative research with Aizawa Lab. and Sasaki Lab. at the Univ. of Tokyo, KDDI R&D Lab., and foo.log Inc. "Food" is one of the most important and regularly consumed factor in our daily life. However, so far, this has rarely been viewed as an object of information processing. In this research, we aim at developing an infrastructure for lifelog, with emphasis on food and food-related activities in our daily life. Especially our laboratory focuses on the method to capture, analyse, visualize and utilize food-related activities.


We improve eating habits by enhancing satisfaction of healthy meals with feedbacks which are how healthy others evaluate meals.

Table Talk Enhancer

Table Talk Enhancer is a tabletop system that enhances and balances mealtime conversations by feedback of lights on the surface.


Vocalog records and analyzes conversations in mealtime, and provides feedback to a user. It enhances mealtime communications.

Lifelog-based Future Prediction

Future Diary

We develop Systems that forecast the rate of progression of daily tasks by analyzing lifelog. The system prevents future collision of tasks.


PRIMA can record and reconstruct the real space as 3-D data in realtime using four depth cameras.

Receiptlog and Expenditure Forecast

This system records purchase activities from receipts, and tells you amount and possibility of future consumption.

Double Time Scale Diagram

We propose a method for changing the driver's departure time by predicting the future traffic conditions and informing the driver on how long the driver will expect to wait in a traffic jam based on the time at which the driver chooses to depart from the rest area.


You can manage daily tasks reasonably with WillDo, which forecasts your future state by analyzing lifelog. Available for iOS.

Xnavi 2

A travel planning system that shows images of experience within each area at the right time.

Multimodal & Crossmodal Interface

While visual and auditory information are mainly used for exsiting interfaces, other modalities are not used much. We are developing multi-modal interfaces such as haptic, olfactory and gustatory displays in order to realize intuitive virtual reality environments. Moreover, we are focusing on cross-modal interfaces which present ultra-realistic experience with limited sensory information by using cross-modal interactions.

Metamorphosis Hand

Metamorphosis Hand provides users with interactive experiences of altering perceptual body image.

Visuo-Haptic Redirected Walking

We propose a method for improving the effects of manipulation in redirected walking (RDW) by using haptic cues, particularly for the discrimination of path curvature. We develop an RDW system, which displays a visual representation of a flat wall and users virtually walk straight along it although, in reality, users walk along a convex surface wall with touching it. Using this system, we conduct an experiment, and the results show that our method reduced the amount of perceived curvature in RDW as compared to an only visual method.

Content-aware Browsing by Pseudo-haptic Feedback

This study investigates the effect of pseudo-haptic feedback, which is rendered based on visuo-haptic interaction with a touch screen, on a memory task during information browsing.

Infinite Stairs

Infinite Stairs provides users with virtual reality (VR) experiences, wherein users feel as if they are ascending/descending stairs through passive haptic feedback.


Transcalibur is a hand-held VR controller that dynamically and illusorily changes the perceived shape of a 2D object.

Magic Table

This is a system that presents a sense of table deformation by combining redirection and pseudo-haptic.

Effect of Self-avatar Appearance in VR

We examine how avatar realism affects perceived object sizes as the size of the virtual hand changes via “body-based scaling”.

Food texture manipulation by the visual presentation of modified chewing movements

This system aims to present visually modified mastication movements in real-time to manipulate the perception of food texture.

Illusion Controller

We propose a novel method for designing hand-held VR controllers which illusorily represent haptic equivalent of visual shape in VR.


"ARAtouch" is a visuo-haptic system which is able to evoke the haptic sensation on the mobile device, without any haptic devices, only using haptic illusion.

Augmented Endurance

"Augmented Endurance" modifies perception of fatigue during handling midium-weight objects and augments our endurance by affecting our weight perception with AR technology

Tabletop Augmented Satiety

This is a tabletop system for affecting our perception of satiety and controlling energy intakes by controlling a size of a projected image around the food.

Augmented Satiety

"Augmented Satiety" is a method for modifying perception of satiety and controlling nutritional intake by changing the apparent size of food with augmented reality.


"Magic Pot" enables us to experience a haptic illusion as if users were touching a virtual magic pot shaped by users, even though they are touching only a physically static cylinder in fact.

Meta Cookie

"Meta Cookie" is a cross-modal gustatory display to change perceived taste of a cookie by overlaying visual and olfactory information onto a real cookie by using augmented reality.

User Support of Physical Labor using Pseudo-haptics in a Mixed Reality Space

We managed to enhance the performance of object lifting tasks by modifying the visual movement to manipulate the perception of weight.

Improvement of drinking habit with augmented reality

This research proposes a system for implicitly influencing the satisfaction we experience while drinking a beverage and for controlling beverage consumption.

Subjective VR & Reflex-based Interface

The purpose of this project involved assessing the efficacy of computer-generated emotion and establishing a method for integrating emotional experience. In the field of cognitive science, the ability to alter a bodily response has been shown to unconsciously generate emotions. We therefore hypothesized emotional experience could be manipulated by having people recognize pseudo-generated bodily reactions as changes to their own bodily reactions and are developing emotion evoking interfaces.

Incendiary reflection

"Incendiary reflection" can evoke positive and negative affect and manipulate preference decisions by the feedback of deformed facial expressions.

Interactonia Balloon

"Interactonia Balloon" is an artwork to raise awareness of own respiration, and evokes and enhances tense feeling by synergistic influence of intentional change of own respiratory condition and a paradoxical experience caused by active of the balloon depending on the condition.

Smart Face

"Smart Face" develops a method for improving creativity by changing the facial appearance of people during video conferences.


"Routine++" is a new technique to implement a pre-performance routine in a short period of time by providing a user artificial successful experiences via a simulator.

Digital Public Art

Digital Public Art is a new genre of art produced by bringing information technology into public spaces and evolving media art into public art. We are convinced that by fusing the interactive and global characteristics of media technology - think of computers - with the powerful presence and the ability to transform locations of public art - think of sculpture - we can transcend these separate viewpoints to stimulate people's awareness of media technology.

Sharelog 3D

Sharelog 3D is a piece of interactive art that visualizes the history of trains the user took from contactless fare cards.

Controllable particle display using water drops

Research of touchable and volumetric visual display using water drops as pixels.

JUKE Cylinder

"JUKE Cylinder" is a piece of interactive art installation to augment sound images through hand interaction and to metamorphose hands into a musical instrument.

Sound Environment Interaction

This system enables to manipulate the transfer path of electricity, using the properties of sound waves.

Senior Cloud

ICT Platform for Improving Society by Circulating the Experience, Knowledge, and Skills of the Elderly

Toward inplementing Mosaic-type work for seniors

For having seniors work more flexiblely, we propose a mosaic-type work system in which elderly human resources are combined to form a single "virtual worker"

Support system of Time-mosaic formation for seniors

For realizing flexible work by seniors and their stable workforce, we propose a support system of time-mosaic formation for them.

An avator robot for spatial mosaic

We are developing an avator robot to have seniors work easily and remotely.


We design the interface that enables user to select hearing sound source under the multiple sound circumstance.

Transcendent Telepresence

Many previous studies on telepresence have extensively investigated conveying distant places exactly. However, it is not necessarily effective to convey exact information. We believe that the capability to transmit information in a modified form is an advantage of telepresence. Thus, we proposed ‘‘Transcendent Telepresence,’’ which uses this advantage positively. We aim to achieve remote communication that is superior to face-to-face communication.


FaceShare is a videochat system which evokes the positive effects of mirroring by generating pseudo-expressions congruently with your partner.

Social Touch Avatar

Changing the operator’s gender impression enhances the positive effects of social touch between persons of the same gender.


Transgazer is a system of robotic eyes that can send averted or direct gazes simultaneously to multiple recipients by switching between convex and hollow eye shapes.

Physical Space Oriented Tele-Communication

Many of the studies in tele-communication focuses on showing remote participants’ faces and sharing digitized documents. However, many tasks still require participants to share physical objects. We are developing system to support tele-communication that needs to share objects in the physical environment.

Mediating Awareness and Communication through Digital but Physical Surrogates

Digital but physical surrogates are tangible representations of remote people positioned within an office and under digital control. By having them react to physical actions of people, surrogates can control the communication capabilities of a media space. This enables the smooth transition from awareness to casual interaction while mitigating concerns about privacy.

Telepresence robot iRIS

iRIS is a telepresence robot that facilitates mutual reference to a physical object over the distance. The robot has a display that shows remote participant’s head. The display is mounted on a 3-DOF neck. The robot also has a built-in projector enabling a remote participant to show his/her actual hand gestures through a physical object in the local environment.

ThirdEye: A surrogate eye

A long-standing challenge in video-mediated communication systems is to represent a remote participant’s gaze direction in local environments correctly. To address this issue, we developed ThirdEye, an add-on eye-display for a video communication system. This display is made from an artificial ulexite (TV rock) that is cut into a hemispherical shape, enabling light from the bottom surface to be projected onto the hemisphere surface.

Other Projects

Ring Brings Kiss

"Ring Brings Kiss" is an entertainment system that aims to set the mood for kiss, and enjoy kiss as an entertainment.

Desktop Kingdom

"Desktop Kingdom" is a multi-user system that allows you to interact with AR objects through the tablet computers.

"Shikkuri" feeling in interaction in virtual reality space

We aimed to find out and evaluate the factors of "Shikkuri" feelings in doing unreal operations in VR space.

Divisible planar object detection for AR applications

This research proposes a divided planar-object detection method for augmented reality(AR) applications. It uses PROSAC and iterative homography calculation the multiple planar-object detection.