感覚とともに · 390 works

With senses

Designing perceptual reality that emerges from cross-modal interaction.

Our perception is not simply the sum of what vision, hearing, touch, taste, and smell each register independently. Information entering through one sense can change how we perceive through another, a phenomenon known as cross-modal perception. For example, changing the appearance or aroma of a cookie can make the same cookie taste different. Showing the movement of one's own hand or a cursor on a screen as slower than the actual movement can produce a sense of weight or resistance even when nothing is being pressed (pseudo-haptics). Perception is generated jointly through interactions among the senses. We study the mechanisms by which such cross-modal perception arises, and we apply these mechanisms in engineering to develop cross-modal interfaces that create diverse multisensory experiences from a limited set of sensory stimuli.

Featured work

Publications in this theme

Filter all publications by this theme →