touch synth / stroke synth / stir synth

touch synth / stroke synth / stir synth

2025

ArtSound

This is a sound installation project that sonifies the interaction between the user and physical materials. When the user touches, strokes or stirs the material (grass, fur, water), it generates sound based on the material's feature extracted from video frame data.

The feature is roughly divided into two features; one is related to the movement, and another is related to texture and its direction. The sound is generated using MAX 9 and RAVE, a generative sound machine-learning model.

The project aims to explore the relationship between sound and physical materials and challenge to give the relaxation experience to the audience with cross-modal experience.

Watch on YouTube