About
Can cars become driving synthesizers? Using driving data (ex. GPS, gyroscope, lidar) as input, my system will turn these into a sonification that becomes a soundtrack to enhance the driving experience.
Drivers can tune their “car/instrument” to their personal preferences via an in-car interface. A city symphony is composed by all the traffic together that lets you hear “mobility of an urban environment”.
Extra
Top view on installation.
The inner part of the installation exist of multiple car setups where drivers compose audio in VR. The outer wall is constructed out of projection screens. Visitors can follow the in car experience via visual are projected on the outer walls. The visuals are a mashup coming from video of the VR headset, outer car view (unreal), maps and driving data visualizations (via Touchdesigner).
TECHNICAL
Driving data will be imported into an Unreal gaming engine to create a real-life model of mobility. Multiple actors (car, bike…) will be moving through time and space. Ableton live and MaxMSP will turn the data into sound, Touchdesigner will be used for the visuals (maps, data visualisation).
Sonification
The project is an opportunity to get deeper in sound design. Using a technique called “physical modeling synthesis” to create new hybrid instruments that couldn’t possibly exist before. PMS uses complex algorithms to emulate not just the sound of an acoustic instrument, but the way they’re physically played as well. Imagine you had an instrument that could change its size, shape, and material while you play/drive it.
Currently going deeper into music composition with Valery Vermeulen (Honorary Mention, S+T+ARTS) that would like to mentor me for of “Sonic Silence”.
DigiPHY by Granstudio
DigiPHY by Granstudio is a mixed reality automotive design tool that combines VR & physical support into an immersive experience.
More info: https://www.granstudio.com/digiphy
The DigiPHY platform will be used to make the VR prototype and enable us to move through it. While the technology is available through Granstudio, the hardware is heavily used in production. A virtual racing setup can be used as alternative hardware.
The DigiPHY platform will allow us to turn moving objects (cars, bikes) into audio in a safe space where we can experiment with motion and audio.
MORE EXPERIMENTS
around mobility and sound
(In preparation of Sonic Silence)
Car sample field
Carsounds are ordered a virtual space via flucoma.
Read more
AI car interface
Car UI to tweak the vehicle to personal preferences
Read more
Car textures
Abstract 3D visuals that visualizes car movement.
Read more
Car maps
Experiments visualizing locations on a new kind of interactive maps. Read more
Navigation