Create-It Studios - Unreal Engine 5 + Ableton Live MIDI Visualizer Demo
Earlier this year, I had the opportunity to work on an audio-focused interactive visualizer project for Create-It Studios. I have been wanting to work on an audio-specific project for a while now, and thanks to this project, I was able to do so using both Unreal Engine 5 and Ableton Live! 🥳
Here's how it works after a few useful setup resources: Unreal picks up data from a track channel in Ableton via a MaxForLive device or plug-in, and it converts MIDI to OSC for use within Unreal (you can also use the OSC/PAR plug-in or any similar one to use any other DAW if you prefer). As for the project, various elements like meshes, materials, and particles react or appear depending on the note you play (either on a MIDI keyboard/controller or just a MIDI pattern in the session). This project was shown and demonstrated at the opening event, and if you visit their location, you can still interact with it!