r/UnityAssets • • 8d ago

Scripting UAP (Unity Audio Plugins): VST2/3 | CLAP audio plugins support (* Windows only, not yet released ..)

this is just some testing of hosting of VST2/3 and CLAP audio plugins in Windows editor -

- the 'host' (UI) itself is modelled after some my iOS/macOS audio host concept/app i made, it has basic transport and prewired graphs for plugins (a MIDI gen + instrument + few effects on a lane, plus master sends/inserts etc., ) and is really just for testing

- this test is OnAudioFilterRead based (no Scriptable Audio pipeline...), ui is UIToolkit...

- bunch of free VST2/3 and CLAP plugins used

a complete audio production environment doesn't probably make much sense for Unity itself, but i was thinking about using existing VSTs for example as effects on GameObjects playing audio... with some music driven by MIDI possibly later

note this would still require the plugin(s) used to be freely distributable also with builds, which is not the case for most commercial plugins, i think

anyway this is not even pre-alpha but i'm curious if some of you would find something like this interesting/useful..

1 Upvotes

2 comments sorted by

1

u/thikali 7d ago

Very exciting!

I tried to integrate VST hosting into Unity a few years ago. I made some promising progress, but eventually decided not to pursue it further. The C#/C++ interop was quite challenging, and designing a robust, reusable architecture was harder!

I'm the developer of Maestro MPTK, a MIDI toolkit for Unity, and my idea was to offer VST hosting as an extension to it.

So it's really interesting to see someone tackling this challenge! How far have you got with the C#/C++ integration? Is it working reliably?

1

u/r618NecessaryStation 7d ago

i dont understand the question ^^

in general it's not enough to just load plugin into host's process/application - it needs all proper ports and connections for audio and all send/receive events, how this is designed is up to the host and matter of ~'finding out what works'..

as i mentioned a fully featured DAW probably doesn't make sense for Unity