Machine Learning Audio Plug-ins with iPlug2 and ONNX Runtime | Oli Larkin (Ableton)
"Oli Larkin is the lead developer of the iPlug2 plug-in framework and a software engineer at Ableton. Oli will introduce the latest iPlug2 developments and show how it can be used with Microsoft’s Onnx runtime to perform inference on models exported from ML frameworks such as Tensorflow or PyTorch."
Oli's Abstract
——
Links:
iPlug2 ONNX GitHub: https://github.com/olilarkin/iPlug2On...
iPlug2 GitHub: https://iplug2.github.io
ONNX: https://onnx.ai + https://onnxruntime.ai
Twitter: / olilarkin
Plug-in examples:
https://www.e-phonic.com/invader.html#/
https://youlean.co
https://www.fullbucket.de/music/vst.html
https://www.hornetplugins.com
https://github.com/AlexHarker/HISSToo...
Neural Amp Modeler:
https://github.com/sdatkinson/neural-...
https://github.com/sdatkinson/NeuralA...
https://github.com/pelennor2170/NAM_m...
https://github.com/GuitarML
Miscellaneous:
https://github.com/jatinchowdhury18/R...
https://github.com/Dobiasd/frugally-deep
https://github.com/serizba/cppflow
https://pytorch.org/cppdocs/installin...
https://www.tensorflow.org/install/la...
https://tensorflow.org/lite
——
0:00 Intro
1:57 Overview of iPlug
5:38 Example plugins
12:55 Machine learning workflow
15:30 Inference engine
22:38 iPlug ONNX runtime
31:11 End of presentation
32:32 Q&A
43:38 Outro
——
Inclusion is at the core of our meetups, and we follow the Berlin Code of Conduct. For more information, please read more here https://berlincodeofconduct.org/
Join the Audio Programmer Discord Group: www.theaudioprogrammer.com/community
See our past meetups here:
• Dave Rowland - Real-time Tradeoffs in...
Support the channel: www.patreon.com/theaudioprogrammer
Website: https://www.theaudioprogrammer.com
Instagram: / theaudioprogrammer
Facebook: / theaudioprogrammer
Twitter: / theaudioprogrammer