🤗 Hugging Cast S2E4 - Deploying LLMs on AMD GPUs and Ryzen AI PCs
Hugging Cast is a live show about building AI with open source.
In this episode, Felix, Mohit and Jeff demo new experiences to deploy LLMs on AMD, on the cloud using the latest MI300X GPU instances on Azure, and on-device using the new Ryzen AI PCs.
🚀 How we collaborate with AMD to make open models go brrr everywhere
☁️ Deploy LLMs on Azure with the new ND MI300X v5 VMs and TGI
💻 Unlock on-device inference with optimum-amd on the new Ryzen AI PCs
Ryzen AI PC demo notebook: https://huggingface.co/mohitsha/ryzen...