How does Groq LPU work? (w/ Head of Silicon Igor Arsovski!)

Опубликовано: 11 Май 2026
на канале: Aleksa Gordić - The AI Epiphany

31,034

741

Become a Patreon:   / theaiepiphany
👨‍👩‍👧‍👦 Join our Discord community:   / discord

I invited head of silicon at Groq, Igor Arsovski, to share the nitty-gritty details behind Groq's LPUs! LPU or language processing units showed promising results (understatement of the year) on inference benchmarks compared to NVIDIA GPUs.

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

⌚️ Timetable:
00:00:00 - 00:00:42 Intro
00:00:42 - 00:02:23 Hyperstack GPU cloud (sponsored)
00:02:23 - 00:12:18 What does Groq do?
00:12:18 - 00:26:40 Hardware
00:26:40 - 00:37:52 Software
00:37:52 - 00:45:09 Power control
00:45:09 - 00:54:22 Networking
00:54:22 - 00:59:30 AllReduce comparison between GPUs and LPUs
00:59:30 - 01:04:10 GPU vs LPU
01:04:10 - 01:11:45 Outro

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 SPONSOR

The AI Epiphany -   / theaiepiphany
One-time donation - https://www.paypal.com/paypalme/theai...

Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar Veličković

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

💼 LinkedIn -   / aleksagordic
🐦 Twitter -   / gordic_aleksa
👨‍👩‍👧‍👦 Discord -   / discord

📺 YouTube -    / theaiepiphany
📚 Medium -   / gordicaleksa
💻 GitHub - https://github.com/gordicaleksa
📢 AI Newsletter - https://aiepiphany.substack.com/

▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬

#groq #lpu #aichip #ai