Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
In this episode, we reconnect with Sharon Zhou, co-founder and CEO of Lamini, to dive deep into the ever-evolving world of enterprise AI.
We discuss how the AI hype is evolving and what enterprises are doing to stay ahead, break down the different players in the Inference market, explore how Memory Tuning is reducing hallucinations in AI models, the role of agents in enterprise AI, and the challenges of making them real-time and reliable.
Lamini
Website - https://www.lamini.ai
Twitter - https://x.com/laminiai
Sharon Zhou
LinkedIn - / zhousharon
Twitter - https://x.com/realsharonzhou
FIRSTMARK
Website - https://firstmark.com
Twitter - / firstmarkcap
Matt Turck (Managing Director)
LinkedIn - / turck
Twitter - / mattturck
LISTEN ON:
Spotify - https://open.spotify.com/show/7yLATDS...
Apple - https://podcasts.apple.com/us/podcast...
00:00 - Intro
02:18 - The state of the AI market in July, 2024
10:51 - What is Lamini?
11:43 - What is Inference?
15:36 - GPU shortage in the enterprise
18:06 - AMD vs Nvidia
22:10 - What is Lamini's final product?
25:30 - What is Memory Tuning?
29:01 - What is LoRA?
32:39 - More on Memory Tuning
35:51 - Sharon's perspective on AI agents
40:01 - What is next for Lamini?
41:54 - Reasoning vs pure compute in AI