Micro Data Centers and the Evolution of AI Infrastructure
In this episode of the EPRI Current, host Samantha Gilman speaks with EPRI’s Director of Agentic AI and Micro Data Centers, Ben Sooter, about the growing role of distributed inference, also known as micro data centers, in the evolving AI landscape. While large, centralized data centers dominate current discussions, Sooter explains why the next wave of compute demand will shift closer to end users to support faster, latency-sensitive applications.
The conversation highlights how this distributed approach could reshape grid planning, including opportunities to leverage available capacity at distribution substations and the need to better understand emerging load profiles. Sooter also discusses EPRI’s collaborative pilot efforts with NVIDIA, Prologis, and InfraPartners to explore siting, deployment, and scalability. As AI adoption accelerates, this episode examines how utilities can prepare for and help enable the next phase of digital infrastructure.