The Evolving Landscape of Dataloading - Laurence Rouesnel, Meta
The Evolving Landscape of Dataloading - Laurence Rouesnel, Meta
Data loading is a critical component in every ML training system. This session covers the dataloading in and around PyTorch today, the pain-points we hear from users, and industry trends. We focus on how we are thinking about our systems as we see models, datasets, and hardware continue to scale.