Cloudflare: Performance isolation in multi-tenant DB
Cloudflare is no longer "just" a CDN serving 55M HTTP requests/sec, they are now offering a wide range of cloud services on the edge. These services run on a data layer with 15 Postgres clusters running hundreds of databases.
Vignesh Ravichandran, engineering manager of Cloudflare's database team, joined us to discuss the challenges of running this large scale multi-tenant environment - dealing with network partitions, noisy neighbors, floods of connections and even global warming.
We talk about the importance of having a good toolset, of practicing incidents and of internally advocating database best practices to a large engineering organization.
The blog: https://blog.cloudflare.com/performan...
The Scale presentation: https://www.socallinuxexpo.org/scale/...
00:00 intros
00:47 What’s Cloudflare?
03:45 Databases at Cloudflare
04:15 Cloudflare’s multi-tenant DB architecture
08:27 Mapping apps, DBs and clusters
14:20 Problems of Scale
20:00 Tools of the trade
24:45 Performance isolation of tenants
31:45 Performance isolation in the future
34:20 Few last tips