System Design: Facebook's Tectonic Filesystem
Learn about how Facebook scaled their distributed filesystem infrastructure to exabyte scale, including housing multiple tenants such as blob store and data warehouse.
Topics covered entail overall system architecture and techniques including scalable metadata store, hedged quorum writes, copyset replication techniques, tenant-specific optimizations, intricate race-conditions related to cross-shard transactions, and more!
Feel free to comment below if you have questions!
--
Timestamps:
0:00 - Briefing
0:11 - Introduction
8:44 - Previous Storage Infrastructure Systems
11:36 - Overall Architecture
15:14 - Chunk Store
18:44 - Metadata Store
34:09 - Client Libraries
36:05 - Background Services
42:10 - Multitenancy
52:10 - Tenant-Specific Optimizations
59:36 - Production Tradeoffs
1:02:55 - Related Works