Airtable - Migrating a Multitenant Architecture to MySQL 8.0
The storage team at Airtable published a blog post describing, in detail, the migration of their petabyte-scale storage layer from MySQL 5.6 to MySQL 8.0.
Andrew Wang, the lead of Airtable's storage team, joined us to discuss the migration, Airtable's storage architecture, data isolation levels, engineering culture, and more.
This podcast is a contribution to SaaS Developer Community by https://thenile.dev, the database for modern SaaS.
The blog: / migrating-airtable-to-mysql-8-0
Github's gh-ost, recommended by Andrew: https://github.com/github/gh-ost
Andrew's LinkedIn (he's hiring): / aawang
Chapters:
00:00 Intro
01:30 What's Airtable?
03:40 Storage architecture
05:24 Managing shards
08:00 Using shards for migrations
09:00 Backup and Restore
10:00 Culture of Getting Things Right
14:00 Problem with Upserts
16:35 Auto increment vs. UUID
18:43 Isolation Levels and MVCC
23:26 Human scale and beyond
26:00 Preparing for the main shard migration
31:10 Magic of a custom MySQL Client
35:54 Advice for building a new data layer