Yunjing Xu: Building Domain Specific Databases With a Distributed Commit Log
Read the full blog post here - https://www.heavybit.com/library/blog...
Smyte is building a platform to analyze all of the traffic running through busy consumer websites and mobile apps. In this talk Yunjing describes how Smyte uses RocksDB, Kafka, and Kubernetes to build various domain specific databases. By leveraging prefix scanning and multiple column families in RocksDB, they achieved significant cost reduction with comparable performance when compared to their previous Redis-/MySQL-based solution.
Yunjing is an engineer at Smyte. Smyte builds trust and safety tools to fight spam, scams, credit card fraud and online harassment on peer-to-peer marketplaces and social apps. Before Smyte, Yunjing worked on the data science and infrastructure team at Square and received Ph.D. from University of Michigan for researching performance and security problems of public cloud infrastructure.
For more developer focused content, visit https://www.heavybit.com/library