Lightning Talk: Partition scalability (Open House 2022)
This 10-minute lightning talk dives into scalability improvements in Redpanda, including the architectural work we did to achieve it.
With:
John Spray, Redpanda Core Engineering Team
0:00 Intro
0:43 Why scale Redpanda?
1:31 Architecture refresh
2:36 Adaptive storage tuning
4:05 Thundering herd problems
6:25 Sizing: scale-up or scale-out?
7:42 Tuning overview
8:48 Testing stability at scale
9:41 Wrap-up
To learn more about Redpanda, the Kafka® API-compatible streaming data platform for developers, visit https://redpanda.com:
◦ The Kafka API is great; now let's make it fast! - https://rpnda.co/fast-safe
◦ How Redpanda’s cloud-first storage model reduces TCO - https://redpanda.com/blog/cloud-nativ...
◦ Validating consistency and the absence of data loss in Redpanda - https://redpanda.com/blog/validating-...
◦ Exploring the benefits of single-binary architecture - https://redpanda.com/blog/single-bina...
Join our Slack community! https://rpnda.co/slack
Contribute to our GitHub repository: https://rpnda.co/github
___
Redpanda is a Kafka® API-compatible streaming data platform for developers, built from the ground up to eliminate complexity, maximize performance, and reduce total costs. Its lean and efficient architecture eliminates categorical dependencies while squeezing the most out of your resources to give you 10x lower latencies and up to 6x lower cloud spend— without sacrificing your data’s reliability or durability.
Follow us on social media:
Twitter - https://rpnda.co/twitter
LinkedIn - https://rpnda.co/linkedin