Ryan Betts [InfluxData] | InfluxData Internals | InfluxDays 2019 NYC
InfluxData builds a Time Series Platform primarily deployed for DevOps and IoT monitoring. This talk presents several lessons learned while scaling the platform across a large number of deployments—from single server open source instances to highly available high-throughput clusters.
This talk presents a number of failure conditions that informed subsequent design choices. Ryan discusses designing backpressure in an AP system with 10’s of thousands of resource-limited writers; trade-offs between monolithic and service-oriented database implementations; and lessons learned implementing multiple query processing systems.