Architecting petabyte scale analytics by scaling out Postgres on Azure with Citus
Links:
Sign up to our Meetup group https://www.meetup.com/hybrid-virtual...
Join our LinkedIn group / 12487962
Follow us on Twitter / hybridvug
...and of course don't forget to subscribe to our channel, like the video, and hit the bell! It really helps us in our mission to produce free content for the masses.
Session Details:
This is the story about a Postgres PaaS service powering a 1.5 petabyte analytics application with 2816 cores and 18.7 TB of memory in the Citus cluster at Microsoft. We will discuss its architecture, features, and use case:
The Windows team measures the quality of new software builds by scrutinizing 20,000 diagnostic metrics based on data flowing in from 800 million Windows devices. At the same time, the team evaluates feedback from Microsoft engineers who are using pre-release versions of Windows updates. At Microsoft, the Windows diagnostic metrics are displayed on a real-time analytics dashboard called “Release Quality View” (RQV), which helps the internal “ship-room” team assess the quality of the customer experience before each new Windows update is released. Given the importance of Windows for Microsoft’s customers, the RQV analytics dashboard is a critical tool for Windows engineers, program managers, and execs.
Speaker Bio:
Alicja Kucharczyk is an EMEA Global Black Belt OSS Data tech Specialist at Microsoft, a PostgreSQL expert, and an experienced developer, administrator, and PostgreSQL coach with strong practical knowledge of Linux and their mutual interactions. She is particularly interested in performance optimization at different levels. Alicja has consulted for a lot of companies providing them with working solutions and supporting them in architecting, deploying, and maintaining PostgreSQL. She is the founder and organizer of Warsaw PostgreSQL Users Group, for Polish PostgreSQL users, a speaker at local users groups, and conferences and advocate for PostgreSQL and open source. In her free time she writes songs about VACUUM. She can be found on Twitter as @StiepanTrofimo
Host/s:
Mark Broadbent.
Mikael Wedham.
---
Originally recorded on 24th November 2020.
Video Production: Mark Broadbent 22nd March 2021.