Building a scalable data platform at Hotstar
In this talk, Jayesh Sidhwani - former head of the data infrastructure at Hotstar - shares the patterns learned in the process of building a scalable data platform. The session covers:
1. Ingestion Patterns
2. Unified Ingestion Proxy
3. Schema Definitions
4. In-flight enrichments
5. Highly Available
6. Storage Patterns
7. Decouple storage and compute
8. Query Lineage & Optimization
9. Noisy Neighbour
10. Consumption Patterns
11. Single GUI and a programmatic interface. All the magic underneath
12. Parity between streaming and stationary data
Session details on https://hasgeek.com/fifthelephant/win...