STOCKS in Motion: Building a Real-Time Pipeline with Kafka and MLops
This is an end-to-end data engineering project that demonstrates how to build a real-time stock market data processing engine using Kafka and other tools and cloud services. In this project, I have used different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL to create a robust and scalable data pipeline.
Github: https://github.com/prajwalpd7/Kafka-Stocks...