Learning Journal

Watermark and output modes

Kafka Producers | Creating Kafka Producers in Java | Producer API

Tumbling Window aggregate

Scala Tutorial - Scala if else

Linux Tutorial - Shell command line structure

Linux Tutorial How to start Linux VM in Seamless Mode

Kafka Tutorial - Introduction

Kafka Streams - Configuring IntelliJ IDEA for Kafka Application Development

Apache Kafka - Installing Kafka in Cloud

Kafka Streams | Real-time Stream Processing using Kafka Streams API | Master Class Introduction

Install and run Apache Kafka

Spark Tutorials - Spark Data Types | Metadata | Functions

Kafka Spring Boot Starter Project | Initializing Spring Kafka Project | Kafka Project in Gradle

Incremental Ingestion - Tools for Incremental load - Where to implement data ingestion

Apache Kafka KSQL | What is Kafka KSQL | Using SQL with Apache Kafka

Apache Spark Performance Tuning | Scenario based interview question | Cluster Autoscaling

How Kafka Streams work in Spring Cloud | What is Kafka Streams | Kafka Streams Vs Spring Cloud

Big Data and Real-time Stream Processing | End of batch Processing Emergence Of Real-time Streaming

Spark Tutorial - Data Sources | How to load data in Spark

Spark Streaming APIs DStream Vs Structured Streaming

Spark Development Environment

Installing Python | How to setup your Python development environment

Apache Spark Performance Tuning on Databricks | Scenario based Spark performance tuning course

Streaming from Kafka Source

Spark Streaming APIs DStream Vs Structured Streaming

Apache Spark in Cloud | Databricks Cloud for Apache Spark

Kafka Tutorial - Producer API

Kafka Streams - Installing Multi Node Kafka Cluster

Spark UDF | User Defined Functions in Apache Spark | How to create and use UDF in Spark

Kafka Streams | Complete Training | Master Class

06 - Batch processing to stream processing

Installing Kafka on Mac | Confluent Kafka on Mac | Setup your Kafka Development Environment on Mac

Kafka Tutorial Producer Workflow

Installing Confluent Kafka on Windows | Setup Kafka cluster in WSL2 | Windows sub system for Linux

When do you need real-time stream processing project | Understand with an example and use case

Apache Spark Performance Tuning Course | Tuning Terabyte Join | Tuning large table joins

What are the three approaches for Data Engineering

How to detect and tune data explosion problem | Apache Spark Performance Tuning Scenario

08 - Azure Portal Overview

11 - Azure Databricks Platform Architecture

05 - Introduction to Databricks Platform

Why is reading JSON slow and how do you optimize it | Apache Spark Performance Tuning Scenario

What is Data Engineering | What is the job of Data Engineer

9 - Creating Databricks Workspace Service

What is Database and SQL

What can you do with Databases and SQL

10 - Introduction to Databricks Workspace

How to Debug Your Kafka Streams Coding Errors | How to Ask Questions for Kafka Streams

Overview of Hadoop Platform

Introduction to Python | Why learn Python | Who is using Python

Scala Tutorial - SBT Build Definition