Apache Spark - Apache Kafka Integration for Real-time Data Processing

Опубликовано: 27 Октябрь 2024
на канале: Unboxing Big Data
3,244
43

Links used in this video :
https://www.scala-sbt.org/1.x/docs/In...
https://www.scala-sbt.org/1.x/docs/sb...
https://stackoverflow.com/questions/2...
https://logging.apache.org/log4j/1.2/...


Steps:

1. INITIALIZE THE ZOOKEEPER

zookeeper-server-start.sh ./config/zookeeper.properties

2. INITIALIZE THE KAFKA

kafka-server-start.sh ./config/server.properties

3. CREATE TOPIC

kafka-topics.sh --zookeeper 127.0.0.1:2181 --create --replication-factor 1 --partitions 1 --topic amritpal

4. RUNNING THE PRODUCER

kafka-console-producer.sh --broker-list localhost:9092 --topic amritpal