Skip to content

Latest commit

 

History

History
 
 

week_6_stream_processing

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 

Week 6: Stream Processing

Code structure

Confluent cloud setup

Confluent cloud provides a free 30 days trial for, you can signup here

Introduction to Stream Processing

Introduction to Kafka

Kafka Configuration

Kafka Streams

Faust - Python Stream Processing

Pyspark - Structured Streaming

Please follow the steps described under pyspark-streaming

Kafka Streams with JVM library

KSQL and ksqlDB

Kafka Connect

Docker

Starting cluster

Command line for Kafka

Create topic

./bin/kafka-topics.sh --create --topic demo_1 --bootstrap-server localhost:9092 --partitions 2

Homework

Form

The homework is mostly theoretical. In the last question you have to provide working code link, please keep in mind that this question is not scored.

Deadline: 13 March 2023, 22:00 CET

Community notes

Did you take notes? You can share them here.