Surfalytics
All pet projects
Streaming & Real-time intermediate ⏱ 10–12 hours

Streaming Fundamentals

Learn the core concepts of real-time data streaming — event producers, brokers, consumers, and stream processing patterns.

KafkaStreamingReal-timeEvents
View project on GitHub

What you’ll build

A streaming pipeline covering the fundamental patterns: producing events, consuming them reliably, handling late data, and processing in real time. Uses Kafka as the broker with Docker-based setup for local development.

Skills you’ll practice

  • Kafka fundamentals: topics, partitions, consumer groups, offsets
  • Producer and consumer patterns in Python
  • Event-driven architecture vs batch processing
  • Exactly-once semantics and delivery guarantees