Surfalytics
All pet projects
Streaming & Real-time intermediate ⏱ 10–12 hours

Streaming Fundamentals

Learn the core concepts of real-time data streaming — event producers, brokers, consumers, and stream processing patterns.

KafkaStreamingReal-timeEvents
View project on GitHub

What you’ll build

A streaming pipeline covering the fundamental patterns: producing events, consuming them reliably, handling late data, and processing in real time. Uses Kafka as the broker with Docker-based setup for local development.

Skills you’ll practice

  • Kafka fundamentals: topics, partitions, consumer groups, offsets
  • Producer and consumer patterns in Python
  • Event-driven architecture vs batch processing
  • Exactly-once semantics and delivery guarantees

The full project guide is for members

Join Surfalytics to unlock every step of this project, all other projects, the full course, and the private community.

7-day free trial · Cancel any time