Surfalytics
All pet projects
Data Engineering beginner ⏱ 5–7 hours

Data Ingestion with Airbyte

Deploy Airbyte locally and build connector-based data pipelines to load external data into your warehouse without writing custom code.

AirbyteELTData IngestionDocker
View project on GitHub

What you’ll build

A local Airbyte instance (via Docker) with configured source connectors pulling data into a target warehouse. You’ll understand the ELT pattern — Extract & Load first, Transform later — which is how modern data platforms work.

Skills you’ll practice

  • Deploying Airbyte with Docker Compose
  • Configuring sources (APIs, databases) and destinations (Snowflake, Postgres)
  • Understanding sync modes: full refresh vs incremental
  • ELT vs ETL: when to use each approach

The full project guide is for members

Join Surfalytics to unlock every step of this project, all other projects, the full course, and the private community.

7-day free trial · Cancel any time