Surfalytics
All pet projects
Data Engineering beginner ⏱ 5–7 hours

Data Ingestion with Airbyte

Deploy Airbyte locally and build connector-based data pipelines to load external data into your warehouse without writing custom code.

AirbyteELTData IngestionDocker
View project on GitHub

What you’ll build

A local Airbyte instance (via Docker) with configured source connectors pulling data into a target warehouse. You’ll understand the ELT pattern — Extract & Load first, Transform later — which is how modern data platforms work.

Skills you’ll practice

  • Deploying Airbyte with Docker Compose
  • Configuring sources (APIs, databases) and destinations (Snowflake, Postgres)
  • Understanding sync modes: full refresh vs incremental
  • ELT vs ETL: when to use each approach