Data Engineer Roadmap

The path from "I can write a SELECT" to "I got the job" - and you practice each step on a real broken pipeline in a live cloud workspace. Every skill links to a live ticket you fix.

Your progress0 of 12 skills

SQL Foundations

Aggregation & reporting

Build a correct revenue report with GROUP BY.

Practice live: Write a Top-5 Revenue SQL Report → Window functions

Rank rows per group with window functions.

Practice live: Rank Rows Per Group With SQL Window Functions →

ETL Pipelines

Idempotency

Make a pipeline safe to re-run without duplicating rows.

Practice live: Make an ETL Pipeline Idempotent → Validation on load

Validate records before they hit the warehouse.

Practice live: Validate Data Before Loading It →

Data Quality

Schema validation

Catch bad records with pandera before they spread.

Practice live: Validate DataFrames With pandera → Dropped records

Find why a pipeline silently loses rows and fix it.

Practice live: Fix a Pipeline Silently Dropping Records →

Performance & Scale

Query tuning

Speed up a slow weekly report with the right index.

Practice live: Speed Up a Slow SQL Report Query → Batch throughput

Make a batch insert fast with COPY and tuning.

Practice live: Optimize Batch Insert Throughput (COPY) →

Analytics Engineering (dbt)

Staging to marts

Build a layered dbt project from raw to marts.

Practice live: Build a Staging-to-Marts dbt Project → Slowly-changing dimensions

Implement SCD2 with dbt snapshots.

Practice live: Implement SCD2 With dbt Snapshots →

Modeling & Architecture

Dimensional modeling

Build a Kimball star schema for reporting.

Practice live: Build a Kimball Star Schema → Refactoring to layers

Turn ad-hoc ETL into a layered dbt project.

Practice live: Refactor Ad-Hoc ETL Into a Layered dbt Project →

Stop reading roadmaps. Start doing them.

Every skill above is a real broken system in a live workspace. Fix it, and it lands on your portfolio.

Start free →