Niklas Heringer
Niklas Heringer
Cybersecurity & Math.
⌘K
Subscribe Sign in
Niklas Heringer

pipelines

Data Engineering With Dagster Part Six – Partitioning & Backfills
dagster

Data Engineering With Dagster Part Six – Partitioning & Backfills

Learn how to make your pipelines smarter by slicing them into manageable, date-based partitions and handling backfills like a pro.
Data Engineering With Dagster Part Five – Automating With Schedules
dagster

Data Engineering With Dagster Part Five – Automating With Schedules

Dagster finally earns its “orchestrator” title - this part dives into jobs, asset selection, cron expressions, and how to wire everything into automated schedules.
Data Engineering With Dagster – Part Four: Resources, DRY Pipelines, and ETL in Practice
dagster

Data Engineering With Dagster – Part Four: Resources, DRY Pipelines, and ETL in Practice

A deeper look at how Dagster handles reusable components like API clients and cloud connectors through resources - with best practices and cookie metaphors baked in.
Data Engineering With Dagster - Part One: A Fresh Take on Orchestration
dagster

Data Engineering With Dagster - Part One: A Fresh Take on Orchestration

A student-hacker’s perspective on learning data engineering with Dagster: asset-centric thinking, orchestrator basics, and setting up the mental model.