Course prerequisites

This course is geared towards those who have some familiarity with Dagster. You don't need to be an expert, but you should know your way around a Dagster project.

Intermediate level

  • Dagster familiarity

    You'll need to know the basics of Dagster to complete this course. We recommend completing check out the Dagster Essentials course if you've never used Dagster before or want a refresher before getting started.

  • Familiar with data engineering

    An understanding of data engineering. While you do not need a deep understanding of ETL before taking the class, some examples if you are more familiar with concepts around databases and data warehouses.

  • Python and SQL knowledge

    While you don’t need to be a Python expert to get started, you do need some Python familiarity to complete this course and use Dagster. In Lesson 2, we’ll cover Dagster’s specific installation requirements. Here are some Pythonic skills that you’ll be using, along with resources to learn about them:


    You won’t be writing complex SQL, but you will need to understand the concept of SELECT statements, what tables are, and how to make them. If you’d like a 5-minute crash course, here’s a short article and cheatsheet on using SQL.

Course curriculum

    1. About this course

    2. What is ETL?

    3. ETL and Dagster

    4. Project preview

    1. Prerequisites and installation

    2. Set up local

    3. Set up codespaces

    1. Overview

    2. File import

    3. Data integrity

    4. Partitions

    5. Complex partitions

    6. Triggering partitions

    7. Knowledge check

    8. Cloud storage

    1. Overview

    2. APIs

    3. API resource

    4. ETL with API

    5. API Dagster assets

    6. Knowledge check

    7. Triggering API job

    8. Backfilling from APIs

    1. Overview

    2. dlt

    3. Basic dlt

    4. Dagster and dlt

    5. Knowledge check

    6. Refactoring static data with dlt

    7. Refactoring APIs with dlt

    1. Overview

    2. Database replication

    3. Knowledge check

    4. Sling

    5. Sling database replication set up

    6. Dagster and Sling

    7. Managing Sling assets

Skills you'll gain in this course

  • How Dagster can help you ingest data
  • Strategies for common ETL patterns
  • How to streamline ETL development with Dagster Components