Course prerequisites

This course is geared towards those who have some familiarity with Dagster and have ETL solutions.

  • Dagster familarity

    You'll need to know the basics of Dagster to complete this course. We recommend completing check out the Dagster Essentials course if you've never used Dagster before or want a refresher before getting started.

  • Python & SQL knowledge

    While you don’t need to be a Python expert to get started, you do need some Python familiarity to complete this course and use Dagster.

Course curriculum

    1. About this course

    2. What is ETL?

    3. ETL and Dagster

    4. Project preview

    1. Prerequisites and installation

    2. Set up local

    3. Set up codespaces

    4. Github Codespace

    1. Overview

    2. File import

    3. Data integrity

    4. Partitions

    5. Complex partitions

    6. Triggering partitions

    7. Knowledge check

    8. Cloud storage

    1. Overview

    2. APIs

    3. API resource

    4. ETL with API

    5. API Dagster assets

    6. Knowledge check

    7. Triggering API job

    8. Backfilling from APIs

    1. Overview

    2. dlt

    3. Basic dlt

    4. Dagster and dlt

    5. Knowledge check

    6. Refactoring static data with dlt

    7. Refactoring APIs with dlt

    1. Overview

    2. Database replication

    3. Knowledge check

    4. Sling

    5. Sling database replication set up

    6. Dagster and Sling

    7. Managing Sling assets

Skills you'll gain in this course

  • Understanding of different ETL patterns
  • How to optimize data ingestion around Dagster
  • Best way to leverage other Dagster features for ETL