Dagster Embedded ELT#

The dagster-embedded-elt package provides a framework for building ELT pipelines with Dagster through helpful asset decorators and resources. It includes the dagster-dlt and dagster-sling packages, which you can also use on their own.

This package includes two integrations:

1. Sling to provide a simple way to sync data between databases and file systems
2. data Load Tool (dlt) to easily load data from external systems and APIs

Sling#

Sling provides an easy-to-use YAML configuration layer for loading data from files, replicating data between databases, exporting custom SQL queries to cloud storage, and much more. The Dagster integration allows you to derive Dagster assets from a replication configuration file.

Click here to get started with the Sling integration.

dlt#

With the ability to leverage pre-made verified sources like Hubspot and Notion, and destinations like Databricks and Snowflake, integrating dlt into your Dagster project enables you to load a data in an easy and structured way.

Click here to get started with the dlt integration.