Dagster Expert / Senior Data Engineer

Project overview

An experienced specialist with in-depth expertise in Dagster, Python, and Data Engineering is sought for a long-term project. The role combines technical consulting with active hands-on development and supports the building and further development of complex data pipelines.

Responsibilities

Consulting on the structuring and implementation of data pipelines using the Python-based open-source solution Dagster

Conception and implementation of Dagster functionalities such as Assets, Resources, Sensors, and Partitions

Active support of development through the creation and further development of program code

Consulting and implementation of Dagster integrations, especially:

dagster-dbt

Embedded ELT with dlt

Development and documentation of customer-specific Dagster components

Automation of the deployment of Dagster code on Kubernetes clusters

Participation in the building and further development of CI/CD processes

Conducting code reviews

Creation of technical documentation

Participation in agile development meetings such as Planning, Daily/Scrum, and Retrospectives

Requirements

In-depth practical experience with Dagster and building complex Dagster projects

Experience with dagster-dbt and Embedded ELT using dlt

Senior-level expertise in Python with more than 5 years of relevant experience

Several years of senior experience in Data Engineering

In-depth experience in the conception and implementation of complex data pipelines

Demonstrable experience with complex dbt-core projects, ideally with at least 3 references

Experience with documentation and structured technical consulting

Desirable Knowledge:

Project experience with AWS

Experience with containerized open-source orchestrators such as Dagster or Apache Airflow

Experience in building and operating data pipelines by development teams

Knowledge of agile project management and process models

Ideally, certifications or demonstrable experience in agile methods

Project details

• Start: flexible
• Location: remote & onsite (10 Tage in 2027 vor Ort in Berlin), DE
• Languages: Dutch