Required skills
- Dagster
- Python
- Data Engineering
- dagster-dbt
- Embedded ELT
- dlt
- dbt-core
- Kubernetes
- CI/CD
- Code Review
- Technical Documentation
- Agile
Languages: Dutch
Job description
Seeking an experienced specialist with deep expertise in Dagster, Python, and Data Engineering for a long-term project. The role involves technical consulting and hands-on development to build and enhance complex data pipelines.
Project overview
An experienced specialist with in-depth expertise in Dagster, Python, and Data Engineering is sought for a long-term project. The role combines technical consulting with active hands-on development and supports the building and further development of complex data pipelines.
Responsibilities
Consulting on the structuring and implementation of data pipelines using the Python-based open-source solution Dagster
Conception and implementation of Dagster functionalities such as Assets, Resources, Sensors, and Partitions
Active support of development through the creation and further development of program code
Consulting and implementation of Dagster integrations, especially:
dagster-dbt
Embedded ELT with dlt
Development and documentation of customer-specific Dagster components
Automation of the deployment of Dagster code on Kubernetes clusters
Participation in the building and further development of CI/CD processes
Conducting code reviews
Creation of technical documentation
Participation in agile development meetings such as Planning, Daily/Scrum, and Retrospectives
Requirements
In-depth practical experience with Dagster and building complex Dagster projects
Experience with dagster-dbt and Embedded ELT using dlt
Senior-level expertise in Python with more than 5 years of relevant experience
Several years of senior experience in Data Engineering
In-depth experience in the conception and implementation of complex data pipelines
Demonstrable experience with complex dbt-core projects, ideally with at least 3 references
Experience with documentation and structured technical consulting
Desirable Knowledge:
Project experience with AWS
Experience with containerized open-source orchestrators such as Dagster or Apache Airflow
Experience in building and operating data pipelines by development teams
Knowledge of agile project management and process models
Ideally, certifications or demonstrable experience in agile methods
Project details
- Start: flexible
- Location: remote & onsite (10 Tage in 2027 vor Ort in Berlin), DE
- Languages: Dutch
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on people4project.com