Required skills
Nice to have:dltAirflow
Languages: German
Job description
Seeking a Senior Data Engineer to design and build production-ready data pipelines using Dagster and Python on a cloud infrastructure. The role involves consulting, hands-on development, CI/CD implementation, and agile participation.
Project overview
The goal of this engagement is to supplement our client's internal IT with experienced expertise to conceptualize a production-ready infrastructural setup, including an operating model with the internal IT service provider, and to build data pipelines using modern principles (CI/CD, automated testing, code reviews) in an agile manner.
Responsibilities
Skills
- Consulting on the structuring and implementation of data pipelines with the Python open-source library Dagster regarding the use and implementation of available features (e.g., Sensors, Partitions, etc.), including documentation and hands-on development
- Consulting on the use of Dagster integrations, especially dagster-dbt and embedded-elt with dlt (including hands-on support through program code)
- Implementation of automated deployment of Dagster code on a Kubernetes cluster (CI/CD)
- Development of Dagster components such as Resources, Assets, Sensors, etc., according to requirements, including documentation
- Conducting code reviews
- Active participation in agile regular meetings (Planning, Dailies/Scrums, Retrospectives)
- Must-have: Dagster expert experience in building and implementing complex Dagster projects, especially dagster-dbt, embedded-elt with dlt
- Experience level in years: Junior ( 5 years experience)
- Must-have: Data Engineering expert consulting on the use and implementation of features, including documentation
- Experience level in years: Senior (> 5 years experience)
- Experience with complex dbt projects with dbt-core
- Number of references: 3
- Experience with projects on AWS infrastructure
- Number of references: 1 (Weighting: 25%)
- Experience in using containerized open-source orchestrators in building and operating data pipelines by developer teams (Airflow or Dagster)
- Know-how in agile project management e.g., IAPM/CAPM, PMI Agile Certified Practitioner, Scaled Agile Framework
- Proof of certification and references for application (Weighting: 25%)
- Experiences with complex dbt projects with dbt-core
- Number of references: 3 (Weighting: 25%)
Project details
- Duration: 01.12.2026
- 31.12.2027
- Utilization: Total PT 202 / of which Onsite PT 10 (in Berlin)
- Start: 01.12.2026
- Duration: 31.12.2027
- Location: 10178 Berlin, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on GULP