Required skills
Nice to have:Apache AirflowAgile Project Managementdlt
Languages: German
Job description
Seeking a Senior Data Engineer with expertise in Dagster and Python to design and implement data pipelines, focusing on CI/CD and automated testing within a cloud environment.
Responsibilities
- Consulting on the structuring and implementation of data pipelines with the Python open-source library Dagster regarding the use and implementation of available features (e.g., Sensors, Partitions etc.) including documentation and hands-on development
- Consulting on the use of Dagster integrations, especially dagster-dbt and embedded-elt with dlt (including hands-on support through programming code)
- Implementation of automated deployment of Dagster code on a Kubernetes cluster (CI/CD)
- Development of Dagster components such as Resources, Assets, Sensors etc. according to requirements, including documentation
- Conducting code reviews
- Active participation in agile regular meetings (Planning, Dailies/Scrums, Retrospectives)
Requirements
Should-Have Criteria:
- Must-have: Dagster expert experience in building and implementing complex Dagster projects, especially dagster-dbt, embedded-elt with dlt
- Experience level in years: Junior (
- Must-have: Python expert
- Consulting and structuring the implementation of data pipelines
- Experience level in years: Senior (> 5 years experience)
- Must-have: Data Engineering expert
- Consulting on the use and implementation of features, including documentation
- Experience with complex dbt projects with dbt-core
- Number of references: 3
- Experience with projects on AWS infrastructure
- Number of references: 1 (Weighting: 25%)
- Experience in using containerized open-source orchestrators in building and operating data pipelines by development teams (Airflow or Dagster)
- Know-how in agile project management e.g. IAPM/CAPM, PMI Agile Certified Practitioner, Scaled Agile Framework
- Proof of certification and references for application (Weighting: 25%)
- Number of references: 3 (Weighting: 25%)
Project details
The goal of the engagement is to supplement our client's internal IT with experienced expertise to conceptualize a production-ready infrastructural setup, including an operating model with the internal IT service provider, and to agilely build the data pipelines using modern principles (CI/CD, automated testing, code reviews).
- Duration: 01.12.2026
- 31.12.2027
- Utilization: Total PT 202 / of which Onsite PT 10 (in Berlin)
- Start: 2026-12
- Duration: 13 Monate
- Remote: hybrid
- Location: Berlin, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE