Senior Data Engineer

Project overview

A modern data platform is being created in the finance department of a leading major group in the mobility and transport sector, supplying central specialist departments, business units, and service centers with financial data and structured data products for analytics purposes from a single source. The project is strongly dependent on a group-wide SAP transformation project, which will create new data sources and require existing data products to be redeveloped and redesigned. The new platform will also replace in-house developments by specialist departments with cloud components and open-source frameworks.

The tech stack used is primarily SQL-based and supplemented by Python components. AWS Redshift is used as the Cloud Data Warehouse, with the integration of SAP and other data sources being central (multi-cluster instance model via Data Sharing). dbt-core is primarily used for data transformation, quality assurance, and documentation; Python frameworks such as Dagster or Airflow (containerized) are used for orchestration.

The goal is the conception and realization of a production-ready setup including an operating model, as well as the development of sustainable, maintainable data pipelines using modern development methods (CI/CD, automated tests, reviews) in an agile mode.

Services:

Requirements – must have: (mandatory, also listed and explained in years and individual project references!)

• Consulting on the structuring of data pipeline implementation with the Python open-source library Dagster regarding the use and implementation of available features (e.g., Sensors, Partitions, etc.) including documentation and hands-on support through code contributions
• Consulting on the use of Dagster integrations, especially dagster-dbt and embedded-elt with dlt (including hands-on development)
• Implementation of automated deployment of Dagster code on a Kubernetes cluster (CI/CD)
• Development of Dagster components such as Resources, Assets, Sensors, etc. according to requirements, including documentation
• Conducting code reviews
• Dagster expert experience in building and implementing complex Dagster projects, especially dagster-dbt, embedded-elt with dlt // min. <= 3 years
• Python expert
• Consulting and structuring the implementation of data pipelines // min. 5 years
• Data Engineering expert
• Consulting regarding the use and implementation of features including documentation // min. 5 years
• Experience with complex dbt projects with dbt-core Number of references 3

Requirements

Framework data:

Period: 01.12.2026 – 31.12.2027 + option for extension

• Experience with projects on AWS infrastructure Number of references 1
• Experience in using containerized open-source orchestrators in building and operating data pipelines by development teams (Airflow or Dagster) Number of references 1
• Know-how in agile project management e.g. IAPM/CAPM, PMI Agile Certified Practitioner, Scaled Agile Framework Certificates Proof of certification and references for application
• Experience with complex dbt projects with dbt-core Number of references 3

Project details

95% Remote / 5% onsite in Berlin

Project language: German

Utilization: Full-time

Other: Residence in Germany

I look forward to receiving your profile including availability and desired conditions!

• Start: 2026-12
• Duration: 12 Monate
• Remote: remote
• Location: Berlin, Deutschland, DE
• Languages: German