Senior Data Engineer – Databricks & DWH Modernization

Project overview

For our client, we are filling the position on a freelance basis of

Senior Data Engineer – Databricks & DWH Modernization

Responsibilities

Technical modernization of an existing Oracle/Informatica DWH landscape and transfer to an Azure/Databricks Lakehouse architecture.

Development and optimization of scalable data pipelines to replace existing ETL routes.

Implementation of suitable data models and historization concepts, as well as ensuring data quality, permissions, and governance.

Securing the migration through tests, data comparisons, and support of parallel operation and cutover.

Coordination of business requirements and iterative implementation together with business departments and Data Engineers in a Scrum team.

Requirements

Sound experience with Azure Databricks and the practical implementation of Lakehouse architectures, including setup and operation.

Deep knowledge of Delta Lake, Unity Catalog, and DLT/SDP, as well as in permissions and governance concepts.

Very good knowledge of Python, PySpark, and SQL, as well as experience in performance optimization of large data volumes and the use of AI-supported development tools.

Strong DWH/BI competence in data modeling, data storage, data transport, and SCD2 historization; ideally experience with migrating classic ETL processes to Databricks, as well as knowledge of Oracle and Informatica.

Experience in agile software development according to Scrum, excellent German language skills, and clear communication with technical teams and business departments.

We look forward to your application!

Project details

ASAP

14 months

Utilization: 100%

Cologne/Bonn - Hybrid (Therefore, please be within commuting distance)

• Start: ab sofort
• Duration: 14 Monate
• Remote: hybrid
• Location: Bonn, Deutschland, DE
• Languages: German