Databricks Data Engineer (Azure / DWH Migration)

Project overview

Key Data:

Responsibilities

• Migration of an existing Oracle/Informatica DWH into a modern Azure/Databricks Lakehouse architecture
• Development and optimization of high-performance ETL and data pipelines with Databricks
• Ensuring data quality, data governance, and authorization concepts
• Accompanying tests, parallel operation, and cutover within the scope of the migration
• Close collaboration with business departments and data engineers in an agile Scrum team
• Use of AI-based tools to increase development efficiency

Requirements

• Sound experience with Databricks, Azure, and Lakehouse architectures
• Very good knowledge of Delta Lake, Unity Catalog, and DLT/SDP
• Very good programming skills in Python, PySpark, and SQL, as well as experience in performance optimization of large data volumes
• Experience with DWH architectures, data modeling, ETL processes, and historization using SCD Type 2
• Ideally, experience in migrating classic DWH and ETL landscapes to Databricks
• Experience in agile software development with Scrum
• Very good German language skills, written and spoken, as well as strong communication skills

Project details

asap

Utilization: 100% (5 days a week)

2 days on-site in Cologne & 3 days remote (weekly)

• Start: ab sofort
• Duration: 3 Monate
• Remote: hybrid
• Location: Köln, Deutschland, DE
• Languages: German