Senior Databricks Data Engineer

Project overview

For our client in Cologne, we are currently looking for a Senior Databricks Data Engineer.

Responsibilities

b) Task Description:

c) Profile Requirements

Our Requirements

• As a Databricks Data Engineer, you will work closely with business departments and other Data Engineers, delivering robust, scalable data solutions
• iteratively, customer-oriented, and in a Scrum setup. On the way to our Azure/Databricks target architecture, you will migrate the existing Oracle/Informatica DWH to a modern Azure Lakehouse architecture. You will migrate ETL processes into performant Databricks pipelines, ensure data quality and governance, and support testing, parallel operation, and cutover.
• Databricks & Lakehouse Experience:
• sound practical experience in implementing Lakehouse architectures as well as in setting up and operating Databricks.
• deep knowledge of Delta Lake, Unity Catalog, DLT/SDP, authorization models, and governance mechanisms.
• Programming & Data Competence:
• sound experience in Python, PySpark, and SQL, as well as in performance optimization of large data volumes.
• AI-based support is confidently used to increase efficiency.
• Migration Expertise – ideally experience in replacing classic ETL routes and migrating to Databricks.
• Data Modeling & DWH Expertise – sound experience in the classic Business Intelligence environment: data storage, data modeling, data transport, SCD2 historization.
• Agile Working Method – experience as a developer within a SCRUM team.
• Communication – excellent German language skills, both written and spoken, and the ability to communicate clearly and confidently with business departments and other development teams.
• Databricks & Lakehouse Experience: sound practical experience in implementing Lakehouse architectures as well as in setting up and operating Databricks | deep knowledge of Delta Lake, Unity Catalog, DLT/SDP, authorization models, and governance mechanisms.
• Programming & Data Competence: sound experience in Python, PySpark, and SQL, as well as in performance optimization of large data volumes | AI-based support is confidently used to increase efficiency.

Project details

• Duration: ASAP until * (option for extension, long-term cooperation desired)
• Location: 40% on-site in Cologne and 60% remote (2 days on-site & 3 days remote per week)
• Industry: Telecommunications
• Start: ab sofort
• Duration: 12 Monate
• Remote: hybrid
• Location: Köln, Deutschland, DE
• Languages: German