Data Engineering Lead - Azure Databricks

Project overview

You will help build a new data ecosystem based on Azure Databricks and Delta Lake.

Profile of the suited interim professional:

• Building end-to-end data pipelines on Azure Databricks and Delta Lake
• Developing transformations in dbt Core
• Defining and monitoring engineering standards
• Coaching colleagues and contributing to the further development of the team
• Bachelor's or Master's degree in Computer Science, Engineering, or equivalent experience
• Minimum 5 years of experience in data engineering on cloud platforms
• Proven experience in the role of technical lead or senior engineer
• Practical experience with Azure Databricks in a production environment (necessary)
• Advanced level in SQL and Python, with experience in dbt Core or a similar tool
• Knowledge of ADLS Gen2, Delta Lake, medallion architecture, and data warehousing, including star schemas and SCD
• Experience with Git and CI/CD, GitLab is a plus
• Affinity with Data Mesh or background in the postal or logistics sector is an added value
• Excellent command of English, oral and written

Project details

• Start: flexible
• Location: Brussel, Flemish Brabant, Brussels, BE
• Languages: Dutch, English