Azure Databricks Engineer

Project overview

Azure Databricks Engineer | Inside IR35 | £500 - £550 | Hybrid | London

We're recruiting for an experienced Azure Databricks Engineer to join a growing data team. You'll be responsible for designing, developing and supporting scalable data solutions across Azure and Databricks, helping to deliver reliable, high-quality data for the business. This role would require you to be onsite 4 days per week with the final day being remote.

Key Responsibilities

• Develop Databricks solutions using SQL, PySpark and Python.
• Build and maintain ETL/ELT pipelines across Azure, SQL Server and Databricks.
• Support Lakeflow pipelines, production jobs and data quality processes.
• Monitor, troubleshoot and optimise data workflows and platform performance.
• Work with Delta Lake, Unity Catalog and modern data lake architectures.
• Integrate Azure services including ADLS, Data Factory, Key Vault and REST APIs.
• Support CI/CD deployments and Databricks automation.

Requirements

Desirable

If this Data Engineer role sounds like a good fit, you can work 4 days per week on site in London and you'd like to know more, please apply with your most up to date CV and I'll be in touch.

Azure Databricks Engineer | Inside IR35 | £500 - £550 | Hybrid | London

• Strong hands-on experience with Azure Databricks in an enterprise environment.
• Excellent SQL Server/T-SQL and data engineering skills.
• Experience building and optimising large-scale data pipelines.
• Knowledge of Spark, Delta Lake, Unity Catalog and Azure data services.
• Exposure to Git, CI/CD and infrastructure automation tools.
• Strong communication skills and a proactive approach to problem solving.
• Databricks certifications.
• Experience with Microsoft Fabric, MLflow or Terraform.
• Background working on enterprise data warehouse or data lake projects.

Project details

• Start: 2026-10-12 00:00:00
• Duration: 6 months
• Location: London, UK, GB
• Rate: 63-69 EUR/h