Databricks Data Engineer (SC Cleared)

Project overview

Databricks Data Engineer (SC Cleared)

Contract: 3 months

Project details

£400 per day

Fully Remote (UK)

Clearance: Active SC Clearance Required

We're supporting a secure cloud data programme and are looking for an experienced Databricks Data Engineer to join a high-performing team on an initial 3-month contract.

This role requires strong hands-on Databricks experience, with a particular focus on platform administration, security, governance, infrastructure automation and AWS-hosted Databricks environments. You'll work closely with engineering, platform and delivery teams to help maintain, optimise and enhance a critical data platform.

Key Responsibilities

Essential Skills

Desirable

• Develop, maintain and optimise data solutions within Databricks.
• Administer Databricks workspaces and account-level configurations.
• Manage permissions, governance and security controls using Unity Catalog.
• Support identity and access management, including user, group and role-based access controls.
• Work with AWS networking teams to ensure secure connectivity and platform access.
• Support disaster recovery planning, testing and documentation.
• Build and maintain Infrastructure as Code using Terraform.
• Develop and support GitHub CI/CD pipelines for platform and engineering deployments.
• Troubleshoot platform, deployment and access-related issues.
• Produce and maintain technical documentation and operational runbooks.
• Support knowledge transfer and platform enablement activities with client teams.
• Strong commercial experience as a Data Engineer working with Databricks.
• Experience administering Databricks environments at workspace and account level.
• Strong understanding of Unity Catalog and Databricks security models.
• Experience with Databricks on AWS.
• Terraform and Infrastructure as Code experience.
• Experience building and maintaining GitHub CI/CD pipelines.
• Knowledge of cloud networking, access controls and platform governance.
• Strong troubleshooting and problem-solving skills.
• Excellent documentation and stakeholder communication skills.
• Active SC Clearance.
• Experience within government, defence or other regulated environments.
• Azure Databricks exposure.
• Experience supporting platform migrations or cloud transformation programmes.
• Knowledge of disaster recovery and business continuity planning.
• Start: 23/11/2026
• Duration: 3 months
• Remote: remote
• Location: London, United Kingdom, GB
• Rate: 50-50 EUR/h
• Languages: English