Skip to content
Job boardOpen

Databricks Architect

Project Global · London, United Kingdom · Hybrid · Senior

  • London, United Kingdom · Hybrid
  • English

Indexed (3 days ago) · refreshed constantly

Start
flexible
Work mode
Hybrid
Contract
Freelance / B2B
Seniority
Senior

Required skills

Nice to have:TerraformAWS GlueAWS LambdaAmazon S3AWS IAMAWS KMS

Languages: English

Job description

Project overview

Databricks Architect

Our client, a leading global supplier for IT services, requires Databricks Architect to be based at their client’s office in London or Manchester, UK.

This is a hybrid role – you can work remotely in the UK and attend the London or Manchester office 3 days per week .

This is a 4+ month temporary contract to start asap

Project details

Competitive Market rate

You will build, secure, automate, and run enterprise Databricks Lakehouse platforms for banking and financial services clients. The role covers workspace provisioning, infrastructure-as-code, CI/CD, security hardening, and platform operations across multiple environments and regions.

Key Responsibilities

Key Requirements

Due to the volume of applications received, unfortunately we cannot respond to everyone.

If you do not hear back from us within 7 days of sending your application, please assume that you have not been successful on this occasion.

Please do keep an eye on our website https://projectrecruit.com/jobs/ for future roles.

  • Build, configure, and maintain enterprise Databricks Lakehouse platforms across Dev, Test, UAT, and Production environments.
  • Provision and manage Databricks workspaces, compute resources, cluster configurations, and platform-level settings.
  • Automate infrastructure provisioning and configuration using Terraform / Infrastructure as Code (IaC).
  • Develop and maintain CI/CD pipelines for Databricks platform configurations, notebooks, jobs, and application deployments.
  • Configure and administer Unity Catalog, including catalogs, schemas, permissions, and access controls.
  • Implement RBAC, service principals, secrets management, and least-privilege access for secure platform operations.
  • Integrate Databricks with cloud services such as AWS or Azure, including storage, networking, identity, and security services.
  • Configure and maintain cluster policies, job clusters, compute configurations, and environment standards.
  • Monitor platform health, workloads, jobs, and compute resources and troubleshoot production issues.
  • Implement logging, monitoring, alerting, and operational processes to improve platform reliability.
  • Optimize Databricks workloads and compute configurations for performance and cost efficiency.
  • Automate repetitive platform administration, deployment, and operational activities.
  • Support multi-environment and multi-region deployments, ensuring consistent platform configurations.
  • Work with Data Engineering, Cloud, DevOps, Security, Governance, and Application teams on platform integration.
  • Maintain technical documentation, deployment standards, operational procedures, and platform configurations.
  • Support security hardening and governance requirements appropriate for banking and financial-services environments.
  • Databricks & Lakehouse
  • Strong hands-on experience with:
  • Databricks Notebooks
  • PySpark DataFrame API
  • SQL transformations
  • Delta Lake
  • Databricks Jobs, Job Flows, Workflows
  • Declarative Pipelines (dpx files, pipeline definitions)
  • Experience with Unity Catalog
  • Databricks Autoloader and Structured Streaming
  • Terraform or IaC experience for Databricks configuration (Optional)
  • Experience building both batch and incremental pipelines.
  • AWS Stack
  • Strong familiarity with:
  • S3, IAM, KMS
  • Glue / Lambda
  • Experience migrating workloads from AWS native tools to Databricks.
  • General Data Engineer
  • Distributed data processing and performance tuning.
  • Strong knowledge of Lakehouse medallion architecture
  • Data modeling for Lakehouse: bronze → silver → gold patterns.
  • Experience with Git, CI/CD.
  • Start: flexible
  • Remote: hybrid
  • Location: London, GB
  • Languages: English

Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing

Found on project-global.com

  1. Job boardNew

    Data Analyst

    Unitech Solutions· Lyon, France· Hybrid· SENIOR· €50 / h

    • Power BI
    • DAX
    • Power Query
    • +4

  2. Job boardNew

    AWS Data Engineer

    Confidential· India· On-site· Senior

    • AWS
    • Amazon S3
    • AWS Glue
    • +9

Browse all jobs
Sign up free to apply