Data Engineer

Project overview

Databricks Data Engineer

London | Contract

This is an opportunity to take ownership of a high-impact data engineering programme within a modern AWS and Databricks environment. You will play a key role in expanding a governed enterprise data platform, onboarding business-critical systems, enhancing data quality and governance, and helping shape the organisation's long-term data strategy.

The Company

They are a data-driven organisation investing in a modern cloud-based analytics platform built on Databricks, AWS, and Unity Catalog. With core foundations already established, they are entering the next phase of their data transformation journey, focused on creating a scalable, governed, and trusted data estate. The successful contractor will work closely with senior engineering stakeholders to help deliver a strategic roadmap across data engineering, governance, and platform operations.

The Role and Deliverables

Your Skills & Experience

How to Apply

If you are an experienced Databricks Data Engineer looking to drive a major cloud data platform initiative, please apply with your latest CV.

• Assess the existing Databricks environment, identify risks and improvement opportunities, and recommend delivery priorities.
• Build reusable, configuration-driven ingestion frameworks and onboard structured business systems into a bronze, silver, and gold architecture.
• Extend and enhance enterprise data models covering customer, engagement, finance, utilisation, recruitment, and operational data domains.
• Implement data governance capabilities including lineage, metadata management, classification tagging, access controls, and data quality monitoring.
• Enhance CI/CD processes, automated testing, monitoring, alerting, and cost management across the Databricks platform.
• Provide architectural guidance, documentation, stakeholder demonstrations, and knowledge transfer to internal teams.
• Strong experience delivering data engineering solutions using Databricks on AWS.
• Strong SQL and Python development skills within cloud data platforms.
• Experience building scalable ETL and ELT pipelines using Infrastructure as Code and modern DataOps practices.
• Deep understanding of Unity Catalog, data governance, metadata management, lineage, and access control frameworks.
• Experience implementing CI/CD pipelines, automated testing, monitoring, and production support processes.
• Strong knowledge of dimensional modelling, enterprise data modelling, and data warehousing concepts.
• Experience implementing data quality frameworks covering completeness, freshness, uniqueness, and referential integrity.
• Ability to engage stakeholders and provide clear architectural recommendations, documentation, and knowledge transfer.

Project details

• Start: flexible
• Location: London
• Rate: 63-75 EUR/h