Data Engineer (AI) - Until end of April - Inside IR35 - Remote

Project overview

Lead Data Engineer

Project details

Contract: Until 30/04/2027

IR35: In Scope

Up to £990/day

The Role

We're looking for an experienced Lead Data Engineer to support the delivery of enterprise-scale AI and data initiatives within a large public sector environment.

You'll lead the design and implementation of complex data integration solutions, building secure, scalable data pipelines and enabling advanced AI-driven capabilities. Working across technical and business teams, you'll help transform operational data into production-ready solutions while ensuring alignment with wider data architecture, governance, and security standards.

Key Responsibilities

Essential Skills & Experience

Please Note

Due to programme timescales and onboarding requirements, candidates must hold active SC Clearance at the point of application.

• Lead the design and delivery of automated data pipelines, ETL/ELT processes, and API integrations.
• Establish data engineering standards and best practices across AI and automation initiatives.
• Ensure data quality, security, access controls, and compliance requirements are Embedded within solutions.
• Conduct data diagnostics and readiness assessments to support AI and automation use cases.
• Build and maintain metadata, observability, and monitoring capabilities across data platforms.
• Act as a bridge between technical delivery teams and business stakeholders, translating complex requirements into effective solutions.
• Strong hands-on experience building scalable ETL/ELT pipelines and API integrations.
• Experience supporting AI, data, or advanced analytics platforms in enterprise environments.
• Expertise in Identity & Access Management, data governance, and security controls.
• Strong understanding of UK GDPR and data compliance requirements.
• Advanced AWS, Python, and SQL skills.
• Experience with Terraform, CI/CD pipelines, automated testing, and modern engineering practices.
• Strong stakeholder management, communication, and leadership skills.
• Experience leading engineering teams and delivering complex data solutions in agile environments.
• Start: flexible
• Location: London, UK, GB
• Rate: 75-122 EUR/h