Lead Fabric Data Engineer

Project overview

Lead Fabric Data Engineer

The Project

We are partnering with an enterprise organisation consolidating its Legacy data footprint into a single, unified analytical layer built on Microsoft Fabric.

This is not a Legacy maintenance role. Lead Fabric Data Engineer will step in as the technical lead to architect, build, and deploy a modern end-to-end OneLake foundation, automated ETL pipelines, and performance-optimised semantic models across core data domains. This project is highly structured with defined milestones, mature CI/CD deployment pipelines, and native Git integration already mapped out.

The Technical Lead Fabric Data Engineer Roadmap:

Required Technical Experience

If interested in this Lead Fabric Data Engineer contract please apply with lastest CV applicants need to be onsite in Manchester 2 days per week.

Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates

• Rate: £500-550 per day (Outside IR35)
• Duration: 6 months (Initial)
• Location: Manchester onsite 2 days per week
• Project Status: Greenfield/Core Architecture Phase
• Phase 1: Foundation & Governance: Set up Fabric workspaces, F-SKU capacity allocation, and Microsoft Purview RBAC security policies.
• Phase 2: Ingestion & Streaming: Implement Copy Jobs, Dataflow Gen2, and Eventstreams for Real Time CDC ingestion into a Bronze Lakehouse.
• Phase 3: Medallion Processing: Develop optimised PySpark/Spark SQL Notebooks transforming data from Bronze to Silver (conformed) and Gold (business aggregates) Delta tables.
• Phase 4: Serving Layer: Model Star/Snowflake schemas, optimising Direct Lake mode for Power BI and deploying GraphQL endpoints.
• Phase 5: DevOps: Connect Fabric development environments to production via automated Azure DevOps/GitHub release pipelines.
• Core Fabric Ecosystem: Proven, production-level experience with OneLake, Delta Lake, and Synapse Data Engineering.
• Ingestion Pipelines: Deep knowledge of Fabric Data Factory, Dataflow Gen2, and Real Time Intelligence features.
• Advanced Modeling: Expertise in building high-performance Direct Lake semantic models to eliminate Import/DirectQuery latency.
• Enterprise DevOps: Strong experience with Fabric Git integration, deployment pipelines, and Microsoft Purview for data governance.
• Languages: Advanced proficiency in PySpark/Spark SQL.

Project details

• Start: November 2026
• Duration: 6 -12 months
• Location: Manchester, UK, GB