Required skills
- Microsoft Fabric
- Python
- GitLab CI/CD
- OneLake
- Data Factory
- Synapse Data Warehouse
- PySpark
- REST APIs
- Microsoft Entra ID
- Delta Lake
- SQL
Languages: English
Job description
Project overview
DevOps Engineer - Microsoft Fabric & Python
Project details
Contract Length: 6 months
Sector: Financial Services
About the Role
We are looking for an experienced DevOps/Data Platform Engineer to join a leading organisation within the financial services sector.
This is a hands-on engineering role focused on building and automating modern data solutions within Microsoft Fabric, developing custom tooling using Python SDKs and REST APIs, and implementing robust GitLab CI/CD practices.
You will play a key role in developing scalable data pipelines, automating Microsoft Fabric workspace administration and deployments, and establishing strong engineering and DevOps standards across the wider data platform.
Key Responsibilities
Essential Skills & Experience
Desirable Skills
The Opportunity
This is an excellent opportunity for an engineer who combines strong Microsoft Fabric and data engineering knowledge with hands-on DevOps and Python automation skills.
The successful candidate will work remotely on a 6-month contract, helping to build and automate a modern enterprise data platform within a major financial services environment.
Key skills: Microsoft Fabric | Python | Fabric SDK | REST APIs | GitLab CI/CD | Data Engineering | OneLake | Data Factory | PySpark | SQL | Delta Lake | Microsoft Entra ID | Terraform | Azure
- Design, build and optimise data pipelines, Lakehouses, Warehouses and notebooks within Microsoft Fabric.
- Develop Python scripts and reusable internal tooling using the Microsoft Fabric Python SDK and REST APIs.
- Automate workspace provisioning, deployments, administration and governance.
- Build, maintain and enhance GitLab CI/CD pipelines for data solutions, infrastructure and Python packages.
- Implement strong engineering practices including automated testing, linting, version control and branching strategies.
- Support the development of scalable and secure data platforms using OneLake, Data Factory and Synapse Data Warehouse.
- Collaborate with data analysts, data scientists and platform architects to translate requirements into reliable, self-service data products.
- Ensure appropriate security and authentication controls are implemented across the platform.
- Strong hands-on experience with Microsoft Fabric, including:
- OneLake
- Data Engineering
- Data Factory
- Synapse Data Warehouse
- Lakehouses and Warehouses
- Strong Python development skills, with experience writing clean, reusable and modular code.
- Experience using Python SDKs and REST APIs to automate cloud platform activities.
- Knowledge of PySpark and libraries such as azure-identity.
- Strong hands-on experience with GitLab and GitLab CI/CD, including .gitlab-ci.yml, runners and automated deployment/testing.
- Solid understanding of data modelling, ETL/ELT, SQL, Parquet and Delta Lake.
- Experience with Microsoft Entra ID, including service principals, managed identities and RBAC.
- Strong understanding of modern DevOps and software engineering practices within data environments.
- Infrastructure as Code experience using Terraform across Azure or Microsoft Fabric environments.
- Experience with Power BI, semantic models and Direct Lake.
- Experience packaging and publishing internal Python libraries through private package registries.
- Previous experience working within a financial services or highly regulated environment.
- Experience working within Agile/Scrum delivery teams.
- Start: ASAP
- Duration: 6 months
- Remote: remote
- Location: London, UK, GB
- Rate: 63-69 EUR/h
- Languages: English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on JobServe