Required skills
- Azure Cosmos DB
- Apache Spark
- PySpark
- Cosmos DB Change Data Feed
- Pytest
- Cosmos DB SQL API
- Cosmos DB SDK
- Git
- Database Partitioning and Indexing
Languages: English
Job description
Project overview
Azure Cosmos DB Developer
Project details
London – hybrid, 1–3 days per week onsite
£465 per day, Inside IR35
Contract: Initial 6 months
Role Overview
We are looking for an experienced Azure Cosmos DB Developer to support a major technology transformation programme within a global financial markets infrastructure and data organisation.
The role will be integral to the transformation of critical application and data engineering components, helping deliver secure, scalable and high-performing cloud-native solutions.
You will bring strong technical expertise across Azure Cosmos DB, Spark and PySpark, working closely with Solution Architects and DevOps teams to develop and optimise data solutions, improve delivery processes and maintain high standards of engineering quality.
The role may involve occasional travel between two customer offices in London, with the option to work from either location.
Key Responsibilities
Essential Experience and Skills
Desirable Experience
- Develop cloud-native applications using Azure Cosmos DB, including SQL API and Mongo API.
- Design efficient NoSQL data models aligned with application requirements.
- Write and optimise queries to minimise Request Unit (RU) consumption and improve performance.
- Implement indexing strategies and partitioning schemes to optimise database performance.
- Establish and maintain CI/CD pipelines using GitLab DevOps to streamline delivery and reduce operational overhead.
- Develop efficient queries using Cosmos DB SQL syntax.
- Design and implement PySpark data pipelines on Microsoft Fabric.
- Work with Cosmos DB Change Data Feed (CDF), including integration with Spark and troubleshooting.
- Implement automated testing and unit testing frameworks.
- Write and maintain unit and integration tests using Pytest.
- Collaborate with Solution Architects and DevOps teams to integrate Cosmos DB into microservices.
- Ensure solutions meet security, governance and data protection requirements.
- Hands-on experience with Azure Cosmos DB, including query optimisation and throughput management.
- Strong understanding of Cosmos DB Change Data Feed (CDF), including integration and debugging with Spark.
- Technical proficiency with Cosmos DB SDKs, such as .NET, Java, Python or Node.js.
- Thorough understanding of Apache Spark and distributed computing concepts.
- Strong hands-on experience with PySpark and Spark.
- Experience writing and maintaining tests using Pytest.
- Experience with concurrency patterns, CLR and scalable application design.
- Strong experience with Cosmos DB SQL API and familiarity with other APIs.
- Understanding of database partitioning, indexing and consistency levels.
- Experience with Git, version control and continuous integration tools.
- Strong problem-solving skills, a goal-oriented approach and the ability to work collaboratively with internal and external stakeholders.
- Excellent written and verbal communication skills.
- Advanced proficiency in C#, ASP.NET and .NET Core.
- Strong object-oriented design principles.
- Start: flexible
- Remote: hybrid
- Location: London, England, GB, GB
- Rate: 58-58 EUR/h
- Languages: English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on find.stottandmay.com