Senior Data Engineer

Project overview

Senior Data Engineer

Nice to have

Key Responsibilities

By applying for this role, you consent to SGI contacting you by telephone regarding recruitment services, market updates, and relevant business opportunities

We believe in equal opportunity for all and actively encourage applications from diverse backgrounds, experiences, and perspectives.

Source Group International Ltd is acting as an Employment Business in relation to this vacancy

• Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
• Databricks Unity Catalog
• Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
• Databricks Genie experience
• Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
• Databricks Certified Data Engineer certification
• Microsoft Azure Data Engineer Associate certification
• Design, develop, and maintain data products within an Azure Databricks lakehouse environment
• Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
• Contribute to data modelling and architecture discussions
• Investigate and resolve data quality and platform issues
• Develop reporting and analytics solutions using Power BI and Databricks
• Partner with business and technical stakeholders to deliver high-quality data products
• Support code reviews, modelling reviews, and engineering best practices
• Ensure solutions are scalable, reusable, and aligned with governance standards
• Communicate technical solutions, trade-offs, and recommendations to stakeholders

Project details

London

Type: Permanent

Required Background

Technical Skills

• 10+ years' experience in Data Engineering, ideally within the insurance sector
• Proven experience delivering enterprise data platforms and business-facing data products
• Strong stakeholder management skills with the ability to work across business and technology teams
• Experience working with underwriters, actuaries, or other business stakeholders
• Strong understanding of data modelling, data governance, and Agile delivery methodologies
• Excellent communication skills with the ability to explain technical concepts to non-technical audiences
• Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)
• Advanced SQL and PySpark
• Azure Databricks and Delta Lake
• Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
• Data modelling and transformation design
• Power BI reporting and dashboard development
• Databricks Dashboards
• Data quality management and troubleshooting
• Semantic layer and consumption layer development
• Azure data platform technologies
• Agile/Scrum delivery practices
• Version control and modern development workflows
• Strong understanding of data governance principles
• Start: flexible
• Location: Greater London, South East, England, GB