Required skills
- Databricks
- Apache Spark
- Python
- SQL
- Unity Catalog
- Delta Lake
- DLT
- Data Modeling
- CI/CD
- AI Data Agents
- Data Engineering
- Team Leadership
Languages: German
Job description
Seeking a technically skilled and experienced Data Engineering Leader for a 12-month contract (with extension option) in London or Brussels, focusing on shaping the data platform and leading a team.
Project overview
We are looking for a technically savvy and experienced Data Engineering Leader for a 12-month position with an option to extend at our London or Brussels location.
As a Senior/Lead Databricks Engineer, you will shape the technical direction of our data platform and lead a team of engineers. You bring deep expertise in Databricks, Spark, Python, and SQL, and set standards for quality, design, and data modeling. You are not only technically proficient but also a compelling leader who gains and retains the trust of engineers, external partners, and business stakeholders.
Your responsibilities include the further development of our Databricks platform into a new, governed workspace with AI-Ready functionality. You will support a growing community of technical analysts and analytics engineers and work in agile delivery teams with a Scrum structure.
You are characterized by a clear engineering vision: you develop reusable templates, shared libraries, and CI/CD processes that other engineers adopt. You understand that good data modeling is the foundation of trustworthy data products and that security and AI readiness must be built in from the start.
Required is at least 7 years of experience in Data Engineering with at least 2 years in leadership or mentoring roles. You have deep practical experience with Databricks, Unity Catalog, Delta Lake, and DLT, as well as advanced Python and SQL skills. Experience with AI Data Agents and their data quality requirements is essential.
Knowledge in AI Agent Architecture, Azure Data Services, dbt, Data Contracts, and FinOps on Databricks, as well as experience with hybrid teams, is advantageous.
Project details
- Start: flexible
- Duration: 12 months initial + extension
- Location: Newport News, Virginia - United States, US
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on nexus.webconia.de