Senior Data Engineer

Project overview

Assignment Description

What will you do?

You will set up infrastructure-as-code processes and further shape the working method on Azure, ensuring robust, automated deployment of the Databricks infrastructure on Azure. You will work with Azure Databricks and connect our source systems via Kafka Connect to reliably unlock, process, and make data available. You will ensure our cloud environment (Azure) meets government requirements for security and regulation. You will collaborate with our existing team and guide them in the chosen solutions so they can continue after your departure.

You will actively transfer knowledge (documentation, explanations, sessions) so that DataOps does not remain dependent on one person.

What are we looking for?

A cloud engineer with demonstrable experience in Azure. Strong knowledge of Azure Databricks and DataOps principles (CI/CD for data, automation, monitoring, reproducibility). Experience with Kafka Connect or similar tooling for batch and streaming data integration. Experience with Git and GitOps. Experience setting up IaC based on ARM/Bicep/Terraform or similar. Experience with Azure network security: hub/spoke, NSGs, Private Endpoints, UDRs, and micro-segmentation. Experience setting up monitoring: Azure Monitor, Log Analytics (KQL) and/or Splunk.

Experience setting up access control for Databricks: Entra ID/IAM, Unity Catalog permissions, and workspace access. (Pre) Experience with Azure infrastructure security: Defender for Cloud, Sentinel (SIEM), SOC processes, and KQL detections. (Pre) Certification Databricks Data Engineer Associate or Microsoft DP 750 (Azure Databricks). Experience working within the government, so you are familiar with the associated processes and frameworks. Ability to guide people, transfer knowledge, and maturely coach a team in new working methods.

Assignment Background

We are looking for a senior data engineer with extensive experience in Azure, Databricks, and DataOps, who will help the data team professionally and scalably set up the Azure Landing Zone. In this role, the emphasis is on setting up and automating data processes in the cloud.

Why this role?

We need someone with sufficient knowledge and experience to professionally set up Azure Databricks. The current team currently lacks the necessary expertise to shape and implement this process independently. External expertise is necessary to achieve the desired progress. This expertise can not only help with the setup but also with the accelerated transfer of knowledge and skills to the team, so that they can independently perform the required working method in the long term.

Requirements

General:

Specific:

Competencies

Additional Information

When you, as a supplier, offer a professional to us and they are placed, we will need information from you as a contracting party, including regarding the Chain and Importer Liability Act (Wet keten- en inlenersaansprakelijkheid). The 'WKA' aims to prevent abuse in the remittance of payroll taxes at all links in the chain; from supplier to client. We cover these risks for our clients through an escrow account, the G-rekening. This is an account to which a portion of the invoice amount is deposited and from which you can pay payroll taxes and VAT to the Tax Authorities.

The percentage to be deposited depends on whether you have a SNA certification (NEN-4400-1 or NEN-4400-2) and whether your company is located in the Netherlands or abroad. You can apply for the G-rekening from the Tax Authorities. If you cannot obtain a G-rekening (and you can provide proof of this from the Tax Authorities), you also have the option to provide an accountant's statement (assurance report regarding personnel lending) every quarter. In this, a certified accountant (AA or RA) will issue a statement about the accuracy, completeness, and timeliness of the remittances.

Please note that the costs for this statement are at your own expense.

• You can set up infrastructure-as-code processes and further shape the working method on Azure, ensuring robust, automated deployment of the Databricks infrastructure on Azure.
• You can use Azure Databricks to unlock source systems via Kafka Connect to reliably unlock, process, and make data available.
• Experience setting up access control for Databricks: Entra ID/IAM, Unity Catalog permissions, and workspace access.
• Experience with Azure infrastructure security: Defender for Cloud, Sentinel (SIEM), SOC processes, and KQL detections.
• (Pre) Certification Databricks Data Engineer Associate or Microsoft DP750 (Azure Databricks).
• Experience working within the government, so you are familiar with the associated processes and frameworks.
• Strong knowledge of Azure Databricks and DataOps principles (CI/CD for data, automation, monitoring, reproducibility).
• Experience with Kafka Connect or similar tooling for batch and streaming data integration.
• Experience setting up IaC based on ARM/Bicep/Terraform or similar.
• Experience with Azure network security: hub/spoke, NSGs, Private Endpoints, UDRs, and micro-segmentation.
• Experience setting up monitoring: Azure Monitor, Log Analytics (KQL) and/or Splunk.
• Ability to guide people, transfer knowledge, and maturely coach a team in new working methods.
• Experience with development and collaboration within the Central Government or other public organizations.
• Experience coordinating development across multiple teams, domains, or organizations.

Project details

• Start: 2026-11-02T23:00:00
• Location: Bilthoven Utrecht, NL
• Languages: Dutch