Required skills
- Microsoft Fabric
- Data Architecture
- Data Governance
- Data Security
- Data Engineering
- Incremental Data Loading
- Data Pseudonymization
- Azure Key Vault
- GDPR
Languages: French
Job description
Our client is looking for a Tech Lead Microsoft Fabric to support their Data Office in evolving and industrializing their Data platform. The role involves strengthening architecture, data flow reliability, and data security within the Microsoft Fabric ecosystem.
Project overview
Mission Context
As part of the evolution and industrialization of its Data platform, our client is looking for a Tech Lead Microsoft Fabric to support its Data Office on several structuring projects.
The objective is to strengthen the architecture, the reliability of the feeding flows, and the security of data within the Microsoft Fabric ecosystem.
The consultant will be involved in architectural choices and the definition of technical solutions as well as their operational implementation.
Missions and Responsibilities
- Microsoft Fabric Architecture and Governance
- Audit and challenge the current organization of Microsoft Fabric workspaces.
- Define a target architecture adapted to business domains and different environments (development, test, production).
- Review security models, access rights management, and Row-Level Security (RLS) mechanisms.
- Formalize naming conventions and governance principles.
- Define and execute a migration plan if architectural evolutions are necessary.
- Industrialization of Incremental Data Flows (Delta)
- Design an incremental ingestion strategy adapted to heterogeneous source systems.
- Define mechanisms for detecting data creations, modifications, and deletions, including in the absence of reliable primary keys or native CDC.
- Implement surrogate keys and change tracking mechanisms.
- Manage data historization in the Silver layer.
- Ensure idempotence, reliability, and replayability of processing.
- Develop and industrialize the chosen solutions in Microsoft Fabric.
- Automation of Data Pseudonymization
- Implement a generic mechanism for pseudonymizing sensitive data, driven by metadata.
- Utilize the existing data classification repository (levels C0 to C3).
- Automate the application of pseudonymization rules on all affected data flows.
- Implement the HMAC-SHA256 mechanism with secure secret management via Azure Key Vault.
- Ensure the processing and routing of data according to their sensitivity level.
- Contribute to securing processing in compliance with GDPR requirements.
Project details
- Start: flexible
- Remote: hybrid
- Location: 94400 Vitry-sur-Seine, France, FR
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on collective.work