Required skills
- Microsoft Fabric
- Lakehouse
- Apache Spark
- PySpark
- Delta Lake
- Data Engineering
- Microsoft Entra ID
- Azure RBAC
- Performance Optimization
- Python
- Git
- CI/CD
Languages: French
Job description
Seeking a Senior Microsoft Fabric Data Architect to audit, secure, and optimize a data platform for a bank. The role involves assessing security, development foundations, performance, and costs, with measurable deliverables.
Project overview
Our client in the Banking and Finance sector is looking for a Senior Microsoft Fabric Data Architect – Audit and Optimization M/F
Mission Description:
Context
An independent bank has had a data platform in production on Microsoft Fabric for one year. It powers banking reporting (Net Banking Income, business dashboards, data quality) and regulatory projects. The Data BI Analytics team has 9 people reporting to the Head of Data: product manager, analytics engineers, data engineers, and data analysts. Key users are present in each business line. The platform includes approximately 180 pipelines, 600 notebooks, and a Python package of shared functions.
It relies notably on OneLake, Lakehouse, Spark / PySpark, SQL endpoint, Direct Lake, and dedicated capacity, with a Bronze / Silver / Gold medallion architecture. Sources include the SAB core banking system and Salesforce, via a real-time API layer and Fabric DataHub. Reporting is done using Power BI and interactive HTML applications.
The team must ensure the run and the 2026-2027 projects, while stabilizing the foundation before adding Fabric IQ and AI agents. The main challenges are securing access with least privilege, reducing coupling to the shared foundation, and controlling storage formats, as well as optimizing performance and costs.
Mission
Act as a Senior Microsoft Fabric Data Architect to audit, secure, and optimize the data foundation. The mission is performed on a fixed-price basis, with measurable and directly usable deliverables for the Data team. It covers three workstreams that can be engaged independently: security and authorizations, development foundation, performance, cost, and sustainability. Each workstream is scoped, measured before and after, and then closed with operational recommendations and structured knowledge transfer to the team.
The approach favors targeted sampling of the most costly processes rather than an exhaustive review of notebooks.
Main Responsibilities
Technical Environment
Expected Deliverables
Candidate Profile
Experience
Technical Skills
Personal Skills
Languages
Essential Skills / Qualities:
Microsoft Fabric and Lakehouse architecture, Spark / PySpark and Delta Lake data engineering, Fabric and Azure security (Entra ID, RBAC), Performance and cost optimization, Python, Git, and CI/CD
- Audit workspaces, roles, permissions, Entra ID groups, shares, RLS / OLS, tenant settings, identities, secrets, shortcut permissions, and network, then evaluate the alignment between Fabric and Azure RBAC.
- Define a target for authorizations per profile, prioritize discrepancies, and propose a remediation plan, a naming standard, and an access recertification procedure.
- Study the centralization and governance of access via OneLake Catalog and OneLake Security, as well as the anonymization architecture for non-production data.
- Examine storage formats by layer and define the Delta Lake / Parquet doctrine, with a decision grid and a convergence plan evaluating performance and cost impacts.
- Diagnose and optimize daily data feeds exceeding 30 minutes, with before and after measurements.
- Audit the most costly processes: Spark configuration and sizing, autoscale, high concurrency sessions, partitions, shuffle, AQE, small files, retention, purging, archiving, OPTIMIZE, and VACUUM.
- Review code, tests, documentation, and best practices; identify quantified quick wins and refactor pilot jobs.
- Prepare tables for Direct Lake and industrialize an OPTIMIZE / VACUUM maintenance plan.
- Transfer documentation and best practices to the team, and lead a debriefing workshop at the end of each workstream.
- Data Platform: Microsoft Fabric, OneLake, OneLake Catalog, OneLake Security, Lakehouse, Spark, PySpark, SQL endpoint, Direct Lake, pipelines, Fabric DataHub
- Storage and Formats: Delta Lake, Parquet, Bronze / Silver / Gold
- Security and Azure: Entra ID, Azure RBAC, Key Vault, RLS, OLS, private endpoints, workspace identity, service principals
- Processing and Performance: Spark pools, autoscale, AQE, OPTIMIZE, VACUUM
- Software and Data Engineering: Packaged Python (wheel), automated tests, Git, CI/CD, Power BI, semantic models
- Code Assistants: Claude Code, Copilot
- Sources and Business: SAB, Salesforce, banking and accounting data
- Mapping of accesses per item and prioritized discrepancy report.
- Target authorization matrix per profile, Fabric / Azure RBAC matrix, sequenced remediation plan, naming standard, and recertification procedure.
- Proposal for centralization and governance of accesses via OneLake Catalog and OneLake Security, as well as a proposal for anonymization architecture for non-production data.
- Delta / Parquet doctrine per layer with decision grid and convergence plan integrating performance and cost impacts.
- Diagnosis and optimization of daily feeds exceeding 30 minutes, measured before and after.
- Performance audit of the most costly jobs and Spark configuration recommendations.
- Partitioning doctrine and retention policy per table; industrialized plan for OPTIMIZE / VACUUM maintenance.
- Code review, quantified quick wins, refactoring of pilot jobs, and before/after measurements.
- Documentation, disseminable best practices, operational recommendations, and debriefing workshop at the end of each workstream.
- 8+ years in data engineering or data architecture.
- Have led a Microsoft Fabric deployment in production.
- Experience in the banking context and with accounting data is appreciated; knowledge of SAB is a plus.
- Expertise in Microsoft Fabric: Lakehouse, OneLake, Spark / PySpark, Delta Lake, SQL endpoint, Direct Lake, pipelines, and capacity management.
- Mastery of Azure security: Entra ID, RBAC, Key Vault, storage, and network, particularly private endpoints.
- Software engineering skills: Packaged Python (wheel), automated tests, Git, CI/CD, and code review.
- Mastery of medallion architecture, modeling, data quality, and Power BI semantic models.
- Common use of code assistants, notably Claude Code and Copilot.
- DP-600 or DP-700 certifications are appreciated.
- Ability to produce measured results before and after.
- Ability to formalize operational recommendations and transfer knowledge to the team.
- No specific language requirement mentioned.
Nice to have
DP-600 or DP-700 certifications; banking and accounting data experience; knowledge of SAB.
Project details
Yes — 2 days/week
Candidate Profile
Experience
Technical Skills
Personal Skills
Languages
Essential Skills / Qualities:
Microsoft Fabric and Lakehouse architecture, Spark / PySpark and Delta Lake data engineering, Fabric and Azure security (Entra ID, RBAC), Performance and cost optimization, Python, Git, and CI/CD
- 8+ years in data engineering or data architecture.
- Have led a Microsoft Fabric deployment in production.
- Experience in the banking context and with accounting data is appreciated; knowledge of SAB is a plus.
- Expertise in Microsoft Fabric: Lakehouse, OneLake, Spark / PySpark, Delta Lake, SQL endpoint, Direct Lake, pipelines, and capacity management.
- Mastery of Azure security: Entra ID, RBAC, Key Vault, storage, and network, particularly private endpoints.
- Software engineering skills: Packaged Python (wheel), automated tests, Git, CI/CD, and code review.
- Mastery of medallion architecture, modeling, data quality, and Power BI semantic models.
- Common use of code assistants, notably Claude Code and Copilot.
- DP-600 or DP-700 certifications are appreciated.
- Ability to produce measured results before and after.
- Ability to formalize operational recommendations and transfer knowledge to the team.
- No specific language requirement mentioned.
- Start: ASAP
- Duration: 2 mois
- Remote: hybrid
- Location: Paris, France, FR
- Rate: 81-81 EUR/h
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on free-work.com