Zum Inhalt springen

Diese Ausschreibung ist auf Englisch.

JobbörseOffen

Senior Microsoft Fabric Data Architect – Audit and Optimization

Originaltitel: Architecte Data Microsoft Fabric senior – Audit et optimisation

LeHibou · Paris, France · Hybrid · SENIOR

  • Paris, France · Hybrid
  • 2 mois
  • French

Indexiert (heute) · laufend aktualisiert

Budget
81 € / h
Start
ASAP
Laufzeit
2 mois
Arbeitsmodell
Hybrid
Vertrag
Freelance / B2B
Erfahrungslevel
SENIOR

Geforderte Skills

Nice to have:Power BIDP-600DP-700Key VaultClaude CodeGitHub CopilotSABMicrosoft Power BISQLData ModelingData QualitySemantic Models

Sprachen: French

Jobbeschreibung

Seeking a Senior Microsoft Fabric Data Architect to audit, secure, and optimize a data platform for a bank. The role involves assessing security, development foundations, performance, and costs, with measurable deliverables.

Project overview

Our client in the Banking and Finance sector is looking for a Senior Microsoft Fabric Data Architect – Audit and Optimization M/F

Mission Description:

Context

An independent bank has had a data platform in production on Microsoft Fabric for one year. It powers banking reporting (Net Banking Income, business dashboards, data quality) and regulatory projects. The Data BI Analytics team has 9 people reporting to the Head of Data: product manager, analytics engineers, data engineers, and data analysts. Key users are present in each business line. The platform includes approximately 180 pipelines, 600 notebooks, and a Python package of shared functions.

It relies notably on OneLake, Lakehouse, Spark / PySpark, SQL endpoint, Direct Lake, and dedicated capacity, with a Bronze / Silver / Gold medallion architecture. Sources include the SAB core banking system and Salesforce, via a real-time API layer and Fabric DataHub. Reporting is done using Power BI and interactive HTML applications.

The team must ensure the run and the 2026-2027 projects, while stabilizing the foundation before adding Fabric IQ and AI agents. The main challenges are securing access with least privilege, reducing coupling to the shared foundation, and controlling storage formats, as well as optimizing performance and costs.

Mission

Act as a Senior Microsoft Fabric Data Architect to audit, secure, and optimize the data foundation. The mission is performed on a fixed-price basis, with measurable and directly usable deliverables for the Data team. It covers three workstreams that can be engaged independently: security and authorizations, development foundation, performance, cost, and sustainability. Each workstream is scoped, measured before and after, and then closed with operational recommendations and structured knowledge transfer to the team.

The approach favors targeted sampling of the most costly processes rather than an exhaustive review of notebooks.

Main Responsibilities

Technical Environment

Expected Deliverables

Candidate Profile

Experience

Technical Skills

Personal Skills

Languages

Essential Skills / Qualities:

Microsoft Fabric and Lakehouse architecture, Spark / PySpark and Delta Lake data engineering, Fabric and Azure security (Entra ID, RBAC), Performance and cost optimization, Python, Git, and CI/CD

  • Audit workspaces, roles, permissions, Entra ID groups, shares, RLS / OLS, tenant settings, identities, secrets, shortcut permissions, and network, then evaluate the alignment between Fabric and Azure RBAC.
  • Define a target for authorizations per profile, prioritize discrepancies, and propose a remediation plan, a naming standard, and an access recertification procedure.
  • Study the centralization and governance of access via OneLake Catalog and OneLake Security, as well as the anonymization architecture for non-production data.
  • Examine storage formats by layer and define the Delta Lake / Parquet doctrine, with a decision grid and a convergence plan evaluating performance and cost impacts.
  • Diagnose and optimize daily data feeds exceeding 30 minutes, with before and after measurements.
  • Audit the most costly processes: Spark configuration and sizing, autoscale, high concurrency sessions, partitions, shuffle, AQE, small files, retention, purging, archiving, OPTIMIZE, and VACUUM.
  • Review code, tests, documentation, and best practices; identify quantified quick wins and refactor pilot jobs.
  • Prepare tables for Direct Lake and industrialize an OPTIMIZE / VACUUM maintenance plan.
  • Transfer documentation and best practices to the team, and lead a debriefing workshop at the end of each workstream.
  • Data Platform: Microsoft Fabric, OneLake, OneLake Catalog, OneLake Security, Lakehouse, Spark, PySpark, SQL endpoint, Direct Lake, pipelines, Fabric DataHub
  • Storage and Formats: Delta Lake, Parquet, Bronze / Silver / Gold
  • Security and Azure: Entra ID, Azure RBAC, Key Vault, RLS, OLS, private endpoints, workspace identity, service principals
  • Processing and Performance: Spark pools, autoscale, AQE, OPTIMIZE, VACUUM
  • Software and Data Engineering: Packaged Python (wheel), automated tests, Git, CI/CD, Power BI, semantic models
  • Code Assistants: Claude Code, Copilot
  • Sources and Business: SAB, Salesforce, banking and accounting data
  • Mapping of accesses per item and prioritized discrepancy report.
  • Target authorization matrix per profile, Fabric / Azure RBAC matrix, sequenced remediation plan, naming standard, and recertification procedure.
  • Proposal for centralization and governance of accesses via OneLake Catalog and OneLake Security, as well as a proposal for anonymization architecture for non-production data.
  • Delta / Parquet doctrine per layer with decision grid and convergence plan integrating performance and cost impacts.
  • Diagnosis and optimization of daily feeds exceeding 30 minutes, measured before and after.
  • Performance audit of the most costly jobs and Spark configuration recommendations.
  • Partitioning doctrine and retention policy per table; industrialized plan for OPTIMIZE / VACUUM maintenance.
  • Code review, quantified quick wins, refactoring of pilot jobs, and before/after measurements.
  • Documentation, disseminable best practices, operational recommendations, and debriefing workshop at the end of each workstream.
  • 8+ years in data engineering or data architecture.
  • Have led a Microsoft Fabric deployment in production.
  • Experience in the banking context and with accounting data is appreciated; knowledge of SAB is a plus.
  • Expertise in Microsoft Fabric: Lakehouse, OneLake, Spark / PySpark, Delta Lake, SQL endpoint, Direct Lake, pipelines, and capacity management.
  • Mastery of Azure security: Entra ID, RBAC, Key Vault, storage, and network, particularly private endpoints.
  • Software engineering skills: Packaged Python (wheel), automated tests, Git, CI/CD, and code review.
  • Mastery of medallion architecture, modeling, data quality, and Power BI semantic models.
  • Common use of code assistants, notably Claude Code and Copilot.
  • DP-600 or DP-700 certifications are appreciated.
  • Ability to produce measured results before and after.
  • Ability to formalize operational recommendations and transfer knowledge to the team.
  • No specific language requirement mentioned.

Nice to have

DP-600 or DP-700 certifications; banking and accounting data experience; knowledge of SAB.

Project details

Yes — 2 days/week

Candidate Profile

Experience

Technical Skills

Personal Skills

Languages

Essential Skills / Qualities:

Microsoft Fabric and Lakehouse architecture, Spark / PySpark and Delta Lake data engineering, Fabric and Azure security (Entra ID, RBAC), Performance and cost optimization, Python, Git, and CI/CD

  • 8+ years in data engineering or data architecture.
  • Have led a Microsoft Fabric deployment in production.
  • Experience in the banking context and with accounting data is appreciated; knowledge of SAB is a plus.
  • Expertise in Microsoft Fabric: Lakehouse, OneLake, Spark / PySpark, Delta Lake, SQL endpoint, Direct Lake, pipelines, and capacity management.
  • Mastery of Azure security: Entra ID, RBAC, Key Vault, storage, and network, particularly private endpoints.
  • Software engineering skills: Packaged Python (wheel), automated tests, Git, CI/CD, and code review.
  • Mastery of medallion architecture, modeling, data quality, and Power BI semantic models.
  • Common use of code assistants, notably Claude Code and Copilot.
  • DP-600 or DP-700 certifications are appreciated.
  • Ability to produce measured results before and after.
  • Ability to formalize operational recommendations and transfer knowledge to the team.
  • No specific language requirement mentioned.
  • Start: ASAP
  • Duration: 2 mois
  • Remote: hybrid
  • Location: Paris, France, FR
  • Rate: 81-81 EUR/h
  • Languages: French

Indexiert von der 9am-Meta-Suche. Du bist Job-Anbieter? Listing beanspruchen oder verwalten

Gefunden auf free-work.com

  1. JobbörseNeu

    Solution Architect

    Vertraulich· London, United Kingdom· Senior· 63–75 £ / h

    • Solution Architecture
    • AWS
    • Apache Kafka
    • +9

  2. JobbörseNeu

    Data Engineer GCP

    Square One Resources· Remote, Gdynia, Warsaw, Cracow, Poznan, Wrocław, Polen· Hybrid· Senior· 120–130 zł / h

    • Google Cloud Platform
    • SQL
    • PL/SQL
    • +9

Alle Jobs durchsuchen
Kostenlos anmelden und bewerben