Data Platform Architect / Cloudera CDP – Hadoop Admin, N3 Support @ Niort

Project overview

Context and challenges

As part of a strategic information system transformation program and the modernization of its Data Hub platform, a major player in the insurance sector is looking for a Data Platform / Cloudera CDP Expert to strengthen its Data Foundation team.

The mission is part of a transformation towards a more Data Driven organization, with several structuring projects:

The objective is to support business, project, and operations teams in the design, modernization, and operation of Data Hub services, while ensuring their robustness, performance, and security.

Detailed missions

Under the responsibility of the domain Product Owner, activities will be organized and prioritized through a backlog of requests.

The mission involves participation in sensitive operations on critical environments, with the possibility of occasional interventions during non-working hours (HNO).

Technical Stack

Level

Technologies and skills

Mandatory Expertise

Cloudera CDP, Cloudera Hadoop, cluster administration and operations, Data Platform MCO, N3 support

Advanced Level

Linux RHEL, Ansible, AWX, Talend, Shell scripting

Appreciated Skills

Kubernetes, Docker, Git, GitLab, Jenkins, OpenShift, Terraform, Python, Java, Scala

Data Architecture

Data Driven, Data Mesh, Lakehouse, event-driven architectures, Data Sharing, interoperability, and hybridization

Operations

Incident management, crisis cells, change management, Capacity Planning, Performance Tuning, security and hardening, HNO

Practical information

• Modernization and technical evolution of the Data Hub platform.
• Support for the Cloudera platform version upgrade project.
• Operational maintenance (MCO) and improvement of Data services availability.
• Evolution of event-driven architectures.
• Study and integration of Lakehouse technologies.
• Development of interoperability between different Data platforms.
• Discussions on data sharing models (Data Sharing).
• Preparation of hybridization scenarios and evolution towards architectures close to Data Mesh.
• Architecture and technical expertise
• Conduct technical studies for the evolution of the Cloudera CDP ecosystem and the Data Hub platform.
• Analyze the technical and functional impacts of planned evolutions.
• Produce architecture documents, scoping notes, and technical recommendations.
• Present study conclusions to technical managers and business stakeholders.
• Contribute to the modernization of Data services offered to platform consumers.
• Support discussions and work around event-driven architectures, Lakehouse, Data Sharing, hybridization, and Data Mesh.
• Participate in interoperability work between Data platforms.
• Cloudera Administration and version upgrade
• Contribute to the technical evolution of Cloudera Hadoop clusters.
• Support work related to the Cloudera platform version upgrade.
• Analyze the impacts of changes on technical components and existing services.
• Ensure the administration and operational maintenance of the platform.
• Participate in change management and sensitive production operations.
• Guarantee the stability and continuity of Data Hub services during evolutions.
• Expert N3 Support and production management
• Provide Level 3 technical support for the entire Data Hub platform.
• Diagnose and resolve complex production incidents.
• Participate in crisis management cells during major incidents.
• Conduct Root Cause Analysis.
• Define and monitor remediation plans.
• Support Level 2 DataOps teams in resolving technical issues.
• Contribute to the continuous improvement of operations and support processes.
• Performance, capacity, and security
• Perform Capacity Planning activities to anticipate resource needs.
• Conduct performance analyses and Performance Tuning operations.
• Improve the robustness, availability, and performance of the platform.
• Contribute to the security and hardening of systems.
• Participate in the continuous improvement of operational maintenance.
• Industrialization and automation
• Industrialize administration and operations processes.
• Develop and maintain automations using Ansible, AWX, and Shell scripts.
• Contribute to the reliability and standardization of technical operations.
• Participate in the improvement of platform Data operations and automation practices.
• Production Interventions

Project details

Niort (79)

Level: Experienced Consultant – Architect Level 2

Environment: Data Hub platform of a large insurance group

Constraints: Occasional HNO interventions possible

• Start: flexible
• Remote: hybrid
• Location: 79000 Niort, France, FR
• Rate: 85-85 EUR/h
• Languages: French