Expert Data Platform Cloudera

Project overview

Context

A major group is undertaking the modernization of its Data Platform and wishes to strengthen its Data Foundation team with a confirmed expert. The mission covers both the evolution of the platform, its daily operation, and supporting the teams that use it.

Several topics are underway: upgrading Cloudera, maintaining operational conditions, evolving towards event-driven architectures, studying Lakehouse solutions, and interconnecting Data platforms. Discussions also concern data sharing and the possible evolution towards hybrid models inspired by Data Mesh.

Mission Objectives

The consultant will contribute to the evolution of the platform and the services offered to data consumers. They will participate in the Cloudera upgrade, handling complex incidents, and improving robustness, performance, and security. They will also help automate administration and operational tasks.

Activities

Reporting to the domain's Product Owner and guided by a backlog of requests, the consultant will work on the following topics:

Studies and Expertise

Operations and Support

Occasional interventions outside of working hours may be necessary, particularly during sensitive production operations.

Technical Environment

Essential Skills

Advanced Skills Expected

Appreciated Skills

Profile Sought

Confirmed consultant with significant experience on Cloudera CDP and operating Hadoop platforms. Solid experience with Linux RHEL and Level 3 production support is expected.

Experience in critical environments with high availability requirements will be particularly appreciated. Knowledge of Data Mesh, event-driven architectures, Lakehouse, Kubernetes, or OpenShift will also be assets.

This is a mission in Niort, 3 days per week.

• Study the technical evolutions of the Cloudera ecosystem and analyze their impacts.
• Write architecture documents and scoping notes.
• Present findings and recommendations to technical and business teams.
• Provide Level 3 support for the Data Platform.
• Analyze major incidents, participate in crisis management, and define corrective actions.
• Support Level 2 DataOps teams.
• Contribute to change management, capacity planning, performance optimization, and maintaining operational conditions.
• Participate in securing and hardening systems.
• Cloudera CDP
• Administration and operation of Hadoop clusters under Cloudera
• Maintaining operational conditions of Data platforms
• Level 3 production support
• Linux Red Hat Enterprise Linux (RHEL)
• Ansible and AWX
• Talend
• Shell Scripting
• Kubernetes, Docker, OpenShift
• Git, GitLab, Jenkins
• Terraform
• Python, Java or Scala

Project details

• Start: flexible
• Remote: hybrid
• Location: 79000 Niort, France, FR
• Rate: 85-85 EUR/h
• Languages: French