Senior Kafka Consultant / Architect (Full TT)

Project overview

Mission Context

As part of the evolution of a critical Kafka platform within a banking environment, we are looking for a Senior Kafka Consultant / Architect.

The mission primarily focuses on modernizing the platform, with an upgrade to Kafka 8.x and a migration from ZooKeeper to KRaft. The consultant will also be involved in architecture, security, audit, and governance topics.

The platform is currently deployed across several environments, including production, pre-production, and staging.

Your Main Responsibilities

You will act as the technical Kafka referent and will be responsible for:

• Auditing existing Kafka architecture and configurations
• Defining the target version and building the migration strategy to Kafka 8.x
• Leading the transition from ZooKeeper to KRaft
• Reviewing cluster sizing and the required number of nodes
• Coordinating the various stakeholders involved in the migration
• Preparing cutover, rolling restart, and rollback procedures
• Analyzing the migration's impact on client applications, particularly Java and Spring environments
• Studying and implementing security requirements around data encryption at rest and in transit
• Reviewing rights and access mechanisms, particularly ACLs and RBAC
• Implementing clear governance around topics, logs, monitoring, and Schema Registry
• Supporting development teams with their Kafka-related issues
• Formalizing best practices and operational procedures
• Participating in the improvement of the platform's observability, performance, and capacity planning

Project details

• Start: flexible
• Remote: remote
• Location: FR
• Rate: 73-73 EUR/h
• Languages: French