Tech Lead Data Engineering (Apache Flink & Kafka) - >10 years - 2066

Project overview

Context: As part of the development and evolution of the Group Data Platform, we are looking for a Tech Lead Data Engineering specialized in real-time architectures, with at least 10 years of experience.

The consultant will work within the Group Data Delivery team to design, develop, and operate real-time data products, from ingestion and stream processing to their exposure via APIs for internal and external consumers.

They will need to bring advanced technical expertise on Apache Flink, Apache Kafka, event-driven architectures, microservices, and AWS technologies, while ensuring technical leadership, development quality, and reliability of solutions put into production.

Main missions

Design and develop end-to-end real-time data products using Apache Flink, Apache Kafka, and event-driven architectures.

Build and maintain resilient data pipelines for real-time and batch data ingestion, processing, transformation, and distribution.

Design and develop REST APIs, OpenAPI specifications, microservices, and streaming interfaces.

Deploy and operate solutions on AWS, including MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3, and IAM.

Implement data quality controls, data models, validation mechanisms, and schema governance.

Define and industrialize CI/CD pipelines with GitLab CI, GitHub Actions, or equivalent tools.

Ensure solution observability using CloudWatch, OpenTelemetry, Prometheus, Grafana, structured logs, metrics, and tracing.

Ensure operational maintenance of services: monitoring, incident management, root cause analysis, and performance optimization.

Ensure compliance with SLAs and service availability, security, and reliability in production.

Apply security best practices: OAuth2/OIDC, data encryption, secret management, network control, and the principle of least privilege.

Write technical documentation: architecture documents, API specifications, operational procedures, and deployment documentation.

Lead technical choices, facilitate architecture discussions, and perform code and design reviews.

Define and promote engineering standards, mentor less experienced developers, and ensure knowledge transfer.

Ensure the delivery of robust, scalable, secure, and production-ready data products.

Technical expertise:

Apache Flink and PyFlink.

Apache Kafka and Amazon MSK.

Event-Driven Architectures.

Data Engineering and real-time systems.

Microservices architecture.

REST API and OpenAPI design and development.

Java, Python, Scala, and SQL.

Data modeling and schema management (Avro, Schema Registry).

Amazon Web Services (AWS): Lambda, Kinesis, Managed Flink, ECS, EKS, S3, API Gateway, and IAM.

DevOps, quality, and operations:

Implementation of CI/CD pipelines (GitLab CI, GitHub Actions).

Automated testing and development quality control.

Observability: CloudWatch, OpenTelemetry, Prometheus, and Grafana.

SLA management and production support.

Securing applications and data flows: OAuth2/OIDC, encryption, and access management according to the principle of least privilege.

Leadership and transversal skills:

Technical leadership and architecture design.

Code reviews and definition of engineering standards.

Ability to solve complex technical problems.

Mentoring and team support.

Communication with technical and business stakeholders.

Excellent command of English, bilingual level.

Project details

• Start: 15/11/2026
• Duration: 10 mois
• Remote: hybrid
• Location: Courbevoie, Île-de-France, FR
• Languages: French, English