Tech Lead Data Streaming AWS / Kafka / Flink / English (10+ years)

Project overview

Context:

As part of the development of its Group Data platform, our client is looking for an experienced Data Tech Lead to drive the design, development, and operation of real-time, high-volume data products.

You will be involved in the entire Data value chain: ingestion, streaming processing, APIs, microservices, and production deployment on a modern AWS Cloud environment.

You will also play a major role in architectural choices, defining technical standards, and supporting development teams.

Your missions:

Technical Environment: Data Streaming

Cloud & Infrastructure

APIs & Development

DevOps & Observability

Security

Profile sought

Over 10 years of experience in Data development and architecture

Confirmed expertise in:

Significant experience in:

Ability to:

Professional English essential.

• Design and develop real-time data processing solutions based on Apache Flink and Apache Kafka
• Define and promote Event-Driven Architectures
• Build robust and scalable real-time and batch data pipelines
• Develop documented REST APIs and microservices (OpenAPI)
• Implement the necessary AWS services for Data platforms
• Ensure the quality, security, and observability of solutions
• Implement CI/CD and DevOps best practices
• Lead architecture reviews, code reviews, and engineering standards
• Support and upskill the team's developers
• Provide production support, performance monitoring, and continuous improvement
• Apache Kafka
• Apache Flink
• Kafka Streams
• Event-Driven Architecture
• Schema Registry
• AWS MSK
• Amazon Kinesis
• AWS Managed Service for Apache Flink
• AWS Lambda
• API Gateway
• ECS / EKS
• S3
• IAM
• REST APIs
• OpenAPI / Swagger
• Microservices
• GitLab CI
• GitHub Actions
• CloudWatch
• OpenTelemetry
• Prometheus
• Grafana
• OAuth2
• OpenID Connect (OIDC)
• Secrets Management
• Real-time architectures
• AWS Cloud
• Data platform design
• Event-driven architectures
• APIs and microservices
• Production deployment and operation
• Challenge technical choices
• Technically mentor a team
• Lead architecture workshops
• Communicate with business and technical teams

Nice to have

Large-scale Streaming Data expertise

Experience in complex international environments

Recognized technical leadership

Strong DevOps and Cloud Native culture

Project details

• Start: ASAP
• Duration: 6 mois renouvelable
• Location: La Défense, Île-de-France, FR
• Rate: 75-81 EUR/h
• Languages: French