Geforderte Skills
Sprachen: French · English
Jobbeschreibung
Seeking a Big Data Developer to enhance an existing production monitoring tool for a Big Data platform using Kafka. The role involves developing new features, optimizing components, and participating in DevOps deployments.
Project overview
The tool is in production: it end-to-end monitors the processing of a Big Data platform and relies on Kafka. The team is mainly in Paris, with IT and business contacts in Portugal: English is commonly used, both spoken and written.
The position is for development support, not a project start: you will be working on an existing base to evolve it.
Responsibilities
Technical Stack
What is expected
- Develop new features for the monitoring tool
- Evolve and refactor cross-functional components: optimizations, version upgrades, and associated tests
- Strengthen the technical tooling for environment management
- Participate in technical design in a collaborative manner, code reviews, and code quality
- Rationalize and share components to maintain a coherent and scalable architecture, without redundancy
- Take charge of deployments to testing and production, in a DevOps context
- Write and maintain technical documentation
- Participate in agile ceremonies (Scrum), technological watch, and presentations to the Data Engineering community
- Hadoop Cloudera on-premise (HDFS, Hive, HBase, Kafka, Ranger)
- Java 21 and Spring Boot
- Spark 3.2 and Scala 2.12
- Control-M
- Jenkins, XLDeploy, XLRelease
- Bitbucket, Jira, Confluence
- IntelliJ or VS Code with AI plugin
- Very good knowledge of the Hadoop ecosystem: YARN, HDFS, Hive, HBase, Kafka, Ranger
- Mastery of Kafka on both producer and consumer sides
- Mastery of Java 21 and Spring Boot
- Good knowledge of Spark 3 and Spark application optimization techniques
- Knowledge of Scala 2 in conjunction with Spark
- Practice in setting up CI/CD pipelines and good code management practices
- Ability to translate a need into a technical solution, estimate workload, and adapt discourse to infrastructure, dev, or business stakeholders
Nice to have
- Functional framework like ZIO or Cats
- Containerization (Docker, Kubernetes, OpenShift)
- Knowledge of a Finance IS, particularly CIB sector
Project details
- Start: flexible
- Remote: hybrid
- Location: Paris, France, FR
- Languages: French, English
Indexiert von der 9am-Meta-Suche. Du bist Job-Anbieter? Listing beanspruchen oder verwalten
Gefunden auf collective.work