Required skills
Languages: French · English
Job description
As a Data Engineer in the Monitoring squad for a bank, you will develop new features for Nightwatch, a transverse monitoring tool built on Kafka. You will contribute to the maintenance of transverse components and enhance environment management tooling.
Project overview
Within the Monitoring squad of a bank, the Data Engineer will develop new features for Nightwatch, a transverse monitoring tool already in production based on Kafka, contribute to the maintenance of transverse components, and strengthen environment management tooling.
The team, located mainly in Paris with IT and business stakeholders in Porto, works in an agile (Scrum) manner and in contact with the business, on an on-premise Big Data Hadoop Cloudera platform (HDFS, Hive, HBase, Kafka, Ranger), with Spark 3.2 and Scala 2.12 as well as Java, Control-M scheduling, IntelliJ or VS Code with the KiloCode generative AI plugin, DevOps Jenkins, XLDeploy and XLRelease, and the Atlassian suite (Bitbucket Git, Jira, Confluence).
Missions:
Expected Profile:
Data Engineer profile with very good knowledge of the Hadoop ecosystem (YARN, HDFS, Hive, HBase, Kafka, Ranger) and proficiency in Kafka (Producer/Consumer), as well as proficiency in Java 21 and Springboot. Good knowledge of Spark 3 and Spark application optimization techniques, and knowledge of Scala 2 in conjunction with Spark. Experience in setting up CI/CD pipelines (DevOps), mastery of good code management practices, and the ability to analyze needs, estimate workload, and communicate in French and English, adapting discourse to Infrastructure, Developers, Business Analysts, and users, are expected.
Knowledge of functional frameworks like ZIO or Cats would be a real plus, as well as knowledge of containerization and general knowledge of the CIB IT system, particularly a Finance IT system.
Languages: French and English: B2 minimum, C1/C2 desired
- Develop new features for Nightwatch, a transverse monitoring tool based on Kafka
- Participate collaboratively in the technical design of features to be developed
- Rationalize and pool components for an optimized, non-redundant, coherent, and scalable architecture
- Ensure the maintenance of transverse components (evolution, refactoring, optimizations)
- Take charge of component version upgrades and associated tests
- Strengthen technical tooling for environment management
- Participate in code reviews and code quality improvement
- Participate in testing and production deployments in a DevOps context
- Write and maintain technical documentation when necessary
- Participate in agile ceremonies and use Jira and Confluence tools
- Contribute to the team's technological watch
- Present work to the Data Engineers community when opportunities arise
Project details
- Start: ASAP
- Duration: 10 mois
- Remote: hybrid
- Location: Paris, France, FR
- Rate: 38-50 EUR/h
- Languages: French, English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on free-work.com