Skip to content
Job boardOpen

[SCH] Data Engineer

Original title: [SCH] Data Engineer - 2095

ISUPPLIER · Paris, France · Hybrid · Senior

  • Paris, France · Hybrid
  • 10 mois
  • French · English

Indexed (today) · refreshed constantly

Budget
€38–50 / h
Start
ASAP
Duration
10 mois
Work mode
Hybrid
Contract
Freelance / B2B
Seniority
Senior

Required skills

Nice to have:ZIOCatsContainerization

Languages: French · English

Job description

As a Data Engineer in the Monitoring squad for a bank, you will develop new features for Nightwatch, a transverse monitoring tool built on Kafka. You will contribute to the maintenance of transverse components and enhance environment management tooling.

Project overview

Within the Monitoring squad of a bank, the Data Engineer will develop new features for Nightwatch, a transverse monitoring tool already in production based on Kafka, contribute to the maintenance of transverse components, and strengthen environment management tooling.

The team, located mainly in Paris with IT and business stakeholders in Porto, works in an agile (Scrum) manner and in contact with the business, on an on-premise Big Data Hadoop Cloudera platform (HDFS, Hive, HBase, Kafka, Ranger), with Spark 3.2 and Scala 2.12 as well as Java, Control-M scheduling, IntelliJ or VS Code with the KiloCode generative AI plugin, DevOps Jenkins, XLDeploy and XLRelease, and the Atlassian suite (Bitbucket Git, Jira, Confluence).

Missions:

Expected Profile:

Data Engineer profile with very good knowledge of the Hadoop ecosystem (YARN, HDFS, Hive, HBase, Kafka, Ranger) and proficiency in Kafka (Producer/Consumer), as well as proficiency in Java 21 and Springboot. Good knowledge of Spark 3 and Spark application optimization techniques, and knowledge of Scala 2 in conjunction with Spark. Experience in setting up CI/CD pipelines (DevOps), mastery of good code management practices, and the ability to analyze needs, estimate workload, and communicate in French and English, adapting discourse to Infrastructure, Developers, Business Analysts, and users, are expected.

Knowledge of functional frameworks like ZIO or Cats would be a real plus, as well as knowledge of containerization and general knowledge of the CIB IT system, particularly a Finance IT system.

Languages: French and English: B2 minimum, C1/C2 desired

  • Develop new features for Nightwatch, a transverse monitoring tool based on Kafka
  • Participate collaboratively in the technical design of features to be developed
  • Rationalize and pool components for an optimized, non-redundant, coherent, and scalable architecture
  • Ensure the maintenance of transverse components (evolution, refactoring, optimizations)
  • Take charge of component version upgrades and associated tests
  • Strengthen technical tooling for environment management
  • Participate in code reviews and code quality improvement
  • Participate in testing and production deployments in a DevOps context
  • Write and maintain technical documentation when necessary
  • Participate in agile ceremonies and use Jira and Confluence tools
  • Contribute to the team's technological watch
  • Present work to the Data Engineers community when opportunities arise

Project details

  • Start: ASAP
  • Duration: 10 mois
  • Remote: hybrid
  • Location: Paris, France, FR
  • Rate: 38-50 EUR/h
  • Languages: French, English

Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing

Found on free-work.com

  1. Job boardNew

    Technical Program Manager

    Sierra Business Solution LLC· Pleasanton / CA - California· Senior· $56 / h

    • Program Management
    • Java
    • J2EE
    • +7

Browse all jobs
Sign up free to apply