Senior Cloudera Engineer for IT Project in Public Sector Wanted

Project overview

For a long-term IT project in the public sector, we are looking for an experienced Senior Cloudera Engineer. The focus is on the development and integration of software solutions within a Cloudera/Hadoop-based data platform and the processing of large data volumes in distributed systems.

Responsibilities

• Development and integration of software components in the Cloudera/Hadoop environment
• Development of backend components with Java and Python
• Implementation of data processing processes with Apache Spark / PySpark
• Integration and use of the Elastic Stack
• Development and coordination of technical interfaces
• Execution of unit tests and integration of the developed components
• Participation in the Scrum process and maintenance of the backlog
• Creation of technical documentation and knowledge transfer

Requirements

• Sound practical experience with Cloudera or the Hadoop ecosystem
• Experience with Apache Spark / PySpark
• Good knowledge of Java and Python
• Very good SQL knowledge
• Experience with Kafka or comparable messaging systems
• Understanding of distributed systems and cluster architectures
• Experience with interfaces and system integrations

Nice to have

Framework Conditions

If you are currently available and interested in collaboration in the public sector, we look forward to your response.

Please send us your current profile including your hourly rate and availability.

Xcellent Talents Team

• Experience with Spring Framework
• Basic knowledge of Kubernetes
• Knowledge of React
• Experience with Cloudera Replication Manager
• Start: immediately
• Duration: long-term
• Location: predominantly remote, sporadic on-site appointments
• Security check SÜ2 mandatorily required or willingness to undergo it is sufficient

Project details

• Start: ab sofort
• Duration: 12 Monate
• Remote: hybrid
• Location: Wiesbaden, Deutschland, DE
• Languages: German