Senior Cloudera Architect for IT Project in Public Sector Wanted

Project overview

For a long-term IT project in the public sector, we are looking for an experienced Senior Kubernetes & Cloudera Architect.

The focus is on the conception, further development, and technical implementation of scalable data and software architectures in the Cloudera, Hadoop, and Kubernetes environment. We are looking for an experienced architect who combines profound architectural competence with practical development and DevOps experience.

Responsibilities

• Conception, further development, and implementation of scalable Cloudera, Hadoop, and Kubernetes architectures
• Architecture and integration of distributed data platforms as well as backend and frontend components
• Hands-on support in the development and optimization of data pipelines and software solutions
• Technical support for development and DevOps teams
• Integration and further development of solutions based on the Elastic Stack
• Conception and coordination of technical interfaces and system integrations
• Technical evaluation, refinement, and acceptance of user stories
• Ensuring the technical quality, scalability, and maintainability of the solutions
• Participation in agile development processes as well as maintenance and prioritization of the backlog
• Creation of technical architecture, development, and operating documentation

Requirements

• At least 3-5 years of relevant experience in software, solution, or data platform architecture
• Profound experience with Cloudera, Hadoop, or comparable big data platforms
• Very good knowledge of Apache Spark / PySpark, Python, and SQL
• Practical experience with Kubernetes and containerized applications
• Experience in the conception and integration of distributed systems and data platforms
• Knowledge in the development and optimization of ETL/ELT processes and data pipelines
• Experience with Pandas, DuckDB, or comparable data processing technologies
• Practical experience in software development as well as in the DevOps environment
• Ability to translate complex technical requirements into scalable architecture and implementation concepts
• German language skills at least at C1 level

Nice to have

Framework Conditions

If you are currently available and interested in collaborating in the public sector, we look forward to hearing from you.

Please send us your current profile including your hourly rate and availability.

Xcellent Talents Team

• Apache Kafka, NiFi, Hive, and Iceberg
• Java 21, Spring Boot, and Maven
• React 18, TypeScript, and AG Grid
• Docker, Helm, and CI/CD
• Elastic Stack and cloud platforms (Databricks, AWS EMR)
• Start: immediately
• Duration: long-term
• Utilization: Full-time (4-5 PT/week)
• Location: predominantly remote, sporadic on-site appointments
• Security clearance: SÜ2 required; willingness to undergo it is sufficient

Project details

• Start: ab sofort
• Duration: 12 Monate
• Remote: hybrid
• Location: Wiesbaden, Deutschland, DE
• Languages: German