Senior Apache NiFi DevOps Engineer / Consultant

Project overview

For a challenging customer project in the area of database and lakehouse management, we are looking for an experienced Senior Apache NiFi DevOps Engineer / Consultant to review, harden, and further develop an existing Apache NiFi infrastructure in a hybrid Kubernetes and Azure environment.

Responsibilities

• Review, hardening, and operational optimization of the existing Apache NiFi infrastructure
• Analysis and optimization of the existing Kubernetes deployment and cluster sizing
• Review and optimization of content repository storage and NiFi Registry
• Consulting on infrastructure scaling with regard to increasing pipeline volumes and new data connections
• Close collaboration with NiFi and Kafka developers to coordinate infrastructure requirements
• Support in setting up and optimizing monitoring, logging, and observability
• Ensuring traceability of data flows and operational states
• Consulting and implementation of high availability and disaster recovery concepts for Apache NiFi in hybrid Kubernetes and Azure environments
• Review and improvement of security and hardening measures for the NiFi infrastructure
• Knowledge transfer, workshops, and training of the internal DevOps team with the goal of ensuring independent operation, hardening, and scaling of the infrastructure
• Review and completion of technical documentation

Requirements

Advantageous:

Framework conditions:

Interested? Please send your profile, availability, and hourly rate (CHF).

• Several years of practical experience with Apache NiFi in productive enterprise environments
• Demonstrable experience in the operation, hardening, and scaling of Apache NiFi clusters on Kubernetes
• Sound knowledge of the Kubernetes environment, ideally with the Stackable Operator for Apache NiFi
• Experience with Apache NiFi Registry as well as flow versioning and flow management
• Sound knowledge in setting up and operating high availability and disaster recovery solutions
• Experience with hybrid infrastructure environments based on Kubernetes and Microsoft Azure
• Practical experience with monitoring, logging, and observability for complex data infrastructures
• Knowledge in securing and hardening NiFi infrastructures in Kubernetes and Azure environments
• Experience in technical collaboration with NiFi and Kafka development teams
• Experience in coaching and knowledge transfer to internal DevOps teams
• Experience with CI/CD pipelines for NiFi deployments in Kubernetes and Azure environments
• Start: By agreement
• Duration: 6 months; alternatively flexible for a concentrated deployment
• Workload: 30–60 %
• Location: Zurich Oerlikon, Switzerland
• Work model: Primarily on-site, occasional remote component by arrangement
• Level: Expert

Project details

• Start: ab sofort
• Remote: hybrid
• Location: Zürich, Schweiz, CH
• Languages: German