Senior Azure DevOps Engineer – GenAI / LLMOps

Project overview

Description

For our client in the financial services sector, we are looking for an experienced Azure DevOps Engineer to build, operate, and further develop a company-wide Generative AI platform.

• Build and operate a scalable GenAI platform on Microsoft Azure
• Configure and manage Azure services such as API Management, AKS, Azure OpenAI, AI Search, Document Intelligence, and Azure AI Foundry
• Automate infrastructure using Terraform, Helm, and GitLab
• Build and optimize CI/CD pipelines for GenAI applications (LLMOps)
• Implement monitoring, logging, and alerting with Grafana, Prometheus, and Azure Monitor
• Integrate and operate Kubernetes-based components such as Langfuse
• Develop technical concepts considering security, architecture, and compliance requirements
• Support the connection of new applications to the GenAI platform
• Develop components for authentication, routing, monitoring, and guardrails
• Analyze and resolve technical problems in production operation

Requirements

• Several years of experience as a DevOps Engineer in the Azure cloud environment
• Profound knowledge of Git, GitLab, Docker, and Terraform
• In-depth experience with Azure API Management, AKS, Azure Functions, Azure OpenAI, AI Search, Document Intelligence, Azure AI Foundry, and Storage Accounts
• Experience with monitoring, logging, and alerting solutions such as Prometheus, Grafana, or Azure Monitor
• Good knowledge of Infrastructure as Code and CI/CD automation
• Experience with GenAI, RAG, Agentic AI, or LLMOps (advantageous)
• Knowledge of Azure Entra ID, RBAC, and OAuth (advantageous)
• Experience with Kubernetes, Helm, and Langfuse (advantageous)
• Programming skills in Python and/or Java (advantageous)
• Experience in the conception and coordination of cloud architectures with security teams (advantageous)
• German C2 and English C1 (advantageous)

Project details

• Start: 2027-01-01
• Duration: 15 Monate ++
• Location: Zürich, CH
• Languages: German