Lead Architect – Azure AI Foundry / Agentic AI, Remote and Cologne

Project overview

Lead Architect – Azure AI Foundry / Agentic AI, Remote and Cologne

Responsibilities

Profile

Technological Environment

Questions and profiles welcome at

Mr. Dong Chen

*

• Responsibility for the conception and further development of the AI target architecture based on Azure AI Foundry
• Design of complex multi-agent architectures including agent orchestration, tool calling, and workflow control
• Conception and architecture of RAG solutions including vector search, embeddings, hybrid search, and knowledge retrieval
• Development of architectural concepts for the use and integration of various LLMs
• Creation of architecture blueprints, reference architectures, and reusable design patterns
• Evaluation and selection of suitable AI technologies, frameworks, and architectural approaches
• Definition of architectural standards regarding security, governance, IAM, scalability, and performance
• Consideration of regulatory requirements, data protection, and AI governance in the insurance environment
• Technical consulting and management of development teams, as well as conducting architecture reviews
• Support of proof of concepts up to productive implementation
• Several years of experience as Lead AI Architect, Enterprise AI Architect, or Solution Architect
• In-depth knowledge of LLMs, RAG, Agentic AI, and multi-agent architectures
• Profound practical experience with Microsoft Azure AI Foundry and Azure OpenAI
• Experience in the design and setup of complex agent orchestrations and RAG architectures
• Very good knowledge of Azure AI Search, vector search, embeddings, and hybrid search
• Experience with agent frameworks such as Microsoft Agent Framework or comparable technologies
• Demonstrable experience in creating architecture blueprints and reference architectures, including concrete project references
• Knowledge of AI security, Responsible AI, guardrails, and AI governance
• Experience with enterprise architectures and ideally in the insurance or financial services sector
• Fluent German and English skills, both written and spoken
• Strong architectural, consulting, and communication skills, as well as an independent and structured way of working
• LLMs, RAG, Agentic AI, Multi-Agent Systems, AI Governance, Enterprise Architecture
• Cloud Platform: Microsoft Azure (focus on Azure AI Foundry, Azure API Management, Azure Resource Manager)
• Infrastructure as Code (IaC): Terraform, Bicep, Azure Resource Manager (ARM)
• CI/CD & Versioning: GitHub, GitHub Actions, Git Workflows
• Identity, Access & Security: Microsoft Entra ID (Azure AD), IAM role concepts, Cloud Security & Governance policies
• Architectural Paradigms: Agentic AI Platform Architectures, Platform Engineering, GitOps, Self-Service Platforms
• Collaboration & Agile: Jira, Confluence, collaborative version control (Pull Requests, Code Reviews)

Project details

from November/December 2026

31.05.2027 with option for extension

Remote with occasional presence in Cologne by arrangement

Contract Type: Services/Freelancing

Project Goal

For an insurance client, we are looking for an experienced Lead Architect (m/f/d) to conceptualize and develop an enterprise-wide AI target architecture based on Microsoft Azure AI Foundry.

The focus is on the architecture and integration of Large Language Models (LLMs), RAG-based solutions, and agent-based multi-agent systems. The goal is to develop a scalable, secure, and enterprise-wide AI architecture, taking into account enterprise and regulatory requirements.

A significant component is the creation of standardized architecture blueprints and reference architectures as a basis for the implementation of future AI use cases. The consultant should be able to present corresponding practical project references and already created blueprints.

• Start: ab sofort
• Duration: 6 Monate
• Remote: remote
• Location: Köln, Deutschland, DE
• Languages: German, English