Required skills
- Enterprise AI Architect
- Cloud Architect
- Microsoft Azure
- Azure AI Foundry
- Azure OpenAI
- Agentic AI
- AI Agents
- Multi-Agent Orchestration
- RAG
- Enterprise Architecture
- API Management
- Cloud Integration
- AI Governance
- Security-by-Design
- Zero Trust
- EU AI Act
- Data Protection
- Observability
- LLM Monitoring
- Terraform
- Bicep
- GitHub Actions
- CI/CD
- Platform Engineering
- Microsoft Entra ID
- API Patterns
- LLM Gateways
- Model Serving
- Architecture Decision Records
- Jira
Languages: German
Job description
Seeking an AI Lead Architect to design and establish a central, scalable Agentic AI Platform on Microsoft Azure, focusing on Azure AI Foundry and integrating security, governance, and regulatory requirements.
Project overview
AI Lead Architect – Azure AI Foundry & Agentic AI, Remote and Cologne
Project details
ASAP
31.05.2027
Scope: approx. 130 PT with option for extension
Remote with occasional presence in Cologne by arrangement
Contract Type: Services/Freelancing
Strategic conception, architecture, and establishment of a central, scalable, and audit-proof Agentic AI Platform based on Microsoft Azure with a focus on Azure AI Foundry. Ensuring company-wide architecture standards and integration of security, AI governance, and regulatory requirements.
Working Method: Agile project environment in close collaboration with the stream lead, cloud/platform engineers, enterprise architects, and business departments.
Inquiries and profiles gladly to
Mr. Dong Chen
*
- Objective
- Tasks
- Development and further development of the AI platform target architecture based on Azure AI Foundry and Azure OpenAI.
- Definition of reference architectures and blueprints for AI Agents, Multi-Agent Systems, and RAG solutions.
- Conception of enterprise integrations, API, and interface architectures.
- Establishment of security, governance, and compliance standards (including Zero Trust, EU AI Act, data protection).
- Definition of standards for AI Observability, tracing, monitoring, evaluation, and cost control.
- Conducting architecture and security reviews as well as technology evaluations.
- Consulting and enablement of development, product, and domain teams.
- Steering architectural collaboration with stream leads, cloud engineers, and enterprise architects.
- Profile Requirements
- Several years of experience as an Enterprise AI Architect, Cloud Architect, or comparable role.
- In-depth practical experience with Microsoft Azure, especially Azure AI Foundry and Azure OpenAI.
- Profound knowledge in Agentic AI, AI Agents, Multi-Agent Orchestration, and RAG.
- Experience with enterprise architectures, API management, and cloud integrations.
- Very good knowledge of AI Governance, Security-by-Design, Zero Trust, and regulatory requirements (EU AI Act, data protection).
- Experience with observability, LLM monitoring, evaluation, and cost control.
- Strong communication, consulting, and moderation skills at management and team level.
- Additionally Required Skills
- Cloud & AI: Azure AI Foundry, Azure OpenAI Services, Microsoft Azure.
- AI Architecture: Agentic AI, Multi-Agent Orchestration, RAG, LLM Gateways, Model Serving.
- Integration & Security: Azure API Management, Microsoft Entra ID (IAM), Enterprise API Patterns.
- Infrastructure & DevOps: Terraform, Bicep, GitHub Actions, CI/CD and Platform Engineering.
- Governance & Observability: AI Governance, EU AI Act, LLM Tracing, Telemetry and Evaluation.
- Architecture & Collaboration: Reference Architectures, Architecture Decision Records (ADRs), Jira and Confluence.
- Start: ab sofort
- Duration: 6 Monate
- Remote: remote
- Location: Köln, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE