Required skills
- AI Engineering
- AI Agents
- Databricks
- Azure
- Python
- Large Language Models (LLMs)
- RAG (Retrieval-Augmented Generation)
- Tool Calling
- Orchestration
- API Integration
- GitLab CI/CD
- Terraform
- MLflow
- Unity Catalog
- Azure OpenAI
- Mosaic AI
Languages: German
Job description
Experienced AI Engineer needed to develop and operate productive AI agents, integrating Large Language Models with enterprise data and internal systems within an agile Scrum team. The role involves platform integration, deployment, security, and collaboration.
Project overview
Introduction
About the Project For a renowned client in the telecommunications industry, we are looking for an experienced AI Engineer (m/f/d). In an agile Scrum team, you will develop and operate productive AI agents and seamlessly link Large Language Models with enterprise data and internal systems.
- Framework conditions
- Period: Immediately until 31.12.2027 (long-term cooperation desired)
- Capacity: Full-time
- Location: Cologne (Rheinauhafen) | Remote: Up to 50% (approx. 1–2 days/week on-site)
Responsibilities
Our Requirements
Desirable Qualifications
Knowledge of Model Context Protocol (MCP), multi-agent communication, structured outputs, and human-in-the-loop.
Experience with FastAPI, Docker, and Kubernetes for containerized services.
Practical experience in data preparation with Spark, SQL, Delta Lake, and Databricks Workflows.
- AI & Agent Development: Conception and implementation of productive single and multi-agent workflows (RAG, Tool Calling, Orchestration, State Management) as well as Python-based agent services and APIs.
- Platform & Integration: Integration of Azure OpenAI and other Foundation Models into Databricks (Mosaic AI, Model Serving, Vector Search, Workflows) as well as existing backend landscapes.
- Deployment & LLMOps: Automated deployment via GitLab CI/CD and Terraform, as well as setting up tracing, monitoring, and evaluations (quality, groundedness, latency, costs) with MLflow.
- Security & Governance: Establishment of guardrails, human-in-the-loop processes, and security concepts (Unity Catalog, Key Vault, Managed Identities, RBAC, Private Endpoints).
- Collaboration & Documentation: Close collaboration with Product Owners, business departments, security, and data teams, as well as documentation of architecture, data flows, and runbooks.
- Experience: Several years of practical experience as an AI, ML, or Software Engineer with a focus on productive LLM and agent solutions (RAG, Tool Calling, Orchestration).
- Software & Frameworks: Very good knowledge of Python, API integration, and automated tests, as well as experience with agent frameworks (e.g., LangGraph, LangChain, Semantic Kernel).
- Databricks: Sound practical experience with Mosaic AI, Model Serving, MLflow, Vector Search, and Unity Catalog.
- Microsoft Azure: Good knowledge of Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking.
- DevOps & IaC: Practical experience with GitLab CI/CD and Terraform for reproducible cloud deployments.
- LLMOps & AI Security: Solid understanding of agent evaluation, observability, data protection, governance, and guardrails.
Project details
- Start: ab sofort
- Duration: 6 Monate
- Remote: hybrid
- Location: köln, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE