Required skills
- Python
- Databricks
- Mosaic AI
- Retrieval-Augmented Generation
- Azure OpenAI
- Microsoft Azure
- MLflow
- Terraform
- GitLab CI/CD
- Unity Catalog
- Key Vault
- Managed Identities
- Agent Frameworks
- API Integration
- Automated Tests
- LLMOps
- AI Security
- RAG
- Tool Calling
- Orchestration
Languages: German
Job description
Seeking an experienced AI Engineer to develop and operate productive AI agents, integrating Large Language Models with enterprise data and internal systems within an agile Scrum team.
Project overview
Framework Conditions
About the Project For a renowned client in the telecommunications industry, we are looking for an experienced AI Engineer (m/f/d). In an agile Scrum team, you will develop and operate productive AI agents and seamlessly link Large Language Models with enterprise data and internal systems.
Skills
Desirable Qualifications
What we offer
Payment Term Shortening: Attractive opportunities to shorten your personal payment term. Simple Credit Process: No more time-consuming invoicing needed. Settlements without Detours: Fast, reliable fee payment. Digital Signature Process: Project contracts concluded via electronic signature.
- Period: Immediately until 31.12.2027 (long-term collaboration desired)
- Utilization: Full-time
- Location: Cologne (Rheinauhafen) | Remote: Up to 50% (approx. 1-2 days/week on-site)
- AI & Agent Development: Conception and implementation of productive single and multi-agent workflows (RAG, Tool Calling, Orchestration, State Management) as well as Python-based agent services and APIs.
- Platform & Integration: Integration of Azure OpenAI and other Foundation Models into Databricks (Mosaic AI, Model Serving, Vector Search, Workflows) as well as existing backend landscapes.
- Deployment & LLMOps: Automated deployment via GitLab CI/CD and Terraform, as well as setup of tracing, monitoring, and evaluations (quality, groundedness, latency, costs) with MLflow.
- Security & Governance: Establishment of guardrails, human-in-the-loop processes, and security concepts (Unity Catalog, Key Vault, Managed Identities, RBAC, Private Endpoints).
- Collaboration & Documentation: Close collaboration with Product Owners, business departments, security, and data teams, as well as documentation of architecture, data flows, and runbooks.
- Experience: Several years of practical experience as an AI, ML, or Software Engineer with a focus on productive LLM and agent solutions (RAG, Tool Calling, Orchestration).
- Software & Frameworks: Very good knowledge of Python, API integration, and automated tests, as well as experience with agent frameworks (e.g., LangGraph, LangChain, Semantic Kernel).
- Databricks: Sound practical experience with Mosaic AI, Model Serving, MLflow, Vector Search, and Unity Catalog.
- Microsoft Azure: Good knowledge of Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking.
- DevOps & IaC: Practical experience with GitLab CI/CD and Terraform for reproducible cloud deployments.
- LLMOps & AI Security: Solid understanding of agent evaluation, observability, data protection, governance, and guardrails.
- Knowledge of Model Context Protocol (MCP), multi-agent communication, structured outputs, and human-in-the-loop.
- Experience with FastAPI, Docker, and Kubernetes for containerized services.
- Practical experience in data preparation with Spark, SQL, Delta Lake, and Databricks Workflows.
Project details
- Start: 30.11.2026
- Duration: unbefristet
- Remote: hybrid
- Location: 50667 Köln, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on GULP