Required skills
- AI Engineering
- Machine Learning Engineering
- Software Engineering
- Python
- API Integration
- Automated Testing
- Code Review
- Modular Software Development
- Databricks
- MLflow
- Mosaic AI
- Model Serving
- Vector Search
- Unity Catalog
- Microsoft Azure
- Azure OpenAI
- Managed Identities
- Key Vault
- Storage
- Networking
- AI Agents
- LLMOps
- RAG
- Agent Orchestration
- Tool Calling
- LangGraph
- LangChain
- Semantic Kernel
- GitLab CI/CD
- Terraform
Languages: German
Job description
Seeking an experienced AI Engineer for a long-term project in Cologne, focusing on developing and deploying AI agents on Databricks and Azure for a telecommunications company.
Project overview
For a long-term project at a telecommunications company in Cologne, we are looking for an experienced AI Engineer (m/f/d) with a focus on the development and productive deployment of intelligent AI agents on Databricks and Microsoft Azure.
The focus is on AI Engineering, LLMOps, and Cloud Architecture, as well as the development of scalable, secure, and traceable agent-based applications for integrating Large Language Models, company data, and internal systems.
Framework Conditions
Responsibilities
Conception, development, and operation of productive AI agent solutions on Databricks and Azure – from prototype to scalable deployment
Development of AI agents and multi-agent workflows to connect Large Language Models, company data, APIs, and internal systems
Implementation of RAG, Tool Calling, and agent orchestration, as well as reusable tools, prompts, and state and context components
Integration of Azure OpenAI and other Foundation Models into Databricks as well as existing application and data landscapes
Development of Python-based agent services and APIs, as well as integration into backend and cloud architectures
Use of Databricks Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring
Implementation of Vector Search, Embeddings, and Retrieval Pipelines for controlled access to company data
Orchestration of agent, data, and automation processes with Databricks Workflows
Automation of deployments with GitLab CI/CD and Terraform, including tests and reproducible environments
Development of evaluations, tracing, and monitoring for response quality, groundedness, security, latency, costs, and reliability
Implementation of Guardrails, authorization concepts, and Human-in-the-Loop processes
Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and Logging
Collaboration with Product Owners, business units, data, backend, and cloud teams, as well as security and privacy
Documentation of agent logic, interfaces, data flows, architecture, evaluation methods, and runbooks
Your Profile – Required Qualifications
Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role
Practical experience with LLM applications and AI agents, ideally with RAG, agent orchestration, tool calling, and productive deployment
Very good Python skills as well as experience with API integration, automated tests, code reviews, and modular software development
In-depth Databricks experience, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog
Good Azure knowledge, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking
Experience with agent and LLM frameworks such as LangGraph, LangChain, or Semantic Kernel, as well as stateful workflows
Practical experience with GitLab CI/CD for testing, versioning, and automated deployment
Practical experience with Terraform (Infrastructure as Code) for Azure and Databricks resources
Solid understanding of LLMOps, Agent Evaluation, Observability, and systematic quality control
Knowledge in AI Security, data protection, governance, guardrails, and secure model access
Ability to deploy AI agents productively, reliably, securely, and scalably
Desirable Qualifications
Knowledge of the Model Context Protocol (MCP) as well as multi-agent and agent-to-agent communication
Experience with FastAPI, Docker, and Kubernetes
Knowledge in Spark, SQL, Delta Lake, and Databricks Workflows
Experience with Human-in-the-Loop, structured outputs, and controlled rollouts
Experience in regulated or data-sensitive corporate environments
Project Environment
You will work in a cross-functional Scrum team with shared end-to-end responsibility from architecture through development to productive operation. The environment offers opportunities to co-shape platform, architecture, and governance decisions, as well as to test and introduce new AI technologies.
Framework Conditions
Project details
Immediately / by arrangement
Until 31.12.2027, long-term cooperation desired
Cologne (hybrid, remote share up to 50% by agreement)
Presence: Regular on-site appointments in Cologne
Project Environment: Cross-functional Scrum team
- Start: ab sofort
- Duration: 13 Monate
- Remote: hybrid
- Location: Köln, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE