Required skills
- AI Engineering
- Machine Learning Engineering
- Software Engineering
- Python
- API Integration
- Automated Testing
- Code Review
- Modular Software Development
- Databricks
- MLflow
- Mosaic AI
- Model Serving
- Vector Search
- Unity Catalog
- Microsoft Azure
- Azure OpenAI
- Managed Identities
- Key Vault
- Storage
- Networking
- LangGraph
- LangChain
- Semantic Kernel
- Stateful Workflows
- GitLab CI/CD
- Terraform
- Infrastructure as Code
- LLMOps
- Agent Evaluation
- Observability
Languages: German
Job description
Develop and deploy productive AI agents and intelligent automation solutions on Azure and Databricks, integrating LLMs, company data, and internal systems for a telecommunications company.
Project overview
Our client is a telecommunications company that offers mobile services as well as complete packages with internet and telephony nationwide. A focus for the client is the development and deployment of productive AI agents and intelligent automation solutions on Azure and Databricks. This includes integrating Large Language Models, company data, and internal systems, in collaboration with Data, Cloud, and Backend teams. The goal is to evolve into a Data- and AI-driven Company.
Key Data
- Duration: Immediate until 31.12.2027 (extension possible)
- Location: Cologne, one to two days per week in the office, otherwise remote; up to 50% remote share possible by arrangement
- Employment as a freelancer or as a permanently employed specialist of the provider
Responsibilities
- Conception, development, and operation of productive AI agent solutions on Databricks and Azure – from the initial prototype to scalable deployment
- Development of AI agents and multi-agent workflows that purposefully connect Large Language Models, company data, APIs, and internal systems
- Implementation of RAG, Tool Calling, and agent orchestration, as well as development of reusable tools, prompts, and state and context components
- Integration of Azure OpenAI and other Foundation Models into Databricks as well as into existing application and data landscapes
- Development of Python-based agent services and APIs and their integration into existing backend and cloud architectures
- Use of Databricks Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring of models and agents
- Implementation of Vector Search, Embeddings, and Retrieval Pipelines for controlled access to relevant company data
- Orchestration of agent, data, and automation processes with Databricks Workflows and defined tool access
- Automation of deployment with GitLab CI/CD and Terraform, including reproducible environments, tests, and traceable releases
- Development of evaluations, tracing, and monitoring for response quality, groundedness, security, latency, costs, and reliability
- Establishment of guardrails, authorization concepts, and Human-in-the-Loop processes for the responsible use of AI Agents
- Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and Logging
- Close collaboration with Product Owners, business departments, Data, Backend, and Cloud teams, as well as Security and Privacy on productive agent use cases
- Documentation of agent logic, tool interfaces, data flows, architecture, evaluation methods, and runbooks for sustainable operation
Requirements
Desirable##
- Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role
- Practical experience with LLM applications and AI Agents, ideally with RAG, agent orchestration, tool calling, and productive deployment
- Very good knowledge of Python as well as API integration, automated tests, code reviews, and modular software development
- Profound experience with Databricks, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog
- Good knowledge of the Microsoft Azure platform, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking
- Experience with agent and LLM frameworks, for example LangGraph, LangChain, or Semantic Kernel, and with stateful workflows
- Practical experience with GitLab CI/CD for testing, versioning, and automated deployment of AI applications
- Practical experience with Terraform (Infrastructure as Code) for deploying Azure and Databricks resources
- Solid understanding of LLMOps, agent evaluation, and observability, including systematic quality controls
- Knowledge of AI Security, data protection, and governance, secure model access, guardrails, and the protection of sensitive information
- Ability to deploy AI Agents productively, reliably, and scalably, and to translate business requirements into robust solutions
- Knowledge of the Model Context Protocol (MCP) and patterns for multi-agent or agent-to-agent communication
- Experience with FastAPI, Docker, and Kubernetes for operating containerized agent services and APIs
- Knowledge of Spark, SQL, Delta Lake, and Databricks Workflows for data preparation and AI-driven processes
- Experience with Human-in-the-Loop, structured outputs, and controlled rollouts for AI applications
- Experience in regulated or data-privacy-sensitive corporate environments
Project details
- Start: 2027-01-04
- Duration: 12 Monate
- Remote: hybrid
- Location: Köln, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on vp-systeme.de