Required skills
- AI Engineering
- Machine Learning Engineering
- Software Engineering
- Python
- API Integration
- Automated Testing
- Modular Software Development
- Databricks
- MLflow
- Mosaic AI
- Model Serving
- Vector Search
- Unity Catalog
- Microsoft Azure
- Azure OpenAI
- Managed Identities
- Key Vault
- Storage
- Networking
- LangGraph
- LangChain
- Semantic Kernel
- GitLab CI/CD
- Terraform
- Infrastructure as Code
- LLMOps
- Agent Evaluation
- Observability
- AI Security
- Data Protection
Languages: German
Job description
Develop and operate productive AI agent solutions on Databricks and Azure, from prototype to scalable deployment. Implement AI agents and multi-agent workflows connecting LLMs, enterprise data, and APIs.
Project overview
Conception, development, and operation of productive AI agent solutions on Databricks and Azure – from the initial prototype to scalable deployment. Development of AI agents and multi-agent workflows for the targeted connection of Large Language Models, enterprise data, APIs, and internal systems. Implementation of RAG, Tool Calling, and Agent Orchestration, as well as development of reusable tools, prompts, and state and context components. Integration of Azure OpenAI and other Foundation Models into Databricks as well as into existing application and data landscapes.
Development of Python-based agent services and APIs and their integration into existing backend and cloud architectures. Use of Databricks Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring of models and agents. Implementation of Vector Search, Embeddings, and Retrieval Pipelines for controlled access to relevant enterprise data. Orchestration of agent, data, and automation processes with Databricks Workflows and defined tool access. Automation of deployment with GitLab CI/CD and Terraform, including reproducible environments, tests, and traceable releases.
Development of evaluations, tracing, and monitoring for response quality, groundedness, security, latency, cost, and reliability. Establishment of guardrails, authorization concepts, and human-in-the-loop processes for the responsible use of AI Agents. Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and Logging. Close collaboration with Product Owners, business departments, Data, Backend, and Cloud teams, as well as Security and Privacy on productive agent use cases.
Documentation of agent logic, tool interfaces, data flows, architecture, evaluation procedures, and runbooks for sustainable operation.
Requirements
Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role. Practical experience with LLM applications and AI Agents, ideally with RAG, Agent Orchestration, Tool Calling, and productive deployment. Very good knowledge of Python as well as API integration, automated tests, code reviews, and modular software development. Profound experience with Databricks, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog.
Good knowledge of the Microsoft Azure platform, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking. Experience with agent and LLM frameworks, for example LangGraph, LangChain, or Semantic Kernel, and stateful workflows. Practical experience with GitLab CI/CD for testing, versioning, and automated deployment of AI applications. Practical experience with Terraform (Infrastructure as Code) for the deployment of Azure and Databricks resources. Solid understanding of LLMOps, Agent Evaluation, and Observability, including systematic quality controls.
Knowledge in AI Security, Data Protection, and Governance, secure model access, guardrails, and the protection of sensitive information. Ability to deploy AI Agents productively, reliably, and scalably and to translate business requirements into robust solutions.
Project details
Cologne.
asap.
- Start: flexible
- Location: DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on interlance.de