Skip to content
Job boardOpen

AI Engineer - AI Agents & Deployment Databricks

Original title: AI Engineer (m/w/d) - AI Agents & Deployment Databricks

Confidential · Germany · Senior

  • Germany
  • German

Indexed (2 days ago) · refreshed constantly

Start
flexible
Contract
Freelance / B2B
Seniority
Senior
Reference
51955

Required skills

Nice to have:Large Language Models (LLMs)AI AgentsStateful WorkflowsHuman-in-the-loop

Languages: German

Job description

Develop and operate productive AI agent solutions on Databricks and Azure, from prototype to scalable deployment. Implement AI agents and multi-agent workflows connecting LLMs, enterprise data, and APIs.

Project overview

Conception, development, and operation of productive AI agent solutions on Databricks and Azure – from the initial prototype to scalable deployment. Development of AI agents and multi-agent workflows for the targeted connection of Large Language Models, enterprise data, APIs, and internal systems. Implementation of RAG, Tool Calling, and Agent Orchestration, as well as development of reusable tools, prompts, and state and context components. Integration of Azure OpenAI and other Foundation Models into Databricks as well as into existing application and data landscapes.

Development of Python-based agent services and APIs and their integration into existing backend and cloud architectures. Use of Databricks Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring of models and agents. Implementation of Vector Search, Embeddings, and Retrieval Pipelines for controlled access to relevant enterprise data. Orchestration of agent, data, and automation processes with Databricks Workflows and defined tool access. Automation of deployment with GitLab CI/CD and Terraform, including reproducible environments, tests, and traceable releases.

Development of evaluations, tracing, and monitoring for response quality, groundedness, security, latency, cost, and reliability. Establishment of guardrails, authorization concepts, and human-in-the-loop processes for the responsible use of AI Agents. Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and Logging. Close collaboration with Product Owners, business departments, Data, Backend, and Cloud teams, as well as Security and Privacy on productive agent use cases.

Documentation of agent logic, tool interfaces, data flows, architecture, evaluation procedures, and runbooks for sustainable operation.

Requirements

Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role. Practical experience with LLM applications and AI Agents, ideally with RAG, Agent Orchestration, Tool Calling, and productive deployment. Very good knowledge of Python as well as API integration, automated tests, code reviews, and modular software development. Profound experience with Databricks, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog.

Good knowledge of the Microsoft Azure platform, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking. Experience with agent and LLM frameworks, for example LangGraph, LangChain, or Semantic Kernel, and stateful workflows. Practical experience with GitLab CI/CD for testing, versioning, and automated deployment of AI applications. Practical experience with Terraform (Infrastructure as Code) for the deployment of Azure and Databricks resources. Solid understanding of LLMOps, Agent Evaluation, and Observability, including systematic quality controls.

Knowledge in AI Security, Data Protection, and Governance, secure model access, guardrails, and the protection of sensitive information. Ability to deploy AI Agents productively, reliably, and scalably and to translate business requirements into robust solutions.

Project details

Cologne.

asap.

  • Start: flexible
  • Location: DE
  • Languages: German

Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing

Found on interlance.de

  1. Job boardNew

    Lead Engineer Eagle Eye

    Harvey Nash Netherlands· Den Bosch, Noord-Brabant, Netherlands· Hybrid· SENIOR

    • Software Development
    • Architecture
    • Data Observability
    • +9

  2. JobServeNew

    AI Forward Engineer

    William Alexander Recruitment Ltd· Greater London, UK· Hybrid· Senior· £88–100 / h

    • AI Application Development
    • Software Engineering
    • AI System Integration
    • +1

  3. Job boardNew

    AI Agent Engineer

    Be in IT to butikowa firma rekrutacyjna IT.· Wrocław, Śródmieście, Poland· Hybrid· SENIOR· zł 70–90 / h

    • Software Engineering
    • Python
    • AI
    • +9

Browse all jobs
Sign up free to apply