Required skills
- Python
- Databricks
- Microsoft Azure
- Azure OpenAI
- AI Agent Development
- RAG
- Agent Orchestration
- Tool Calling
- LangGraph
- LangChain
- Semantic Kernel
- MLflow
- Mosaic AI
- Model Serving
- Vector Search
- Unity Catalog
- GitLab CI/CD
- Terraform
- LLMOps
- Agent Evaluation
- Observability
- AI Security
- Data Protection
- Governance
- Guardrails
Languages: German
Job description
Experienced AI Engineer needed for a project focusing on AI Agents on Databricks and Azure, involving RAG, tool calling, and agent orchestration.
Project overview
For a demanding project, we are looking for an experienced AI Engineer with in-depth knowledge of Python, Microsoft Azure, and Azure Databricks.
Responsibilities
Requirements / Must-have
Desirable Knowledge
Framework Conditions
If interested, please send your current CV and your current hourly rate.
- Conception, development, and operation of productive AI agent solutions on Databricks and Azure – from prototype to scalable deployment
- Development of AI agents and multi-agent workflows with RAG, tool calling, and agent orchestration
- Integration of Azure OpenAI and other foundation models into Databricks and existing application landscapes
- Vector search, embeddings, and retrieval pipelines for controlled access to company data
- Use of Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring
- Evaluations, tracing, and monitoring for response quality, groundedness, security, latency, and costs
- Guardrails, authorization concepts, and human-in-the-loop; security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, and Private Endpoints
- Automated deployment with GitLab CI/CD and Terraform; documentation of agent logic, architecture, and runbooks
- Several years of experience as an AI Engineer, ML Engineer, or Software Engineer
- Practical experience with LLM applications and AI agents, ideally with RAG, agent orchestration, tool calling, and productive deployment
- Very good knowledge of Python, API integration, automated tests, and code reviews
- In-depth Databricks experience (e.g., MLflow, Mosaic AI, Model Serving, Vector Search, Unity Catalog)
- Good Azure knowledge, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking
- Experience with agent and LLM frameworks such as LangGraph, LangChain, or Semantic Kernel, as well as stateful workflows
- Practice with GitLab CI/CD and Terraform
- Solid understanding of LLMOps, agent evaluation, and observability
- Knowledge of AI security, data protection, governance, and guardrails
- Model Context Protocol (MCP), multi-agent or agent-to-agent communication
- FastAPI, Docker, Kubernetes
- Spark, SQL, Delta Lake, Databricks Workflows
- Human-in-the-loop, structured outputs, controlled rollouts
- Experience in regulated or data-privacy-sensitive environments
- Start: asap
- Duration: until the end of 2027, option for extension
- Utilization: 100%
- Location: Cologne, up to 50% remote by arrangement
- Project Language: German
Project details
- Start: ab sofort
- Duration: 12 Monate
- Remote: hybrid
- Location: Köln, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE