Required skills
- AI Engineering
- Machine Learning Engineering
- Software Engineering
- LLM Applications
- AI Agents
- RAG
- Agent Orchestration
- Tool Calling
- Python
- API Integration
- Automated Testing
- Code Review
- Modular Software Development
- Databricks
- MLflow
- Mosaic AI
- Model Serving
- Vector Search
- Unity Catalog
- Microsoft Azure
- Azure OpenAI
- Managed Identities
- Key Vault
- Storage
- Networking
- LangGraph
- LangChain
- Semantic Kernel
- GitLab CI/CD
- Terraform
Languages: German
Job description
The client is seeking an AI Engineer to design, develop, and deploy intelligent AI Agents on Databricks and Azure, focusing on LLMOps, Cloud Architecture, and integrating enterprise data with Large Language Models.
Project overview
Our client is a nationwide company based in the greater Cologne area, offering comprehensive solutions from a single source and known for quality, fair prices, and flexibility.
The scope of work involves the conception, development, and productive deployment of intelligent AI Agents on Databricks and Azure – securely, transparently, and scalably.
This includes AI Engineering LLMOps and Cloud Architecture, as well as the realization of agent-based applications to connect enterprise data, Large Language Models, and internal systems in collaboration with a cross-functional team.
Scope of Work:
- Conception, development, and operation of productive AI Agent solutions on Databricks and Azure – from the initial prototype to scalable deployment.
- Development of AI agents and multi-agent workflows for the targeted connection of Large Language Models, enterprise data, APIs, and internal systems.
- Implementation of RAG, Tool Calling, and Agent Orchestration, as well as development of reusable tools, prompts, and state and context components.
- Integration of Azure OpenAI and other Foundation Models into Databricks and existing application and data landscapes.
- Development of Python-based agent services and APIs, and their integration into existing backend and cloud architectures.
- Use of Databricks Mosaic AI, Model Serving, and MLflow for versioning, evaluation, deployment, and monitoring of models and agents.
- Implementation of Vector Search, Embeddings, and Retrieval Pipelines for controlled access to relevant enterprise data.
- Orchestration of agent, data, and automation processes with Databricks Workflows and defined tool access.
- Automation of deployment with GitLab CI/CD and Terraform, including reproducible environments, tests, and traceable releases.
- Development of evaluations, tracing, and monitoring for response quality, groundedness, security, latency, cost, and reliability.
- Establishment of guardrails, authorization concepts, and Human-in-the-Loop processes for the responsible use of AI Agents.
- Ensuring security and governance with Unity Catalog, Managed Identities, Key Vault, RBAC, Private Endpoints, and Logging.
- Close collaboration with Product Owners, business departments, Data, Backend, and Cloud teams, as well as Security and Privacy on productive agent use cases.
- Documentation of agent logic, tool interfaces, data flows, architecture, evaluation methods, and runbooks for sustainable operation.
Requirements
- Several years of experience as an AI Engineer, Machine Learning Engineer, Software Engineer, or in a comparable technical role.
- Practical experience with LLM applications and AI Agents, ideally with RAG, agent orchestration, tool calling, and productive deployment.
- Very good knowledge of Python, as well as API integration, automated tests, code reviews, and modular software development.
- Profound experience with Databricks, for example with MLflow, Mosaic AI, Model Serving, Vector Search, and Unity Catalog.
- Good knowledge of the Microsoft Azure platform, especially Azure OpenAI, Managed Identities, Key Vault, Storage, and Networking.
- Experience with agent and LLM frameworks, for example LangGraph, LangChain, or Semantic Kernel, and stateful workflows.
- Practical experience with GitLab CI/CD for testing, versioning, and automated deployment of AI applications.
- Practical experience with Terraform (Infrastructure as Code) for the deployment of Azure and Databricks resources.
- Solid understanding of LLMOps, Agent Evaluation, and Observability, including systematic quality controls.
- Knowledge of AI Security, Data Protection, and Governance, secure model access, guardrails, and the protection of sensitive information.
- Ability to deploy AI Agents productively, reliably, and scalably, and to translate business requirements into robust solutions.
- Knowledge of the Model Context Protocol (MCP) and patterns for multi-agent or agent-to-agent communication.
- Experience with FastAPI, Docker, and Kubernetes for operating containerized agent services and APIs.
- Knowledge of Spark, SQL, Delta Lake, and Databricks Workflows for data preparation and AI-driven processes.
- Experience with Human-in-the-Loop, structured outputs, and controlled rollouts for AI applications.
- Experience in regulated or data-privacy-sensitive corporate environments.
Project details
- Start: ab sofort
- Duration: 12 Monate
- Remote: hybrid
- Location: Köln, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE