Required skills
- Python
- LLM
- GenAI
- RAG
- Hybrid Search
- LangChain
- LangGraph
- MCP
- FastAPI
- PostgreSQL
- pgvector
- AWS
- Docker
- Terraform
- CI/CD
- Monitoring
- Observability
- Prompt Engineering
- Backend Development
- API Development
Languages: German
Job description
Develop and operate production-ready LLM and GenAI applications using Python as a Senior AI Engineer and Architect. Focus on enterprise RAG systems, agent-based workflows, and LLMOps.
Project overview
Conception, development, and operation of production-ready LLM and GenAI applications with Python in the role of Senior AI Engineer and Architect. Development of enterprise RAG systems with hybrid search (BM25 and embeddings), cross-encoder reranking, and source-based answers with citations. Conception and development of agent-based, multi-stage workflows with LangChain/LangGraph and MCP, including persistent workflow execution (Restate) as well as deterministic error handling and recovery mechanisms.
Implementation of structured outputs and security mechanisms (Guardrails) with Pydantic, circuit breakers, retries, and dead-letter queues to ensure robustness. Building LLMOps and quality assurance processes with automated regression and evaluation suites (LangFuse Golden Datasets, latency baselines) as release criteria for deployments, as well as LLM tracing, monitoring, and observability (Grafana, Loki, Prometheus). Development of backends with FastAPI and PostgreSQL/pgvector as well as deployment of containerized services on AWS with Docker, Terraform, and CI/CD pipelines.
Ensuring long-term maintainability through Clean Architecture, clear module boundaries, static code analyses, and automated quality checks, including for AI-generated code. Independent and remote-first working style, consulting stakeholders, and documenting architectural decisions.
Requirements
Proven professional experience as a Senior AI Engineer or Architect in Python-based development of LLM and GenAI applications, including RAG (hybrid search, reranking, vector databases), prompt engineering, and agent-based workflows with LangChain/LangGraph and MCP. Very good knowledge in backend and API development (FastAPI, REST/GraphQL, PostgreSQL/pgvector, Pydantic, SQLAlchemy) as well as sound knowledge in TypeScript/React. Practical experience with LLMOps and evaluation (LangFuse, regression tests, Golden Datasets) as well as monitoring and observability (Grafana, Loki, Prometheus).
Practical experience with DevOps technologies and processes, especially AWS, Docker, Terraform, Linux, and CI/CD, as well as software testing (pytest, integration, E2E, performance, and security tests). Sound knowledge in software architecture (C4, UML, Design Patterns), Clean Code, static code analysis (SonarQube), as well as data architecture and data governance. Experience with agile methods (Scrum, Kanban). Experience with self-hosted LLMs and data sovereignty requirements is an advantage.
Remote, from now until 03/31/2027.
Project details
- Start: flexible
- Remote: remote
- Location: DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on interlance.de