Westhouse Job: AI Test Agent Architect

Project overview

Westhouse is one of the leading recruitment companies for the placement of highly qualified specialists from the entire IT lifecycle and engineering sector.

For our client, we are currently looking for an

AI Test Agent Architect

Framework Information

Reference:180494

Responsibilities

• You will transform existing QA processes: requirements analysis, test case derivation, reviews, and approvals into AI-supported workflows.
• You will conceptualize and develop AI agents that check requirement documents for consistency, completeness, and testability, and are able to derive an ISTQB-compliant test strategy, test planning, as well as manual and automated test cases from them.
• We will define QA architecture, standards, and evaluation criteria together.
• You will integrate the solutions into the existing toolchain (Java, Spring Boot, Maven, GitLab CI).
• You will contribute to the quality assurance of the company-critical applications and processes (UKV) of the sales platform.
• What makes the position special:
• What is created here goes into the productive development process of the sales platform.
• We will define the architecture, standards, and evaluation criteria together.
• From prototype to team deployment takes weeks, not quarters.
• A grown and proven QA foundation with a central Quality Gate mechanism, pipeline metrics, and existing test automation.

Project details

Frankfurt

Start Date:16.11.2026

Working Hours:Full-time

Your Qualifications

• You have at least 3 years of experience in software testing, test management, or test automation, ideally evidenced by an ISTQB certification.
• You have already brought at least one LLM-powered application into production. This includes prompt and context design, integration with existing systems, and a robust methodology for measurably evaluating result quality.
• You develop confidently in Java (Spring Boot, Maven) and work routinely with GitLab and CI/CD pipelines.
• You are familiar with process modeling and have a very structured way of working.
• You have fluent German language skills, both written and spoken (at least C1).
• You have successfully completed a degree in computer science or have a comparable qualification with relevant professional experience.
• Desirable:
• You have knowledge of data protection, the EU AI Act, and responsible AI usage.
• You have experience with software architecture in an enterprise environment and with microservices.
• You have experience in test management: test strategies for functional and non-functional tests, test plans, risk control, and management-level reporting.
• You have experience with Spring AI.
• You have experience with Scrum and/or SAFe.
• You have experience with Business Process Management (BPM).
• You have experience in project and stakeholder management.
• Further Skills and Characteristics
• Required:
• Critical Thinking: You evaluate AI results skeptically and back up your assessment instead of accepting outputs.
• Ability to Abstract: You recognize recurring patterns in processes and translate them into generalizable solutions.
• Explanatory Skill: You can make people without a technical background understand how Agent Skills, RAG, MCP, or A2A work, and describe how path dependency affects agent networks.
• You have high self-motivation to independently drive and optimize topics within the team.
• You are strong in communication and can professionally justify and defend your position.
• You have strong analytical problem-solving skills.
• You work in a team-oriented manner and know how to achieve goals together.
• Passion for quality assurance. You see QA as a design task, not a control instance.
• Start: 2026-11
• Duration: 24 Monate
• Remote: hybrid
• Location: Frankfurt, Deutschland, DE
• Languages: German