Required skills
- AI
- Machine Learning
- Generative AI
- LLM
- RAG
- Test Automation
- CI/CD
- Azure DevOps
- GitHub
- C#
- Vue.js
- Quality Assurance
Languages: French
Job description
Our client, a large audit and consulting firm, is looking for a QA specialist to design, develop, and improve AI agents for test design and scripting. You will define and implement the qualification strategy for AI solutions and integrate tests into CI/CD pipelines.
Project overview
Our client is a large audit and consulting firm. It develops and operates internally about fifteen application products in C# .NET / Vue.js on Microsoft Azure, intended for its Audit, Advisory, and support functions.
Your missions
- Design, develop, and improve AI agents for test design and scripting: generation of test cases, scenarios, and automated scripts
- Define and implement the qualification strategy for AI solutions (LLM, RAG, agents)
- Implement evaluation methods adapted to generative AI:
- reference test sets
- quality metrics (relevance, fidelity, hallucinations)
- non-regression of prompts and models
- Secure the transition from POC to product: acceptance criteria, robustness, security (prompt injection, data leakage), performance, and cost control
- Integrate tests into CI/CD pipelines (Azure DevOps / GitHub)
- Support product teams on quality best practices applied to AI
Project details
- Start: flexible
- Remote: hybrid
- Location: 92400 Courbevoie, France, FR
- Rate: 69-69 EUR/h
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on collective.work