Quality Assurance Manager

New Yesterday

QA Manager - £650 outside IR35 - London (3 days per week in the office) - 6 month contract This is a six‑month contract role with an expectation of being in the office three days per week. La Fosse are currently supporting a leading organisation undergoing a major AI transformation, and they're looking for an Quality Assurance Manager to help shape and build their entire AI testing and evaluation framework from the ground up. This is a hands‑on contract role where you’ll define the standards, tools, and methods that ensure their AI products — including LLM-based tools, RAG systems, and third‑party AI platforms — are accurate, reliable, safe, and aligned to user needs. Key experience:
Strong background in testing/evaluating AI or software systems, ideally with NLP/LLM exposure Running hands‑on testing across prototypes, PoCs, and production tools Supporting vendor assessments and POCs with robust test protocols Understanding of prompt evaluation, semantic search, hallucination detection, bias analysis, and LLM behavioural nuances Experience with tools such as TruLens, HumanLoop, PromptLayer, or similar Knowledge of RAG pipelines, embeddings, modern AI architectures, and API integrations (OpenAI, Azure OpenAI, Anthropic, etc.) Ability to design structured test regimes in evolving, ambiguous environments Excellent communication skills and confidence working with both technical teams and business users Proven experience producing frameworks, documentation, and training materials for handover
#J-18808-Ljbffr
Apply
Location:
Greater London
Job Type:
FullTime

We found some similar jobs based on your search