AI Evaluation Engineer
other jobs TXP Technology x People
Added before 3 Days
- England,London,City of London
- Full Time, Contract
- £700 - £750 per day
Job Description:
Full job descriptionAI Evaluation Engineer
Rate / Duration / Location£700-£750/day Inside IR35 | Duration: 4 months | Clearance: BPSS + SC eligible | Location: London, Bristol or Manchester | Hybrid: 2 days onsite per week.
OverviewWe’re looking for an experienced AI Evaluation Engineer to join a specialist Public Sector Technology team. This hands-on role focuses on building evaluation frameworks, tooling and harnesses for AI systems, particularly LLM and agentic AI solutions. The role requires ownership, experimentation and rapid delivery.
Key Responsibilities*Design evaluation frameworks and tooling
*Develop evaluation harnesses
*Evaluate model and agentic AI systems
*Define metrics and methodologies
*Build repeatable evaluation processes
*Investigate AI failures
*Work directly with government teams
*Prototype and test solutions
*Present findings and recommendations
*Contribute to strategic direction.
What We Are Looking For*Strong software engineering experience
*Experience building and evaluating AI systems
*Understanding of LLMs and agentic AI
*Experience with AI evaluation frameworks
*Ability to code independently
*Strong problem-solving and communication skills
*Comfortable working autonomously.
Technical ExperienceAI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration.
Ideal BackgroundAI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer or Software Engineer specialising in AI.
TeamSmall Public Sector Technology team of approximately 2 to 6 people within a wider organisation.
What Will Make Someone Stand OutExperience building evaluation tooling, evaluating LLMs, using Ragas, identifying AI failure modes, combining engineering with strategic thinking, and thriving in fast-moving environments.
SummaryHands-on AI Evaluation Engineer role supporting government AI initiatives through evaluation, testing, benchmarking and framework development.
Rate / Duration / Location£700-£750/day Inside IR35 | Duration: 4 months | Clearance: BPSS + SC eligible | Location: London, Bristol or Manchester | Hybrid: 2 days onsite per week.
OverviewWe’re looking for an experienced AI Evaluation Engineer to join a specialist Public Sector Technology team. This hands-on role focuses on building evaluation frameworks, tooling and harnesses for AI systems, particularly LLM and agentic AI solutions. The role requires ownership, experimentation and rapid delivery.
Key Responsibilities*Design evaluation frameworks and tooling
*Develop evaluation harnesses
*Evaluate model and agentic AI systems
*Define metrics and methodologies
*Build repeatable evaluation processes
*Investigate AI failures
*Work directly with government teams
*Prototype and test solutions
*Present findings and recommendations
*Contribute to strategic direction.
What We Are Looking For*Strong software engineering experience
*Experience building and evaluating AI systems
*Understanding of LLMs and agentic AI
*Experience with AI evaluation frameworks
*Ability to code independently
*Strong problem-solving and communication skills
*Comfortable working autonomously.
Technical ExperienceAI/LLM Evaluation, RAG Evaluation, Ragas, Agentic AI Evaluation, Evaluation Harnesses, LLM Testing and Benchmarking, Prompt Engineering, Python Development, Model and Agent Integration.
Ideal BackgroundAI Evaluation Engineer, Applied AI Engineer, AI Engineer, LLM Engineer, Harness Engineer, Prompt Engineer or Software Engineer specialising in AI.
TeamSmall Public Sector Technology team of approximately 2 to 6 people within a wider organisation.
What Will Make Someone Stand OutExperience building evaluation tooling, evaluating LLMs, using Ragas, identifying AI failure modes, combining engineering with strategic thinking, and thriving in fast-moving environments.
SummaryHands-on AI Evaluation Engineer role supporting government AI initiatives through evaluation, testing, benchmarking and framework development.
Job number 4057376
Increase your exposure to recruiters with ProJobs
Thousands of recruiters are looking for you in the Job Master profile database, increase your exposure 4 times with a ProJob subscription
You can cancel your subscription at any time.
metapel
Company Details:
TXP Technology x People
Company size: 50–99 employees
Industry: Recruitment Consultancy
Accelerate your career with TXPTXP doesn’t just match you to a job; we align you with roles that fit your career trajectory, from tech trainee t...