Full job descriptionCRO / AI Experimentation Engineer Contract
6-month minimum contract, Outside IR35, £350-450 Day Rate, August Start Date, London.
This is an opportunity to shape how AI-powered products are measured, tested and optimised in a live commercial environment. You will take ownership of experimentation delivery across AI-native customer experiences, ensuring every product change is assessed against meaningful business outcomes such as conversion, containment and customer satisfaction.
The Company
They are a data and technology-led organisation delivering AI-powered digital products alongside an established web estate. Their teams are investing heavily in conversational AI, recommendation engines and LLM-driven customer experiences. As they expand their experimentation capability, they are looking for a hands-on specialist who can bridge traditional optimisation practices with AI-native product development.
The Role and Deliverables
*Build, instrument and deliver experiments across live digital and AI-powered products
*Extend and manage feature flagging capabilities across the product estate using LaunchDarkly or a comparable platform
*Configure, validate and troubleshoot experiment tracking, analytics instrumentation and event collection
*Define and review event schemas, data layer specifications and tracking requirements, including experiment exposure and AI-related metadata
*Work closely with analytics and senior stakeholders to evaluate the commercial impact of product and AI changes
*Support experimentation across conversational agents, AI advisors and LLM-powered decisioning experiences
Your Skills & Experience
*Strong hands-on experience delivering experiments in production environments, including implementation, debugging and live releases
*Practical experience with LaunchDarkly or a comparable feature flag management platform
*Working knowledge of experimentation platforms such as Adobe Target, Optimizely, or similar tools
*Experience working with AI or LLM-powered products, conversational interfaces or intelligent customer journeys
*Strong understanding of analytics implementation, event tracking, data layers and experimentation measurement
*Ability to operate independently in a remote, cross-functional environment
*Exposure to Microsoft Azure, Azure AI services, prompt engineering, API integrations or agent orchestration is beneficial
*Familiarity with AI architectures such as RAG, tool usage or multi-agent workflows is advantageous
*Experience within telecoms, e-commerce or subscription-based digital products is a plus
*A commercially focused mindset, with the ability to assess success through customer and business outcomes rather than technical delivery alone
How to Apply
If you have a track record of delivering experimentation programmes and optimising AI-powered customer experiences in production environments, please apply with your latest CV.