Full job descriptionTest Engineer (Data & Automation)
Overview
We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams.
This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms.
Key Responsibilities
*Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage
*Analyse and interpret test results, identifying risks, issues, and areas for improvement
*Produce clear reports on testing activities, outcomes, and associated risks
*Automate data validation and application testing processes across distributed systems
*Investigate production issues using data analysis to identify root causes
*Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures
*Validate data using tools such as Jupyter Notebooks and Amazon Athena
*Analyse data across multiple formats to ensure integrity and correctness of new functionality
*Support CI/CD practices using Git-based workflows and pipeline automation
*Participate in infrastructure and deployment activities, including containerisation and Infrastructure as Code
*Collaborate with cross-functional teams to translate business requirements into testable solutions
*Mentor and guide team members on testing methodologies and best practices
Key Skills & Experience
Technical Skills
*Proficiency in Python, SQL, and at least one additional programming language (e.g., Java)
*Experience with scripting languages such as Bash
*Strong understanding of automated testing frameworks and methodologies
*Hands-on experience with Apache Airflow and log analysis
*Familiarity with data processing tools such as Apache Spark
*Experience working with cloud platforms and services, including:*Monitoring and logging tools
*Storage and data services
*Compute and container services

*Experience with CI/CD pipelines and version control systems (e.g., GitLab)
*Knowledge of Infrastructure as Code (e.g., Terraform)
*Familiarity with Docker and containerised environments
Data & Analytics
*Strong data analysis skills, including working with structured and semi-structured data
*Experience validating and querying data using tools such as Athena and notebooks
*Understanding of data modelling concepts, including dimensional models and slowly changing dimensions
*Ability to generate realistic test data for various scenarios
Additional Knowledge
*Understanding of distributed data platforms and big data environments (e.g., EMR)
*Knowledge of encryption principles (client-side and server-side)
*Awareness of production system monitoring and incident analysis
Soft Skills
*Strong analytical and problem-solving abilities
*Excellent communication skills, with the ability to present findings clearly
*Proactive approach to identifying and mitigating risks
*Ability to mentor and support less experienced team members
*Collaborative mindset with experience working in agile delivery environments
Working Arrangements
*UK-based role with flexible location
*Occasional travel required for team collaboration sessions and workshops