Full job descriptionSanderson are working with a consulting client who are looking to grow their Data capability. The client is seeking candidates who have experience with pipeline development, architecture and deployment.


Key Responsibilities
Data Pipeline Development
*Build, optimize, and maintain scalable data pipelines using Java, plus exposure to Python, Flink, Kafka, or Spark.
*Develop and support real-time streaming pipelines and event-driven integrations.
*Integrate data from multiple sources using AWS managed services


Data Architecture & Standards
*Contribute to data modelling, data architecture best practices, and modern patterns
*Ensure data quality, lineage, governance, and security controls are applied consistently.


DevOps & Deployment
*Deploy and maintain data applications using CI/CD tooling
*Use Infrastructure as Code to manage cloud environments.
*Work with container technologies


Core Data Engineering
*Strong programming proficiency in Java or Python.
*Hands-on experience with at least one of: Kafka, Flink, Spark
*Solid understanding of stream processing concepts
*Understanding of software engineering best practices: testing, design patterns, CI/CD, Git.
*Experience building ETL/ELT or streaming data pipelines.
*Exposure to microservices and distributed system concepts.
*Experience working with cloud platforms
*Understanding of distributed compute, large-scale data systems, and performance considerations.


DevOps & Engineering Practices
*Experience with CI/CD tools
*Infrastructure-as-Code
*Experience with containerisation and orchestration platforms


This role will require you to be willing and eligible to undergo UK security clearance.


If you’re interested in the above, apply or reach out to