Data DevOps Engineer
Are you passionate about building scalable, reliable data infrastructure in the cloud? Join our innovative team as a Data DevOps Engineer and play a pivotal role in transforming how data powers decision-making and operational excellence. This is your chance to work at the forefront of cloud-native data architecture, ensuring seamless deployment, management, and optimization of large-scale analytics solutions that drive impactful insights and business growth.
Compensation: £85,000 p/a
Work Model: 3 days on site per week in Watford
What You’ll Do:
*Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services.
*Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases.
*Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation tools.
*Manage data provisioning workflows, environment freshness, and synchronization across development, testing, and production stages.
*Optimize data pipelines for performance, resource utilization, and cost efficiency while ensuring high reliability and scalability.
*Establish observability frameworks with CloudWatch, Grafana, or Datadog for proactive monitoring and troubleshooting.
*Collaborate with cross-functional teams to enhance deployment strategies, resolve technical issues, and implement best practices in security, compliance, and governance.
*Continuously explore innovative cloud services and tools to improve deployment speed, operational efficiency, and developer experience.
Required Skills:
*Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform).
*Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar.
*Strong scripting skills in Python for automation, logging, and observability integrations.
*Expertise in SQL, especially Redshift, and in managing large-scale data processing frameworks like Spark and EMR.
*Hands-on experience with containerization (Docker, Kubernetes).
*Professional certifications such as AWS Certified Solutions Architect and AWS Certified DevOps Engineer are highly desirable.
*Deep understanding of environment management, code promotion, deployment pipelines, and release management.
*Familiarity with Jira integrations and data provisioning automation.
Nice to Have Skills:
*Experience with Power BI, DAX, and data modeling for optimized reporting.
*Knowledge of big data orchestration tools like Apache Airflow.
*Previous exposure to regulated environments such as finance, healthcare, or gaming.
*Experience in a lottery or similar domain is a plus.
Preferred Education & Experience:
*Bachelor’s or Master’s degree in Computer Science, Data Analytics, or related field.
*Several years of professional experience in cloud data engineering, DevOps, or related roles.
Other Requirements:
*Ability to work within an agile team, managing multiple deliverables simultaneously.
*Strong troubleshooting skills and the ability to diagnose complex cloud-based issues.
*Commitment to security, compliance, and best practices in data governance.
Take the next step in your career—apply now and be part of a transformative journey to create a more innovative, reliable, and impactful data environment that makes a real difference!