Lead Data Engineer - Remote - AWS - Databricks - up to £110,000
I am working with a client specialising in AI-driven learning platform used by enterprise clients across the globe. They are scaling fast, innovating constantly, and they are investing heavily in data engineering as a core pillar of the business. This is the kind of environment where a strong engineer can genuinely influence direction, modernise the stack, and build things the right way.
If you want to lead real transformation, drive architectural decisions, and work in a company where data is at the heart.
Your work will include:
*Leading the adoption of Databricks and building a modern Lakehouse architecture.
*Designing and implementing AWS-native ETL pipelines using S3, Glue, Athena, Step Functions.
*Building scalable, ACID-compliant datasets using Apache Iceberg.
*Running cost-efficiency initiatives across Redshift and broader AWS services.
*Consolidating fragmented environments into a secure, multi-tenant data platform.
*Implementing automated data quality and validation workflows.
*Establishing platform-wide security baselines (encryption, deletion policies, access control).
*Working cross-functionally with product, sales, and operations teams to deliver high-value data products.
*Mentoring junior engineers and shaping the data engineering culture as the team grows.
Benefits
*Competitive salary + performance-aligned progression
*Hybrid working with flexibility around Cambridge HQ
*Opportunity to define and own the data engineering roadmap
*A collaborative, mission-driven team using cutting-edge tooling
*Exposure to AI-powered learning technologies and large-scale enterprise deployments
*Clear path for leadership and technical authority as the team expands
Key Experience
*5+ years in data engineering, including experience in a senior or lead position
*Strong expertise across AWS
*Hands-on experience with Databricks, PySpark, and Lakehouse patterns
*Strong Python and SQL engineering ability
*Experience implementing scalable ETL/ELT pipelines
*Background in data modelling and building analytics-ready datasets
*Understanding of security best practices and compliance-driven architecture
*Ability to influence, mentor, and collaborate with stakeholders across the business
Ready to take ownership and shape the future of data at a fast-growing AI company?
This is a high-impact role with real influence and roles at this level don’t stay open for long.
Apply now or send your CV directly!