Senior Data Engineer
other jobs True North Group
Added before 3 Days
- England,North East,Tyne and Wear,Newcastle upon Tyne
- Full Time, Permanent
- £70,000 - £75,000 per annum
Job Description:
Full job descriptionSenior Data Engineer
Location: 100% Remote (UK-based)
Employment Type: Permanent
Salary: Up to £75,000
Positions Available: 2
The Opportunity
We’re looking for two experienced Senior Data Engineers to join a growing data platform team delivering modern cloud-native data solutions at scale.
This role is ideal for self-starters who enjoy autonomy, ownership, and solving complex engineering challenges within a highly collaborative environment.
The core technology stack is Databricks on AWS, and candidates must have strong hands-on experience specifically with Databricks deployed in AWS environments. Experience with Databricks on other cloud platforms alone will not be sufficient, as the implementation approach and tooling differ significantly.
You’ll play a key role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark
• Build and optimise Delta Lake architectures and data pipelines on AWS
• Implement ingestion frameworks using Databricks Autoloader
• Develop transformation workflows using Lakeflow / Delta Live Tables
• Work with Data Asset Bundles for deployment and environment management
• Support CI/CD and infrastructure automation across the data platform
• Ensure data quality, governance, lineage, and observability best practices
• Optimise cluster performance, orchestration, and cost efficiency
• Collaborate with architects, analysts, and wider engineering teams
• Contribute to platform standards, reusable frameworks, and engineering best practices
Essential Skills & Experience
• Strong commercial experience as a Senior Data Engineer
• Proven expertise with Databricks on AWS (essential)
• Strong understanding of Spark, Delta Lake, and Lakehouse architecture
• Hands-on experience with Databricks Autoloader and Lakeflow / DLT
• Experience using Data Asset Bundles within Databricks environments
• Strong AWS experience across modern cloud-native data platforms
• Good understanding of the full data engineering lifecycle
• Experience building scalable, maintainable, and production-grade data solutions
• Strong communication and stakeholder engagement skills
• Comfortable working independently with high levels of ownership and autonomy
Nice to Have
• CI/CD and Infrastructure as Code experience
• Experience with governance and metadata tooling
• Exposure to data observability and monitoring frameworks
• Previous experience working in fast-paced agile delivery environments
This is an excellent opportunity to join a modern engineering environment where you’ll have genuine influence over platform direction, architecture, and engineering standards.
Location: 100% Remote (UK-based)
Employment Type: Permanent
Salary: Up to £75,000
Positions Available: 2
The Opportunity
We’re looking for two experienced Senior Data Engineers to join a growing data platform team delivering modern cloud-native data solutions at scale.
This role is ideal for self-starters who enjoy autonomy, ownership, and solving complex engineering challenges within a highly collaborative environment.
The core technology stack is Databricks on AWS, and candidates must have strong hands-on experience specifically with Databricks deployed in AWS environments. Experience with Databricks on other cloud platforms alone will not be sufficient, as the implementation approach and tooling differ significantly.
You’ll play a key role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark
• Build and optimise Delta Lake architectures and data pipelines on AWS
• Implement ingestion frameworks using Databricks Autoloader
• Develop transformation workflows using Lakeflow / Delta Live Tables
• Work with Data Asset Bundles for deployment and environment management
• Support CI/CD and infrastructure automation across the data platform
• Ensure data quality, governance, lineage, and observability best practices
• Optimise cluster performance, orchestration, and cost efficiency
• Collaborate with architects, analysts, and wider engineering teams
• Contribute to platform standards, reusable frameworks, and engineering best practices
Essential Skills & Experience
• Strong commercial experience as a Senior Data Engineer
• Proven expertise with Databricks on AWS (essential)
• Strong understanding of Spark, Delta Lake, and Lakehouse architecture
• Hands-on experience with Databricks Autoloader and Lakeflow / DLT
• Experience using Data Asset Bundles within Databricks environments
• Strong AWS experience across modern cloud-native data platforms
• Good understanding of the full data engineering lifecycle
• Experience building scalable, maintainable, and production-grade data solutions
• Strong communication and stakeholder engagement skills
• Comfortable working independently with high levels of ownership and autonomy
Nice to Have
• CI/CD and Infrastructure as Code experience
• Experience with governance and metadata tooling
• Exposure to data observability and monitoring frameworks
• Previous experience working in fast-paced agile delivery environments
This is an excellent opportunity to join a modern engineering environment where you’ll have genuine influence over platform direction, architecture, and engineering standards.
Job number 3729051
Increase your exposure to recruiters with ProJobs
Thousands of recruiters are looking for you in the Job Master profile database, increase your exposure 4 times with a ProJob subscription
You can cancel your subscription at any time.