Full job description

We’re seeking an experienced Senior Data Engineer to join a leading global organisation on a contract basis, helping to design and deliver scalable, enterprise-grade data solutions.
This role will focus on building and optimising modern data platforms using Python, Databricks and Spark, enabling advanced analytics, reporting and data-driven innovation across the business.




Client Details


Our client is a leading international financial institution with a long-established presence across major global markets. Serving a diverse client base that includes corporates, financial institutions and investors, the organisation delivers a broad range of banking, financing and capital markets services.
With significant investment in digital transformation and data-led innovation, the organisation is modernising its technology estate and expanding its enterprise data capabilities. Data plays a critical role in supporting business operations, regulatory obligations, analytics and strategic decision-making, making this an exciting opportunity to contribute to large-scale, business-critical data initiatives within a complex global environment.




Description


*Design, build and maintain scalable data pipelines using Python and Databricks
*Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake
*Create robust data models and data architectures within modern Lakehouse environments
*Implement and manage data workflows across the Databricks ecosystem
*Ensure data quality, governance, reliability and performance across platforms
*Optimise distributed data processing workloads at scale
*Collaborate closely with data scientists, analysts and stakeholders to support analytics and machine learning initiatives
*Implement monitoring, logging and alerting capabilities across data solutions
*Champion engineering best practices and mentor less experienced team members


Profile


You will bring:
*10+ years’ experience in Data Engineering
*Experience delivering data engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments.
*Strong hands-on expertise in Python
*Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake
*Strong knowledge of Apache Spark / PySpark
*Experience designing and delivering large-scale ETL/ELT pipelines
*Advanced SQL skills and experience with relational databases
*Experience working with cloud technologies such as AWS, Azure or GCP
*Knowledge of modern data warehousing platforms such as Snowflake, Redshift or BigQuery
*Understanding of data modelling principles and Lakehouse architecture
*Excellent communication, stakeholder management and problem-solving skills
Desirable experience includes:
*Databricks certifications
*Streaming technologies such as Kafka or Structured Streaming
*CI/CD and DevOps practices
*Docker and Kubernetes
*Exposure to machine learning pipelines


Job Offer


*Competitive day rate of £550-£880 Inside IR35 (Umbrella)
*Initial 6-month contract
*Hybrid working model with flexibility
*Opportunity to work on cutting-edge data engineering projects
*Exposure to modern cloud and data technologies
*Collaborative and high-performing engineering environment
*Chance to make a tangible impact on enterprise-scale data transformation initiatives