Full job descriptionData Engineer - Data Migration Programme | London (Hybrid) | Contract - up to £500/d (outside IR35)
Are you a Data Engineer with hands-on experience delivering enterprise data migration solutions? Our client - a fast-scaling European digital infrastructure provider with 100+ sites across the continent - is looking for a Data Engineer to join a major transformation programme consolidating multiple operational systems into a single target platform.
You’ll be at the centre of the migration workstream: building the pipelines, transformation logic, and validation frameworks that move data from legacy systems into the new target operating platform - working closely with the Data Workstream Lead, business SMEs, and application teams.
What you’ll be doing:
*Designing and building ETL/ingestion pipelines using Microsoft Fabric (Data Factory, Pipelines, Lakehouse, Notebooks) or equivalent Azure tooling
*Implementing source-to-target mappings and transformation logic for the migration
*Owning data validation, reconciliation, and defect resolution through migration test cycles
*Building reusable migration frameworks - ingestion pipelines, validation routines, error-handling
*Supporting CI/CD, Git-based release processes via Azure DevOps
What you’ll bring:
*Extensive data engineering/integration/migration experience
*Hands-on Azure Data Factory, Fabric Data Factory, or Synapse Pipelines
*Strong SQL - profiling, transformation, validation, reconciliation
*PySpark/Spark SQL notebook experience (Databricks or Fabric)
*Proven experience on a data migration project end-to-end (extraction through reconciliation)
*Microsoft Fabric experience is a bonus, not a requirement - strong Azure Databricks/Synapse background welcomed
Nice to have: Microsoft Purview, Delta Lake/medallion architecture, Key Vault/Managed Identities, Azure DE Associate or Databricks certification.