Full job description Senior Data Engineer for Investment Firm
The client, a leading global investment firm with a strong focus on technology and systematic strategies, is seeking an experienced Data Engineer to join their expanding London office. The role is a Senior Data Engineer set to join a team responsible for building a research-facing data platform that supports systematic trading and electronic market-making. The platform is designed to make market and reference data consistent, traceable, and easy to use at scale while working directly with Quants and Traders.
Senior Data Engineer Responsibilities
*Build and evolve a cloud-native data platform supporting research and trading workflows
*Develop and maintain Python-first data pipelines and access layers for large-scale datasets
*Design and standardise datasets across asset classes, ensuring consistency and usability
*Implement and improve data lineage, freshness tracking, and metadata systems
*Work with columnar data processing tools (e.g. PyArrow, Polars) for efficient data handling
*Collaborate closely with Quants and Researchers to improve how data is consumed and used
*Continuously enhance a pragmatic, production data environment, balancing performance, reliability, and maintainability
*Take ownership of systems end-to-end, from ingestion through to consumption
Key Requirements
*5+ years’ experience building data platforms or data infrastructure
*Strong Python and SQL skills (Python-first engineering environment)
*Experience with data modelling, schema design, and dataset standardisation
*Hands-on experience with cloud environments (ideally AWS)
*Experience working with large-scale, real-world datasets in production
*Familiarity with workflow orchestration tools (e.g. Airflow)
*Exposure to columnar data processing (e.g. PyArrow, Polars, Spark)