Senior Data Engineer
London Area • Permanent • Competitive

Senior Data Engineer

New Easy Apply
London Area On-site Permanent 27 Applications
Competitive
Full-time
Posted 21 Nov 2026
Expires 21 Dec 2026

Job description

Senior Data Engineer | Commodities Trading | 12 month outside IR35 contract | London


I'm working on an exciting opportunity for a Senior Data Engineer to join a leading global commodity trading organisation on a long-term, Outside IR35 contract in London.


This is an opportunity to work on a major technology programme at the heart of the trading business, building critical data infrastructure that enables traders and risk teams to access accurate, real-time and same-day trading P&L.


You'll be working across data engineering, market data and risk technology, with direct exposure to traders, quants, risk managers and senior engineering teams.


Key responsibilities:

  • Design, build and own high-performance Python data pipelines supporting intraday and end-of-day P&L.
  • Ingest and process market data, including settlement prices, broker marks and forward curves.
  • Drive market data quality, identifying missing or incorrect prices before they impact trading and risk calculations.
  • Orchestrate flash and end-of-day P&L runs using a risk engine.
  • Reconcile P&L against trading desk and trader feeds, investigating discrepancies.
  • Build and maintain scalable cloud-based services using AWS and Kubernetes.
  • Contribute to engineering standards across testing, CI/CD, monitoring and automation.


Key experience required:

  • Extensive commercial Python data engineering experience
  • Hands-on experience with Apache Airflow or similar workflow orchestration tools.
  • Understanding of commodity or financial market data, including futures, swaps, settlement prices and forward curves.
  • Working knowledge of trading P&L, mark-to-market and P&L
  • Strong SQL skills and experience with PostgreSQL, ClickHouse or similar databases.
  • Experience supporting business-critical data processes within a front-office or risk environment.


Desirable experience:

  • Open Source Risk Engine (ORE), QuantLib or similar valuation engines.
  • Market data providers such as LSEG, Argus, Platts or ZEMA.
  • AWS, Docker, Kubernetes, Kafka and CI/CD.
Is there something wrong with this job listing? Let us know.