Job description
Senior Data Engineer | Commodities Trading | 12 month outside IR35 contract | London
I'm working on an exciting opportunity for a Senior Data Engineer to join a leading global commodity trading organisation on a long-term, Outside IR35 contract in London.
This is an opportunity to work on a major technology programme at the heart of the trading business, building critical data infrastructure that enables traders and risk teams to access accurate, real-time and same-day trading P&L.
You'll be working across data engineering, market data and risk technology, with direct exposure to traders, quants, risk managers and senior engineering teams.
Key responsibilities:
- Design, build and own high-performance Python data pipelines supporting intraday and end-of-day P&L.
- Ingest and process market data, including settlement prices, broker marks and forward curves.
- Drive market data quality, identifying missing or incorrect prices before they impact trading and risk calculations.
- Orchestrate flash and end-of-day P&L runs using a risk engine.
- Reconcile P&L against trading desk and trader feeds, investigating discrepancies.
- Build and maintain scalable cloud-based services using AWS and Kubernetes.
- Contribute to engineering standards across testing, CI/CD, monitoring and automation.
Key experience required:
- Extensive commercial Python data engineering experience
- Hands-on experience with Apache Airflow or similar workflow orchestration tools.
- Understanding of commodity or financial market data, including futures, swaps, settlement prices and forward curves.
- Working knowledge of trading P&L, mark-to-market and P&L
- Strong SQL skills and experience with PostgreSQL, ClickHouse or similar databases.
- Experience supporting business-critical data processes within a front-office or risk environment.
Desirable experience:
- Open Source Risk Engine (ORE), QuantLib or similar valuation engines.
- Market data providers such as LSEG, Argus, Platts or ZEMA.
- AWS, Docker, Kubernetes, Kafka and CI/CD.