Senior Data Engineer
London Area • Permanent • Competitive

Senior Data Engineer

New Easy Apply
London Area Remote Permanent 20 Applications
Competitive
Full-time
Posted 18 Nov 2026
Expires 18 Dec 2026

Job description

🚀 Senior Data Engineer (Azure Databricks) | Largely Remote, London | Up to £75,000


I'm working with an established, growing SaaS business in the healthcare technology space that is looking to bring in a Senior Data Engineer to take ownership of its Azure Databricks data platform.

The business develops software used by thousands of healthcare and practice-based organisations across the UK, supporting sectors including primary care, dentistry, veterinary and pharmacy.

Following a period of significant growth and multiple acquisitions, the business is investing in its data infrastructure, with a key focus on consolidating its existing product ecosystem and building out a modern Lakehouse architecture using Databricks.


The opportunity

This is a hands-on role with a genuine level of autonomy. You'll become the technical owner of the Databricks platform, taking responsibility for its ongoing development, performance and scalability.

You'll be working closely with the wider Engineering and Platform teams, helping shape the direction of the data platform rather than simply delivering against an existing technical roadmap.

Your responsibilities will include:

  • Taking ownership of the Azure Databricks data platform and its ongoing development.
  • Designing, building and optimising scalable data pipelines using Python, PySpark and SQL.
  • Developing ingestion layers to bring data together from multiple internal platforms and external sources.
  • Building and maintaining Lakehouse architecture, working with Delta Lake and Unity Catalog.
  • Improving data quality, governance, reliability and performance across production workloads.
  • Contributing to technical decisions and improving engineering practices, including CI/CD, automated testing and deployment.
  • Working with stakeholders across Engineering to turn business requirements into effective data solutions.


What we're looking for:

  • Strong commercial experience with Azure Databricks in a production environment.
  • Excellent Python, PySpark and SQL skills.
  • Experience with Delta Lake, Unity Catalog and Lakehouse architecture.
  • A solid understanding of data ingestion, transformation, orchestration and modelling.
  • Experience building and maintaining production data pipelines.
  • Someone comfortable working independently, taking ownership and driving technical improvements.

Experience with Azure Data Lake Storage, Azure DevOps, Terraform and Databricks Asset Bundles would also be beneficial.


Why consider this opportunity?

  • Largely remote position in London (Sponsorship not offered)
  • Salary up to £75,000.
  • Genuine technical ownership and autonomy.
  • The opportunity to shape and develop an evolving Databricks platform.
  • Exposure to a significant data consolidation and Lakehouse initiative.
  • A collaborative engineering environment with opportunities to explore AI-assisted development tools.
  • Quarterly team workshops, bringing colleagues together in person for a few days (travel expenses covered).


This would suit a Senior Data Engineer who enjoys solving problems, building things properly and having a tangible influence on the technology they work with.

Interested in hearing more?

Drop me a message or apply directly, I'd be happy to share further details!

#DataEngineering #Databricks #Azure #PySpark #Python #SQL #Hiring

Is there something wrong with this job listing? Let us know.