Job description
- As a Data Engineer in our Data Architecture team, you’ll build and run the pipelines and platform components that keep the firm’s data secure, reliable and ready to use
- You’ll deliver agreed parts of our migration to Microsoft Fabric and help build the foundations for analytics, self-service reporting and AI
- You’ll work to shared standards alongside your colleagues, with direction on design and priorities from the Head of Data Architecture
- Build and run data pipelines and notebooks in Fabric, using Data Factory, Lakehouse, Python, PySpark and SQL
- Ingest data from our core systems, including Workday, Dynamics 365, Business World and SharePoint
- Build and maintain data structures in Fabric Warehouse and Lakehouse, and deliver documented, certified datasets for Power BI that analysts can reuse
- Prepare governed data for AI, including retrieval through RAG and MCP, and turn documents such as PDFs into structured, searchable form
- Apply our data classification, access control and co-mingling standards in everything you build, so client and firm data stay separate
- Move existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the way
- Use version control, CI/CD, automated testing and monitoring to keep your pipelines reliable, and fix root causes when issues arise
- Keep up to date with new Fabric features, document your work and share what you learn
- Success in this role looks like pipelines that run reliably, migration milestones met with no loss of data and no break in reporting, and certified datasets that analysts reuse. Colleagues should be able to build on your work because it is well documented
- We’ve set ambitious growth targets for the firm, and we need the right people to help us achieve these. We’re looking for people who will bring ambition and drive to their role. In changing markets, we need to be able to work at pace and be adaptable to change and to be curious, asking questions of ourselves, each other and our clients to ensure we are delivering the services and quality we expect
Benefits
- Income protection
- Matched pension
- Life cover
- Private medical, including anytime access to Doctor@Hand and Stronger Minds
- Professional subscriptions
- It would be great if you had some of the following skills, but don’t worry if you don’t tick every box, we’ll help you develop along the way:
- Experience in professional services or another regulated environment
- Ability to manage your own workload and communicate clearly with technical and non-technical colleagues
- Practical experience with Microsoft Fabric (Data Factory, Lakehouse, Warehouse and Notebooks) or Databricks
- Understanding of CI/CD pipelines for data solutions
- Exposure to processing unstructured data, such as PDFs and documents
- Working knowledge of Power BI and version control (for example Git / DevOps)
- An understanding of data modelling, warehousing and ETL/ELT principles
- Awareness of good practice in data governance, security and compliance
- Exposure to preparing data for AI use, for example RAG, vector databases or MCP
- Exposure to notebook-based platforms (Fabric / Databricks)
- Exposure to migrating from Azure Data Factory and Azure Data Lake to Fabric
- Exposure to data catalogue, lineage or classification tools
- Working proficiency in Python, PySpark and SQL for data engineering
- End Date: December 6, 2026
Is there something wrong with this job listing? Let us know.