Lead Azure Databricks Engineer in London
2 Days Old
Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.
We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.
Job Description
Lead Azure Databricks Engineer
\n
About the Role
\n
We are seeking a Lead Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics and next‑ engineering capabilities.
\n
This role requires strong experience working within the Lloyd's of London or wider London Market insurance environment, with the ability to deliver data solutions that meet strict regulatory, audit and operational standards.
\n
You will take ownership of designing, building and optimising large‑scale Azure data solutions, working closely with business and technical stakeholders to translate complex data challenges into secure, scalable and production‑ready platforms. You will help shape cloud data strategy, define engineering best practice and guide delivery across cross‑functional teams.
\n
Responsibilities
\n
\n
Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks
\n
Deliver reliable, high‑quality data pipelines
\n
Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit and data governance requirements
\n
Work with stakeholders to make sure solutions meet regulatory requirements.
\n
Promote best practices in engineering, automation and cloud design.
\n
Lead and mentor engineers, setting technical standards.
\n
Improve platform performance, resilience and cost efficiency.
\n
\n
Skills and Experience
\n
\n
Extensive engineering experience across Azure Data Services and Databricks in enterprise environments.
\n
Proven delivery experience within the Lloyd's of London or London Market insurance sector
\n
Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling.
\n
Strong Python, PySpark and Spark SQL capability
\n
Solid understanding of data governance
\n
Proven track record of ownership, delivery and operating effectively in fast‑paced environments.
\n
\n
What's on Offer
\n
\n
Salary of up to £95,000
\n
Performance related bonus scheme
\n
Hybrid working - Up to 3 days working from home
\n
Comprehensive benefits package
\n
\n
This is just a brief overview of the opportunity. To learn more, simply apply with your CV and we'll be in touch to discuss the role in more detail.
\n
Tenth Revolution Group are the go‑to recruiter for Data & AI roles in the UK, offering more opportunities nationwide than any other recruitment agency. We are proud sponsors of SQLBits, Power Platform World Tour and the London Fabric User Group.
If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.
- Location:
- London
- Job Type:
- FullTime