Lead Data Platform Engineer (Azure & Databricks) in Edinburgh
New Today
Energy Jobline is the largest and fastest growing global Energy Job Board and Energy Hub. We have an audience reach of over 7 million energy professionals, 400,000+ monthly advertised global energy and engineering jobs, and work with the leading energy companies worldwide.
We focus on the Oil & Gas, Renewables, Engineering, Power, and Nuclear markets as well as emerging technologies in EV, Battery, and Fusion. We are committed to ensuring that we offer the most exciting career opportunities from around the world for our jobseekers.
Job Description
LEAD DATA PLATFORM ENGINEER
£85,000 + BENEFITS
PRIMARILY REMOTE
This is a standout opportunity to take ownership of a modern data platform and drive the evolution of a Databricks-centric environment at scale.
THE COMPANY:
This client are a well-established organisation with a strong engineering culture and a growing Data and Machine Learning function. The team is collaborative, supportive and operates with solid engineering principles at its core. With flexible-by-choice working, a positive work-life balance and a commitment to technical excellence, this is an environment where you can make a visible impact while continuing to grow your expertise
THE ROLE:
You will focus on the design, build and optimisation of the Azure Databricks Lakehouse platform, ensuring it is scalable, secure and reliable. You will work closely with engineers and stakeholders across the business, providing technical leadership and taking ownership of key data platform initiatives.
Key responsibilities include:
Developing and deploying the Lakehouse platform in Azure.
Owning Databricks engineering, administration and platform optimisation.
Designing end-to-end data platform solutions
Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory.
Creating and maintaining CI/CD pipelines and automated testing frameworks.
Developing APIs to support integration
Implementing monitoring, logging and alerting for platform reliability.
YOUR SKILLS AND EXPERIENCE:
Deep expertise in Databricks, PySpark, Python and SQL.
Proven experience designing and delivering Lakehouse solutions.
Strong DevOps capabilities, including CI/CD and automated testing.
Experience with Infrastructure as Code and cloud automation.
Familiarity with monitoring, logging and alerting tools.
Strong stakeholder engagement and the ability to work across teams.
Experience with APIs and data integration methods.
Azure Data Factory experience is beneficial.
THE BENEFITS:
You will receive a salary, dependent on experience. Salary is up to £85,000 On top of the salary there are some fantastic extra benefits.
HOW TO APPLY
Please register your interest by sending your CV to Molly Bird via the apply link on this page.
If you are interested in applying for this job please press the Apply Button and follow the application process. Energy Jobline wishes you the very best of luck in your next career move.
- Location:
- Edinburgh
- Job Type:
- FullTime
- Category:
- Engineer, Data, Lead, Engineering, Oil And Gas