Data Engineer

New Today

Data Engineer for a major offshore wind project in The United Kingdom
Responsibilities
Design and implement scalable ingestion pipelines from multiple source systems including and internal business data sources. * Ensure reliable, automated, and monitored data flows into the Bronze layer of the Medallion architecture. * Work within clients existing security framework to establish compliant connectivity to operational data sources. * Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL. * Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery * Support the ML/Data Scientist in preparing clean, structured datasets for anomaly detection and asset performance modelling. * Contribute to technical documentation and ensure pipelines are maintainable and transferable. * Stay current on Databricks and Azure platform developments relevant to the stack. * Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap evolves.
Experience * Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical field. * Professional certifications in Azure, Databricks preferred * Training or background in energy systems, renewable energy, offshore wind or BESS technologies is a strong plus. * 4-7 years of hands-on data engineering experience in a cloud environment. * Demonstrated experience delivering production pipelines on Databricks and Azure (ADLS Gen2, ADF or equivalent). * Proven ability to implement Medallion architecture or equivalent layered data modelling patterns. * Experience with REST API ingestion and integration of business systems (ERP, finance tools). * Experience in a contractor or project-based delivery model preferred. * Exposure to OT/SCADA environments or energy sector data. * Exposure to MLOps workflows or collaboration with data science teams
Apply
Location:
City Of London, London
Job Type:
FullTime
Category:
Other

We found some similar jobs based on your search