Data Architect (Databricks SME)

Location - Derby (1/2 days a month)

Type - Contract (End of the year - likely to extend)

Role Overview:

I'm looking for a Databricks Specialist with strong experience in the Azure ecosystem to help design, build, and optimise a scalable data platform. This role combines hands-on development with architecture, governance, and team support to ensure a high-performing and secure environment. The role reports to a project delivery lead and works closely with internal technical teams.

Key Responsibilities:

• Design and implement Databricks Lakehouse architecture (Delta Lake, Unity Catalog, etc.)
• Develop ETL/ELT pipelines using Spark, Python, SQL, and Databricks workflows
• Integrate with Azure services and BI tools (e.g., Power BI)
• Optimise performance and support CI/CD and MLOps pipelines
• Enable knowledge transfer through code reviews, training, and reusable templates

Key Skills:

• In-depth experience with Databricks (Delta Lake, Unity Catalog, Lakehouse architecture).
• Strong knowledge of Azure services (e.g. Data Lake, Data Factory, Synapse).
• Solid hands-on skills in Spark, Python, PySpark, and SQL.
• Understanding of data modelling, governance, and BI integration.
• Familiarity with CI/CD, Git, and Infrastructure as Code (e.g. Terraform).
• Excellent communication and mentoring skills.

Desirable:

• Experience with Qlik or similar BI tools.
• Strong data analysis and SQL abilities.

If this sounds like something you are interested in, please get in contact: thomas.deakin@spgresourcing.com SPG Resourcing is an equal opportunities employer and is committed to fostering an inclusive workplace which values and benefits from the diversity of the workforce we hire. We offer reasonable accommodation at every stage of the application and interview process.