Director of Data Engineering: AI & Data Platforms

Location: London (Hybrid – 1–2 days per week onsite)

Salary: Up to £140,000 + equity & benefits

Reports to: CTO

Overview of the Role

This is a rare opportunity to shape and lead the evolution of a next-generation, AI-native data platform within a high-growth, well-funded scale-up.

As Director of Data Engineering, you will operate at the intersection of strategy and execution partnering closely with the CTO to define the long-term architecture, build a high-performing team, and transition the organisation from a traditional data platform to an agentic, AI-driven ecosystem.

You will inherit a capable team, but more importantly, you will define its future: how it scales, what it builds, and where it leverages external innovation. This role combines hands-on technical leadership (circa 50%) with team and organisational leadership (circa 50%), making it ideal for a builder-leader who thrives on both architecture and people.

Key Responsibilities

Strategic Leadership & Platform Vision

• Partner with the CTO to define and execute the AI and data platform strategy, including critical build vs buy decisions
• Establish a clear approach to partner vs upskill, ensuring the team leverages external innovation while building core internal capability
• Shape the long-term vision for an agentic, AI-native data ecosystem

AI-Driven Data Platform Development

• Lead the design of a unified AI search layer, combining vector, keyword, and graph-based approaches (e.g. GraphRAG)
• Architect and scale agent-based systems and human-in-the-loop workflows
• Oversee the development of a knowledge graph and data enrichment pipelines to unlock proprietary data value
• Drive AI/ML Ops maturity, including LLM deployment, RAG pipelines, and evaluation frameworks

Engineering & Architecture

• Define scalable, cloud-native architectures across GCP (preferred) and AWS
• Lead cross-cloud data orchestration, ensuring seamless data flow from ingestion to intelligence layers
• Guide technical decisions on tooling, frameworks, and platform evolution

Team Leadership & Growth

• Lead and develop a team of data and AI engineers, including senior and staff-level contributors
• Build a culture of engineering excellence, accountability, and continuous improvement
• Hire, mentor, and scale the team in line with business growth

Delivery & Impact

• Ensure engineering effort is focused on high-value, domain-specific problems
• Improve velocity through modern engineering practices and AI-assisted development
• Balance innovation with pragmatism, avoiding unnecessary reinvention while maintaining competitive advantage

Key Requirements

Leadership & Experience

• Proven experience as a Director or Senior Engineering Manager leading data/platform teams
• Strong track record of scaling teams and mentoring engineers (typically 5+ years in leadership roles)
• Comfortable operating in a hands-on leadership capacity

Data Platform & Cloud Expertise

• Experience building and scaling high-volume data platforms
• Strong knowledge of GCP (BigQuery preferred) and exposure to AWS
• Expertise in data pipelines, distributed processing, and Python-based data services

AI & Emerging Technologies

• Exposure to or strong interest in agentic systems, LLMs, and AI-driven architectures
• Experience with AI search (vector databases, hybrid search, GraphRAG) is highly desirable
• Familiarity with knowledge graphs, ontologies, or complex data modelling

Strategic & Commercial Thinking

• Experience making build vs buy and technology investment decisions
• Ability to evaluate and integrate third-party tools, platforms, and partnerships
• Strong alignment with business outcomes, not just technical delivery

Additional Information

• Working Pattern: Hybrid (1–2 days per week in London office)
• Salary: Up to £140,000 + equity + benefits (private healthcare, pension)
• Team Size: ~4–5 engineers currently, scaling further
• Career Progression: Clear path towards VP Engineering / CTO
• Environment:
• Stable, well-funded scale-up (not early-stage chaos)
• Highly unique, proprietary datasets
• Strong investment in modern AI tooling and practices

Interview Process (3 Stages)

1. Introductory conversation with senior leadership
2. Technical/design interview (architecture-focused)
3. Final interview with executive stakeholders (in-person)

This role is ideal for a senior engineering leader who wants to build, shape, and scale—not just maintain. If you’re motivated by cutting-edge AI, complex data challenges, and genuine strategic influence, this is an opportunity to make a lasting impact.