Lead Data Platform Engineer

arrow

Edinburgh / £80000 - £85000 annum

INFO

Salary
SALARY:

£80000 - £85000

Location

LOCATION

Edinburgh

Job Type
JOB TYPE

Permanent

Lead Data Platform Engineer

UK Remote

Salary: £80,000 - £85,000

This is an opportunity to step into a highly influential Data Platform Engineering role where you will shape, optimise and own a modern Databricks Lakehouse environment. You will play a key role in driving engineering best practice, improving automation and enabling scalable data solutions across a growing data function.

The Company

They are a large, well‑established organisation known for combining deep technical expertise with a people‑first culture. With a nationwide presence and a modern approach to flexible working, they invest heavily in technology, innovation and colleague development. Their data function is expanding and plays a central role in supporting transformation, decision‑making and future AI initiatives. You will join a collaborative team that values engineering excellence, autonomy and continuous improvement.

The Role

As Lead Data Platform Engineer, you will:

* Develop and deploy Databricks Lakehouse platform solutions within Azure.

* Build and maintain automation for clusters, tagging, monitoring and platform operations.

* Architect and design end‑to‑end data platform solutions focused on scalability, security and reliability.

* Lead delivery using Databricks, PySpark, Spark SQL and Azure Data Factory.

* Drive DevOps best practices including CI/CD, automated testing and infrastructure as code.

* Collaborate closely with data engineers, ML engineers and wider technical teams to deliver robust platform capabilities.

* Take ownership of key data platform projects and influence engineering direction.

* Provide technical leadership and ensure standards, patterns and best practices are followed.

Your Skills and Experience

You will bring:

* Strong commercial experience in Azure and Databricks, with deep knowledge of Lakehouse architecture.

* Proficiency in PySpark, Python, SQL and Spark SQL.

* Strong DevOps engineering skills including CI/CD, automated testing and deployment pipelines.

* Experience with monitoring, logging and alerting solutions.

* Ability to design, build and optimise cloud platform solutions.

* Stakeholder management skills and confidence working across multiple teams.

* API development experience.

* Azure Data Factory knowledge is beneficial.

What They Offer

* Salary between £80,000 and £85,000 plus bonus.

* Comprehensive benefits package and annual pay review.

* Flexible by choice working environment with remote‑first culture.

* 35‑hour working week promoting genuine work‑life balance.

* Opportunities to shape platform strategy and contribute to future AI and automation initiatives.

How to Apply

If you are a strong Data Platform Engineer with deep Databricks expertise and want to take ownership of a modern Azure Lakehouse environment, please apply today.

CONTACT

Kai Qamar

Recruitment Consultant

SIMILAR
JOB RESULTS

4k-Harnham_DA copy
CAN’T FIND THE RIGHT OPPORTUNITY?

STILL
LOOKING?

If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.