DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
Senior Fullstack Software Engineer
Cambridge
$150000 - $180000
+ Data Engineering
PermanentCambridge, Massachusetts
To Apply for this Job Click Here
Senior Fullstack Software Engineer
Location: Cambridge, MA (Hybrid) – 3 Days Onsite
Compensation: Up to $180,000 Base + Equity
If you’re excited by the opportunity to build technology that directly improves patient outcomes, this is a chance to join an early-stage healthcare AI business at a pivotal stage of growth. You’ll work across the full stack, helping to shape a patient-facing platform that combines clinical data, AI-driven insights, and intuitive user experiences to support long-term care and recovery.
The Company
This fast-growing healthcare technology startup is transforming how patients are supported beyond treatment by combining artificial intelligence, clinical data, and modern care delivery workflows. Backed by significant investment and operating at the intersection of healthcare, data, and product innovation, they are building technology that enables more personalised and proactive patient care.
With a lean, highly collaborative engineering team, the organisation offers the opportunity to make a visible impact, influence technical decisions, and take ownership of major product initiatives from an early stage.
The Role
As a Senior Fullstack Software Engineer, you will play a key role in building and scaling patient-facing applications and the underlying platform that powers them.
Key responsibilities include:
- Designing, building, and shipping full-stack product features across web and mobile applications
- Developing backend services and APIs that support patient workflows and clinical operations
- Creating intuitive frontend experiences using modern React-based technologies
- Integrating healthcare and clinical data systems into product workflows
- Building AI-enabled functionality including intelligent recommendations and workflow automation
- Collaborating closely with product, design, clinical, and engineering stakeholders
- Contributing to architecture decisions and platform scalability
- Taking ownership of features from concept through deployment and ongoing optimisation
Your Skills & Experience
You will bring:
- Strong commercial experience as a Fullstack Engineer delivering production software
- Expertise with Python and Django backend development
- Strong frontend development experience using React
- Experience building and shipping customer-facing products at scale
- Strong API design and systems integration knowledge
- Experience working within regulated or complex data environments
- Ability to operate independently in a fast-paced, high-growth environment
- Strong stakeholder communication and product collaboration skills
Desirable experience includes:
- Healthcare, healthtech, telehealth, or EMR integration experience
- Mobile application development experience
- Exposure to AI products, LLM integrations, or intelligent workflow systems
- Experience working with patient-facing digital products
What They Offer
- Opportunity to work on meaningful healthcare challenges with real-world impact
- High levels of ownership and autonomy
- Exposure to AI, healthcare data, and product engineering at scale
- Clear progression opportunities as the engineering function grows
- Collaborative, product-led culture with direct influence over technical direction
- Hybrid working environment with flexibility for the right candidate
How to Apply
To learn more about this opportunity, apply today with your latest CV for a confidential discussion!

To Apply for this Job Click Here
Director of Engineering
Boston
$250000 - $270000
+ Data Engineering
PermanentBoston, Massachusetts
To Apply for this Job Click Here
Director of Engineering
Location: Cambridge, MA (Hybrid, 4 days onsite)
Compensation: $250,000 to $270,000 base + 20% bonus + equity
This is an opportunity to join a well-funded HealthTech startup at a pivotal stage of growth. As Director of Engineering, you will play a key role in building the engineering organisation, shaping technical strategy, and scaling products that have the potential to improve healthcare outcomes through the application of machine learning and clinical data.
The Company
They are a venture-backed technology company operating at the intersection of healthcare, machine learning, and real-world data. Their mission is to improve how complex diseases are detected, monitored, and understood through innovative technology and data-driven insights.
Having secured significant early-stage funding, they are now scaling their platform, team, and engineering capabilities. This is a rare opportunity to join at a formative stage and directly influence the company’s technical foundations, culture, and long-term success.
The Role
As Director of Engineering, you will combine hands-on technical leadership with people management and delivery ownership. Working closely with senior leadership, Product, and Engineering teams, you will help create the processes, systems, and culture needed to support continued growth.
Key responsibilities include:
- Lead, mentor, and develop a high-performing engineering team
- Manage engineering delivery, sprint planning, backlog prioritisation, and execution
- Partner with Product and technical stakeholders to deliver scalable solutions
- Contribute directly to production code and complex engineering initiatives
- Architect and evolve backend systems, cloud infrastructure, and application platforms
- Establish best practices across CI/CD, testing, observability, and engineering operations
- Drive engineering standards, technical quality, and continuous improvement
- Support hiring, team growth, and organisational scaling initiatives
- Champion pragmatic adoption of AI-assisted development workflows
- Help build a collaborative and high-performing engineering culture
Your Skills & Experience
- Strong commercial experience leading software engineering teams
- Proven people management and coaching experience within engineering environments
- Excellent hands-on software development capabilities
- Strong Python development experience
- Experience building scalable backend systems and distributed applications
- Expertise with cloud platforms such as AWS or GCP
- Experience implementing and improving CI/CD pipelines and deployment practices
- Background working in startup or high-growth technology environments
- Strong understanding of engineering execution, delivery management, and technical decision making
- Ability to collaborate effectively across Engineering, Product, and leadership teams
Desirable experience:
- Healthcare, HealthTech, biotech, or regulated industry experience
- Experience with HIPAA, SOC2, or similar compliance frameworks
- Exposure to clinical data platforms or healthcare data systems
- React or React Native development experience
- Experience with AI products, AI agents, or AI-assisted software development
- Infrastructure or platform engineering expertise
What They Offer
- Opportunity to build and scale an engineering organisation from an early stage
- Direct access to executive leadership and strategic decision making
- Significant technical ownership and influence
- Clear progression opportunities as the company grows
- Hybrid working model based in Cambridge, MA
How to Apply
If you’re an experienced engineering leader who enjoys combining hands-on technical contribution with team leadership in a high-growth environment, apply today to learn more about this opportunity.

To Apply for this Job Click Here
Data Engineer
London
£40000 - £50000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
DATA ENGINEER
UP TO £50,000
LONDON
This is an exciting opportunity for a Data Engineer to join a technology-driven organisation. You’ll have the chance to build modern data platforms from the ground up, support AI-focused initiatives, and work across a range of high-profile client projects. You’ll play a key role in shaping the future of the data engineering capability.
THE COMPANY
Our client is a well-established organisation operating at the intersection of data, technology and customer experience. They partner with a range of global brands to deliver innovative, data-led solutions across analytics, marketing and digital transformation. You’ll join a collaborative team working closely with Data Science and business stakeholders to solve complex data challenges.
THE ROLE
Responsibilities include but are not limited to:
- Build and maintain modern data platforms and scalable data pipelines
- Develop cloud-based data solutions
- Support AI-enabled initiatives and emerging data products
- Help establish engineering best practices
- Support data modelling, reporting and analytics requirements
YOUR SKILLS AND EXPERIENCE:
- Strong commercial experience with Python, SQL and cloud-based data platforms is essential
- Experience in marketing, advertising or media sectors is highly desirable
- Strong communication skills and ability to engage with stakeholders
- Experience with Snowflake, Microsoft Fabric and/or BigQuery is highly desirable
SALARY AND BENEFITS
- Up to £50,000 base salary
- Contributory pension scheme
HOW TO APPLY
Please register your interest to Mia Randhawa by sending your CV through the ‘Apply’ link

To Apply for this Job Click Here
Kafka Data Governance Contractor
London
£500 - £650
+ Data Engineering
ContractLondon
To Apply for this Job Click Here
Data Governance Contractor – Streaming Schema Governance
London | Outside IR35
This is an opportunity to play a key role in a major data transformation programme focused on establishing and embedding Kafka schema governance at scale. You will help shape governance frameworks, drive stakeholder alignment, and ensure robust controls are implemented across a complex streaming data environment. [Data
The Company
A leading financial services organisation currently building and scaling its enterprise event-streaming capability. As part of a major data transformation programme, the business is implementing Kafka schema governance from the ground up, creating the standards, controls and operating processes needed to support a large-scale Kafka estate of over 300 topics within a regulated environment.
The Role and Deliverables
- Establish and operate a Kafka schema governance framework covering schema quality, nullability, and lifecycle management.
- Facilitate agreement and ratification of schema governance rules, topic taxonomies, and operating standards.
- Define governance processes, including schema review gates, change control, exception management, and ownership models.
- Support onboarding and adoption of the governance framework through stakeholder engagement and guidance.
- Lead assessment and remediation activities across an existing Kafka estate, including schema compliance reviews and prioritisation of issues.
- Drive schema version governance, deprecation processes, and consumer migration activities through to completion.
Your Skills & Experience
- Strong experience delivering data governance or cloud governance programmes.
- Must-have experience with Kafka, including schema governance, schema registry, and data contract concepts.
- Experience working with Confluent Kafka, Avro, or comparable schema management technologies.
- Ability to translate governance, regulatory, or policy requirements into technical controls and operating frameworks.
- Strong stakeholder management skills with the ability to influence governance, architecture, engineering, and business teams.
- Experience producing governance documentation, process design, and audit-ready evidence.
How to Apply
If you have strong Kafka and Data Governance experience and are interested in a high-impact contract opportunity, please apply with your latest CV.

To Apply for this Job Click Here
Data Platform Engineer
Newcastle upon Tyne
£73000 - £84000
+ Data Engineering
PermanentNewcastle upon Tyne, Tyne and Wear
To Apply for this Job Click Here
Data Platform Engineer
£73,000 – £84,000
Newcastle (2 days a week in office)
This is an opportunity to join a well-established international organisation investing heavily in its enterprise data capabilities. You will play a key role in maintaining and evolving a modern cloud-based data platform built on Microsoft Azure technologies, ensuring it remains secure, reliable, and ready to support business-critical data initiatives.
THE COMPANY
They are a globally recognised professional services organisation with a large international footprint and a strong focus on innovation and technology. Their data platform underpins strategic decision-making across multiple business functions and regions. With significant investment in cloud, data, and engineering capabilities, they are building a robust, scalable environment that supports long-term growth. They foster a collaborative culture where technical expertise, continuous improvement, and knowledge sharing are highly valued.
THE ROLE
As a Data Platform Engineer, you will take ownership of the operational health and reliability of a modern Azure-based data platform.
Specifically, you can expect to be involved in the following:
- Providing L2/L3 support across Microsoft Fabric, Azure Databricks, and associated Azure services
- Monitoring platform performance, availability, resilience, and utilisation
- Investigating and resolving incidents, problems, and service requests through established ITSM processes
- Supporting major incident response and root cause analysis activities
- Managing platform administration, operational checks, and environment maintenance
- Supporting change, release, and deployment processes through CI/CD pipelines
- Maintaining monitoring, alerting, logging, dashboards, and observability solutions
- Ensuring platform changes meet operational readiness and governance requirements before release
- Collaborating with architecture, infrastructure, security, and business stakeholders
- Developing runbooks, technical documentation, operational procedures, and knowledge articles
- Supporting governance, security, compliance, and access control activities
- Driving continuous improvement across platform operations and support processes
SKILLS AND EXPERIENCE
The successful Data Platform Engineer will have the following skills and experience:
- Strong commercial experience supporting cloud-based data platforms in production environments
- Experience with Microsoft Fabric, Azure Databricks, or similar modern data platform technologies
- Strong understanding of Azure services including Key Vault, Azure Monitor, Log Analytics, Entra ID, and secure networking concepts
- Experience managing incidents, problems, changes, and releases within an ITSM framework
- Familiarity with ServiceNow or similar service management tools
- Experience with monitoring, logging, diagnostics, and operational reporting
- Knowledge of Azure DevOps, Git, CI/CD pipelines, and release automation
- Working knowledge of scripting and automation using PowerShell, Python, or similar technologies
- Exposure to Infrastructure as Code tools such as Terraform
- Understanding of data governance, security controls, audit requirements, and compliance within regulated environments
- Ability to produce high-quality technical documentation and operational procedures
BENEFITS
The successful Data Platform Engineer will receive the following benefits:
- Salary between £70,000 – £90,000 – depending on experience
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

To Apply for this Job Click Here
Software Engineer
Dallas
$190000 - $225000
+ Data Engineering
PermanentDallas, Texas
To Apply for this Job Click Here
Software Engineer
$190,000 – $225,000 + 20% bonus
Multiple US Cities (4 days a week in office)
This is an opportunity to join a highly visible innovation team building AI-enabled products that directly influence major investment decisions. You’ll work on greenfield technology, partner closely with senior stakeholders, and help shape the future of predictive analytics within a data-rich business environment.
THE COMPANY
They are a large, established organisation operating at significant scale across the United States, with a strong focus on technology, data, and innovation. Their teams are investing heavily in AI, machine learning, and predictive analytics to transform how business decisions are made. The innovation function operates with the agility of a start-up while benefiting from the resources and backing of a large enterprise. You will join a collaborative team of software engineers, data scientists, and AI specialists working on high-impact products used by senior business leaders.
THE ROLE
As a Software Engineer, you will join a high-impact AI and predictive analytics team building a greenfield investment platform, combining Python, React and machine learning to influence multi-billion-dollar business decisions in a start-up environment backed by a major enterprise.
Specifically, you can expect to be involved in the following:
- Build and enhance a full-stack investment analytics platform used by key business stakeholders.
- Develop scalable backend services using Python and modern frontend applications using React and TypeScript.
- Design and implement AI-enabled workflows, tools, and integrations that improve decision-making processes.
- Partner closely with Product, Design, Data Science, and business teams to identify problems and deliver solutions.
- Contribute to architectural decisions and help establish best practices for a growing engineering function.
- Surface machine learning and predictive analytics insights through intuitive user experiences.
- Improve development processes, testing frameworks, and deployment pipelines.
- Work in a fast-paced environment where you can take ownership from concept through to production.
SKILLS AND EXPERIENCE
The successful Software Engineer will have the following skills and experience:
- Strong commercial experience in full-stack software engineering.
- Expertise in Python with experience building scalable backend systems and APIs.
- Strong frontend development experience with React, JavaScript, or TypeScript.
- Experience building production-ready software in start-up, scale-up, fintech, or technology-led environments.
- Exposure to AI, machine learning, LLM applications, AI agents, or predictive analytics products.
- Experience delivering greenfield or 0-to-1 product development initiatives.
- Ability to balance technical excellence with product thinking and business impact.
- Strong stakeholder management and communication skills.
- Experience with cloud platforms such as Azure or AWS.
- Exposure to machine learning frameworks such as TensorFlow, Scikit-learn, or similar is beneficial.
BENEFITS
The successful Software Engineer will receive the following benefits:
- Salary between $190,000 – $225,000 – depending on experience
- Annual bonus of up to 20%
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

To Apply for this Job Click Here
Principal Data Engineer
London
£90000 - £110000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Principal Data Engineer
£90,000 – £110,000
London, Harmondsworth (3 days a week in office)
This is an opportunity to join a large-scale organisation undergoing an exciting transformation of its data capabilities. You’ll play a key role in shaping engineering standards, influencing technical direction, and leading the delivery of business-critical data products within a modern cloud environment.
THE COMPANY
They are a well-established UK organisation investing heavily in their data and technology landscape. Operating within a federated data model, they have embedded data teams across the business to drive innovation and commercial impact. Their engineering teams work with complex, high-volume datasets that directly support key business decisions and outcomes. You’ll join a collaborative environment where technical excellence, continuous improvement, and knowledge sharing are actively encouraged. This is a role with genuine influence and visibility across the wider organisation.
THE ROLE
As a Principal Data Engineer, you will combine hands-on engineering with technical leadership, people management, and stakeholder engagement.
Specifically, you can expect to be involved in the following:
- Providing technical leadership across Data Engineering, Software Engineering, and DevOps practices
- Building, improving, and maintaining scalable data platforms and pipelines
- Working closely with engineering teams to establish best practices, standards, and delivery frameworks
- Troubleshooting complex technical challenges and helping unblock delivery teams
- Leading, coaching, and mentoring engineers to support their professional development
- Driving continuous improvement across data products, tooling, and engineering processes
- Collaborating with senior stakeholders to align technical solutions with business objectives
- Supporting the ongoing evolution of a modern cloud-based data ecosystem using AWS, Snowflake, and dbt
- Contributing to the operation, monitoring, optimisation, and reliability of production data systems
SKILLS AND EXPERIENCE
The successful Principal Data Engineer will have the following skills and experience:
- Strong commercial experience in Data Engineering and modern software engineering practices
- Expertise working with AWS cloud services
- Experience building and scaling solutions within Snowflake
- Strong knowledge of dbt and modern data transformation methodologies
- Excellent SQL and data modelling capabilities
- Experience with CI/CD, DevOps practices, testing, monitoring, and operational support
- Ability to lead technical discussions and influence engineering decisions across teams
- Experience managing, coaching, or mentoring engineers
- Strong stakeholder management and communication skills
- Ability to thrive within large, complex organisational environments
BENEFITS
The successful Principal Data Engineer will receive the following benefits:
- Salary between £90,000 – £110,000 – depending on experience
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

To Apply for this Job Click Here
Senior Data Platform Engineer
Los Angeles
$160000 - $200000
+ Data Engineering
PermanentLos Angeles, California
To Apply for this Job Click Here
Senior Data Platform Engineer
Location: Los Angeles, CA
Salary: $160-200k base
We’re partnering with a fast-scaling, mission-driven advanced technology company building complex software and hardware systems deployed in real-world environments. Their platform processes and operationalizes high-volume data to power critical decision-making across the organization.
They are hiring a Senior Data Platform Engineer to design and scale the core data infrastructure that supports company-wide operations.
The Role
As a Senior Engineer on the Data Platform team, you will:
- Design and build scalable data pipelines and transformation frameworks
- Own ingestion and egress systems that unify multiple operational data sources
- Develop reliable, secure data models that power internal data products and applications
- Partner with engineering, product, and operations to translate business needs into production-grade systems
- Advocate for best practices across testing, CI/CD, data modeling, and security
- Debug and optimize complex transformation pipelines in production environments
What They’re Looking For
- 5+ years of experience in data engineering or backend engineering
- Strong programming skills in Python or similar languages
- Experience with Spark, PySpark, SQL, and dbt
- Familiarity with large-scale data platforms and cloud environments (AWS, Azure, or GCP)
- Experience with containerization and modern deployment practices
- Ability to operate autonomously in fast-moving environments
- Strong ownership mindset and attention to security best practices
- Must be a U.S. Person due to export-controlled information requirements
This is a high-impact role focused on building durable data systems that directly support operational execution at scale.

To Apply for this Job Click Here
Staff Data Engineer
San Francisco
$220000 - $300000
+ Data Engineering
PermanentSan Francisco, California
To Apply for this Job Click Here
Staff Data Engineer
San Francisco, CA
$240K-$300K base + equity
We’re partnered with one of the most recognized developer platforms in the world, trusted by engineering teams at OpenAI, Meta, Netflix, and Adobe, who are scaling their data platform and looking to hire a Senior Data Engineer to own the pipelines and foundations at the core of their data ecosystem.
You’ll own the full pipeline lifecycle, from ingestion architecture through to analytics-ready data, working closely with Data Platform Engineers and partnering with analysts and data scientists who depend on what you build every day.
What You’ll Do
- Design and build scalable ingestion pipelines and orchestration frameworks across structured, semi-structured, and event-based sources
- Own reliability, observability, and performance across the full pipeline lifecycle from raw ingestion to analytics-ready delivery
- Build and maintain dbt transformation pipelines serving as the single source of truth across Finance, Product, GTM, and Engineering
- Ensure revenue and billing data meets the accuracy and auditability required for public company reporting, including SOX compliance
- Apply software engineering principles throughout: CI/CD, testing, observability, version control, and automation
- Enable self-serve analytics through semantic layer development, strong abstractions, and clear documentation
- Champion data quality and governance across classification, ownership, access policies, and data lifecycle management
What We’re Looking For
- 8+ years in data engineering or a hybrid data/analytics engineering role, with a track record of owning pipelines end-to-end in high-growth or enterprise environments
- Advanced SQL and dbt (Core or Cloud), Snowflake or comparable cloud data warehouse, Python, and Airflow
- Deep experience with Kafka and streaming data systems, with strong working knowledge of ClickHouse, Iceberg, or similar technologies
- Experience with ingestion tools such as Fivetran, Airbyte, or Polytomic
- Cloud-native architecture expertise across AWS, GCP, or Azure
- Experience designing and scaling data systems to support petabyte-level workloads
- Track record of building data infrastructure that meets compliance and governance requirements, including SOX or equivalent
- Strong communication and collaboration skills, with the ability to operate as a senior technical voice across engineering and business stakeholders

To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
Is your organisation ready for AI? What leaders need to assess before investing
61% of people are using AI in their current roles, yet only 37% of companies report having…
How Much Does a Data Analyst Make in 2026?
Whether you’re starting your career as a Data Analyst or thinking about your next move, knowing what…
What Does a Data Engineer Do?
A Data Engineer builds and maintains the systems and pipelines that collect, store and prepare data for…
How to Become a Data Engineer
The more companies invest in AI, the more they need people who can make their data usable…
How Much Does a Data Scientist Make?
Data Scientist salaries vary considerably by location, experience, sector and technical expertise. In the UK, salaries commonly…
What Does a Data Scientist Do?
A Data Scientist turns data into decisions. They use statistical analysis and machine learning to find patterns,…
How Much Does a Data Engineer Make?
Data Engineers in the UK typically earn between £31,000 at junior level and £100,000+ in senior and…
How to Become a Data Scientist
Becoming a Data Scientist is one of the most education-led routes in technology. It usually starts with…
What Does an AI Engineer Do?
What Does an AI Engineer Do? Job Description, Responsibilities and Skills AI Engineers turn artificial intelligence from…
How Much Does an AI Engineer Make?
How Much Does an AI Engineer Make? AI Engineers are among the most sought-after technology professionals in…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals across the globe.
We understand the challenges our customers face and offer the
recruitment solutions needed to drive business success through Data & AI.









