DATA ENGINEERING
FOCUS
Specialist Focus Areas
At Harnham, we specialize in the following key areas within Data Engineering:
-
- Analytics Engineering: Bridging the gap between data engineering and data science to enable sophisticated analytics.
-
- Cloud Engineering: Developing and managing scalable cloud-based data solutions.
-
- Data & DevOps: Integrating data management with DevOps practices to streamline workflows and enhance productivity.
-
- Data Architecture: Designing and implementing the overall data framework and architecture for your organization.
-
- Data Engineering & Big Data: Handling large-scale data processing and building data pipelines.
-
- Data Platform Engineering: Creating and managing data platforms that support analytics and data science operations.
-
- Data Product Management: Overseeing the development and management of data products.
-
- DevOps Engineering: Combining software development and IT operations to improve deployment and efficiency.
-
- Platform Engineering: Building and maintaining the platforms that support data operations.
-
- Software Engineering: Developing software solutions that enhance data engineering capabilities.
JOBS
LATEST Data engineering
OPPORTUNITIES
With over 17 years of experience, Harnham has established itself as the leading global authority in Data and AI Recruitment
Front End Developer (React)
London
£70000 - £90000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Front end Developer
Location: London, Hybrid
Salary: Up to £90,000
We are looking for a skilled Frontend Developer to join our Acquisition Team, working on driving customer growth through various digital channels. This role involves collaborating with a cross-functional team to enhance web applications, optimize landing pages, and improve the overall user experience. If you’re passionate about building high-quality web applications and want to contribute to a dynamic team, this could be the perfect opportunity for you.
Key Responsibilities:
- Manage day-to-day development tasks, working closely with other team members to deliver new features and improvements.
- Implement best practices in software development such as CI/CD, code reviews, and testing.
- Maintain and support existing products, including resolving issues, refactoring code, and performing acceptance testing.
Essential Skills:
- Experience building complex web applications using TypeScript and modern frameworks like React or Vue.
- Ability to write clean, well-documented code and participate in code and design reviews.
- A willingness to learn new programming languages and technologies as needed.
Preferred Skills:
- Experience with Next.js and server-side rendering applications.
- Knowledge of SEO best practices.
- Experience with tools like Puppeteer for functional testing.
- Familiarity with Python, Docker, Kubernetes, RabbitMQ, PostgreSQL, and MongoDB.
About the Team:
You’ll be joining a remote team of 10 professionals spread across the UK and Europe. The team’s focus is on growing organic traffic, improving website performance, and converting traffic into customers. The role involves working on a range of web applications, from landing pages to email marketing systems.
Technologies You’ll Work With:
- Web applications built using TypeScript, with the React framework and MobX for state management.
- Micro-frontend architecture and a suite of libraries for UI and utility purposes.
What We Value:
- A positive and independent mindset, capable of building strong team relationships.
- A passion for technology and continuous improvement.
Benefits:
- Competitive salary.
- Annual travel budget and personal learning budget.
- Private medical insurance, pension contributions, and a cycle-to-work scheme
To Apply for this Job Click Here
Senior Software Engineer
New York
$170000 - $200000
+ Data Engineering
PermanentNew York
To Apply for this Job Click Here
Senior Software Engineer
Apparel/Technology
United States
$170,000-$200,000 + Equity
About Us:
This company we are working with aims to transform the sustainable clothing with their AI platform. They are looking for a fullstack focused software engineer to help improve their product and continue to build new state-of-the-art consumer-facing features.
Role Description:
As a Senior Software Engineer, you are adept at architecting intricate distributed systems, exemplified by their API handling tens of thousands of requests per second. You also excel in constructing data pipelines feeding our state-of-the-art neural networks, indexing millions of images. Your ability to swiftly adapt to new technologies is matched by your pride in crafting solutions that pave the way for the future of contextual interactivity.
- Deliver high-quality code with a direct impact on the business’s bottom line.
- Model complex problems and design large-scale distributed systems.
- Create stable and efficient APIs for both internal and client-facing products.
- Contribute to shaping the long-term vision of our technology and products.
Requirements:
- Proficient in JavaScript, Typescript and React
- Extensive experience deploying at a massive scale in cloud environments such as AWS, Azure, or GCP.
- Strong experience with Node.js
- In-depth knowledge of relational databases like MySQL or PostgreSQL.
- Demonstrated experience collaborating closely with engineering, product, and design stakeholders.
- Experience working at a start up
The Benefits:
As a Senior Software Engineer, you will receive a $170,000- $200,000 base. This role also includes equity, 401k, health, dental, and vision care.
How to Apply:
Please register your interest by sending your resume to Jacob Bisson via the Apply link on this page.
Key Words:
Typescript, JavaScript, AWS, GCP, Snowflake, Docker, Kubernetes, React, MySQL, PostgreSQL, Start up, Distributed Systems, APIs, Software Engineering
To Apply for this Job Click Here
Lead Platform Engineer
Palo Alto
$170000 - $200000
+ Data Engineering
PermanentPalo Alto, California
To Apply for this Job Click Here
LEAD PLATFORM ENGINEER
HEALTH TECH
PALO ALTO, CA (HYBRID)
$170,000 – $200,000
THE COMPANY
We are partnering with an innovative health tech startup dedicated to transforming the industry with its gen AI platform. Focused on enhancing healthcare outcomes, this company is building a talented team to develop their technology further. They are currently looking for an experienced Lead Platform Engineer to drive the architecture and development of their platform.
THE ROLE – Lead Platform Engineer
In this role, you’ll take on a pivotal position, overseeing the design and integration of core platform services for their Gen AI for Healthcare SaaS product. Responsibilities include:
- Defining and implementing the platform’s overall architecture to ensure scalability and performance
- Leading the development of core services and their seamless integration into the platform
- Writing clean, maintainable code that follows best practices
- Collaborating with the team to produce comprehensive technical documentation
- Managing project timelines, milestones, and deliverables
- Mentoring junior engineers and guiding their growth
- Actively participating in automation, monitoring, and alerting strategies
SKILLS AND REQUIREMENTS
- Expertise in Python
- Experience with scaling generative AI applications or platforms
- Strong understanding of microservices architecture and RESTful APIs
- Extensive experience with a major cloud platform (AWS or GCP) and knowledge of infrastructure as code (Terraform)
- Proficiency in DevOps practices, including CI/CD pipelines and monitoring tools
- Knowledge of scaling technologies like Docker and Kubernetes
- Excellent communication, problem-solving, and proven leadership skills
- Available to work on-site in Palo Alto 3x weekly
THE BENEFITS
The Lead Platform Engineer role offers a competitive salary range of $170,000- $200,000, depending on experience, along with equity in the company. Comprehensive health, dental, and vision benefits are also included.
HOW TO APPLY
Please register your interest by sending your resume to Malia Jalbert via the Apply link on this page.
KEYWORDS
Technical Lead, Platform Engineer, Generative AI, SaaS, Microservices, Cloud, Infrastructure as Code, DevOps, Python, TypeScript, Healthcare, Artificial Intelligence, Health tech
To Apply for this Job Click Here
Lead Platform Engineer
Palo Alto
$170000 - $200000
+ Data Engineering
PermanentPalo Alto, California
To Apply for this Job Click Here
LEAD PLATFORM ENGINEER
TECHNOLOGY
PALO ALTO, CA
$170,000 – $200,000 + EQUITY
THE COMPANY
We are working with a cutting-edge healthcare AI company that is on a mission to transform unstructured clinical data into structured, actionable insights using Generative AI. They are looking for a Lead Platform Engineer to join their team.
THE ROLE – Lead Platform Engineer
This role is a unique opportunity to join a fast-growing AI company focused on healthcare innovation. As the Lead Platform Engineer, you will be responsible for leading the architecture and development of the platform, with an emphasis on reliability, scalability, and security. You’ll take ownership of the platform as a product, ensuring it runs efficiently, while also helping to expand the team as the company continues to grow.
- Lead the design and architecture of the platform, ensuring it scales effectively and remains secure.
- Spend 75% of your time writing and reviewing code in Python, ensuring code quality and performance.
- Work closely with machine learning teams to enhance backend services and streamline deployment.
- Troubleshoot platform issues, with a focus on monitoring, streaming, and authentication challenges.
- Drive the development of tools that verify the accuracy of AI-generated insights against clinical standards.
- Help hire and mentor additional team members to expand the engineering team.
- Build a unified platform for monitoring AI applications and measuring their clinical impact.
SKILLS AND REQUIREMENTS
Deep experience in backend development with Python, including building scalable, reliable platforms.
- Strong expertise with cloud infrastructure (GCP preferred, AWS or Azure also acceptable).
- Proficiency with Terraform, Kubernetes, and containerization technologies.
- Familiarity with healthcare data standards like FHIR is a strong plus.
- Experience with Generative AI, vector databases (Pinecone, Llama Index), and large language models (LLMs).
- Proven ability to take ownership of a platform and treat it as a product that requires continuous improvement.
- Strong problem-solving skills and the ability to work collaboratively with cross-functional teams.
THE BENEFITS
This position offers a competitive base salary ranging from $170,000 to $200,000 plus SIGNIFICANT equity along with comprehensive health, dental, and vision benefits.
HOW TO APPLY
Please register your interest by sending your resume to Danny Macdonald via the Apply link on this page.
KEYWORDS
Platform Engineer, Technical Lead, Python, GCP, AWS, Terraform, Kubernetes, Generative AI, Vector Databases, LLMs, Backend Engineering, Healthcare AI, Infrastructure
To Apply for this Job Click Here
Senior Solutions Engineer
London
£80000 - £90000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Senior Solutions Engineer Opportunity
Location: London (Hybrid)
Salary: Up to £90,000
We are seeking a skilled Senior Solutions Engineer to join our Sales & Customer Success team. If you’re passionate about technology and thrive in dynamic environments, this role offers the opportunity to work with cutting-edge AI in the retail automation sector. Our focus is on making Computer Vision technology accessible for businesses of all sizes, and we are looking for someone who can help deliver world-class technical solutions to our clients.
Key Responsibilities:
- Solution Design & Architecture: Design and present scalable, secure, and high-performance technical solutions to meet client requirements. Implement strategies to optimise processes and enhance efficiency.
- Project Delivery: Collaborate with project teams to customise tools, troubleshoot technical issues, and ensure seamless delivery.
- Pre-Sales & Post-Sales Support: Provide expert technical support to the sales team, help identify customer needs, and ensure a smooth transition through the sales and implementation process.
- Cross-functional Collaboration: Work closely with internal stakeholders to gather feedback and contribute to the continuous improvement of our solutions.
- Continuous Improvement: Stay updated with industry trends, propose innovative solutions, and enhance our service capabilities.
Essential Skills:
- 5+ years of experience in software development, solutions engineering, or technical consulting.
- Proficiency in programming languages such as Python, JavaScript, or similar.
- Experience with DevOps tools (e.g., Docker, Kubernetes) and cloud platforms (AWS, Azure).
- Familiarity with API integrations, data engineering, and web development frameworks (e.g., React, Angular).
- Strong communication skills, with the ability to explain complex concepts to both technical and non-technical stakeholders.
- Problem-solving mindset and the ability to work collaboratively in a fast-paced environment.
Benefits:
- Competitive salary of £80,000-£90,000, plus equity options.
- Hybrid working model, with flexible hours and the option to work from home.
- 34 days annual leave (including public holidays).
- Private medical insurance, including mental health and dental cover.
- Pension plan, cycle-to-work scheme, and bi-annual company retreats.
Join us in pushing the boundaries of Computer Vision technology and delivering innovative solutions to enterprise clients. If you’re ready to make a real-world impact, we’d love to hear from you!
To Apply for this Job Click Here
Senior Data Engineer
Brighton
£60000 - £80000
+ Data Engineering
PermanentBrighton, East Sussex
To Apply for this Job Click Here
Senior Data Engineer
Location: Hybrid, Brighton (Two Days Per Week)
Salary: £60,000 – £80,000
Job Overview:
We are seeking an experienced and motivated Senior Data Engineer to join a rapidly growing data team. You’ll play a key role in developing, managing, and maintaining the company’s data infrastructure, helping the business achieve data-driven growth. Working autonomously, you will have ownership of complex data engineering processes and be responsible for building efficient and scalable data pipelines, particularly in Python, GCP, and ETL methodologies.
You’ll collaborate closely with stakeholders across various departments, including the Product and Engineering teams, to deliver impactful solutions, maintain high data standards, and ensure the smooth delivery of business-wide BI. This is an exciting opportunity to influence the direction of the company’s data infrastructure while contributing to the design and implementation of cutting-edge solutions.
Key Responsibilities:
- Develop and maintain data warehouses and data pipelines to support business-wide BI.
- Collaborate on the design, development, and production of data warehouses and pipelines.
- Translate business requirements into effective technical solutions.
- Build end-to-end data pipelines using Python and cloud technologies.
- Convert models and algorithms into production-ready solutions.
- Champion data best practices and standards.
- Maintain data artefacts, including models, dictionaries, and glossaries.
Ideal Candidate:
You are a hands-on data engineer with a track record of designing, building, and owning robust data pipelines. You are comfortable working independently, have a keen eye for detail, and are eager to solve complex challenges in a fast-paced environment. You’ll bring strong technical expertise and a passion for creating scalable, efficient solutions.
Skills & Experience:
- At least 3 years of hands-on experience in a data engineering role.
- Strong experience in Python and building ETL pipelines.
- Proficiency in BigQuery and SQL.
- Experience with cloud infrastructure (GCP), Kubernetes, and CI/CD processes.
- Familiarity with Git, Jenkins, and distributed data systems.
Desirable Skills:
- Experience with Tableau Cloud and Terraform.
- Background in ecommerce or marketplace environments.
- Exposure to Big Data platforms, Postgres, and MySQL.
What We Offer:
- Competitive salary package.
- Hybrid working model, with central Brighton office access.
- Opportunities for personal and professional growth in a dynamic, collaborative team.
This role provides a unique opportunity to contribute to the development of a rapidly expanding data infrastructure, working in an exciting, data-driven environment.
To Apply for this Job Click Here
Senior Data Engineer
£70000 - £82000
+ Data Engineering
PermanentOxfordshire
To Apply for this Job Click Here
Senior Data Engineer
Location: Remote, Oxford (Once per Month)
Salary: £82k + Benefits
Overview:
We are looking for a Senior Data Engineer to play a key role in evolving our data infrastructure, ensuring enhanced reliability and scalability. Reporting to the Data & Analytics Director, you will be integral in driving forward our data capabilities, as we move towards a larger data mesh set-up managed from a central hub of excellence. Over the past three years, we have built a lakehouse architecture with automated reporting and self-service capabilities. With an expanding scope, we now need a Senior Data Engineer to mature and scale our solution efficiently, focusing on DataOps/DevOps, data ingestion, and processing within Databricks.
Key Responsibilities:
- Enhance and stabilize our data infrastructure for increased reliability.
- Manage data ingestion pipelines (currently using ADF and Python).
- Ensure high-quality raw datasets to enable Data Analysts in creating reliable data models.
- Deploy and manage data-related tools on Kubernetes, including Airflow, Superset, and RStudio Connect.
- Support Data Analytics workflows by managing DBT, implementing deployment rules, and handling DevOps processes.
Skills & Experience:
- Proven Data Engineering experience, particularly with Azure, Databricks, and Delta Lake.
- Expertise in Kubernetes, Infrastructure as Code, and Terraform.
- Strong knowledge of Azure DevOps.
- Preference for simplicity and transparency in solutions, avoiding unnecessary complexity.
- Innovative and proactive approach, driving forward best practices and delivering effective solutions.
What We Offer:
- Enhanced holiday package to support work-life balance.
- Flexible hours and hybrid working options.
- Access to our modern head office in Thame, Oxfordshire-a great environment for collaboration and teamwork.
- Comprehensive benefits package, including private medical insurance, competitive pension, cycle-to-work scheme, volunteering days, death-in-service insurance, and sick pay.
- Social events to foster team connection and maintain a fun, engaging workplace culture.
- Career development support through a detailed performance management system.
To Apply for this Job Click Here
Senior DevOps Engineer (AWS)
London
£80000 - £100000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Senior DevOps Engineer
Location: London (Hybrid)
Salary: £75,000 – £100,000 per year
Overview:
We are looking for an experienced and motivated DevOps Engineer to join our growing team, helping to maintain and enhance our infrastructure in support of data-driven and machine learning solutions within the retail automation industry. As a key player in our DevOps/MLOps efforts, you will optimize and manage cloud infrastructure, enabling the efficient deployment of machine learning workflows and data-intensive applications.
At our company, we are focused on making Computer Vision technology accessible to all businesses, pushing the boundaries of what’s possible in the retail automation space. You’ll collaborate closely with product, machine learning, and engineering teams, streamlining deployment processes, automating key tasks, and ensuring the reliability and performance of our operations.
Key Responsibilities:
- Design, deploy, and manage scalable cloud infrastructure (AWS/GCP) to support machine learning workflows and data-intensive applications.
- Implement and maintain CI/CD pipelines for automating build, testing, and deployment processes, ensuring fast delivery of updates.
- Develop and maintain monitoring, logging, and alerting systems to identify and address performance, security, and operational issues proactively.
- Collaborate with machine learning and computer vision engineers to optimize application performance, troubleshoot issues, and ensure uptime in line with SLAs.
- Implement security best practices and compliance standards (e.g., Cyber Essentials, SOC2) to safeguard sensitive data.
- Lead continuous improvement initiatives to optimize infrastructure costs, increase efficiency, and improve performance.
- Stay current on emerging trends and technologies in DevOps and MLOps, and recommend innovative solutions.
Requirements:
- Proven experience as a DevOps Engineer, Site Reliability Engineer (SRE), or similar role, with a focus on cloud infrastructure and automation.
- Proficiency in cloud platforms, with a preference for AWS, and hands-on experience using Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
- Experience with containerization technologies such as Docker, and container orchestration platforms like Kubernetes.
- Strong understanding of CI/CD concepts, with experience using CI/CD tools (e.g., GitHub Actions) to automate software pipelines.
- Familiarity with machine learning concepts and experience managing ML models in production environments (e.g., BentoML, Valohai) is a plus.
- Excellent problem-solving skills, attention to detail, and strong communication abilities.
- Right to work in the UK.
Benefits:
- Hybrid working model with flexibility to work from home and the London office (minimum two days per week in the office).
- Flexible working hours.
- Equity options.
- 34 days of annual leave, including public holidays.
- Bi-annual company retreats and team meetings (workation).
- Private medical insurance, including mental health, dental, and optical cover, along with business and personal travel insurance.
- Pension plans and Cycle to Work scheme.
This is a unique opportunity for a DevOps Engineer passionate about infrastructure and innovation, contributing to the growth of cutting-edge AI/ML technology in a rapidly expanding field.
To Apply for this Job Click Here
Head of Data Engineering
London
£120000 - £120000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Head of Data Engineering
FinTech – Moorgate, London (Hybrid – 3 days per week in office)
Up to £120,000 + Benefits
OVERVIEW
Harnham is exclusively working with a fast-growing FinTech company looking for a Head of Data Engineering. This is a unique opportunity to lead the development of their data platform, work closely with senior leadership, and help shape the future of commercial insurance.
THE COMPANY
This company is revolutionizing the commercial insurance industry, providing an independent marketplace for brokers to trade risks. With a recent funding round closed and strong growth projected, they are now focused on building a world-class data function to support their platform.
THE ROLE
As Head of Data Engineering, you will:
– Lead and scale the data engineering function, building a robust platform to handle complex data needs.
– Collaborate with stakeholders to develop external-facing APIs and enhance customer experience.
– Manage and mentor a team, driving data strategy across the business.
– Work cross-functionally to integrate data science and analytics into the platform for real-time risk assessment.
YOUR SKILLS AND EXPERIENCE
– Proven experience leading data engineering teams, ideally within FinTech or B2B startups.
– Strong technical background in Azure, Python, Airflow, CI/CD, Terraform, and SQL.
– Ability to build and scale data platforms, with hands-on knowledge of external API development.
– Excellent leadership and communication skills, with experience managing senior stakeholders.
SALARY AND BENEFITS
– Up to £120,000 + 10% bonus.
– EMI Share Option Scheme.
– 25 days holiday + bank holidays.
– 2 weeks work from anywhere per quarter.
– £1k annual L&D allowance.
– Statutory pension, cycle-to-work scheme, and more.
HOW TO APPLY
To be considered for this opportunity, please register your interest via the apply link on this page or send your CV
To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.