DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
Our esteemed position as a global leader in data recruitment stems from our deep expertise in Big Data and Data Engineering, supported by hundreds of dedicated specialists located across the United States, Europe, and the United Kingdom.
Our extensive network enables us to deliver exceptional recruitment services, expertly matching our clients with top-tier Data Engineering talent.
We acknowledge the distinct challenges and requirements of each organization's data infrastructure.
Therefore, our recruitment strategies are meticulously tailored, emphasizing a thorough understanding of and alignment with your specific business objectives and data technological needs.
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
QA Automation Engineer
London
£60000 - £65000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
QA Automation Engineer
London, Hybrid
£65,000 plus benefits
This is an opportunity to join a fast‑scaling technology business building a next‑generation financial platform. You will play a key role in shaping how quality engineering is done, introducing AI‑driven automation and helping build a modern test architecture that removes manual work while improving reliability.
The Company
They are a growing technology organisation operating in the financial domain, creating a platform that helps users understand and manage their full financial picture. Their environment is modern, product‑led and engineering‑driven, working in small squads with a strong focus on innovation. Quality engineering is seen as a strategic capability and they are investing heavily in automation, data reliability, and AI‑powered workflows. You will join a team where experimentation is encouraged and new ideas influence the product directly.
The Role
You will work as part of a cross‑functional engineering squad, responsible for designing and delivering the automation that ensures the platform is fast, stable and accurate. Key responsibilities include:
* Building and maintaining automated tests for a new web platform.
* Developing automation for backend, API and data validation workflows.
* Introducing AI‑assisted tooling to accelerate test creation, debugging and data generation.
* Reducing manual testing by expanding robust, scalable test coverage.
* Supporting regression and functional testing for product changes, including integrations with third‑party systems.
* Helping shape test architecture, frameworks and best practices as the business scales.
Your Skills and Experience
* Strong commercial experience in software test automation within modern engineering teams.
* Confident testing both frontend web applications and backend APIs.
* Hands‑on experience with Java, Kotlin, TypeScript or Python in an automation context.
* Strong understanding of HTML, CSS, JavaScript and web application behaviour.
* Experience building UI tests with tools such as Selenium or Playwright.
* Working knowledge of test frameworks such as JUnit or TestNG.
* Understanding of APIs, HTTP, JSON and related testing tools.
* Comfortable working in data‑rich environments and validating data accuracy.
* Experience using AI tools within your engineering workflow to accelerate development and reduce repetitive tasks.
* Familiar working with CI/CD pipelines, Jira and modern dev practices.
What They Offer
* 25 days annual leave with the ability to carry over additional days.
* Salary sacrifice options including electric car scheme, cycle‑to‑work, nursery benefits and pension contribution options.
* Enhanced parental leave.
* Study support and allocated study time.
* Work‑from‑home equipment provided.
* Support for physical and mental wellbeing.
* Dog‑friendly office and regular team socials.
How to Apply
If you are a QA Automation Engineer looking to join a forward‑thinking tech environment, apply now to discuss the role in more detail.
To Apply for this Job Click Here
Senior Data Engineer
Leeds
£75000 - £75000
+ Data Engineering
PermanentLeeds, West Yorkshire
To Apply for this Job Click Here
Senior Data Engineer
Leeds/Manchester – hybrid 2x week in office
Salary: up to £75,000
This is an opportunity to play a key role in building and improving a modern cloud data platform for a growing financial organisation. You will shape data architecture, deliver high‑quality pipelines, and help uplift engineering standards in a team that values innovation, governance, and technical leadership.
The Company
They are a fast‑growing financial services organisation with a strong presence across the UK. Their work spans commercial banking, fintech‑focused services, and SME lending. With continued investment in data and technology, they are scaling their data capabilities to support new products, stronger analytics, and an ambitious transformation agenda. You will join a team focused on building a trusted, well‑governed, and scalable data environment.
The Role
* Own the design, build, and optimisation of cloud‑based ELT and ETL pipelines.
* Shape the data warehouse architecture and ensure data is prepared for analytics, reporting, and operational use.
* Improve existing processes and contribute to a modernised engineering approach.
* Introduce governance best practices including data quality, observability, lineage, and access control.
* Mentor a junior engineer and support the uplift of engineering standards.
* Contribute to potential migration projects and wider transformation initiatives.
* Collaborate with data, engineering, and business teams in an agile environment.
Your Skills and Experience
* Strong commercial experience working as a Data Engineer in a cloud environment.
* Proven capability with AWS, Python, SQL, and Airflow.
* Hands‑on experience designing and maintaining data pipelines and data models.
* Knowledge of Redshift or similar cloud data warehouse tools.
* Experience with infrastructure‑as‑code tools such as Terraform.
* Understanding of data governance, quality, and architectural best practices.
* Comfortable operating in fast‑scaled environments such as fintechs, scale‑ups, or modern engineering teams.
What They Offer
* Hybrid working with 2-3 days per week in the office.
* A collaborative culture and clear opportunities for technical growth.
* Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt.
* The chance to shape a data platform and have meaningful influence on engineering standards.
How to Apply
If you are interested in this Senior Data Engineer position, please apply with your CV.
To Apply for this Job Click Here
Head of Data Governance
London
£70000 - £80000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Head of Data Governance
Location: Remote (London Office)
Salary: £80,000
This is a rare chance to take full ownership of Data Governance for a large, complex global organisation. You will shape the foundations of how data is defined, managed and used, while balancing hands‑on delivery with strategic influence. If you enjoy building structure in ambiguity and want to make a meaningful impact at scale, this role offers exactly that.
The Company
They are a major international organisation operating across multiple regions, with a strong mission focus and a commercially minded leadership team. Data, AI and digital capabilities are undergoing significant investment as the organisation modernises core processes and improves how data supports decision making. You will join a collaborative environment that values pragmatic execution, stakeholder partnership and high‑quality governance.
The Role
In this Head of Data Governance role, you will:
- Act as the global business owner for Data Governance.
- Translate high‑level strategy into a practical, actionable roadmap.
- Deliver hands‑on work across key DG pillars including metadata, glossary, data dictionary, data quality and policy.
- Build and embed stewardship responsibilities across a complex network of global teams.
- Lead key governance forums to drive consistency and shared understanding.
- Ensure clear, reliable and well‑structured data is available for enterprise use.
- Work closely with IT, product owners and analytics stakeholders to align business and technical governance.
- Navigate senior stakeholders and influence decision makers in a sophisticated environment.
Your Skills and Experience
You will be a strong fit if you have:
- Broad, practical experience across multiple Data Governance pillars.
- Proven ability to operationalise DG frameworks and deliver hands‑on outputs.
- Experience managing governance in large, complex or global organisations.
- Strong stakeholder management and facilitation skills.
- Confidence working autonomously with limited resources.
- Ability to translate strategy into tangible execution.
- Clear communication skills with examples of real‑world delivery.
Desirable experience includes consulting backgrounds at Manager or Senior Manager level, NGO or mission‑driven environments, or exposure to outcomes and impact governance.
How to Apply
If this Head of Data Governance role sounds like the right next step, please apply with your CV.
To Apply for this Job Click Here
Senior Data Architect
London
£70000 - £88000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Senior Data Architect – London – Hybrid
About the Role
We are looking for a talented Senior Data Architect to join a global consultancy specializing in financial services. This role offers the chance to work on high-impact projects, shaping modern data strategies and solutions for leading financial institutions. If you have a passion for innovation and a deep understanding of data systems, we want to hear from you.
The Company
Our client is a top-tier technology and business consultancy known for its innovative approach and commitment to diversity and inclusion. With a strong presence in the financial services sector, they empower their employees to deliver meaningful results and thrive in a collaborative, inclusive environment.
Key Responsibilities
- Deliver data architecture projects, working closely with clients to design efficient and scalable solutions.
- Provide best practice guidance for data management, architecture design, and optimization.
- Develop modern data architecture frameworks, including cloud migration strategies and governance models.
- Collaborate with multidisciplinary teams to deliver robust, future-ready solutions.
- Drive data transformation initiatives to unlock value and operational efficiency.
Ideal Candidate Profile
- Demonstrable experience in data architecture, strategy, and governance within enterprise settings.
- Expertise in cloud technologies (AWS, Azure, or GCP) with relevant certifications preferred.
- Strong knowledge of data modeling, cloud migration patterns, and data governance tools.
- Hands-on experience with data privacy, security frameworks, and cost management in cloud ecosystems.
- Excellent communication skills, with the ability to convey complex technical concepts to diverse audiences.
- Experience in financial services or other complex industries is advantageous.
What You’ll Gain
- Collaborate with a global network of data professionals and industry experts.
- Work on transformational projects for some of the largest financial institutions.
- Enjoy a flat, inclusive structure where your contributions are recognized.
- Access learning and development programs to enhance your career growth.
- Benefit from family-friendly policies, including enhanced leave and wellness support.
If you’re ready to elevate your career and make a meaningful impact, apply now for this exciting opportunity as a Senior Data Architect.
To Apply for this Job Click Here
Principal Data Architect
London
£90000 - £117000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
Principal Data Architect – Hybrid – London – No Sponsorship Available
About the Role
We are seeking an experienced and visionary Principal Data Architect to join a leading consultancy in the financial services sector. This strategic role involves leading complex, high-profile data initiatives that drive innovation and transformation for major financial institutions.
The Company
Our client is a globally recognized consultancy specializing in technology and business transformation within financial services. Known for fostering an entrepreneurial culture and championing diversity, they empower their teams to deliver impactful solutions in a collaborative and inclusive environment.
Key Responsibilities
- Lead large-scale data architecture projects, providing strategic direction and expert guidance.
- Partner with senior technology leaders to develop and implement modern data strategies.
- Design and deliver innovative solutions for data management, governance, and cloud migration.
- Oversee the development of robust data platforms using cutting-edge cloud technologies.
- Manage project teams, mentor junior staff, and support business development initiatives.
Ideal Candidate Profile
- Extensive experience in enterprise data architecture, strategy, and implementation.
- Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable.
- In-depth knowledge of data modeling, data lake design, and metadata management tools.
- Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems.
- Experience in the financial services sector, with a track record of success in complex environments.
- Outstanding leadership and stakeholder management skills, with a collaborative and innovative mindset.
Why Join Us?
- Work on transformative projects with leading financial institutions.
- Join a global network of data strategists, architects, and engineers.
- Enjoy a non-hierarchical, inclusive culture that values your expertise.
- Take advantage of extensive learning and career development opportunities.
- Access competitive family-friendly benefits, including enhanced leave and wellness programs.
If you’re passionate about data innovation and ready to lead groundbreaking projects, we encourage you to apply for the Principal Data Architect role today.
To Apply for this Job Click Here
Senior Backend Engineer
Los Angeles
$180000 - $220000
+ Data Engineering
PermanentLos Angeles, California
To Apply for this Job Click Here
Senior Backend Engineer – Los Angeles (Hybrid) – $175,000 – $215,000
We’re building advanced avatar and AI companion technology that powers the next era of interactive digital identity. Our platform enables developers and creators to build game‑ready AI characters, personalized digital assets, and rich real‑time experiences. If you’re passionate about high‑performance backend systems, AI‑driven products, and solving complex engineering challenges, this role is for you.
What You’ll Do
- Build and maintain backend microservices powering mobile and web experiences
- Design and develop large‑scale ML infrastructure and compute‑heavy systems
- Architect and optimize real‑time pipelines for reliability, performance, and scale
- Develop backend applications that integrate ML models and data workflows
- Improve automation, testing, CI/CD, security, and deployment practices
- Collaborate with product and engineering teams on roadmaps and requirements
- Contribute to architectural decisions, code reviews, and team mentorship
What You Bring
- 3+ years of professional software engineering experience
- Strong proficiency in Python or Golang
- Experience building or supporting ML systems and high‑compute workloads
- Strong fundamentals in algorithms, data structures, and distributed systems
- Background with AWS or GCP, REST APIs, microservices, NoSQL/SQL databases
- Familiarity with IaC, CI/CD pipelines, caching, event‑driven architecture
- A proactive, collaborative, and creative engineering mindset
- Excellent written and verbal communication skills
What We Offer
- Competitive equity packages
- Comprehensive medical, dental, and vision insurance
- Unlimited PTO + company holidays
- Paid parental leave
- Monthly wellness reimbursement
- Hybrid work structure (LA-based, 4 days onsite)
- Modern, creative office environment
- Strong culture of ownership, growth, and innovation
Our Culture
A fast‑growing, well‑funded startup that values curiosity, creativity, and thoughtful engineering. You’ll have the autonomy to shape systems from the ground up, influence technical direction, and work alongside people who love solving big, meaningful problems.
Interested?
If you’re excited about building scalable backend systems that power next‑generation AI and digital identity experiences, we’d love to connect.
Apply or message directly to learn more.
To Apply for this Job Click Here
Data Architect
London
£600 - £630
+ Data Engineering
ContractLondon
To Apply for this Job Click Here
Job Title: Data Architect (Contract)
Location: London (Hybrid – 2 days per week)
Rate: £630 per day (Inside IR35)
We are supporting a leading aviation business undergoing a major data platform transformation and are looking for an experienced Data Architect to play a key role in delivering this programme.
Role Overview
This is a hands-on Data Architect role focused on leading the migration of a legacy Oracle estate into AWS and Snowflake. You will be responsible for overseeing a team of engineers while driving the design and implementation of a scalable, modern cloud data platform.
Key Responsibilities
-
Lead the end-to-end architecture and delivery of an Oracle to AWS/Snowflake migration
-
Oversee and guide a team of data engineers, ensuring best practices and high-quality delivery
-
Design scalable, secure, and high-performing data models and pipelines
-
Re-engineer legacy Oracle data structures into modern cloud-native architectures
-
Work closely with stakeholders to gather requirements and align technical solutions to business needs
-
Ensure strong data governance, quality, and performance across the platform
Key Requirements
-
Proven experience as a Data Architect on large-scale cloud migration programmes
-
Strong experience migrating Oracle systems to AWS and Snowflake
-
Experience leading and mentoring engineering teams
-
Strong background in data modelling, architecture design, and cloud data platforms
-
Experience working with HR data (key requirement)
-
Excellent stakeholder management and communication skills
To Apply for this Job Click Here
Data Architect – HR Integration
London
£600 - £630
+ Data Engineering
ContractLondon
To Apply for this Job Click Here
Data Architect – HR Integration
£600-£630 per day
London
This is an opportunity to join a major HR data transformation programme, playing a pivotal role in shaping new data models and driving the migration from legacy Oracle systems to a modern AWS and Snowflake environment. You will be joining a high-impact team delivering new HR data products that sit at the heart of a large-scale agile transformation.
The Company
They are undergoing a strategic rebuild of their HR data ecosystem as part of a wider digital transformation. Operating in a complex, fast‑paced environment, they are modernising their core HR systems and embedding cloud-first data practices. You will join a collaborative, delivery-focused team that is building out new data foundations and establishing best practice across architecture and engineering.
The Role and Deliverables
* Lead data architecture work across HR datasets, ensuring models are well designed and aligned with business needs.
* Work closely with Oracle SMEs to understand the current-state data structures and translate them into target-state cloud models.
* Collaborate with data engineers to ensure engineering outputs align with the architectural blueprint.
* Support migration work into AWS and Snowflake as part of a new HR solution implementation.
* Provide architectural guidance and technical oversight within a cross-functional delivery team.
* Deliver six defined HR data products over the initial contract period.
Your Skills and Experience
* Strong capability working with HR data, particularly across complex enterprise environments.
* Deep experience in AWS and Snowflake, especially in contexts involving migration from legacy systems.
* Strong understanding of Oracle data models and how to interpret and translate them into cloud architectures.
* Ability to work closely with engineering teams to validate modelling decisions and ensure build quality.
* Clear communicator comfortable influencing stakeholders across architecture, engineering, and product.
How to Apply
If you have the technical depth and architectural mindset to drive an HR data transformation, we would love to hear from you. Apply today to learn more.
To Apply for this Job Click Here
Senior Data Engineer – Geospatial Focus
New York
$65 - $80
+ Data Engineering
ContractNew York
To Apply for this Job Click Here
Senior Data Engineer – Geospatial Focus
About the Role
We are seeking a Senior Data Engineer (Contract) to help build and scale the ingestion, transformation, and orchestration layers for a new data product entering beta launch across multiple U.S. states. This role is ideal for an engineer with strong Python foundations, deep experience working with geospatial data, and a passion for building reliable, production‑ready data systems.
You’ll work closely with a highly collaborative, research‑driven engineering team to design data models, develop pipelines, troubleshoot complex geospatial challenges, and ensure the platform is ready for its next phase of growth.
What You’ll Do
- Develop, own, and maintain data ingestion and transformation pipelines in a type‑safe Python environment
- Design and optimize data models, with an emphasis on geospatial datasets and real‑estate-oriented data problems
- Build and manage orchestration workflows (e.g., Prefect) to support scalable, reliable production systems
- Work within a sprint-based process, delivering high‑quality, well‑tested code
- Collaborate closely with a thoughtful, academically minded engineering team to solve complex data challenges
- Contribute to documentation, code reviews, and continuous improvement of engineering standards
Required Skills & Experience
Core Technical Background
- Strong Data Engineering experience
- Hands-on experience with:
- Python (custom/bespoke codebases, not just notebooks or light scripting)
- Snowflake
- AWS (data‑oriented cloud services)
- Workflow orchestration tools (e.g., Prefect, Dagster, Airflow, etc.)
Geospatial Expertise (Required)
Experience with geospatial data tools, libraries, formats, or platforms such as:
- ArcGIS
- GeoPandas
- Apache Sedona
- PySpark GIS
- QGIS
- Shapefiles, raster/tiling systems, spatial joins, projections, coordinate systems, etc.
Nice to Have
- Experience with Machine Learning, feature engineering, or ML model pipelines
- Familiarity with real‑estate or location‑based data products
- Experience building systems for early‑stage product launches
Logistics
- Flexible time zones; mandatory standups M/W/F at 9:30 AM ET.
- 20 hours/week ramping to 40 hours/week within 2-3 months, continuing full-time for ~6 months.
- Hourly Rate: $65/hr – $80/hr
To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
Analytics in Private Equity: Driving Portfolio Value
by Kiran Ramasamy, Business Manager at Harnham. Analytics Leadership in PE Portfolios: Timing the Right Hire A…
Data & Analytics Hiring Trends: Market Insight
by Jamie Smith, Senior Manager at Harnham, UK. Data & Analytics Hiring Trends How working models, technology…
How Analytics Teams Drive Value Creation in Growth-Stage Portfolio Companies
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Analytics teams support value creation…
How a Leading European Media Group Unified Its Data Strategy with Harnham
by Jamie Smith, Senior Manager at Harnham, UK. A major privately owned media organisation in Europe, employing…
From Start-Up to Scale-Up: Hire Exceptional Data Talent in Two Weeks
By Guillian Eller, Manager AI/ML – Harnham You’re growing fast. You needed data talent yesterday. The reality…
Reskilling & Upskilling: What US Data Professionals Are Doing
By Luc Simpson-Kent, Managing Consultant – Harnham US Candidates want growth. Employers want retention. And in today’s…
What’s Driving Northern UK’s Data & AI Hiring in 2025?
by Jamie Smith, Senior Manager at Harnham, UK. At a glance The Northern data and tech market…
The Key to a Strong AI Team: Diversity
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Every company wants to build…
Why US Companies Are Scaling AI with Contractors in 2025
Artificial intelligence has arrived in the workplace and it’s changing how companies are structured, resourced, and scaled. …
How Sacher.AI Strengthened Its GenAI Delivery in Just 12 Days
by Thomas Savidge, Principal Consultant – AI, Machine Learning and Data Science Sacher.AI, a UK-based innovation lab…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.
Candidate – Market Research Analyst
Thanks to Harnham, I am now in a role that suits me. My recruiter was able to quickly identify the skills I had to offer and match me up with his client. It was a win-win for everyone. I was given great advice throughout the process, and I also appreciated the follow-ups that I received.
Candidate /
Market Research Analyst
Candidate – Chief Data Officer
It was a real treat to work with Harnham. My recruiter consistently went above and beyond to ensure that I navigated through the recruitment process as smooth as possible. I had been in contact with other professional at Harnham in the past and I can attest that the level of professionalism is always top-notch.
Candidate /
Chief Data Officer
Client – Data Direction – Broadcast Media
I have worked with Harnham for over 2 years now as our main Analytics Recruiter partner and I am very pleased with the overall service and the people we have hired via Harnham. Harnham’s team is very good at understanding our recruitment needs and always come back with relevant and well scanned CVs, which saves me precious time.
Client /
Data Direction – Broadcast Media
Candidate – Senior Data Engineer
I've been a Senior Data Engineer for about 4-5 years and Harnham is one of the best recruitment agencies I worked with. There was a time when my offer fell through and the recruiter I was working with at Harnham jumped in to the rescue and scheduled interviews for me within a couple of days. Really good agency and some great people.
Candidate /
Senior Data Engineer
Candidate – Data Analyst
I’ve had a great experience with Harnham. The recruiter provided great advice and ensured that I understood everything, and even followed up with me after I started my new role to see how I was settling in. I would recommend Harnham as a great recruitment company for anyone looking for a role in data and analytics.
Candidate /
Data Analyst
Client – Director of Customer Data Science – Apparel
The team at Harnham have been outstanding in helping our company build a market-leading data science team. Harnham’s communication is great, and the recruiter’s take a consultative approach that’s really focused on provided value for both their clients and their candidates. They provide strong candidates that help us fill our roles with high achievers who are also a great fit for our culture.
Client /
Director of Customer Data Science – Apparel
Client – Director of People Operations
We’ve been collaborating with Harnham to recruit some key positions for our company, and they have been incredible partners. They team has been great and efficient. They understood our needs perfectly and provided us very talented candidates. We'll keep collaborating with them in the future. Thank you for your excellent job!
Client /
Director of People Operations
Candidate – Digital Media and Analytics
I've recently got a short-term contract role through Harnham, and things couldn't have gone better! My recruiter was incredibly helpful throughout the entire process. They also provided incredible admin support so that I could focus on the actual job in hand, rather than having to spend too much time dealing with these matters.
