DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
Our esteemed position as a global leader in data recruitment stems from our deep expertise in Big Data and Data Engineering, supported by hundreds of dedicated specialists located across the United States, Europe, and the United Kingdom.
Our extensive network enables us to deliver exceptional recruitment services, expertly matching our clients with top-tier Data Engineering talent.
We acknowledge the distinct challenges and requirements of each organization's data infrastructure.
Therefore, our recruitment strategies are meticulously tailored, emphasizing a thorough understanding of and alignment with your specific business objectives and data technological needs.
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
Forward Deployed Engineer
New York
$150000 - $200000
+ Data Engineering
PermanentNew York
To Apply for this Job Click Here
Forward Deployed Engineer (AI & Data Consultant)
Location: New York, NY (Hybrid w/ travel)
Pay: $150k – $200k Base + bonus
Overview
This role sits within a high‑growth data, digital, and AI consultancy focused on helping enterprise organisations unlock value through advanced analytics, AI, and modern data platforms. The team is known for delivering practical, production‑ready solutions in fast‑moving, complex environments while enabling clients to adopt responsible and scalable AI capabilities.
As a Forward Deployed Engineer Consultant, you will work directly inside client teams to design, build, and deploy data and AI solutions that drive real business impact. The role is hands‑on, delivery‑focused, and ideal for engineers who enjoy working close to stakeholders while learning new systems quickly.
Responsibilities
- Embed directly within client teams to build and deploy AI and data solutions in live enterprise environments
- Develop Python and SQL pipelines to extract, transform, and operationalise data
- Build and configure AI components and data products within established platform architectures
- Extend and customise enterprise AI and data platforms to meet client requirements
- Participate in client stand‑ups, technical working sessions, and delivery cadences
- Deliver working solutions rapidly while operating in complex, evolving environments
- Document technical solutions and support knowledge transfer to client stakeholders
Must‑Have Qualifications
- 3-5 years of experience in software engineering, data engineering, or a forward‑deployed technical role
- Strong hands‑on experience with Python and SQL
- Experience working with at least one enterprise data or AI platform (e.g. Palantir Foundry or cloud‑native equivalents)
- Comfort working directly within client environments with limited oversight
- Ability to clearly document technical work and explain outputs to non‑technical stakeholders
To Apply for this Job Click Here
Senior Analytics Engineer
Costa Mesa
$206884.9 - $219054.6
+ Data Engineering
PermanentCosta Mesa, California
To Apply for this Job Click Here
This role sits at the intersection of analytics and data engineering and focuses on data modeling, pipelines, and trusted datasets rather than reporting.
You will partner closely with product managers, engineers, and analytics stakeholders to design scalable data models and pipelines that enable self service analytics, automation, and measurable business impact.
Key Responsibilities
- Design and maintain canonical data models including facts, dimensions, and entities to support analytics and reporting
- Build and optimize batch and near real time data pipelines using SQL and Python
- Develop analytics transformations using modern analytics engineering tools such as dbt
- Work with cloud data platforms such as Snowflake and Databricks to process large scale datasets
- Ensure data quality, freshness, and reliability through testing, validation, and monitoring
- Partner with stakeholders to translate business problems into durable data solutions
- Reduce data duplication by centralizing models and creating reusable datasets
- Support dashboards and self service analytics by delivering clean, well documented data products
- Contribute to data governance, access controls, and best practices
Required Qualifications
- 6 or more years of experience in data engineering or analytics engineering roles
- Strong SQL and Python skills
- Solid experience with data modeling including star and snowflake schemas and slowly changing dimensions
- Hands on experience with Snowflake and or Databricks
- Experience building ETL or ELT pipelines for analytics use cases
- Familiarity with dbt, Airflow, or similar orchestration and transformation tools
- Experience working with large and complex datasets in production environments
- Ability to operate as an individual contributor and own work end to end
Nice to Have
- Experience with operational or near real time analytics
- Exposure to regulated domains such as healthcare, finance, or privacy focused systems
- Experience supporting analytics or data science teams
- Familiarity with streaming technologies such as Kafka or Event Hubs
To Apply for this Job Click Here
Staff Data Engineer
New York
$200000 - $250000
+ Data Engineering
PermanentNew York
To Apply for this Job Click Here
Staff Data Engineer
Location: New York, NY (Hybrid)
Pay: $200k – $250k Base
Overview
This Staff Engineer role sits within a growing data engineering organisation supporting multiple product lines inside a modern digital media and analytics company. The position plays a critical role in shaping shared data architecture, enabling cross‑platform collaboration, and driving the company’s AI and generative AI roadmap.
You’ll act as a senior technical leader – influencing architectural direction, mentoring engineers, and remaining hands‑on with production systems – ensuring data platforms scale coherently as products and teams continue to integrate and evolve.
Responsibilities
- Design, own, and evolve shared data architecture across multiple product platforms
- Establish scalable patterns and standards for data modelling, pipelines, and observability
- Lead technical strategy for integrating data products across teams to enable cross‑platform insights
- Drive the AI and backend infrastructure roadmap, including pipelines supporting ML and LLM‑powered features
- Collaborate closely with product, engineering, and ML teams to translate business needs into durable architectural decisions
- Mentor data engineers, identify skill gaps, and raise the overall technical bar across the organisation
- Evaluate and prototype emerging AI and generative AI technologies for real‑world product use cases
- Contribute to engineering planning, roadmap prioritisation, and support for production systems
Must‑Have Qualifications
- 8+ years of experience in data engineering, data architecture, or a closely related field
- Proven experience designing and operating large‑scale data systems across complex, multi‑product environments
- Strong experience with cloud data warehouses (e.g. Snowflake, BigQuery, or equivalent)
- Hands‑on experience building batch and streaming data pipelines using tools such as Spark, Kafka, Airflow, or similar
- Demonstrated experience integrating AI / ML capabilities into production data systems, including LLMs or foundation models
- Strong Python proficiency and data architecture expertise
- Excellent communication skills with the ability to influence both technical and non‑technical stakeholders
To Apply for this Job Click Here
Data Engineer (Snowflake, DBT)
London
£500 - £550
+ Data Engineering
ContractLondon
To Apply for this Job Click Here
DATA ENGINEER
6-MONTH CONTRACT
LONDON (1 day in office)
£500 – £550 per day (Outside IR35)
This position as a Snowflake Engineer offers the opportunity to join a leading travel company based near West London, currently undergoing a major cloud data transformation.
THE COMPANY
This established Pharma brand is known for its innovation and commitment to delivering seamless customer experiences through data. With a focus on modernising its data platforms, the company is investing in Snowflake and cloud-native tooling to better understand customer journeys, improve operations, and fuel growth. Contractors and perm hires we’ve placed here consistently highlight the collaborative culture, exciting technical challenges, and strong support from leadership.
THE ROLE
As a Data Engineer, you will play a crucial role in a data transformation program, focusing on optimising data pipelines and enabling cloud-driven insights. You will also be responsible for post-project documentation, ensuring clear communication with non-technical stakeholders.
Your key responsibilities will include:
- Designing and implementing a Snowflake-based data warehouse, ensuring scalability and efficiency.
- Developing and optimising ELT pipelines, leveraging Snowflake best practices for data ingestion and transformation.
- Enhancing performance and query optimisation, ensuring cost-effective and high-performing workloads.
- Working with dbt and Airflow to transform raw data into structured datasets for analytical consumption.
- Creating clear documentation to communicate technical processes to non-technical teams.
KEY SKILLS AND REQUIREMENTS
To succeed in this role, you should have:
- Strong commercial experience with Snowflake and its ecosystem.
- Proficiency in SQL for data modelling and transformation within Snowflake.
- Experience with dbt to develop scalable data pipelines.
- Knowledge of ELT processes and best practices for cloud-based data architecture.
- Hands-on experience with performance tuning and query optimisation in Snowflake.
- Familiarity with cloud platforms (AWS/GCP/Azure) and their integration with Snowflake.
HOW TO APPLY
Please register your interest by sending your CV via the apply link on this page.
To Apply for this Job Click Here
Application Support Engineer
Boston
$50 - $60
+ Data Engineering
ContractBoston, Massachusetts
To Apply for this Job Click Here
Application Support Engineer
Harnham, the leading recruitment specialist in Data and Technology, is partnering with a well‑established professional services firm to hire an experienced Application Support Engineer on a contract basis. The role supports core enterprise applications that underpin critical firm‑wide workflows.
- Role: Application Support Engineer
- Engagement: Contract
- Location: On‑site / Hybrid (Boston or New York)
- Duration: 6 moth Initial contract (extension or C2H)
- Pay: $50 – $60 per hour (some flexibility for the right candidate)
The Role
As an Application Support Engineer, you will provide hands‑on support and optimisation for the firm’s enterprise applications. You will act as a key escalation point, working closely with IT leadership, vendors, and business users to ensure systems remain stable, secure, and efficient.
This is a delivery‑focused role suited to someone comfortable operating in a complex, enterprise environment.
Key Responsibilities
- Provide Tier 2-3 support for mission‑critical enterprise applications
- Monitor system performance and resolve incidents to minimise downtime
- Perform root‑cause analysis and implement fixes and improvements
- Manage user access, permissions, and security configurations
- Build and support integrations using APIs, scripts, and middleware
- Assist with upgrades, enhancements, and application rollouts
- Maintain clear technical documentation and support materials
- Work with third‑party vendors on issue resolution and changes
Requirements
- 5+ years’ experience in Application Support in the Legal field
- Strong demonstrable experience with iManage & M365
- Solid SQL skills for queries, reporting, and data extracts
- Familiarity with APIs, system integrations, and authentication protocols
- Exposure to cloud platforms (Azure, AWS, or similar)
- Strong communication skills and ability to work under pressure
If interested in this opportunity; please apply below or contact Ciarán
To Apply for this Job Click Here
Lead Data Engineer
City of London
£90000 - £100000
+ Data Engineering
PermanentCity of London, London
To Apply for this Job Click Here
Lead Data Engineer
Remote UK, £90,000 to £100,000
This is an opportunity to join a fast scaling, digital first consumer platform at a pivotal point in its data journey. They are investing heavily in their data infrastructure and are building a high performing, software led data engineering team to support real time, high volume analytics across the business. You will have genuine influence over how data engineering is done, working on modern tooling and best practice from day one.
The Company
They are a UK based, consumer facing digital platform operating in a highly regulated online environment. Since launching less than a decade ago, the business has grown rapidly, supported by significant recent funding and a strong focus on product, user experience and responsible engagement. Data is central to their growth strategy, and they are building a modern, scalable analytics platform to support this ambition. The team operates fully remotely across the UK and Europe.
The Role
- Design, build and own end to end data pipelines supporting real time and batch analytics
- Work on high volume, low latency data use cases with a strong focus on reliability and scalability
- Develop production grade data solutions using software engineering best practices such as CI/CD, testing and version control
- Contribute to the design of data models and analytics layers used across the business
- Help implement and mature staging, testing and deployment processes across the data platform
- Collaborate closely with analytics, product and engineering teams to enable better decision making
Your Skills and Experience
- Strong commercial experience as a data engineer in modern, cloud based environments
- Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks
- Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS
- Hands on experience with modern analytics stacks such as Snowflake, dbt and Iceberg
- Familiarity with orchestration tools such as Dagster or Airflow
- Strong understanding of data modelling concepts and analytics best practice
- A software engineering mindset, including Git, testing and CI/CD workflows
What They Offer
- The chance to help shape a growing data platform and engineering culture
- Clear progression opportunities as the data team continues to expand
- Exposure to complex, real world data challenges at scale
How to Apply
If you are a Lead Data Engineer looking to make a real impact in a growing, product led business, apply now to learn more about the opportunity.
To Apply for this Job Click Here
Senior Data Engineer (AWS, Airflow, DBT)
Manchester
£80000 - £100000
+ Data Engineering
PermanentManchester, Greater Manchester
To Apply for this Job Click Here
Senior Data Engineer
Up to £100,000 + Benefits
Remote – UK
This is a great opportunity to join a high‑growth organisation where you can take ownership of end‑to‑end data engineering projects and play a key role in shaping a modern, scalable data platform.
THE COMPANY:
This a next‑generation sports betting and gaming platform built for a new wave of players. Combining sharp product thinking, bold branding and fast execution.
THE ROLE:
You will take ownership of the full data engineering lifecycle.
Key responsibilities include:
- Owning end‑to‑end data engineering projects across the platform
- Designing, building and optimising scalable data pipelines using Python, SQL and modern orchestration tools
- Developing robust data models aligned with industry best practices
- Ensuring high standards of data quality through testing, monitoring and alerting
- Driving engineering best practices, contributing to code reviews and mentoring other engineers
YOUR SKILLS AND EXPERIENCE:
You will bring strong capability in:
- Python and advanced SQL
- Building and maintaining production‑grade data pipelines
- Modern data orchestration tools (e.g. Dagster, Airflow, Prefect)
- Data modelling methodologies (Kimball, Data Vault, etc.)
- Engineering best practices including testing, version control and clean code
- AWS experience
THE BENEFITS:
You will receive a salary of up to £100,000 depending on experience, along with a comprehensive benefits package including private health insurance, income protection, flexible working, enhanced holiday entitlement and a fully supported home‑office setup.
HOW TO APPLY:
Please register your interest by sending your CV to Molly Bird via the apply link on this page.
To Apply for this Job Click Here
Senior Data Engineer – Snowflake
Morristown
$70 - $80
+ Data Engineering
ContractMorristown, New Jersey
To Apply for this Job Click Here
Senior Data Engineer – Snowflake
***We will not be engaging with 3rd party agencies for this role.***
About the Role
We’re looking for a Data Engineer with finance and accounting data experience to support critical financial reporting, reconciliation, billing, and operational accounting workflows. In this role, you will build and optimize cloud‑based data pipelines and financial data models that ensure accuracy, audit readiness, and traceability across the organization.
You’ll partner closely with Finance, Accounting, FP&A, and Analytics teams to translate business requirements into scalable, reliable data solutions. This position is hands‑on, collaborative, and ideal for someone who enjoys solving complex financial data challenges in a modern cloud environment.
What You’ll Do
- Develop, test, and deploy cloud‑based data pipelines supporting financial reporting, close processes, reconciliations, and analytics use cases
- Coordinate with stakeholders and internal team members
- Build and optimize Snowflake data models and DBT transformations for finance and accounting workflows
- Implement SQL transformations, reconciliation logic, and data quality checks
- Collaborate with Finance, Accounting, FP&A, and Analytics teams to define and deliver scalable data solutions
- Support cloud migration of financial and accounting data from on‑premises SQL environments
- Ensure data quality, lineage, auditability, and compliance with financial data standards
- Participate in Agile ceremonies including sprint planning, daily standups, and retrospectives
- Contribute to documentation, testing, and release processes
What You Bring
- 6+ years of experience in data engineering
- Hands‑on experience with Snowflake and AWS cloud‑native data services
- Strong SQL skills, including performance optimization and complex query development
- Experience with DBT or similar modern ELT/ETL tools
- Background working with financial data warehouses or data lakes
- Familiarity with cloud migrations from on‑premises SQL systems
- Understanding of financial data modeling, ETL/ELT best practices, and analytics architecture
- Strong communication skills, especially when working with finance and accounting stakeholders
- Experience in Agile/Scrum environments
- Experience using AI‑assisted development tools (Cortex, Claude, Copilot, Cursor, etc.)
Preferred Qualifications
- 7+ years working with modern ELT/ETL tooling (DBT preferred)
- Expertise tuning and optimizing SQL stored procedures and transformations
- Python experience for data engineering, automation, or financial data processing
- Experience supporting financial close cycles, reconciliations, audits, or executive financial reporting
- Familiarity with real‑time or near‑real‑time data processing
- Knowledge of Git, CI/CD pipelines, DevOps tools, Jira, and Confluence
- Exposure to regulated financial systems or healthcare‑related financial data (nice to have)
Location – Remote (Hybrid 1 day onsite in Morristown, NJ if commutable
Pay – $70/hr – $80/hr
Length: Extendable, 6 months initial contract
Utilization: 40 hours per week
To Apply for this Job Click Here
Senior Data Engineer
London
£10000 - £10000
+ Data Engineering
PermanentLondon
To Apply for this Job Click Here
SENIOR DATA ENGINEER
£100,000
REMOTE (LONDON)
An opportunity to join a fast-growing, consumer-focused digital platform that is redefining how modern users interact with data-led products. This is a senior, high-impact role within a scaling data function, offering ownership, influence, and the chance to work on systems operating at significant scale.
THE COMPANY
A well-funded, UK-based digital entertainment business operating within a regulated environment. Founded in London and backed by recent investment, the company has grown quickly by focusing on strong product design, performance, and an engineering-first culture.
The business values scalable solutions over quick fixes, with a collaborative and technically ambitious environment. The role sits within a growing data function that plays a critical part in supporting continued customer growth and increasingly real-time analytics use cases.
THE ROLE
As a Senior Data Engineer, you will be responsible for building and scaling core data infrastructure, working closely with senior data and engineering stakeholders. You’ll be hands-on across multiple initiatives while helping shape platform direction and technical standards.
Key responsibilities include:
- Designing, building, and maintaining scalable, production-grade data pipelines
- Scaling the data platform to support increasing data volumes and user growth
- Developing and owning robust data models used across the business
- Helping build a full staging and testing environment that closely mirrors production
- Improving reliability, monitoring, and observability across data systems
- Supporting a move towards lower-latency analytics from an engineering perspective
This role offers genuine architectural input and is well suited to engineers who enjoy complex technical challenges in a scale-up setting.
YOUR SKILLS AND EXPERIENCE
Required:
- 5+ years’ experience in data engineering or software engineering roles
- Strong Python and SQL capability
- Experience building data platforms in AWS
- Excellent data modelling fundamentals (non-negotiable)
- Experience working in smaller companies or growing environments
- Engineering-first mindset, ideally with a backend or software engineering background
Desirable:
- Experience with Snowflake
- Orchestration tools such as Dagster or Airflow
- dbt for data transformation and modelling
- Apache Iceberg or modern table formats
- Background in high-growth, consumer-facing products
SALARY AND BENEFITS
- Base salary up to £100,000
- Competitive benefits package
- Fully remote working within the UK
- Optional London office access for collaboration
- Opportunity to work on a modern, evolving data stack
HOW TO APPLY
Please register your interest by sending your CV to Harry Lack via the Apply link. All applications will be handled confidentially.
To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
AI in Private Equity: How Talent Strategy Drives Portfolio Value Creation
by Nick Mandella, Director at Harnham. Most PE firms are investing in AI, but returns remain mixed….
How to Choose the Right AI Recruitment Agency in the US
Kyle Arriola, Harnham’s AVP of Data & AI Talent Acquisition, recently spoke with Simon Clarke, CEO of…
Why Dutch-Speaking Data & AI Talent Is So Hard to Hire
by Ross Henderson, Director at Harnham. Why it’s so hard to hire Dutch-speaking Data & AI talent…
Tech in Europe on the decline? The reality of the engineering talent market in the Netherlands tells a different story
by Ross Henderson, Director at Harnham. If you read the news, you’d be forgiven for thinking…
Analytics in Private Equity: Driving Portfolio Value
by Kiran Ramasamy, Business Manager at Harnham. Analytics Leadership in PE Portfolios: Timing the Right Hire A…
Data & Analytics Hiring Trends: Market Insight
by Jamie Smith, Senior Manager at Harnham, UK. Data & Analytics Hiring Trends How working models, technology…
How Analytics Teams Drive Value Creation in Growth-Stage Portfolio Companies
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Analytics teams support value creation…
How a Leading European Media Group Unified Its Data Strategy with Harnham
by Jamie Smith, Senior Manager at Harnham, UK. A major privately owned media organisation in Europe, employing…
From Start-Up to Scale-Up: Hire Exceptional Data Talent in Two Weeks
By Guillian Eller, Manager AI/ML – Harnham You’re growing fast. You needed data talent yesterday. The reality…
Reskilling & Upskilling: What US Data Professionals Are Doing
By Luc Simpson-Kent, Managing Consultant – Harnham US Candidates want growth. Employers want retention. And in today’s…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.
Client – Director of People Operations
We’ve been collaborating with Harnham to recruit some key positions for our company, and they have been incredible partners. They team has been great and efficient. They understood our needs perfectly and provided us very talented candidates. We'll keep collaborating with them in the future. Thank you for your excellent job!
Client /
Director of People Operations
Client – Director of Customer Data Science – Apparel
The team at Harnham have been outstanding in helping our company build a market-leading data science team. Harnham’s communication is great, and the recruiter’s take a consultative approach that’s really focused on provided value for both their clients and their candidates. They provide strong candidates that help us fill our roles with high achievers who are also a great fit for our culture.
Client /
Director of Customer Data Science – Apparel
Candidate – Market Research Analyst
Thanks to Harnham, I am now in a role that suits me. My recruiter was able to quickly identify the skills I had to offer and match me up with his client. It was a win-win for everyone. I was given great advice throughout the process, and I also appreciated the follow-ups that I received.
Candidate /
Market Research Analyst
Client – Data Direction – Broadcast Media
I have worked with Harnham for over 2 years now as our main Analytics Recruiter partner and I am very pleased with the overall service and the people we have hired via Harnham. Harnham’s team is very good at understanding our recruitment needs and always come back with relevant and well scanned CVs, which saves me precious time.
Client /
Data Direction – Broadcast Media
Candidate – Chief Data Officer
It was a real treat to work with Harnham. My recruiter consistently went above and beyond to ensure that I navigated through the recruitment process as smooth as possible. I had been in contact with other professional at Harnham in the past and I can attest that the level of professionalism is always top-notch.
Candidate /
Chief Data Officer
Candidate – Data Analyst
I’ve had a great experience with Harnham. The recruiter provided great advice and ensured that I understood everything, and even followed up with me after I started my new role to see how I was settling in. I would recommend Harnham as a great recruitment company for anyone looking for a role in data and analytics.
Candidate /
Data Analyst
Candidate – Senior Data Engineer
I've been a Senior Data Engineer for about 4-5 years and Harnham is one of the best recruitment agencies I worked with. There was a time when my offer fell through and the recruiter I was working with at Harnham jumped in to the rescue and scheduled interviews for me within a couple of days. Really good agency and some great people.
Candidate /
Senior Data Engineer
Candidate – Digital Media and Analytics
I've recently got a short-term contract role through Harnham, and things couldn't have gone better! My recruiter was incredibly helpful throughout the entire process. They also provided incredible admin support so that I could focus on the actual job in hand, rather than having to spend too much time dealing with these matters.
