DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
Our esteemed position as a global leader in data recruitment stems from our deep expertise in Big Data and Data Engineering, supported by hundreds of dedicated specialists located across the United States, Europe, and the United Kingdom.
Our extensive network enables us to deliver exceptional recruitment services, expertly matching our clients with top-tier Data Engineering talent.
We acknowledge the distinct challenges and requirements of each organization's data infrastructure.
Therefore, our recruitment strategies are meticulously tailored, emphasizing a thorough understanding of and alignment with your specific business objectives and data technological needs.
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
Lead AI Engineer
Sheffield
£80000 - £90000
+ Data Engineering
PermanentSheffield, South Yorkshire
To Apply for this Job Click Here
Lead AI Engineer
£80,000 – £90,000
Sheffield (Hybrid, 1-2 days a week)
A rare opportunity to step into a Lead level role where you will shape a new AI function and play a direct role in transforming how a digital insurer operates. You will build production grade AI systems, influence architecture, and drive agentic automation with a clear path to impact and visibility.
THE COMPANY
They are a technology driven insurance provider specialising in complex and non-standard home risks. Their model blends advanced AI capability with digital platforms to deliver a faster, smarter customer experience. You would be one of the first hires into this team, joining at a genuinely pivotal moment
THE ROLE
As a Lead AI Engineer you can expect to be involved in the following:
- Build production-ready AI agents on GCP using modern frameworks and Google’s ADK.
- Develop scalable RAG pipelines spanning ingestion, text processing and vector search.
- Integrate AI systems into policy, claims and CRM platforms through REST and JSON APIs.
- Implement monitoring, evaluation, A/B testing and cost or latency dashboards.
- Contribute to broader AI architecture and help shape engineering patterns and strategy.
- Work closely with engineering, ML Ops and data teams to bring models and prototypes into stable, scalable production.
SKILLS AND EXPERIENCE
The successful Lead AI Engineer will have the following skills and experience:
- Strong commercial experience in AI engineering, ML engineering, data engineering or software engineering with applied AI delivery.
- Deep expertise in GCP including Vertex AI, BigQuery, Cloud Run or Functions and related tooling.
- Strong Python skills and experience developing APIs and production AI systems.
- Hands on experience with LLMs, embeddings, RAG, vector databases and retrieval frameworks.
- Familiarity with LangChain, LangGraph or similar agentic frameworks.
- Solid engineering fundamentals including Docker, Kubernetes and CI/CD.
BENEFITS
The successful Lead AI Engineer will receive the following benefits:
- Salary between £80,000 – £90,000 – depending on experience
- Hybrid working with 1-2 office days in Sheffield.
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.
To Apply for this Job Click Here
Senior Software Engineer – Lua
San Francisco
$200000 - $280000
+ Data Engineering
PermanentSan Francisco, California
To Apply for this Job Click Here
Senior Software Engineer – Lua
Remote (US) | $200,000 – $280,000 base + equity + benefits
A market leader in cloud infrastructure and developer tooling is seeking a Senior Software Engineer to help design, scale, and optimize a next-generation global CDN. This team builds the backbone of high-performance web delivery-handling billions of requests per day and powering some of the fastest, most reliable online experiences in the world.
The Role
As part of the CDN Infrastructure team, you’ll build and enhance distributed systems that make the internet faster and more resilient. You’ll design large-scale systems, write production-grade code, and work closely with product and infrastructure engineers to deliver high-impact improvements in routing, caching, and network performance.
What You’ll Do
- Design, implement, and optimize new CDN features and edge performance improvements
- Diagnose and reduce latency across a global network serving petabytes of data
- Improve reliability and scalability for billions of daily requests
- Build internal tools and workflows for infrastructure developers (primarily in Lua)
- Collaborate across teams to deliver next-generation web infrastructure
What We’re Looking For
- 5+ years of professional experience with Lua
- Deep understanding of HTTP, web servers, and CDN architecture
- Proven experience with distributed systems and large-scale performance optimization
- Strong problem-solving skills and a passion for experimentation
- Bonus: experience with Golang or other backend languages
Why Join
- Work on systems that serve petabytes of data and billions of requests daily
- Competitive compensation including equity and full health coverage
- Flexible, remote-friendly work environment
- Opportunity to shape the next generation of internet-scale infrastructure
To Apply for this Job Click Here
AI Software Engineer
Remote
$120000 - $160000
+ Data Engineering
PermanentOhio
To Apply for this Job Click Here
AI Software Engineer
Remote (US – ET/CT Time Zone)
$120K-$160K + Benefits
I’m partnering with a global leader in digital learning technology that’s transforming how millions of students and educators experience personalized, AI-powered learning. Following major investment in generative AI, the company is scaling its AI Platform Engineering team to build the next generation of adaptive learning tools.
This is a hands-on engineering role focused on building production-grade generative AI applications that power multiple products across the business.
The Role:
You’ll design and build scalable, full-stack systems that integrate large language models and AI capabilities into digital learning platforms. Working closely with data scientists, product managers, and engineers, you’ll help take GenAI prototypes from experimentation to production-driving forward real-world AI impact.
Key Responsibilities
- Develop and maintain AI-powered applications and platform services that are reliable, scalable, and secure
- Build and optimize LLM-based and RAG-powered solutions using frameworks such as LangChain or LangGraph
- Collaborate with Data Science teams to productionize models and streamline deployment pipelines
- Lead and contribute to technical design, architecture, and CI/CD improvements
- Ensure applications meet accessibility (WCAG 2.2 AA), performance, and security standards
- Stay current on the latest advancements in GenAI and advocate for best practices across the team
About You
- 5+ years of professional software engineering experience
- Strong full-stack skills across:
- Backend: Python, Node.js, or Go
- Frontend: Angular or React
- Databases: MySQL/PostgreSQL + NoSQL (e.g., DynamoDB)
- Cloud/Infra: AWS or Azure, Terraform, CI/CD tools
- Hands-on experience building AI/GenAI-enabled applications (Azure OpenAI, Amazon Bedrock, etc.)
- Practical understanding of RAG techniques, vector databases, and AI orchestration tools
- Strong system design, performance optimization, and collaboration skills
- Passionate about building impactful technology and staying ahead in the AI space
To Apply for this Job Click Here
Software Engineering Lead (Data & Analytics Enablement)
Atlanta
$160000 - $180000
+ Data Engineering
PermanentAtlanta, Georgia
To Apply for this Job Click Here
Software Engineering Lead, Data & Analytics
Location: US Remote (preferred states – Georgia, Alabama, New York, Colorado, Florida)
Salary: $160-180k base + bonus
We’re partnering with a large, well-capitalized private equity platform to hire a Senior Software Engineer to support and scale their growing Data & Analytics organization.
This role sits at the intersection of software engineering, data infrastructure, and analytics products, with a direct line of sight into how data is used to drive investment decisions and portfolio performance across a global, multi-brand ecosystem.
The Opportunity
The business is investing heavily in its internal data and analytics capabilities. This hire will play a key role in building the software foundations that allow data scientists and analysts to deliver production-ready insights.
You’ll work closely with data science, analytics, and engineering teams to translate business problems into scalable, reliable analytics products, including data pipelines, internal applications, and modern user interfaces.
This is a hands-on engineering role with end-to-end ownership across the full development lifecycle.
What You’ll Be Doing
- Partner with data science and analytics teams to turn business problems into engineered solutions
- Build and maintain data pipelines and cloud infrastructure supporting analytics and ML workloads
- Develop production-ready analytics tools and internal applications delivered through modern UIs
- Support analytics solutions from exploratory analysis through prototyping, validation, and deployment
- Build custom packages and services, including automated CI/CD pipelines with testing
- Work across ETL frameworks to support new and existing data feeds
- Stay current on modern software engineering tools and best practices
What We’re Looking For
- 8+ years of professional software engineering experience
- Strong experience building and deploying production systems end to end
- Proficiency in Python, SQL, and JavaScript (or similar languages)
- Experience designing and operating cloud-based architectures using Docker, Kubernetes, and related tools
- Background working closely with data science and analytics teams
- Experience translating business requirements into scalable technical solutions
- Strong communication skills across technical and non-technical stakeholders
Nice to Have
- Experience building analytics or data-heavy products used by business teams
- Familiarity with GCP, BigQuery, Postgres, and Flask
- Experience with CI/CD, testing frameworks, and software lifecycle best practices
- Comfort operating in fast-paced, deadline-driven environments
To Apply for this Job Click Here
Staff Analytics Engineer
Los Angeles
$180000 - $230000
+ Data Engineering
PermanentLos Angeles, California
To Apply for this Job Click Here
Staff Analytics Engineer
Location: Los Angeles, CA | Hybrid
Salary: $180-220k base
We’re partnering with a rapidly scaling, mission-driven advanced technology company operating at the intersection of AI, software, and complex real-world systems. Their platform ingests and operationalizes high-volume, real-time data to support critical decision-making in high-stakes environments.
As the organization grows, they are hiring a Staff Analytics Engineer to take ownership of core data domains and help shape the long-term architecture of the data platform.
The Opportunity
This is a senior, high-ownership role focused on building foundational data systems, not just reporting. You will define and evolve the ontologies and reusable data models that represent how the company operates across domains such as Finance, Supply Chain, Manufacturing, People, and Operations. These models will power internal applications, executive reporting, and operational workflows across the business.
At the Staff level, you’ll influence platform direction, set engineering standards, and serve as a technical leader within the data organization.
What You’ll Do
- Lead the design and implementation of scalable, domain-level data models that serve as the backbone of the business
- Architect ingestion and transformation frameworks across diverse operational systems
- Set best practices for testing, version control, and CI/CD within analytics workflows
- Partner closely with engineering, product, and operations leaders to translate ambiguous needs into production-grade data systems
- Drive roadmap decisions for the data platform, balancing immediate delivery with long-term maintainability
- Mentor and raise the technical bar for analytics engineers across the team
- Push the organization beyond dashboards toward reusable data applications and self-serve analytics at scale
What They’re Looking For
- 7+ years of experience in Analytics Engineering, Data Engineering, or similarly technical data roles
- Deep expertise in SQL and strong proficiency in Python or another programming language
- Proven experience designing scalable, reusable data models in complex environments
- Strong background with modern data stack tools such as dbt, Redshift, and enterprise BI platforms
- Experience shaping data architecture and influencing technical direction
- High ownership mindset with the ability to operate autonomously
- Strong stakeholder management skills with both technical and non-technical leaders
- Ability to obtain and maintain a U.S. Secret security clearance
This is an opportunity to define how data is modeled and operationalized inside a technically ambitious, fast-scaling organization. If you’re excited by building durable systems that leadership relies on to run the business, this role offers significant scope and impact.
To Apply for this Job Click Here
Senior Analytics Engineer
Los Angeles
$150000 - $200000
+ Data Engineering
PermanentLos Angeles, California
To Apply for this Job Click Here
Senior Analytics Engineer
Location: Los Angeles, CA (Hybrid)
Salary: $150-200k base
We’re partnering with a rapidly scaling, mission-focused advanced technology company operating at the intersection of AI, hardware, and large-scale systems. Their software platform aggregates and operationalizes complex, real-time data to power critical decision-making in high-stakes environments.
As the company continues to grow, they are hiring a Senior Analytics Engineer to help architect and scale the core data foundation of the business.
The Opportunity
You will design and implement the core data models that represent how the organization operates across functions such as Finance, Supply Chain, Manufacturing, People, and Operations. These models will power internal applications, workflows, and metrics used by leadership to run the business.
You’ll sit at the intersection of analytics, engineering, and operations, helping build a scalable “digital twin” of a fast-moving, technically complex organization.
What You’ll Do
- Define and develop domain-level data models that reflect real business operations
- Build secure, scalable, and extensible transformations and data pipelines
- Own ingestion and egress frameworks across multiple source systems
- Contribute to architectural decisions and roadmap direction for the data platform
- Partner cross-functionally with engineering, product, and operations stakeholders
- Translate ambiguous business questions into structured, production-grade data systems
- Drive adoption of self-serve data applications beyond traditional BI
What They’re Looking For
- 5+ years of experience in Analytics Engineering, Data Engineering, or highly technical analytics roles
- Advanced SQL skills and strong experience with Python or similar languages
- Demonstrated success building scalable, reusable data models in fast-paced environments
- Experience with modern data stack tools such as dbt, Redshift, and BI platforms; exposure to enterprise data platforms is a plus
- High degree of ownership and comfort operating autonomously
- Strong communication skills and ability to partner with non-technical stakeholders
- Ability to obtain and maintain a U.S. Secret security clearance
This is a high-impact opportunity to shape foundational data systems inside a company solving complex, real-world problems at scale. If you’re excited by building data applications that influence how an organization operates, click apply to learn more.
To Apply for this Job Click Here
Senior Data Platform Engineer
Los Angeles
$160000 - $200000
+ Data Engineering
PermanentLos Angeles, California
To Apply for this Job Click Here
Senior Data Platform Engineer
Location: Los Angeles, CA
Salary: $160-200k base
We’re partnering with a fast-scaling, mission-driven advanced technology company building complex software and hardware systems deployed in real-world environments. Their platform processes and operationalizes high-volume data to power critical decision-making across the organization.
They are hiring a Senior Data Platform Engineer to design and scale the core data infrastructure that supports company-wide operations.
The Role
As a Senior Engineer on the Data Platform team, you will:
- Design and build scalable data pipelines and transformation frameworks
- Own ingestion and egress systems that unify multiple operational data sources
- Develop reliable, secure data models that power internal data products and applications
- Partner with engineering, product, and operations to translate business needs into production-grade systems
- Advocate for best practices across testing, CI/CD, data modeling, and security
- Debug and optimize complex transformation pipelines in production environments
What They’re Looking For
- 5+ years of experience in data engineering or backend engineering
- Strong programming skills in Python or similar languages
- Experience with Spark, PySpark, SQL, and dbt
- Familiarity with large-scale data platforms and cloud environments (AWS, Azure, or GCP)
- Experience with containerization and modern deployment practices
- Ability to operate autonomously in fast-moving environments
- Strong ownership mindset and attention to security best practices
- Must be a U.S. Person due to export-controlled information requirements
This is a high-impact role focused on building durable data systems that directly support operational execution at scale.
To Apply for this Job Click Here
Staff Analytics Engineer
$200000 - $250000
+ Data Engineering
PermanentCalifornia
To Apply for this Job Click Here
Staff Analytics Engineer
Location: Remote
Salary: $200-250k
Are you a data expert ready to drive transformative analytics at a cutting-edge cloud platform company? This fast-growing Series C innovator is revolutionizing how teams build, preview, and deploy high-performance digital applications.
About the Role
The Staff Analytics Engineer will lead the design and implementation of robust data models and pipelines, enabling business units to uncover insights and make data-driven decisions. This role is a unique chance to collaborate with engineering, product, and business teams, building scalable analytics systems that power operational efficiency and growth.
Key Responsibilities
- Design and maintain scalable data models and pipelines to serve as a single source of truth across the enterprise.
- Develop tools to enhance data accessibility, auditing, and validation, ensuring consistent, trustworthy datasets.
- Partner with cross-functional teams to uncover actionable insights and support decision-making.
- Build self-service analytics tools and dashboards for key stakeholders, streamlining workflows.
- Collaborate on advancing the company’s data platform using cutting-edge tools like dbt, Snowflake, and Superset.
- Lead initiatives to improve data quality, governance, and discoverability, ensuring alignment with business goals.
About You
- 8+ years of experience in analytics engineering or a similar role in a modern tech company.
- Advanced proficiency in SQL, with experience working on complex datasets.
- Expertise in data platforms like Snowflake or BigQuery and transformation tools like dbt.
- Familiarity with programming languages such as Python, Java, or Go.
- Experience with BI tools like Hashboard or Superset, and a strong grasp of schema design and dimensional modeling.
- Strong communication skills and the ability to collaborate in a fast-paced environment.
Be part of a forward-thinking team where data is at the core of every decision. If you’re passionate about transforming data into meaningful insights, this role offers the chance to work on impactful projects, collaborate with top talent, and make a lasting difference.
To Apply for this Job Click Here
Staff Data Platform Engineer
San Francisco
$200000 - $245000
+ Data Engineering
PermanentSan Francisco, California
To Apply for this Job Click Here
Staff Data Platform Engineer
US Remote
$200-245k base + Equity
We’re working with a rapidly expanding consumer tech startup that recently raised $125M in Series D funding. As they continue to scale, they’re looking to hire a Staff Data Engineer to join their growing data team. If you have a strong foundation in software engineering, a collaborative mindset, and a passion for driving data strategy, this is the opportunity for you!
The Role:
As a Staff Data Engineer, you’ll be a crucial part of the team, ensuring data is accessible, reliable, and actionable across the company. Working alongside engineers, data scientists, and business teams, you’ll help build scalable data platforms that drive key business initiatives and enable data-driven decision-making.
What You’ll Do:
- Collaborate with engineering, data science, and business teams to understand data needs and implement effective solutions aligned with business objectives.
- Design and build scalable data infrastructure and pipelines to handle high volumes of data as the company grows.
- Lead the design and optimization of data architecture, ensuring it’s secure, high-performing, and scalable.
- Improve and streamline data pipelines to provide fast, reliable access to high-quality data.
- Contribute to the design of reporting frameworks and analytics tools that empower teams to make data-driven decisions.
- Work with security teams to ensure data privacy and compliance standards are met.
- Mentor junior engineers, share expertise, and promote best practices across the team.
- Stay updated on new technologies and suggest improvements to enhance processes and tool efficiency.
You’re a Great Fit If:
- You have 7+ years of experience in data engineering.
- You’ve worked at a leading consumer tech company known for engineering excellence.
- You’re an expert in SQL, Python, and data platform development.
- Nice-to-have: Familiarity with AWS, Kubernetes, Redshift, Athena, S3, and Airflow.
- You have hands-on experience with complex data infrastructures and optimizing data pipelines.
- You’ve led large-scale data projects that had a significant impact on your organization.
- You thrive in collaborative environments and have strong communication skills.
- You have an ownership mindset and take responsibility for delivering results.
To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
Analytics in Private Equity: Driving Portfolio Value
by Kiran Ramasamy, Business Manager at Harnham. Analytics Leadership in PE Portfolios: Timing the Right Hire A…
Data & Analytics Hiring Trends: Market Insight
by Jamie Smith, Senior Manager at Harnham, UK. Data & Analytics Hiring Trends How working models, technology…
How Analytics Teams Drive Value Creation in Growth-Stage Portfolio Companies
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Analytics teams support value creation…
How a Leading European Media Group Unified Its Data Strategy with Harnham
by Jamie Smith, Senior Manager at Harnham, UK. A major privately owned media organisation in Europe, employing…
From Start-Up to Scale-Up: Hire Exceptional Data Talent in Two Weeks
By Guillian Eller, Manager AI/ML – Harnham You’re growing fast. You needed data talent yesterday. The reality…
Reskilling & Upskilling: What US Data Professionals Are Doing
By Luc Simpson-Kent, Managing Consultant – Harnham US Candidates want growth. Employers want retention. And in today’s…
What’s Driving Northern UK’s Data & AI Hiring in 2025?
by Jamie Smith, Senior Manager at Harnham, UK. At a glance The Northern data and tech market…
The Key to a Strong AI Team: Diversity
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Every company wants to build…
Why US Companies Are Scaling AI with Contractors in 2025
Artificial intelligence has arrived in the workplace and it’s changing how companies are structured, resourced, and scaled. …
How Sacher.AI Strengthened Its GenAI Delivery in Just 12 Days
by Thomas Savidge, Principal Consultant – AI, Machine Learning and Data Science Sacher.AI, a UK-based innovation lab…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.
Client – Data Direction – Broadcast Media
I have worked with Harnham for over 2 years now as our main Analytics Recruiter partner and I am very pleased with the overall service and the people we have hired via Harnham. Harnham’s team is very good at understanding our recruitment needs and always come back with relevant and well scanned CVs, which saves me precious time.
Client /
Data Direction – Broadcast Media
Candidate – Market Research Analyst
Thanks to Harnham, I am now in a role that suits me. My recruiter was able to quickly identify the skills I had to offer and match me up with his client. It was a win-win for everyone. I was given great advice throughout the process, and I also appreciated the follow-ups that I received.
Candidate /
Market Research Analyst
Candidate – Chief Data Officer
It was a real treat to work with Harnham. My recruiter consistently went above and beyond to ensure that I navigated through the recruitment process as smooth as possible. I had been in contact with other professional at Harnham in the past and I can attest that the level of professionalism is always top-notch.
Candidate /
Chief Data Officer
Candidate – Senior Data Engineer
I've been a Senior Data Engineer for about 4-5 years and Harnham is one of the best recruitment agencies I worked with. There was a time when my offer fell through and the recruiter I was working with at Harnham jumped in to the rescue and scheduled interviews for me within a couple of days. Really good agency and some great people.
Candidate /
Senior Data Engineer
Candidate – Data Analyst
I’ve had a great experience with Harnham. The recruiter provided great advice and ensured that I understood everything, and even followed up with me after I started my new role to see how I was settling in. I would recommend Harnham as a great recruitment company for anyone looking for a role in data and analytics.
Candidate /
Data Analyst
Client – Director of People Operations
We’ve been collaborating with Harnham to recruit some key positions for our company, and they have been incredible partners. They team has been great and efficient. They understood our needs perfectly and provided us very talented candidates. We'll keep collaborating with them in the future. Thank you for your excellent job!
Client /
Director of People Operations
Client – Director of Customer Data Science – Apparel
The team at Harnham have been outstanding in helping our company build a market-leading data science team. Harnham’s communication is great, and the recruiter’s take a consultative approach that’s really focused on provided value for both their clients and their candidates. They provide strong candidates that help us fill our roles with high achievers who are also a great fit for our culture.
Client /
Director of Customer Data Science – Apparel
Candidate – Digital Media and Analytics
I've recently got a short-term contract role through Harnham, and things couldn't have gone better! My recruiter was incredibly helpful throughout the entire process. They also provided incredible admin support so that I could focus on the actual job in hand, rather than having to spend too much time dealing with these matters.
