DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
Head of Cloud Archiecture – Working with Azure landing zones
€61000 - €130000
+ Data Engineering
PermanentNetherlands
To Apply for this Job Click Here
Job Title: Head of Cloud Architecture (Azure & Azure Landing Zones)
Location: Amsterdam
Department: IT / Cloud Services
Reports To: Chief Technology Officer (CTO)
About Us:
This company are a scalable, innovative, and secure solutions. They are on a the hunt for an experienced, visionary Head of Cloud Architecture to spearhead the design and implementation of our Azure-based cloud strategy. If you’re passionate about Microsoft Azure and have hands-on experience with Azure Landing Zones, we want you to help shape the future of our cloud infrastructure.
Key Responsibilities:
- Lead the architecture and strategy for our Azure cloud platform, focusing on building and optimizing Azure Landing Zones to support a secure, scalable, and high-performing environment.
- Design and implement end-to-end cloud solutions leveraging Azure services (e.g., Azure Virtual Networks, Azure Kubernetes Service, Azure Security Center, etc.).
- Lead the establishment of best practices, standards, and guidelines for Azure cloud implementations, ensuring consistency across the organization’s cloud infrastructure.
- Provide leadership and mentorship to a team of cloud architects and engineers, enabling them to design and deploy best-in-class cloud solutions with a focus on cost optimization, security, and scalability.
- Drive the adoption of Infrastructure as Code (IaC) practices, leveraging tools like Azure Resource Manager (ARM), Terraform, and Bicep for automated deployment and configuration management.
- Collaborate with cross-functional teams, including security, networking, DevOps, and development, to integrate cloud solutions seamlessly and ensure alignment with business objectives.
- Own the governance of the cloud platform, ensuring compliance with industry standards, security protocols, and cloud governance frameworks.
- Continuously monitor and optimize cloud performance and operational efficiencies, addressing any issues related to performance, security, or cost.
- Advocate for the continuous improvement of the Azure cloud strategy, recommending new technologies, practices, and tools to enhance infrastructure performance.
- Provide technical leadership and guidance to senior stakeholders, ensuring alignment between cloud architecture and organizational goals.
Requirements:
- Proven experience (8+ years) in cloud architecture, with a deep focus on Azure and cloud solution design.
- Expertise in Azure Landing Zones, including understanding of foundational Azure architecture and governance, security, and operational considerations.
- Strong experience in managing enterprise-level Azure environments, including networking, compute, storage, and security services.
- Hands-on experience with Azure services like Azure Kubernetes Service (AKS), Azure Functions, Azure DevOps, and Azure Active Directory (AAD).
- Strong understanding of Infrastructure as Code (IaC) tools (e.g., Terraform, Azure Bicep, ARM templates) and DevOps principles.
- Deep knowledge of cloud security best practices, including identity and access management, encryption, and regulatory compliance in Azure environments.
- Proven ability to lead and mentor teams, balancing hands-on technical expertise with strategic leadership.
- Experience in hybrid and multi-cloud architectures and migration to Azure is a plus.
- Excellent communication skills, with the ability to translate technical concepts for non-technical stakeholders.
- A Bachelor’s or Master’s degree in Computer Science, Engineering, or related field (or equivalent experience).
- Relevant Azure certifications (e.g., Azure Solutions Architect Expert, Azure DevOps Engineer Expert) are highly preferred.
Why Join Us?
- Play a leading role in the cloud transformation of a forward-thinking company.
- Build, scale, and secure cutting-edge cloud solutions on Azure.
- Work with a talented, collaborative team that values innovation and continuous learning.
- Competitive salary and comprehensive benefits package.
- Flexible work options, including remote work.
- Access to a continuous learning environment and career growth opportunities.

To Apply for this Job Click Here
Head of Security Engineering
Dallas, TX
$200000 - $235000
+ Data Engineering
PermanentDallas, Texas
To Apply for this Job Click Here
HEAD OF SECURITY ENGINEERING – GLOBAL ENTERPRISE
ONSITE – DALLAS FORT- WORTH METROPLEX
SALARY: $200,000 – $235,000 + BONUS + EQUITY
SECURITY ENGINEERING MANAGER
We’re seeking a results-driven and detail-oriented leader to join our global IT team as Head of Security Engineering. This role is central to advancing our cybersecurity program-driving strategy, execution, and optimization of our security engineering services and tool stack.
RESPONSIBILITIES
- Develop and execute the enterprise security architecture and engineering strategy, leveraging NIST frameworks and Zero Trust principles.
- Partner across teams to embed security-by-design, least privilege, and defense-in-depth into solutions, integrating SAST/DAST tools for continuous secure development.
- Lead the delivery and optimization of security tools and architecture, including next-gen SIEM platforms (e.g., Splunk) for real-time threat detection and analytics.
- Automate and enhance incident response using SOAR to streamline detection, remediation, and playbook execution.
- Continuously improve processes, governance, and cloud-native protections-particularly within AWS environments.
- Translate business risks into scalable, practical security solutions that exceed compliance requirements.
- Recruit, mentor, and scale a high-performing security engineering team.
- Use data-driven insights (from SIEM, SOAR, and AWS metrics) to monitor and strengthen security posture.
SKILLS
- Passion for cybersecurity innovation and automation (SOAR, Zero Trust, cloud security).
- Proven success designing and implementing secure architectures across enterprise applications, networks, and AWS.
- Deep expertise in Splunk SIEM, NIST CSF, and Zero Trust implementation.
- Hands-on experience with secure code analysis (SAST/DAST) and DevSecOps automation in CI/CD pipelines.
- Strong communicator who can simplify complex security topics for diverse audiences.
- Knowledge of compliance standards (PCI DSS, GDPR, SOX) and advanced threat defense.
REQUIREMENTS
- Bachelor’s degree in Computer Science, Cybersecurity, or related field.
- 5+ years designing and implementing enterprise security solutions (SIEM, AWS, SOAR).
- 3+ years leading security engineering or operations teams, integrating modern security tooling.
- Experience applying NIST and Zero Trust frameworks and communicating risks across functions.
- Commitment to integrity, compliance, and excellence in hybrid/multicloud environments.

To Apply for this Job Click Here
Systems Development Manager
Birmingham
£60000 - £70000
+ Data Engineering
PermanentBirmingham, West Midlands
To Apply for this Job Click Here
System Development Manager
Location: Birmingham (Hybrid, 2 days per week in office)
Salary: £50,000 – £70,000 (depending on experience)
A growing FS company is seeking a System Development Manager to lead and develop their in-house technology function. This is a great opportunity to join a business that’s modernising its core systems, bringing previously outsourced technology in-house to improve efficiency, quality, and control.
Key Responsibilities
- Lead and manage two development teams (SQL and PHP), ensuring efficient workflow and clear priorities.
- Unify both teams under one cohesive structure to strengthen collaboration and delivery consistency.
- Provide leadership and guidance to developers – supporting their technical and professional growth.
- Oversee development processes, appraisals, and goal setting.
- Contribute hands-on to development work where appropriate (particularly valuable if you have PHP experience).
- Shape the long-term technical strategy, including tooling, frameworks, and best practices.
- Manage and refine the testing and deployment strategy, supported by a dedicated system tester.
- Provide architectural oversight for new and existing projects, ensuring solutions are secure, scalable, and maintainable.
About You
- Proven experience leading or managing software development teams.
- Strong understanding of PHP, SQL Server, and related technologies.
- Confident in guiding teams on priorities, resolving blockers, and improving development processes.
- Technically capable: able to contribute to architecture discussions and design reviews.
- Excellent stakeholder management skills with the ability to collaborate across departments.
- Passionate about developing people and driving technical maturity within a growing organisation.

To Apply for this Job Click Here
Data Engineer
£70000 - £70000
+ Data Engineering
PermanentWiltshire
To Apply for this Job Click Here
Data Engineer
Location: Wiltshire (Hybrid; 2 days per week in office)
Salary: Up to £70,000
A leading global retailer is seeking a Data Engineer to join their growing analytics and infrastructure function. This organisation operates across both B2B and B2C channels, and this is a great opportunity to join a business that combines purpose and innovation.
The Role
You’ll work within a small but expanding data team, focusing on ensuring that the organisation’s data infrastructure, models, and systems are robust, efficient, and well-structured.
Responsibilities include:
- Supporting and improving data infrastructure and pipelines.
- Validating and deploying data models to ensure integrity and reliability.
- Reviewing and maintaining existing database structures and processes.
- Working closely with analytics and business teams to deliver accurate, actionable insights.
- Assisting with data architecture and modelling activities.
About You
- Strong technical background in SQL and experience working with Azure.
- Confident in working with data systems, pipelines, and operational data processes.
- Comfortable liaising with stakeholders across technical and non-technical teams.
- Experience in data validation, database optimisation, or data warehouse environments.
- Knowledge of data architecture or modelling is beneficial.
- A proactive communicator who enjoys improving systems and solving problems.
The Process
- Verbal & non-verbal reasoning test
- Online interview (Teams)
- Final technical interview (onsite)

To Apply for this Job Click Here
Senior Data Engineer
Wiltshire
£60000 - £70000
+ Data Engineering
PermanentWiltshire
To Apply for this Job Click Here
Senior Data Engineer
Salary: £70,000
Location: Wiltshire (2 Days a Week in Office)
Step into a leadership role where your technical expertise fuels strategic decision-making across multiple regions. Own the evolution of a resilient, scalable data ecosystem built on Azure and next-gen analytics tools
The Opportunity
This is an exciting opportunity to join a forward-thinking organisation that’s putting data at the heart of its strategy and decision-making. You’ll play a key role in shaping and managing a modern, cloud-based data infrastructure that supports operations across the UK, Ireland, and North America.
As a senior leader within a collaborative data and analytics team, you’ll have the freedom to innovate, implement new technologies, and influence how data drives business growth. You’ll lead cloud migration initiatives, enhance system performance, and ensure data quality and security at scale. If you’re looking to make a measurable impact and take ownership of a global data ecosystem, this role offers the ideal platform to do it.
The Role and Responsibilities
In this role, you’ll take ownership of a complex, cloud-based data infrastructure supporting multiple international markets. You’ll lead the development, optimisation, and governance of data pipelines and warehouses, ensuring reliability, scalability, and top-tier data quality. The position involves hands-on work with technologies such as Azure, SQL/T-SQL, SSIS, and Databricks, alongside exposure to data modeling, integration, and DevOps processes.
You’ll collaborate closely with analytics, IT, and security teams to deliver secure, high-performing data environments and support advanced business intelligence and predictive analytics initiatives. The ideal candidate brings at least five years of experience in production data engineering, a problem-solving mindset, and a passion for driving continuous improvement in data infrastructure and performance.
Interview Process: 2 Stage
- Initial competency interviews on Teams
- Face to Face interview, competency and technical
If you’re an experienced data engineer, looking for an exciting career change we would love to hear from you today, apply now!

To Apply for this Job Click Here
Senior Data Engineer
£60000 - £65000
+ Data Engineering
PermanentWiltshire
To Apply for this Job Click Here
SENIOR DATA ENGINEER
Hybrid – Wiltshire – £60,000 – £65,000
Company
Our client is a forward-thinking, dynamic business that’s undergoing a digital transformation. They are committed to harnessing the power of data to drive strategic decisions and enhance customer experiences across B2B and B2C markets. Their dedicated data and analytics team is at the heart of this journey, exploring innovative technologies to fuel growth and deliver business intelligence across global operations.
Role
They are looking for a Senior Data Engineer to join their collaborative Data and Analytics team. In this key role, you will be responsible for managing and developing the company’s data infrastructure, ensuring that it is scalable, resilient, and aligned with the latest technological advancements. You’ll play a critical part in evaluating and integrating data from multiple sources, maintaining high-quality reporting, and ensuring data governance across markets in the UK, Ireland, Canada, and the USA.
You will also lead the migration of key infrastructure to the Cloud and provide guidance to a junior data engineer, supporting their development. As part of the Data and Analytics Leadership team, you’ll have the opportunity to lead strategic projects, enhance performance, and support a range of analytical and business intelligence teams across the organization.
Your Experience
To succeed in this role, you’ll need:
- Minimum of 5 years’ experience working with SQL production environments, ideally in a Data Engineer or DBA capacity.
- Expertise with SQL, T-SQL, and the ability to manage dynamic data warehouse loads.
- Extensive experience in data integration, modelling, and data ingestion.
- Strong hands-on experience with Azure, SSIS, and DataBricks.
- A collaborative, problem-solving mindset with a focus on continual optimization.
- Strong analytical skills and the ability to apply these in a business setting.
Desirable:
- Experience handling large datasets from both internal and external sources via APIs and SFTP.
- Familiarity with data visualization tools, such as Tableau.
- Knowledge of Information Security principles and collaboration with IT colleagues to ensure a secure infrastructure.
- Previous experience with tools like SAP, Microsoft NAV, or Erwin would be a plus.
- Strong stakeholder management skills and experience working closely with both data analysts and IT teams.
Benefits
- Competitive Salary & Benefits package.
- Opportunity to work with cutting-edge cloud technologies (Azure, DataBricks).
- Collaborative, supportive team with excellent growth opportunities.
- A chance to work on high-impact projects across multiple international markets.
- Hybrid Working: You’ll be required to be in the office 3 days per week, based in Wiltshire (reasonable commute required).
- Ongoing career development with opportunities to mentor and lead.

To Apply for this Job Click Here
Founding DevOps Engineer
San Francisco, CA
$170000 - $200000
+ Data Engineering
PermanentSan Francisco, California
To Apply for this Job Click Here
FOUNDING DEVOPS ENGINEER
REMOTE – US BASED
$170,000 – $200,000 BASE SALARY + EQUITY + BENEFITS
COMPANY & ROLE OVERVIEW
Our client develops advanced conversational AI and radar-powered sensor platforms to transform digital health, enabling real-time engagement and intelligent monitoring for consumers and healthcare providers. As a DevOps Engineer, you’ll help scale and automate cloud infrastructure to support secure, high-availability health services driven by cutting-edge AI and sensor technology.
RESPONSIBILITIES
- Architect and maintain cloud infrastructure for highly available, secure digital health services.
- Manage and enhance CI/CD pipelines for automated deployments.
- Operate and optimize Kubernetes clusters (AWS EKS), handling deployment, scaling, and troubleshooting.
- Collaborate with engineering teams to build infrastructure supporting radar sensors and LLM workloads.
- Implement infrastructure-as-code (Terraform, Helm) and automate monitoring/alerting.
- Monitor system health and performance with modern observability tools.
- Enforce security best practices: audits, access controls, secrets management.
REQUIREMENTS
- Bachelor’s degree in a relevant field (or equivalent experience).
- 7+ years in DevOps, SRE, or infrastructure engineering.
- Deep expertise in AWS (EKS, EC2, S3, RDS, CloudWatch, IAM, VPC).
- Skilled with Docker, Kubernetes, Terraform, CI/CD tools (GitHub Actions, Jenkins, etc.).
- Experience with observability tools (Prometheus, Grafana, ELK/EFK, Datadog).
- Strong scripting ability (Python, Bash, or Go).
- Solid understanding of Linux, networking, and cloud security.
- Excellent troubleshooting and teamwork skills.
BENEFITS
- Competitive salary, equity, medical/dental/vision, 401(k), paid time off.

To Apply for this Job Click Here
Senior Data Engineer
New York
$70 - $90
+ Data Engineering
ContractNew York
To Apply for this Job Click Here
Job Summary:
Seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support data-driven decision-making across the organization. You’ll play a key role in transforming raw data into actionable insights, working with tools like Redshift, Airflow, AWS, DBT, Git, and modern CI/CD practices.
Responsibilities:
-
Design, build, and maintain robust ETL/ELT pipelines using tools such as Apache Airflow and DBT.
-
Develop and optimize data models and warehouse structures in Amazon Redshift.
-
Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and deliver solutions.
-
Implement and manage CI/CD pipelines for data workflows to ensure high-quality, reliable deployments.
-
Ensure data quality, consistency, and integrity across systems through validation and testing practices.
-
Manage infrastructure on AWS, leveraging services like S3, Lambda, Glue, and CloudWatch.
-
Monitor performance and troubleshoot data pipeline issues to ensure timely and accurate data availability.
-
Enforce best practices in data governance, security, and access controls.
-
Participate in code reviews, technical design discussions, and contribute to overall architecture planning.
-
Mentor junior data engineers and support team development.
Required Skills and Qualifications:
-
5+ years of professional experience in data engineering or a related field.
-
Strong expertise in Amazon Redshift, including performance tuning and schema design.
-
Hands-on experience with Apache Airflow for orchestration of data pipelines.
-
Proficient with AWS cloud services related to data engineering.
-
Expertise in building and managing DBT models and transformations.
-
Solid understanding of ETL/ELT processes and data integration patterns.
-
Experience with version control systems like Git and implementing CI/CD workflows.
-
Proficient in SQL and at least one programming language such as Python.
-
Familiar with data warehousing, dimensional modeling, and big data concepts.
-
Strong problem-solving skills and attention to detail.
-
Excellent communication and collaboration abilities.
Preferred Qualifications:
-
Experience in real-time data processing or event-driven architecture.
-
Familiarity with containerization tools (e.g., Docker) and infrastructure-as-code (e.g., Terraform).
-
Background in analytics, statistics, or data science.

To Apply for this Job Click Here
Java Developer/AI Engineer
Manhattan
$50 - $60
+ Data Engineering
PermanentManhattan, New York
To Apply for this Job Click Here
Position Overview
A growing fintech organization is seeking a talented Java Developer with experience integrating Generative AI technologies into enterprise-grade systems. This role involves developing backend services, APIs, and data-driven applications that enhance financial operations through AI automation and intelligent insights. The ideal candidate combines strong Java engineering skills with curiosity and hands-on experience applying LLMs or other AI models in production environments.
Key Responsibilities
-
Design, develop, and maintain Java-based microservices and APIs to support AI-enhanced financial applications.
-
Collaborate with data science and AI engineering teams to integrate Generative AI models (e.g., OpenAI, Anthropic, Hugging Face) into backend systems.
-
Implement scalable and secure solutions for data ingestion, transformation, and model inference.
-
Build and maintain RESTful and event-driven architectures optimized for high performance and low latency.
-
Contribute to prompt optimization, model evaluation, and the fine-tuning of AI-driven application components.
-
Write clean, efficient, and maintainable code following best practices for software design and testing.
-
Participate in code reviews, architectural discussions, and Agile ceremonies.
-
Ensure high availability, reliability, and security of production systems.
-
Continuously evaluate new technologies to improve AI integration and developer efficiency.
Qualifications
-
Bachelor’s degree in Computer Science, Engineering, or a related technical field.
-
4-6+ years of professional software development experience with Java (Spring Boot, Quarkus, or Micronaut preferred).
-
Solid understanding of microservice architectures, REST APIs, and event-driven systems.
-
Hands-on experience working with or integrating Generative AI models via APIs or SDKs (e.g., OpenAI, Vertex AI, Bedrock).
-
Familiarity with AWS or other cloud platforms for deploying and managing AI applications.
-
Strong understanding of data pipelines, JSON, and message queues (Kafka, RabbitMQ, or SNS/SQS).
-
Experience with CI/CD pipelines, Git-based workflows, and DevOps best practices.
-
Excellent communication and collaboration skills across cross-functional technical teams.
Preferred Qualifications
-
Experience in financial technology or data-intensive environments.
-
Knowledge of Python for AI model experimentation or prompt engineering.
-
Familiarity with RAG (Retrieval-Augmented Generation) architectures and vector databases.
-
Exposure to containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform, CloudFormation).
-
Interest in exploring multi-agent systems, AI-driven automation, or LLM application frameworks.

To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
From Start-Up to Scale-Up: Hire Exceptional Data Talent in Two Weeks
By Guillian Eller, Manager AI/ML – Harnham You’re growing fast. You needed data talent yesterday. The reality…
Reskilling & Upskilling: What US Data Professionals Are Doing
By Luc Simpson-Kent, Managing Consultant – Harnham US Candidates want growth. Employers want retention. And in today’s…
What’s Driving Northern UK’s Data & AI Hiring in 2025?
by Jamie Smith, Senior Manager at Harnham, UK. At a glance The Northern data and tech market…
The Key to a Strong AI Team: Diversity
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Every company wants to build…
Why US Companies Are Scaling AI with Contractors in 2025
Artificial intelligence has arrived in the workplace and it’s changing how companies are structured, resourced, and scaled. …
How Sacher.AI Strengthened Its GenAI Delivery in Just 12 Days
by Thomas Savidge, Principal Consultant – AI, Machine Learning and Data Science Sacher.AI, a UK-based innovation lab…
From Zero to AI: How One Investment Firm Built a World-Class Team in 18 Days
A global investment advisor managing over $268 billion across real estate, equity, and credit needed to build…
How to Maximise Your Data’s Value: The Use of AI in Advanced Analytics
By Roshni Baillie, Recruitment Consultant – Marketing & Insight, Harnham One thing I’m hearing again and again…
AI Governance Starts with People
By Kiran Ramasamy, Managing Consultant, Harnham When it comes to AI it is no longer a question…
15,000 Placements Later: What We’ve Learned About the Global Data & AI Talent Market
 By David Farmer, CEO, Harnham Global We haven’t just hit 15,000 placements, we’ve launched 15,000 careers,…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.









