DATA ENGINEERING AND BIG DATA
TALENT SOLUTIONS
Processing Big Data has become crucial to countless businesses. Those who decide to pursue a career within Big Data face complex development challenges, too tough for relational database systems. After all, there is no Data Science without Data Engineers.
Whilst businesses may have vast quantities of data at the ready, it holds no real value unless it can be stored, harnessed and utilised. It’s estimated that most UK companies have at least 100 terabytes of data stored which could be used for various purposes around the business, as well as newly accessible hard-to-process sources such as web data, image data, and social media data.
This is where those who work in Data Engineering become extremely valuable, as they develop Data Platforms that allow this kind of volume to be processed and used by Data Scientists and analysts across the business.
WHY
HARNHAM?
OUR
SERVICES
-
Permanent and Contract Recruitment: We offer both permanent and contract recruitment solutions, adapting flexibly to support the dynamic requirements of your Big Data and Data Engineering projects.
Â
-
Executive Search: Our executive search service focuses on identifying and securing top-tier leaders in the Data Engineering domain who can advance your strategic goals and technological advancements.
Â
-
Industry-Specific Expertise: Our operations span multiple industries, providing specialized recruitment solutions tailored to the distinctive challenges and opportunities of your sector.
Â
Contact us today to discover how our custom talent solutions can bolster your organization's Data Engineering prowess.
JOBS
LATEST
OPPORTUNITIES
Harnham are a specialist Data & AI recruitment business with teams that only focus on niche areas.
Backend Engineer
Austin
$140000 - $160000
+ Data Engineering
PermanentAustin, Texas
To Apply for this Job Click Here
What You’ll Do
- Own and evolve the metrics platform, including schemas, storage layouts optimized for high-volume writes and fast analytical reads, and clear versioning strategies
- Build and maintain a framework for writing and running metrics, including interfaces, examples, local execution, and CI compatibility checks
- Design and implement testing systems for metrics and pipelines, including unit, contract, and regression tests using synthetic and sampled data
- Operate compute and storage systems in production, with responsibility for monitoring, debugging, stability, and cost awareness
- Partner with metric authors and stakeholders across development, analytics, and QA to plan changes and roll them out safely
What You’ll Need
- Strong experience using Python in production, including asynchronous programming (e.g., asyncio, aiohttp, FastAPI)
- Advanced SQL skills, including complex joins, window functions, CTEs, and query optimization through execution plan analysis
- Solid understanding of data structures and algorithms, with the ability to make informed performance trade-offs
- Experience with databases, especially PostgreSQL (required); experience with ClickHouse is a strong plus
- Understanding of OLTP vs. OLAP trade-offs and how schema and storage decisions affect performance
- Experience with workflow orchestration tools such as Airflow (used today), Prefect, Argo, or Dagster
- Familiarity with data libraries and validation frameworks (NumPy, pandas, Pydantic, or equivalents)
- Experience building web services (FastAPI, Flask, Django, or similar)
- Comfort working with containers and orchestration tools like Docker and Kubernetes
- Experience working with large-scale datasets and data-intensive systems
Nice to Have
- Ability to read and make small changes in C++ code
- Experience building ML-adjacent metrics or evaluation infrastructure
- Familiarity with Parquet and object storage layout/partitioning strategies
- Experience with Kafka or task queues
- Exposure to basic observability practices (logging, metrics, tracing)

To Apply for this Job Click Here
Engineering Manager – Enterprise Security
Washington, DC
$200000 - $250000
+ Data Engineering
PermanentWashington, District of Columbia
To Apply for this Job Click Here
Engineering Manager, Enterprise Security
Fully Remote – USA
$200,000 – $250,000
The Opportunity
My client is expanding their Enterprise Security product line and are looking for a technical leader to build and scale the engineering team behind it. This group develops the security capabilities that enterprise IT leaders rely on to approve, deploy, and trust our platform.
You’ll lead the development of high-impact features such as data loss prevention, audit logging, SIEM integrations, encryption controls, and data governance capabilities. These products are directly tied to large enterprise deals and long-term revenue growth.
This role combines hands-on technical leadership with team building and product ownership. You’ll shape the roadmap, define success metrics, and ensure we deliver enterprise-grade security features that meet the highest standards of reliability and compliance.
What You’ll Own
Technical Direction & Delivery
- Drive architecture and technical strategy for enterprise security products.
- Contribute meaningfully to the codebase while guiding engineering standards and quality.
- Deliver key roadmap milestones, including advanced DLP capabilities and real-time SIEM integrations.
- Ensure security services meet strict uptime, compliance, and audit requirements.
Team Leadership & Growth
- Build and develop a high-performing engineering team focused on enterprise security.
- Establish clear ownership, execution standards, and performance expectations.
- Create clarity in ambiguous spaces and guide the team toward measurable outcomes.
Product & Business Impact
- Partner closely with Product to define and prioritize initiatives based on enterprise customer needs.
- Align engineering efforts with adoption, deal velocity, and revenue impact.
- Help shape Enterprise Security as a distinct and strategic product area within the broader platform.
What You Bring
- Proven experience building enterprise security products for IT administrators and security leaders (e.g., DLP, SIEM integrations, audit systems, access controls, encryption, compliance tooling).
- Strong understanding of enterprise buyers, compliance requirements, and the operational expectations of security products.
- 5+ years of hands-on software engineering experience, ideally in modern web stacks (Node.js/TypeScript, React, or similar).
- 2+ years of experience managing and mentoring engineers, with a history of delivering complex, high-impact systems.
- Comfort operating in high-visibility environments where reliability and trust are non-negotiable.
- Experience leveraging AI tools to accelerate development workflows or a strong interest in adopting them.
- Excellent remote collaboration skills, with experience leading distributed teams through clear documentation and async communication.
Nice to Have
- Experience working with enterprise compliance frameworks such as SOC 2, FedRAMP, or GDPR.
- Familiarity with integrations across enterprise security ecosystems (e.g., SIEM platforms and monitoring tools).
- Background in companies evolving from SMB-focused offerings to enterprise-scale solutions.

To Apply for this Job Click Here
Lead Fullstack Software Engineer
Dallas
$180000 - $200000
+ Data Engineering
PermanentDallas, Texas
To Apply for this Job Click Here
Lead Full Stack Software Engineer C#/.NET & React
4 Days per week onsite in Dallas, TX or Chicago, IL
We are seeking an experienced Lead Full Stack Software Engineer to join industrial real estate client. This is a hands-on technical leadership role where you’ll guide a team of 9 engineers while maintaining significant individual contribution through code review, architecture decisions, and strategic technology initiatives.
About the Role
As Lead Full Stack Software Engineer, you’ll be the technical anchor for our engineering team, ensuring code quality, architectural consistency, and technical excellence across our platform. You’ll balance hands-on technical work with team leadership, owning the full lifecycle of 10+ critical APIs while mentoring engineers and driving adoption of modern development practices.
Key Responsibilities
- Conduct comprehensive code reviews for a team of 9 engineers, ensuring adherence to best practices, design patterns, and architectural standards
- Own and maintain 10+ production APIs that support core business operations
- Lead proof-of-concept initiatives and evaluate new tools, frameworks, and technologies to continuously improve our tech stack
- Design and implement full stack solutions using C#, .NET, React, and Azure services
- Architect scalable solutions within distributed computing environments
- Drive CI/CD pipeline improvements and champion DevOps best practices across the team
- Collaborate closely with product managers, business stakeholders, and cross-functional teams to translate requirements into technical solutions
- Mentor and develop junior and mid-level engineers through pair programming, technical guidance, and career development
- Establish and enforce coding standards, documentation practices, and software development lifecycle (SDLC) processes
- Participate in architecture reviews and provide technical direction for complex engineering challenges
Required Qualifications
- 7+ years of professional software engineering experience with full stack development
- Strong proficiency in C# and .NET framework/core for backend development
- Expert-level experience with React for modern front-end development
- Hands-on experience with Azure cloud services (App Service, Functions, Storage, SQL Database, etc.)
- Deep understanding of distributed computing environments and microservices architecture
- Proven experience with CI/CD processes and tools (Azure DevOps, GitHub Actions, or similar)
- Strong knowledge of RESTful API design, development, and maintenance
- Experience owning and operating APIs in production environments
- Solid understanding of the full Software Development Lifecycle (SDLC)
- Demonstrated ability to conduct thorough code reviews and provide constructive technical feedback
- Excellent written and verbal communication skills with ability to explain complex technical concepts to non-technical stakeholders
- Experience leading technical initiatives and proof-of-concepts
Nice to Have
- Experience in real estate technology, property management systems, or similar domains

To Apply for this Job Click Here
SENIOR BUSINESS ANALYST (RISK ANALYTICS)
Phoenix, AZ
$115000 - $130000
+ Data Engineering
PermanentPhoenix, Arizona
To Apply for this Job Click Here
SENIOR BUSINESS ANALYST (RISK ANALYTICS)
HYBRID – GREATER PHOENIX AREA
$115,000 – $130,000 BASE + FULL BENEFITS
The Opportunity
We’re partnering with a large, data-driven residential real estate platform operating at national scale, where analytics directly influence who gets approved, how homes are filled, and how risk is managed.
This is a high-impact senior analyst role, not a reporting-only position. You’ll own analyses that shape resident screening strategy, occupancy outcomes, and credit performance, with regular visibility to executive leadership.
What You’ll Be Working On
- Analyze resident screening, approval, and performance data to balance occupancy growth vs. credit risk
- Identify trends, tradeoffs, and root causes behind key business metrics
- Develop SQL-based analyses pulling from large production data warehouses
- Translate complex data into clear recommendations for senior and executive stakeholders
- Monitor KPIs tied to screening outcomes, resident performance, and operational efficiency
- Partner cross-functionally with Risk, Operations, Revenue, and Data teams
- Improve data quality and integrity by influencing upstream processes and systems
What We’re Looking For
- 5+ years in business analytics, data analytics, or consulting
- Strong SQL skills with experience working in large, messy datasets
- Experience using data to influence policy, pricing, or risk decisions
- Comfort presenting insights and recommendations to senior leadership
- Ability to manage multiple projects in a fast-paced, high-ownership environment
- Curious, problem-solving mindset with strong business intuition
Strong Pluses
- Credit, risk, pricing, or underwriting analysis experience
- Consulting background
- Python for data analysis (pandas, dataframes)
- Experience with statistical analysis or model monitoring
- Prior exposure to executive-level storytelling with data
Tech Stack (Core)
- SQL (complex queries, joins, aggregations)
- Excel (pivot tables, lookups)
- Python for data analysis
- BI tools and cloud-based data warehouses
Why This Role
This role sits at the intersection of data, strategy, and real-world outcomes. Your work directly impacts revenue, risk exposure, and customer experience at national scale. You’ll have autonomy, executive exposure, and the chance to expand beyond one function as the business grows.
If you’re motivated by using data to drive decisions-not just dashboards, APPLY.

To Apply for this Job Click Here
SENIOR SOFTWARE ENGINEER, AI PRODUCT
San Francisco, CA
$180000 - $220000
+ Data Engineering
PermanentSan Francisco, California
To Apply for this Job Click Here
SENIOR SOFTWARE ENGINEER, AI PRODUCT
REMOTE – UNITED STATES
$180,000 – $220,000 BASE + EQUITY + BENEFITS
The Opportunity
We’re working with a collaborative SaaS company embedding AI directly into its core product experience. The focus isn’t demos or prototypes-it’s shipping real AI-powered features that help teams create, collaborate, and make decisions faster.
This role sits at the intersection of product engineering and applied AI, ideal for engineers who enjoy building polished user-facing experiences backed by LLMs and modern cloud infrastructure.
What You’ll Be Working On
- Build and ship AI-powered product features (e.g. chat assistants, summaries, contextual recommendations)
- Integrate LLMs into production systems using modern SDKs and APIs
- Design end-to-end workflows from frontend → backend → AI services
- Collaborate closely with product and design to shape AI-driven UX
- Improve reliability, performance, and iteration speed of AI features
- Contribute to patterns and best practices for AI product development
What We’re Looking For
- 5+ years of experience as a software engineer
- Strong TypeScript / JavaScript background with modern frontend frameworks
- Experience building backend services and APIs (Node.js, serverless, etc.)
- Hands-on experience shipping AI features using LLMs (RAG, agents, copilots, etc.)
- Product-oriented mindset with high ownership
- Comfort working in ambiguity and iterating quickly
Tech Stack (Core)
- TypeScript, React / Next.js
- Node.js, serverless backends
- Cloud infrastructure (AWS or similar)
- LLM platforms (e.g. Bedrock, OpenAI, Anthropic)
- RAG pipelines and AI SDKs
Why This Role
- You’ll help define what great AI product experiences look like at a company investing deeply in AI. High visibility, strong product partnership, and the chance to shape how AI shows up for thousands of users.

To Apply for this Job Click Here
Engineering Manager- Security
District of Columbia
$200000 - $240000
+ Data Engineering
PermanentDistrict of Columbia
To Apply for this Job Click Here
Engineering Manager, Enterprise Security
Fully Remote- USA
The Opportunity
My client is expanding their Enterprise Security product line and are looking for a technical leader to build and scale the engineering team behind it. This group develops the security capabilities that enterprise IT leaders rely on to approve, deploy, and trust our platform.
You’ll lead the development of high-impact features such as data loss prevention, audit logging, SIEM integrations, encryption controls, and data governance capabilities. These products are directly tied to large enterprise deals and long-term revenue growth.
This role combines hands-on technical leadership with team building and product ownership. You’ll shape the roadmap, define success metrics, and ensure we deliver enterprise-grade security features that meet the highest standards of reliability and compliance.
What You’ll Own
Technical Direction & Delivery
-
Drive architecture and technical strategy for enterprise security products.
-
Contribute meaningfully to the codebase while guiding engineering standards and quality.
-
Deliver key roadmap milestones, including advanced DLP capabilities and real-time SIEM integrations.
-
Ensure security services meet strict uptime, compliance, and audit requirements.
Team Leadership & Growth
-
Build and develop a high-performing engineering team focused on enterprise security.
-
Establish clear ownership, execution standards, and performance expectations.
-
Create clarity in ambiguous spaces and guide the team toward measurable outcomes.
Product & Business Impact
-
Partner closely with Product to define and prioritize initiatives based on enterprise customer needs.
-
Align engineering efforts with adoption, deal velocity, and revenue impact.
-
Help shape Enterprise Security as a distinct and strategic product area within the broader platform.
What You Bring
-
Proven experience building enterprise security products for IT administrators and security leaders (e.g., DLP, SIEM integrations, audit systems, access controls, encryption, compliance tooling).
-
Strong understanding of enterprise buyers, compliance requirements, and the operational expectations of security products.
-
5+ years of hands-on software engineering experience, ideally in modern web stacks (Node.js/TypeScript, React, or similar).
-
2+ years of experience managing and mentoring engineers, with a history of delivering complex, high-impact systems.
-
Comfort operating in high-visibility environments where reliability and trust are non-negotiable.
-
Experience leveraging AI tools to accelerate development workflows or a strong interest in adopting them.
-
Excellent remote collaboration skills, with experience leading distributed teams through clear documentation and async communication.
Nice to Have
-
Experience working with enterprise compliance frameworks such as SOC 2, FedRAMP, or GDPR.
-
Familiarity with integrations across enterprise security ecosystems (e.g., SIEM platforms and monitoring tools).
-
Background in companies evolving from SMB-focused offerings to enterprise-scale solutions.

To Apply for this Job Click Here
VP of Engineering – Fintech
New York
$325000 - $350000
+ Data Engineering
PermanentNew York
To Apply for this Job Click Here
VP of Engineering – Fintech
Location: New York, NY (3 days/week on site minimum)
Compensation: $325,000-$350,000 base + 40% bonus + RSUs
About the Company
Harnham is partnering with a Fortune 500 leader in cybersecurity and digital trust, combining the scale of a global enterprise with the agility of a startup culture. The company protects hundreds of millions of users worldwide, boasts best-in-class retention, and maintains an unwavering commitment to innovation.
Its platform processes over half a million telemetry events per second, and following a major fintech acquisition in 2025, the organization has significantly expanded its footprint in New York City.
The Role
They are looking for a Vice President of Engineering to oversee a global engineering organization of 150+ professionals, supported by approximately 10 direct reports. This is a highly visible, reporting directly to the C-suite.
Key responsibilities include:
-
Leading the development of customer-facing applications across mobile and web, as well as core backend and infrastructure initiatives.
-
Driving the integration of existing products with newly acquired fintech platforms to unlock and maximize strategic value.
-
Advancing AI adoption across both products and internal operations, with AI solutions already live in production and a target of achieving 30%+ productivity improvements.
-
Scaling platforms to support large-scale, real-time, high-throughput environments.
-
Shaping business and technology strategy in close partnership with senior executive leadership.
Ideal Candidate Profile
-
10+ years of experience leading commercial software development teams.
-
Demonstrated success within scaling fintech organizations with customer-facing products (e.g., Stripe, Plaid, Chime, Chase, Capital One).
- Experience with regulatory requirements is a plus.
-
Deep experience designing and operating large-scale, real-time systems.
-
Strong technical grounding, with experience in Java, React, or Scala preferred; background in platform or system migrations is a plus.
-
Ability to thrive in a fast-moving Fortune 500 environment with a startup mindset; comfortable in matrixed companies.
-
Strategic, forward-looking leader with a strong interest in AI-powered innovation.
BENEFITS
The compensation package contains a base salary, bonus, RSUs and a comprehensive benefits package.
HOW TO APPLY
Please register your interest by sending your CV via the Apply link on this page.
KEY TERMS
Software Engineering | Leadership | VP | Engineering | Fintech | Customer | Customer-Facing | Product | Production | Real Time | Vice President | Regulation | Python | Compliance | Regulatory | Startup Environment | Executive | Scale | Scaling | Artificial Intelligence

To Apply for this Job Click Here
Lead Data Engineer
Leeds
£100000 - £120000
+ Data Engineering
PermanentLeeds, West Yorkshire
To Apply for this Job Click Here
Lead Data Engineer
£100,000 – £120,000
UK, Remote
An opportunity for a highly technical Lead Data Engineer looking to join a fast-growing Online Gambling and Sports Betting Platform that focuses on its first-in-class mobile app.
THE COMPANY
This future-ready Online Gambling and Sports Betting Platform offers customers the best mobile app experience in the industry.
THE ROLE
As a Lead Data Engineer, you will take charge of a Data Engineering team focused on data ingestion and modelling.
Specifically, you can expect to be involved in the following:
- ETL pipelines for data ingestion and data modelling
- Using AWS to store and process data, with Snowflake as the data warehouse
- Use of Python and SQL
- Data orchestration and use of Terraform
SKILLS AND EXPERIENCE
The successful Lead Data Engineer will have the following skills and experience:
- Strong Python and SQL skills
- AWS or GCP
- Orchestration, ideally with Airflow or Dagsta but open to others
- Data warehousing – Snowflake, Redshift, BigQuery (NOT Databricks)
- Terraform or Palumi
BENEFITS
The successful Lead Data Engineer will receive the following benefits:
- Salary between £100,000 – £120,000 – depending on experience
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

To Apply for this Job Click Here
Lead Data Engineer
Manchester
£100000 - £120000
+ Data Engineering
PermanentManchester, Greater Manchester
To Apply for this Job Click Here
Lead Data Engineer
£100,000 – £120,000
UK, Remote
An opportunity for a highly technical Lead Data Engineer looking to join a fast-growing Online Gambling and Sports Betting Platform that focuses on its first-in-class mobile app.
THE COMPANY
This future-ready Online Gambling and Sports Betting Platform offers customers the best mobile app experience in the industry.
THE ROLE
As a Lead Data Engineer, you will take charge of a Data Engineering team focused on data ingestion and modelling.
Specifically, you can expect to be involved in the following:
- ETL pipelines for data ingestion and data modelling
- Using AWS to store and process data, with Snowflake as the data warehouse
- Use of Python and SQL
- Data orchestration and use of Terraform
SKILLS AND EXPERIENCE
The successful Lead Data Engineer will have the following skills and experience:
- Strong Python and SQL skills
- AWS or GCP
- Orchestration, ideally with Airflow or Dagsta but open to others
- Data warehousing – Snowflake, Redshift, BigQuery (NOT Databricks)
- Terraform or Palumi
BENEFITS
The successful Lead Data Engineer will receive the following benefits:
- Salary between £100,000 – £120,000 – depending on experience
HOW TO APPLY
Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

To Apply for this Job Click Here
CAN’T FIND THE RIGHT OPPORTUNITY?
GET IN TOUCH
today
If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.
Industry Hub
HARNHAM
News & Blog
With over 10 years experience working solely in the Data & AI sector our consultants are able to offer detailed insights into the industry.
Visit our Blogs & News portal or check out our recent posts below.
How Analytics Teams Drive Value Creation in Growth-Stage Portfolio Companies
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Analytics teams support value creation…
How a Leading European Media Group Unified Its Data Strategy with Harnham
by Jamie Smith, Senior Manager at Harnham, UK. A major privately owned media organisation in Europe, employing…
From Start-Up to Scale-Up: Hire Exceptional Data Talent in Two Weeks
By Guillian Eller, Manager AI/ML – Harnham You’re growing fast. You needed data talent yesterday. The reality…
Reskilling & Upskilling: What US Data Professionals Are Doing
By Luc Simpson-Kent, Managing Consultant – Harnham US Candidates want growth. Employers want retention. And in today’s…
What’s Driving Northern UK’s Data & AI Hiring in 2025?
by Jamie Smith, Senior Manager at Harnham, UK. At a glance The Northern data and tech market…
The Key to a Strong AI Team: Diversity
by Tom Brammer, Senior Manager – AI and Machine Learning US Team Every company wants to build…
Why US Companies Are Scaling AI with Contractors in 2025
Artificial intelligence has arrived in the workplace and it’s changing how companies are structured, resourced, and scaled. …
How Sacher.AI Strengthened Its GenAI Delivery in Just 12 Days
by Thomas Savidge, Principal Consultant – AI, Machine Learning and Data Science Sacher.AI, a UK-based innovation lab…
From Zero to AI: How One Investment Firm Built a World-Class Team in 18 Days
A global investment advisor managing over $268 billion across real estate, equity, and credit needed to build…
How to Maximise Your Data’s Value: The Use of AI in Advanced Analytics
By Roshni Baillie, Recruitment Consultant – Marketing & Insight, Harnham One thing I’m hearing again and again…
Testimonials
Client and
candidate
testimonials
A trusted partner of professionals
across the globe.
We understand the challenges our
customers face and offer the
recruitment solutions needed to drive
business success through Data &
AI.









