Harnham
SEARCH
Shortlist

Senior Data Engineer

London
£70000 - £80000 per annum + +benefits
Apply Save job

SENIOR DATA ENGINEER (PYTHON)

£70,000-£80,000 + BENEFITS

REMOTE WORKING/CENTRAL LONDON

Are you an experienced senior engineer wanting to move into a fast moving data led business? Do you want to work on a Python and big data engineering team? This Data Engineer position offers the opportunity to work on cutting edge serverless data solutions projects using AWS, Spark and Python, with the opportunity to work remotely twice a week.

THE COMPANY

An opportunity to work in a growing team within an iconic and rapidly expanding tech focused e-commerce business. Having recently recorded record sales after developing a greenfield data platform, they are now looking for a Senior Data Engineer with experience using serverless AWS technology such as Lambdas, alongside tech such as Python, Spark and SQL.

THE ROLE

As a Senior Data Engineer, you will have the opportunity to work on their new serverless data platform.

In this role you could also expect to:

  • Build data pipelines using python
  • Apply your knowledge of big data tools such as Spark
  • Work on creating complex big data solutions surrounding both customer data and business data, using technologies such as Python and AWS

THE CANDIDATE

The successful Senior Data Engineer will likely have the following skills and experience:

  • Educated to a degree level or above within a numerical discipline
  • Python programming experience
  • An in-depth knowledge and commercial experience of spark
  • Experience using cloud technologies, such as AWS
  • A commercial knowledge of serverless AWS technologies such as Lambdas

BENEFITS

Benefits include £70,000-£80,000 PA dependent on experience. You will also receive a range of incredible benefits, including competitive holiday allowance, work from home, and many more.

HOW TO APPLY

Please register your interest by sending your CV to Kyle Fenton via the Apply link on this page.

Apply Save job
Send similar jobs by email
100984/KF
London
£70000 - £80000 per annum + +benefits
  1. Permanent
  2. Big Data

Similar Jobs

Software Engineer - OUTSIDE IR35
Salary

Up to £400 per day

Location

London

Description

A chance to work for a leading ecommcerce company in a fast paced environment on ML models

ADD TO SHORTLIST
DATA ENGINEER
Salary

€50000 - €60000 per annum

Location

Paris, Île-de-France

Description

En plein développement, cette entreprise de conseil en marketing recherche un Data Engineer pour rejoindre son équipe

ADD TO SHORTLIST
Senior Data Engineer
Salary

£70000 - £75000 per annum

Location

London

Description

A new role for a Senior Data Engineer within an international media company based in London.

ADD TO SHORTLIST
DATA ENGINEER
Salary

€50000 - €60000 per annum

Location

Paris, Île-de-France

Description

En plein développement, cette entreprise de conseil en marketing recherche un Data Engineer pour rejoindre son équipe

ADD TO SHORTLIST

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

The Dialogue: Keeping Data Secure While Working Flexibly

Last week, Peter Schroeter and Ryan Collins, head of DevSecOps at Upvest, and co-founder of RapidGroup, discussed how to keep Data secure while working flexibly.  Ryan brings to the table 12 years of experience from Server Administrator to CTO roles as well as experience as a Contractor. And as a business owner himself, he sees where the shortage falls and perhaps a way to fill the gap. Security is in the Spotlight Security is a priority for many businesses today. Avoiding negative PR has caused an internal shift in which companies take more care with their Data. There is also a Catch-22. In order to provide higher levels of security, businesses are slowing down their developers and software engineers, and taking more engineering time which in turn costs more money. Security before cost is becoming the new reality. The contradiction of deployment, project run time, and budgets are only part of the bigger picture. Compromise is key and follow these three tenets. Don’t leave anything open to vulnerability.Focus on auditability.Offer more training for Software Engineers. The Security-Focused Skills Gap How can you push security forward in a meaningful way when you can’t find the people you need with relevant experience? There’s a big gap in the market right now for security-oriented DevOps engineers. The skillsets many businesses are looking for include: Google Platform AWS and possibly Azure with a modern suite of tools with Teraform.Ability to float to the development side and work in SRE to ensure things are stable and scalable.DevOps Engineers with experience in the GO stack are especially hard to find. Companies want to go with what they know. However, there is a shift toward a more remote-friendly and contractor culture. When you can’t find the talent you need, sometimes it’s best to bite the bullet, and consider a Contractor. The Case to Hire a Contractor If this year has taught us anything, it’s that we don’t have to be confined to an office or to even one location. And yes, while there is an element of risk to being a Contractor, there are benefits to both sides. Contractors are compensated higher because businesses have lower HR costs, less tax regulations, payroll, and reporting to do.  Though there is some risk, there is always work for because so many companies want to secure their data. There’s always something to be optimised, always something which needs attention. You won’t be without work for long, if you have the skills. Disconnect Between Capability and Desire in the Market Some candidates have mentioned they have 60% of the skills required, but not enough project-based experience. How do you reconcile the disconnect?  It’s hard to specialise in DevOps, DevSecOps, and similar roles because it’s about automation, you have to be that "Swiss Army Knife", you have to live in the middle. You have to know how to get into the code, you have to know how to get in and do the CI workflows, etc. It’s almost Developer plus value-added skills or security engineer plus value-added skills. Remote Working Habits You Need Now Have a separated space set up for work.If you have a mix of people in office and those working remote, you have to make sure they’re communicating with each other.Rolling coffee breaks within Google Meet or something similar.Have a task management and time tracking system used by employees both on and offline.Build culture by picking at random two people and putting them together for a half hour to have a conversation that isn’t about work.  Startup vs Legacy Hiring Don’t box yourself in, but understand startups have a unique set of skills they need and most often without the budget to train someone. Whereas legacy businesses more often than not have the budget to train someone in the skillset they need. However, it’s important to note, the tech stack itself doesn’t really change. Best Practices for Async-Comm Teams Remember not everyone works in the same time zone. Don’t expect and immediate answer, and if you need an immediate answer, pick up the phone. Make sure your team has remote tools such as Slack or Google Meet and is doing most of their communication this way, even if they are in an office. If you don’t, your remote workers could be missing key information. The Future of DevOps and Data Security Many businesses may see a shift toward a more open working environment which is a good balance for what works best for talent and is good for productivity as well. Ultimately, we’re all solving the same challenges What is most important when it comes to keeping Data secure? Most important is getting people, systems, and education in place to do something in the first place. In other words, build from concept rather than moving too fast and breaking too many things. How Can Prospective Candidates Prepare? Focus on continuous learning and getting your skillsets like automation tools. If you really want to get involved with security side and SRE, you really have to get involved with the development side, too. Using the modern tech stacks like the GOLANG, the RUST, the SWIFT on the mobile side, and there’s always new pieces to the puzzle.There’s room for all types of relationships. Whether you’re looking for a long-term role, a short-term role, or something in between, DevOps is a never-ending project, so continuous learning is key for both candidate and company. You can watch the full conversation below:

Ali Mirza

03. December 2020

News

It Takes Two: Data Architect Meets Data Engineer

Information. Data. The lifeblood of business. Information and data are used interchangeably, gathered, collected, and analysed to create actionable insights for informed business decisions. So, what does that mean exactly? And to that end, how do we know what information or data we need to make those decisions? Enter the Data Architect. The Role of a Data Architect Just like you might hire an architect to sketch out your dreamhouse, the Data Architect is a Data Visionary. They see the full picture and can craft the design and framework creating the blueprint for the Data Engineer, who will ultimately build the digital framework. Data Architects are the puzzle solvers who can take a jumble of puzzle pieces, in this case massive amounts of data, and put everything in order. It’s their job to figure out what’s important and what isn’t based on an organisation's business objectives. Skills for a Data Architect might include: Computer Science degree, or some variation thereof.Plenty of experience working with systems and application development.Extensive knowledge and able to deep dive into Information ManagementIf you’re just starting your Data Architect path, be prepared for years of building your experience in data design, data storage, and Data Management. The Role of a Data Engineer The Data Engineer builds the vision and brings it to life. But they don’t work in a vacuum and are integral to the Data Team working nearly in tandem with the Data Architect. These engineers are building the infrastructure – the pipelines and data lakes. Once exclusive to the software-engineering field, the data engineer’s role has evolved exponentially as data-focused software became an industry standard. Important skills for a Data Engineer might include. Strong developer skills.Understand a host of technologies such as Python, R, Hadoop, and moreCraft projects to show what you can do, not just talk about what you can do – your education isn’t much of a factor when it comes to data engineering. On the job training does it best.Social and communication skills are critical as you map initial designs, and a love of learning keeps everything humming along, even as technology libraries shift, and you have to learn something new. The Major Differences between the Data Architect and Data Engineer RolesAs intertwined as these two roles might seem, there are some crucial differences. Data Architect Crafts concept and visualises frameworkLeads the Data Science teams Data Engineer Builds and maintains the frameworkProvides supporting framework With a focus on Database Management technologies, it can seem as though Data Architect and Data Engineer are interchangeable. And at one time, Data Architects did also take on the Data Engineering role. But the knowledge each has is used differently.  Whether you’re looking to enter the field of Data Engineering, want to move up or over with your years of experience to Data Architect, or are just starting out. Harnham may have a role for you. Check out our current opportunities or get in touch with one of our expert consultants to learn more.  

Eoin Pierce

Eoin Pierce

26. November 2020

News

Recently Viewed jobs