Harnham
SEARCH
Shortlist

Senior Data Engineer

London
£500 - £550 per day

This vacancy has now expired. Please see similar roles below...

SENIOR DATA ENGINEER - OUTSIDE IR35
£500-5500 PER DAY
3 MONTH CONTRACT
FULLY REMOTE

As a Data Engineer, you will be building end to end data pipelines in Python within AWS, using EMR, Spark and Redshift

THE COMPANY:

As a Data Engineer, you will be working for a retail client. You will be working fas part of a fast paced team to help them design and build data pipelines on AWS

THE ROLE:

As a Senior Data Engineer, you will be responsible for building a data pipeline on their AWS platform. Therefore as a Senior Data Engineer, you must have strong end to end experience within Python and be very comfortable with ETL. You will be working with AWS using the EMR stack and working with Redshift so must be familiar with AWS services and working within this cloud. You must also be confident with streaming technologies such as Spark. As a Senior Data Engineer knowledge of big data such as Hadoop is advanteagous as well as familiar with Snowflake. They are looking for someone experience who is comfortable both designing and implementing a robust data pipeline onto their platform. Any experience with DBT is also extremely advantageous.

YOUR SKILLS AND EXPERIENCE:

The successful Senior Data Engineer will have the following skills and experience:

  • Extensive experience with Python
  • Good knowledge of AWS specifically EMR stack, Redshift
  • Experience with Hadoop
  • Prior knowledge of Snowflake
  • Confident with stream technologies such as Spark, Kafka, Kinesis
  • Experience with DBT

THE BENEFITS:

  • A chance to work on important projects

HOW TO APPLY:

Please register your interest by sending your CV to Anna Greenhill via the Apply link on this page.

Send similar jobs by email
921467/AG
London
£500 - £550 per day
  1. Contract
  2. Big Data

Similar Jobs

Data Engineer (Contract) - GCP
Salary

£650 - £700 per day

Location

London

Description

Data Engineer (Contract) BigQuery, Python, SQL, ETL £650 - £700 per day (Inside IR35) Central London/Remote 6 month contract (View to extend)

ADD TO SHORTLIST
Data Engineer
Salary

£50000 - £70000 per annum + Additional Benefits

Location

Birmingham, West Midlands

Description

Footsie-100 looking for a Data Engineer based in Birmingham. Click below for more details...

ADD TO SHORTLIST
Lead Data Engineer
Salary

US$180000 - US$190000 per year

Location

New York

Description

This NYC-based tech startup is making big waves nationally with its utilization of artificial intelligence in the IT support industry.

ADD TO SHORTLIST
Data Engineer
Salary

Up to £70000 per annum

Location

London

Description

Harnham is partnered with a growing start-up, that is looking for their next Data Engineer to have a real impact in their data journey.

ADD TO SHORTLIST

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

Using Data Visualisation To Bring Data & Analytics To Life

The majority of the human population are visual learners. Our brains are wired in such a way where we can register 36,000 visual messages per hour, and visuals are processed 60,000 times faster than text. In short, one of the best ways to truly assimilate and understand new-found knowledge is through clear and digestible imagery.  Because of this valuable insight, we are now witnessing the fast-growing trend of Data Visualisation. Over the next six years, the value of Data Visualisation tools is expected to reach $19.2 billion, over double what it was in 2019.  Data & Analytics is one key area where data visualisation is used continuously. The raw data collected on a daily basis by Data Analysts can be incredibly time-consuming to sift through, not forgetting near-impossible to form palatable findings from. However, through the use of data visualisation tools such as graphs, heat maps, charts and infographics, confusing, text-based data can be transformed and brought to life. So, how can Data Visualisation help your business? Greater understanding of your data As Lydia, our Senior Recruitment Consultant, stated in her most recent article – data insights have the capability of not only improving decision-making, but also allow you to spot key trends, errors and predict future challenges. Nevertheless, all of these brilliant capabilities of data insights can only occur when teams can garner an in-depth understanding of the data being presented to them.  Without a background in statistics, which very few members of any team would possess, the raw data simply wouldn’t mean anything, and key insights could be missed. Utilising data visualisations not only makes data more tangible, but it also allows every team member to understand the data, make decisions and implement changes more efficiently. Standing out from the competition The effectiveness of Data Visualisation is no secret, and time and time again it’s been proved that this way of presenting data is far more likely to produce results than simply reviewing text.  Research within Analytics Insight reported that businesses using data discovery tools are 28 per cent more likely to find timely information compared to their dashboard-using counterparts, and 48 per cent of business intelligence users at companies with visualisation tools are able to find the information they need without the help of a specialist team.  Nevertheless, despite the incredible benefits, only 26 per cent of businesses globally are using data visualisation tools.  While the reasons for this slow uptake are varied, it’s clear that those companies who are willing to invest in Data Visualisation are far more likely to stand a head above their competitors. It can improve customer experience 98 per cent of companies will use data to help drive a better customer experience, but it doesn’t always mean that this data is collected, managed or presented well.  Data is, and should be, used as a way to back up what brands are saying, especially if they’re shouting from the rooftops about how fantastic they are.  When a business or brand uses accurate Data Visualisation to tell this story – for example, the percentage of consumers who report high levels of customer satisfaction, or the amount of money donated to CSR projects – audiences will respond much better than if the claim appears to be empty words without any evidence.  Data Visualisation is undoubtedly one of the most effective ways to communicate data, both internally and externally. The comprehensible formats available enables information to be processed with ease, and for learnings and understandings to be absorbed and implemented with much more efficiency than text-based raw data. It’s clear that this trend is only going to grow in popularity as businesses begin to put more investment behind it in order to reap the benefits and watch the positive impact on their bottom lines prosper.  For examples of how Harnham uses Data Visualisation, head over to our recent research reports.  If you're looking to take the next step in your career or build out your Data & Analytics team, we can help. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more. 

Chantelle Mynhardt

Chantelle Mynhardt

13. May 2021

News

How Can Your Career In Big Data Help You To Accelerate Change?

Data & Analytics is fast becoming a core business function across a range of different industries. 2.5 quintillion bytes of data are produced by humans every day, and it has been predicted that 463 exabytes of data will be generated each day by humans as of 2025. That’s quite a lot of data for organisations to break down. Within Gartner’s top 10 Data & Analytics trends for 2021, there is a specific focus on using data to drive change. In fact, business leaders are beginning to understand the importance of using data and analytics to accelerate digital business initiatives. Instead of being a secondary focus — completed by a separate team — Data & Analytics is shifting to a core function. Yet, due to the complexities of data sets, business leaders could end up missing opportunities to benefit from the wealth of information they have at their fingertips. The opportunity to make such an impact across the discipline is increasingly appealing for Data Engineers and Architects. Here are a just a selection of the benefits that your role in accelerating organisational change could create. Noting the impact In a business world that has (particularly in recent times) experienced continued disruption, creating impact in your industry has never been more important. Leaders of organisations of a range of sizes are looking to data specialists to help them make that long-lasting impression. What is significant here is that organisations need to build-up and make use of their teams to better position them to gather, collate, present and share information – and it needs to be achieved seamlessly too. Business leaders, therefore, need to express the specific aim and objective they are using data for within the organisation and how it’s intended to relate to the broader overarching business plans. Building resilience Key learnings from the past year have taught senior leaders around the globe that being prepared for any potential future disruption is a critical part of an organisation’s strategic plans. Data Engineers play a core role here. Using data to build resilience, instead of just reducing resistance or limiting the challenges it presents, will ensure organisations are well-placed to move into a post-pandemic world that makes use of the abundance of data available to them. Big Data and pulling apart and understanding these large scale and complex data sets will offer a new angle with which to inform resilience-building processes.  Alignment matters An organisation’s ability to collect, organise, analyse and react to data will be the thing that sets them apart from their competitors, in what we expect to become an increasingly competitive market. Business leaders must ensure that their teams are part of the data-driven culture and mindset that an organisation adopts. As this data is used to inform how an organisation interacts with its consumers, operates its processes or reaches new markets, it is incredibly important to ensure that your Data Engineers (and citizen developers) are equipped and aligned with the organisation’s visions. Change is a continuous process, particularly for the business community. Yet, there are some changes that are unpredictable, disruptive and mean that many pre-prepared plans may face a quick exit from discussions. Data professionals have an opportunity to drive the need for change, brought about by the impacts of the pandemic, in a positive and forward-thinking way. In understanding impact, resilience and alignment, this can be truly achieved. Data is an incredibly important tool, so using this in the right way is absolutely critical. If you’re in the world of Data & Analytics and looking to take a step up or find the next member of your team, we can help. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more.

Georgina Garraway

Georgina Garraway

25. March 2021

News

Recently Viewed jobs