Data Engineer

Utrecht
€680 - €760 per day

Data Engineer

Utrecht, Netherlands

90 EUR Per Hour

3 Months

As a Data Engineer you will be developing automation for multi-cloud data pipelines to aid this growing tech company to provide a streamlined customer retail experience. You will be deploying both existing and new data pipelines to Azure and GCP.

THE COMPANY:

The client is a growing tech company whose mission is to utilise data and technology to improve the retail experience for the consumer. As a Data Engineer, you will focus on automating data pipelines deployed to Azure and GCP which have previously been deployed manually.

THE ROLE:

As a Data Engineer you will be expected to be able to create cloud and hybrid multi-cloud data pipelines. You will also need to be able to redeploy existing pipelines using the best data engineering practices. It is essential to have experience with Azure and GCP, where you will be automating the deployment of data pipelines.

YOUR SKILLS AND EXPERIENCE:

The ideal Data Engineer will have:

  • Commercial experience in managing cloud infrastructure as code for Azure and GCP
  • Commercial experience using Azure Data Factory
  • Expertise in making custom Azure/Google functions
  • Commercial experience in setting up data pipelines in Google Data Fusion
  • Commercial experience using Google BigQuery

HOW TO APPLY:

Please submit your CV to Lily Desmond at Harnham via the Apply Now button.

Send similar jobs by email
87283 - LD
Utrecht
€680 - €760 per day
  1. Contract
  2. Big Data

Similar Jobs

Salary

£60000 - £70000 per annum

Location

London

Description

Large Health insurance company looking for talented Data Engineers

Salary

US$130000 - US$140000 per annum

Location

Cincinnati, Ohio

Description

Looking for Senior Data Engineers to design/build data pipelines in a multi-cloud environment for data science teams.

Salary

£60000 - £70000 per annum

Location

London

Description

Large Health insurance company looking for talented Data Engineers

Salary

US$120000 - US$130000 per annum + Additional Benefits

Location

Cincinnati, Ohio

Description

A CPG business in Cincinnati are looking for passionate and energetic seasoned senior data engineers to join their business!

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

How Can Your Career In Big Data Help You To Accelerate Change?

Data & Analytics is fast becoming a core business function across a range of different industries. 2.5 quintillion bytes of data are produced by humans every day, and it has been predicted that 463 exabytes of data will be generated each day by humans as of 2025. That’s quite a lot of data for organisations to break down. Within Gartner’s top 10 Data & Analytics trends for 2021, there is a specific focus on using data to drive change. In fact, business leaders are beginning to understand the importance of using data and analytics to accelerate digital business initiatives. Instead of being a secondary focus — completed by a separate team — Data & Analytics is shifting to a core function. Yet, due to the complexities of data sets, business leaders could end up missing opportunities to benefit from the wealth of information they have at their fingertips. The opportunity to make such an impact across the discipline is increasingly appealing for Data Engineers and Architects. Here are a just a selection of the benefits that your role in accelerating organisational change could create. Noting the impact In a business world that has (particularly in recent times) experienced continued disruption, creating impact in your industry has never been more important. Leaders of organisations of a range of sizes are looking to data specialists to help them make that long-lasting impression. What is significant here is that organisations need to build-up and make use of their teams to better position them to gather, collate, present and share information – and it needs to be achieved seamlessly too. Business leaders, therefore, need to express the specific aim and objective they are using data for within the organisation and how it’s intended to relate to the broader overarching business plans. Building resilience Key learnings from the past year have taught senior leaders around the globe that being prepared for any potential future disruption is a critical part of an organisation’s strategic plans. Data Engineers play a core role here. Using data to build resilience, instead of just reducing resistance or limiting the challenges it presents, will ensure organisations are well-placed to move into a post-pandemic world that makes use of the abundance of data available to them. Big Data and pulling apart and understanding these large scale and complex data sets will offer a new angle with which to inform resilience-building processes.  Alignment matters An organisation’s ability to collect, organise, analyse and react to data will be the thing that sets them apart from their competitors, in what we expect to become an increasingly competitive market. Business leaders must ensure that their teams are part of the data-driven culture and mindset that an organisation adopts. As this data is used to inform how an organisation interacts with its consumers, operates its processes or reaches new markets, it is incredibly important to ensure that your Data Engineers (and citizen developers) are equipped and aligned with the organisation’s visions. Change is a continuous process, particularly for the business community. Yet, there are some changes that are unpredictable, disruptive and mean that many pre-prepared plans may face a quick exit from discussions. Data professionals have an opportunity to drive the need for change, brought about by the impacts of the pandemic, in a positive and forward-thinking way. In understanding impact, resilience and alignment, this can be truly achieved. Data is an incredibly important tool, so using this in the right way is absolutely critical. If you’re in the world of Data & Analytics and looking to take a step up or find the next member of your team, we can help. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more.

It Takes Two: Data Architect Meets Data Engineer

Information. Data. The lifeblood of business. Information and data are used interchangeably, gathered, collected, and analysed to create actionable insights for informed business decisions. So, what does that mean exactly? And to that end, how do we know what information or data we need to make those decisions? Enter the Data Architect. The Role of a Data Architect Just like you might hire an architect to sketch out your dreamhouse, the Data Architect is a Data Visionary. They see the full picture and can craft the design and framework creating the blueprint for the Data Engineer, who will ultimately build the digital framework. Data Architects are the puzzle solvers who can take a jumble of puzzle pieces, in this case massive amounts of data, and put everything in order. It’s their job to figure out what’s important and what isn’t based on an organisation's business objectives. Skills for a Data Architect might include: Computer Science degree, or some variation thereof.Plenty of experience working with systems and application development.Extensive knowledge and able to deep dive into Information ManagementIf you’re just starting your Data Architect path, be prepared for years of building your experience in data design, data storage, and Data Management. The Role of a Data Engineer The Data Engineer builds the vision and brings it to life. But they don’t work in a vacuum and are integral to the Data Team working nearly in tandem with the Data Architect. These engineers are building the infrastructure – the pipelines and data lakes. Once exclusive to the software-engineering field, the data engineer’s role has evolved exponentially as data-focused software became an industry standard. Important skills for a Data Engineer might include. Strong developer skills.Understand a host of technologies such as Python, R, Hadoop, and moreCraft projects to show what you can do, not just talk about what you can do – your education isn’t much of a factor when it comes to data engineering. On the job training does it best.Social and communication skills are critical as you map initial designs, and a love of learning keeps everything humming along, even as technology libraries shift, and you have to learn something new. The Major Differences between the Data Architect and Data Engineer RolesAs intertwined as these two roles might seem, there are some crucial differences. Data Architect Crafts concept and visualises frameworkLeads the Data Science teams Data Engineer Builds and maintains the frameworkProvides supporting framework With a focus on Database Management technologies, it can seem as though Data Architect and Data Engineer are interchangeable. And at one time, Data Architects did also take on the Data Engineering role. But the knowledge each has is used differently.  Whether you’re looking to enter the field of Data Engineering, want to move up or over with your years of experience to Data Architect, or are just starting out. Harnham may have a role for you. Check out our current opportunities or get in touch with one of our expert consultants to learn more.  

Recently Viewed jobs