Senior Big Data Engineer

Boston, Massachusetts
US$120000 - US$165000 per annum + bonus + equity

Senior Big Data Engineer
Global Leader in eCommerce
Boston, MA

THE COMPANY

A globally renowned eCommerce business is looking for a Big Data Engineer to join their team in the Greater Boston Area. If you are ambitious, want to join a centralized, data-driven organization and have a solid background in leading big data-driven engineering teams then we want to speak to you. This is the perfect role for someone who enjoys a fast-paced environment using the newest technologies available.

THE ROLE - Big Data Engineer

  • Architect, design and implement big data platforms and solutions
  • Meeting with stakeholders and analytical team leaders to define and develop the company's infrastructure and roadmap to provide functional support to all areas of the business
  • Implement data-driven solutions that are both robust and scalable
  • Build systems that support data analytics through ETL transformations and data modeling
  • Develop easy to consume data sets while becoming a subject matter expert for your business unit

YOUR SKILLS AND EXPERIENCE

  • Experience implementing end to end data solutions
  • Custom BI tool experience using tools like Tableau, Qlik, PowerBI or Looker
  • Python and SQL Server programming experience
  • Big Data Ecosystem experience leveraging technologies like Hadoop, Hive, Spark, Sqoop and Kafka
  • Cloud Computing Experience - GCP and BigQuery experience highly preferred

THE BENEFITS

You will receive a base salary of up to $165k, industry leading benefits, a strong bonus package, opportunity to grow into a management role and much more

HOW TO APPLY

Please register your interest by sending your CV to Tommy Daughtrey via the Apply link on this page. REF NUMBER 66933

Send similar jobs by email
66933
Boston, Massachusetts
US$120000 - US$165000 per annum + bonus + equity
  1. Permanent
  2. Big Data

Similar Jobs

Salary

£90000 - £110000 per annum

Location

London

Description

Exciting opportunity for a data architect with strong data modelling skills to step into a management position at the UK's largest ethical energy company!

Salary

£600 - £700 per day

Location

Surrey

Description

As a Lead Data Engineer you will be working for a leading marketing company in streamlining their AWS infrastructure!

Salary

US$100000 - US$140000 per annum + Additional Benefits

Location

Detroit, Michigan

Description

Have a new Back End Engineering role for Data Products in Michigan! Interested in learning more?

Salary

€90000 - €120000 per annum + benefits

Location

Berlin

Description

A leading e-commerce company in Berlin is looking for an experienced Data Science Lead for its pricing/forecasting division.

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

What defines a Data Architect?

Data Analyst. Data Wrangler. Data Architect? If you like pulling together threads of a company’s Data into one cohesive point, you may want to consider a Data Architect role. But what exactly is a Data Architect and how does it differ from a Data Engineer? Data Architect vs. Data Engineer As businesses continue to combine their Data and business strategies into one, they are beginning to understand to the need for a variety of Data Analysts. But as important as it is to have someone build your platform and begin pipeline processes, there is also need for someone with vision. Someone who can see patterns and designs. Someone who has end-to-end vision and can see how the patterns flow through your processes. This is your Data Architect. Data Engineers, on the other hand, lay the foundation for your Data platform. They draft the blueprint. After all, you can’t build a house without a blueprint first, right? The Data Engineer is at the beginning of the process, so the rest of the team can do their parts. But it’s the Data Architect who pulls it all together. THE ROLE OF THE DATA ARCHITECT  If you’re considering your next career move and wondering if Data Architecture is for you, here are some typical requirements. A typical Data Architect will: Meet with stakeholders to understand business needs and translate them into technical requirements using ETL techniques to develop Data ArchitectureUnderstand their full Data lifecycle to provide technical architecture leadershipDesign a real-time data pipeline ecosystem and how to make it scalable usingDevelop Big Data Architecture in an AWS environmentBe educated to a degree level in a numerate discipline (Mathematics, Statistics, Computer Science, Computer Engineering)• Have proven experience in a commercial environmentHave advanced Cloud Computing Ecosystem experience with AWS (GCP or Azure also considered)Have proven Big Data Ecosystem experienceHave proven Big Data Architecture experience in a commercial environment Have proven Data Engineering experience in a commercial environment Though the likes of Google, IBM, and others have ramped up their education efforts, and online courses traditional universities offer a variety of Data Science degrees, there is still a shortage of professionals in the industry. So can businesses simplify and automate processes without the right people in place? Businesses Step Up Their Data Strategies Though there are easier ways to get the information a business needs through rented predictive modelling or an already drafted Data Science model, it doesn’t give the true value of Data. Add in new regulations, requirements, and new Data which offer new insights, and the impact on business is profound.   It’s time for business to start ensuring that their Data teams are treated as critically as possible. Time to lay a path of progression, a pipeline, of systems and processes for the creation and production of Data. After all, simply optimising your Data will only get you so far. Enterprise-wide Data systems are more than wrangling and analysing Data.  Most importantly, businesses need to ensure they have the right people in place. They also need to understand what they need and why they need it. This is a key part of Data Strategy and with the right people in place, can put your business ahead of the competition.  Digging Deeper into Requirements for Top Talent While the standard requirements for a Data professional are to be educated to a degree level in things like Computer Science and Mathematics, technical skills, and experience within certain industries, for the natural progression from Data Analyst to Data Architect, there’s a bit more nuance to consider. Whether your business is just getting started in Data Science or you’re ready to start growing an existing team, there are some things you may want to focus on when looking for your Data Architect role. Define and determine how to keep projects streamlined with repeatable processes. Pivot between guiding team members through the pipeline and explaining insights to executives and stakeholders. Determine the right format for the right project. Determine when and when not to use automation to integrate Data. Visualise and extract models to predict future events and describe the process. In other words, be able to interpret Data to ensure reliability of the best approach. With the right talent in place, your teams can collaborate and build on their shared expertise to ensure Data is analysed and understood to the best benefit of your business. If you like solving puzzles, pulling disparate threads together into organised systems, and have experience as analysing and collecting Data, we may have a role for you.  Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more.  

The Harnham 2019 Data & Analytics Salary Guide Is Here

We are thrilled to announce the launch of our 2019 UK, US and European Salary Guides. With over 3,000 respondents globally, this year’s guides are our largest and most insightful yet.  Looking at your responses, it is overwhelmingly clear that the Data & Analytics industry is continuing to thrive. This has led to an incredibly active market with 77% of respondents in the UK and Europe, and 72% in the US, willing to leave their role for the right opportunity.  Salary expectations remain high, although we’re seeing that candidates often expect 2-10% more than they actually achieve when moving between roles.  Globally, we’ve also seen a change in the reasons people give for leaving a position, with a lack of career progression overtaking an uncompetitive salary as the main reason for seeking a change.   There also remains plenty of room for industry improvement when looking at gender parity; the UK market is only 25% female and this falls to 23% in the US and 21% across the rest of Europe.  In addition to our findings, the guides also include insights into a variety of markets and recommendations for both those hiring, and those seeking a new role.  You can download your copies of the UK, US and European guides here.

Recently Viewed jobs