Senior Data Engineer

Boston, Massachusetts
US$150000 - US$170000 per year

SENIOR DATA ENGINEER
$120,000 - $150,000
BOSTON

Join one of the world's largest transportation companies shaping the future of urban mobility!

THE COMPANY
This global transportation company is looking for a highly experienced data engineer to join their team! At one of the most exciting, fun, dynamic environments in the heart of Boston, you will sit on a team with passionate data engineers with a shared interested to take on big data challenges!

THE ROLE - SENIOR DATA ENGINEER
As a Senior Data Engineer, you will work in a fun, fast-paced environment finding new challenges to solve every day as the clients are relying on the tools that your team creates and implements. You will have an array of tools at your disposal to succeed and advance in your career!

As a senior data engineer, your responsibilities will include:

  • Developing AWS data lakes using Java or Python (both are considered!)
  • Altering current data warehousing processes from ETL to ELT
  • Working closely with product, data analysis and data science teams to support their data needs
  • Meeting with stakeholders to understand the business needs
  • Working with structured and unstructured data to build data pipelines using big data processes, Hadoop and Spark

YOUR SKILLS AND EXPERIENCE
You will need:

  • Educated to a degree level in a numerate discipline (Mathematics, Statistics, Computer Science, Computer Engineering)
  • Proven Commercial Experience with either SQL and Scala, Java or Python
  • Experience with Big Data Tools Spark and Hadoop
  • Proven infrastructure experience in a commercial environment
  • Realtime data ingestion experience

HOW TO APPLY

  • Please register your interest by sending your CV to Caroline Schlueter via the Apply link on this page.

KEYWORDS

Data Engineer, SQL, Scala, Java, Python, Hadoop, Spark, Big Data, Infrastructure, ELT, ETL, AWS, Oracle, Snowflake, Talend, Kinesis, Lamba

Send similar jobs by email
64796
Boston, Massachusetts
US$150000 - US$170000 per year
  1. Permanent
  2. Big Data

Similar Jobs

Salary

US$14000 - US$150000 per annum + + $50,000 benefits

Location

Boston, Massachusetts

Description

A global technology company are looking for a Big Data Engineer to join them in the heart of Boston! Click below to read more!

Salary

US$150000 - US$200000 per year

Location

New York

Description

Lead Data Engineer

Salary

US$200000 - US$220000 per year + Total Compensation

Location

Boston, Massachusetts

Description

New Big Data Architect opportunity in Boston. Apply Today!

Salary

US$90000 - US$100000 per year

Location

San Francisco, California

Description

Work with the fastest growing Wine distributing company in the world by being being the first BI Engineer for the team.

Salary

£80000 - £90000 per annum + Additional Benefits

Location

London

Description

Join one of the world's first telecoms companies, now creating the biggest analytics function in the UK.

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

The Harnham 2019 Data & Analytics Salary Guide Is Here

We are thrilled to announce the launch of our 2019 UK, US and European Salary Guides. With over 3,000 respondents globally, this year’s guides are our largest and most insightful yet.  Looking at your responses, it is overwhelmingly clear that the Data & Analytics industry is continuing to thrive. This has led to an incredibly active market with 77% of respondents in the UK and Europe, and 72% in the US, willing to leave their role for the right opportunity.  Salary expectations remain high, although we’re seeing that candidates often expect 2-10% more than they actually achieve when moving between roles.  Globally, we’ve also seen a change in the reasons people give for leaving a position, with a lack of career progression overtaking an uncompetitive salary as the main reason for seeking a change.   There also remains plenty of room for industry improvement when looking at gender parity; the UK market is only 25% female and this falls to 23% in the US and 21% across the rest of Europe.  In addition to our findings, the guides also include insights into a variety of markets and recommendations for both those hiring, and those seeking a new role.  You can download your copies of the UK, US and European guides here.

Integrate Your Data And Business Strategies For Success

Why You Need To Integrate Your Data and Business Strategies

United we stand, together we fall. Not too put too fine a point to it, but how your business and data strategies align are integral to your business. Today’s world is about change, being able to pivot toward new strategies, and being open to trying new things. Consider this: the “mom-and-pop” shop is back and it is flourishing. Younger generations of farmers are returning to their family farms when they graduate and they’re bringing new knowledge with them. And the makerspace, freelance, and gig economies are thriving. These businesses are learning how to work with technology and align their Data Strategy with their Business strategy. Some legacy enterprises are taking notice. Others are missing the mark. Consumers may have changed how they want to shop and learn about services and products, but the services they want and expect haven’t changed that much which is why it’s more important than ever to “know your customer.”  3 Key Elements of Integrated Strategies While there are a number of things to take into consideration as you align your strategies, these three key elements can help get you started. 1. Understand the key elements of Business Strategy. 2. Apply innovation strategy to business objectives. 3. Determine key elements of your Data Strategy for use in a real-world scenario. Understand the key elements of business strategy  A business strategy encapsulates two main ideas; cost advantage versus competition. The cost advantage includes costs and other resources, identification and awareness of strengths, weaknesses, and competition. Competitive advantage happens when you’ve done your market research and can show what makes you different from any other provider with similar goods and services. This is the time you might perform a SWOT (strengths, weaknesses, opportunity, and threat) analysis of your business. It’s helpful to include your mission and vision statements, objectives, core values, risk tolerance, and understanding trends in your business. Apply Innovation Strategy to Business Objectives Ideas and innovation flow when you and your business understand your customers and are able to easily shift into new things. Think R&D into Bioinformatics, automated tasks into AI, or a platform such as streaming services to help sell services such as insurance. Laying the groundwork to apply innovation strategies to your business objectives follow these ideas: Identify your business objectives by asking questions.Assess the budget and personnel resources and develop a budget strategy.Test the market to determine what issues will or need to be solved and understand how this innovation will benefit your overall strategy. If you’re working on a Data initiative to integrate into your Business strategy, one of the key elements is to determine how those changes may affect your business. Determine Key Elements of Data Strategy for Use in Real-World Scenarios As you work on developing your Data Strategy, it’s important to consider all the elements required to ensure success. So, what do you need to take into consideration when working on this type of strategy? Here are some things to consider as you develop your framework. Determine your business needs and their current state.Determine what works and what can be improved upon if there is a technology improvement or process.Evaluate your Data from sales, profit, and evaluate your progress.}Develop an action plan. Many businesses don’t incorporate just one type of Data into their strategy. They consider the potential impact of technologies such as Machine Learning, Predictive and Data Analytics, and other Big Data Strategies to drive improvements when it comes to decision making. They understand these Data-driven insights can help them improve or solve their most critical problems. There is a caveat, however, and it is how you collect the information for real-world scenarios. Certain requirements are in place for a reason and they ensure only relevant Data is collected. This is done by formulating “predictive models” and necessary information to operate and determine whether your case will be something to be done over time or if it’s something brand new to consider when looking at real-time access. One Final Thought… Data-centric organisations have a distinct advantage over their competition. The information gained from collecting and analysing to understanding their customers can offer great insight as to what’s working and what isn’t. Integrating your Business Strategy with a Data Strategy can offer you a more well-rounded understanding of the customers you serve and can ultimately, help you to serve them better; now and in the future. Disruptive business models from this way of thinking can also foster growth and lead to innovative changes in your marketplace. If you want to be at the forefront of change we may have a role or candidate for you. Take a look at our latest opportunities or get in touch with one of our expert consultants to find out more.

Recently Viewed jobs