Senior Data Engineer - Python + SQL + AWS

New York
US$120000 - US$150000 per year + Comprehensive Benefits

This vacancy has now expired. Please see similar roles below...

Senior Data Engineer - Python + AWS + SQL

New York, New York

$120,000-$150,000 + Comprehensive Benefits

This opportunity will give you the chance to make an impact with your technical expertise and work with a growing team of forward-thinking, innovative colleagues. This is a thriving company, but also one that is positioned for exceptional growth in 2018 and beyond. The team is working with very large data sets and they are looking for a talented data engineer to drive forward their data and analytics strategy, and in turn the business as a whole.

THE COMPANY

Our client is a leading Non-profit Organization that seeks massively improved education outcomes for kids by providing information, infrastructure, and support for education-related public advocacy and community building efforts.

One of this client's key initiatives is an online platform that allows users to aggregate data from a wide variety of sources such as partner organization's member data, publicly available data, consumer data, voter file data, and more. This data can then be used by partners to activate and expand their supporter bases effectively and mobilize them for sustained political change. They also use this data to build predictive machine learning models that improve our partner's efficiency. This client has the unique opportunity to build, with partners, a massive dataset that can leverage creative data science to profoundly change the way that advocacy efforts and service providers engage their bases

THE ROLE

They are looking for an innovative Senior Data Engineer to maintain and architect the data systems and pipelines to support our efforts. The Senior Data Engineer would work alongside their existing Senior Data Engineer and use a variety of leading database technologies (AWS Redshift, MongoDB) and tools (AWS EC2, AWS S3, Python) to process and store their existing data. The role calls for expertise in managing AWS resources and maintaining and expanding their Python-based data ingestion pipelines. There is also the opportunity to architect new data stores for our ever-growing data needs, and so a creative, problem solving mindset is highly desirable.

In particular you can expect to be involved in the following:

  • Help maintain and enhance their robust data warehouse that houses data from partners, vendors and other data sources.
  • Manage and improve the data ingestion pipelines that service their data warehouse, which are currently built in Python.
  • Deploy and use AWS resources like Redshift and RDS clusters and EC2 instances to support their work, and manage the security around those resources through AWS Security Groups and VPCs
  • Collaborate with our Data Science team to help build out our data analytics automated pipeline in Python
  • Make recommendations and provide strategic support regarding ways to make data and database operations more efficient and effective

YOUR SKILLS AND EXPERIENCE

The successful Senior Data Engineer will likely have the following skills and experience:

  • MSc or higher in Computer Science or equivalent degree OR strong commercial experience in a Data Engineering role
  • Experience managing large AWS database resources, either RDS, Redshift or DynamoDB, and the setup of VPCs and Security Groups to manage access to these resources
  • Excellent SQL skills, with experience in building and interpreting complex queries
  • Excellent Python programming skills, with a track record of well-designed and maintainable code.
  • Experience in database design and structure, with an emphasis on scalability
  • A strong desire to develop new and innovative ways to improve our data storage and processing.
  • Exposure to Big Data tools (Hadoop, Kafka, Spark, etc.)

THE BENEFITS

The Senior Data Engineer position is a full-time, salaried position with a comprehensive benefits package. Salary for this position is commensurate with experience and ranges from $120,000 - $150,000

HOW TO APPLY

Please register your interest by sending your résumé via the Apply link on this page.

39071
New York
US$120000 - US$150000 per year + Comprehensive Benefits

Similar Jobs

Salary

US$140000 - US$165000 per year + Bonus, Health Benefits, Relocation

Location

Boston, Massachusetts

Description

One of the LEADING developers of autonomous solutions have taken on a mission to space! Want to take part?

Salary

US$165000 - US$180000 per year + Equity

Location

Boston, Massachusetts

Description

Do you want to have an input on how satellite imagery and geospatial data can have an impact on the financial and insurance industries?

Salary

US$110000 - US$170000 per year

Location

Boston, Massachusetts

Description

An exciting role where you get to apply cutting edge machine learning techniques to a global leader in the electronics industry!

Salary

US$130000 - US$150000 per year

Location

Pittsburgh, Pennsylvania

Description

Hi All, I'm currently working with an exciting startup in the Pittsburgh area that are looking for robotics engineers with a strong background in C++ and ROS.

Salary

US$100000 - US$135000 per year

Location

Boston, Massachusetts

Description

An innovative and exciting company in the life sciences space, with their founders coming from MIT is looking to grow their data science team!

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

The Harnham 2019 Data & Analytics Salary Guide Is Here

We are thrilled to announce the launch of our 2019 UK, US and European Salary Guides. With over 3,000 respondents globally, this year’s guides are our largest and most insightful yet.  Looking at your responses, it is overwhelmingly clear that the Data & Analytics industry is continuing to thrive. This has led to an incredibly active market with 77% of respondents in the UK and Europe, and 72% in the US, willing to leave their role for the right opportunity.  Salary expectations remain high, although we’re seeing that candidates often expect 2-10% more than they actually achieve when moving between roles.  Globally, we’ve also seen a change in the reasons people give for leaving a position, with a lack of career progression overtaking an uncompetitive salary as the main reason for seeking a change.   There also remains plenty of room for industry improvement when looking at gender parity; the UK market is only 25% female and this falls to 23% in the US and 21% across the rest of Europe.  In addition to our findings, the guides also include insights into a variety of markets and recommendations for both those hiring, and those seeking a new role.  You can download your copies of the UK, US and European guides here.

HOW BRANDS USE DATA TO CREATE SUCCESSFUL CAMPAIGNS

Make no mistake: making minor adjustments to an ad or campaign that’s meant to appeal to the masses just won’t cut it. Customers crave creativity. They want to be understood. Which is why people respond best to brands that do their homework, doing their research into what appeals to different groups. How should businesses appeal to their chosen segments, then, considering how diverse people are? Data, of course. Why Data? For one thing, it drives results and creates improved outcomes. Data also helps to prove the value of marketing, providing a bargaining chip for future budget discussions. And, most rewarding of all, brands get valuable insights into their target market. Which, in turn, leads to more well-targeted, profitable campaigns.  And if you think Data doesn’t belong in the world of creative campaigns, think again. As OpenJaw Technologies Chief Marketing Officer Colin Lewis argues: “Creativity is not just compatible with being Data-driven – Data can drive better creative.” Psychological profiling Strategic communications consultancy, Verbalisation, researches and analyses language to form valuable insights. Using its Rapid Audience Insights Diagnostic system, the company’s team of psychologists and researchers work out how an audience thinks. They also learn the actual words an audience uses, which they then use as the basis of a marketing strategy.  Based on their unique research and insights, Verbalisation has created several successful campaigns for high-profile brands. These include the #NotAnotherBrother campaign for counter-terrorism organisation Quilliam, which looked at the motivations of jihadists.  The campaign is now used by the UN and schools across the UK, as well as the US Department of Defense. It is the most viewed counter-extremism campaign of all time, with more than half a billion global media impressions.  Location, location, location Out-of-home (OOH) advertising. Yes, it goes way back, but it’s actually the only traditional advertising channel posting rapid growth. In fact, thanks to mobile-location Data, brands can target audiences quicker and with a greater chance of success than ever before.  Great news for JCDecaux (JCD), a leading OOH company with ads reaching 410 million people in over 4,000 cities. JCD now works with location Data to define and segment audiences. Doing so helps it decide where to place media, improve campaigns and measure resulting store footfall and purchases.  Knowledge, so they say, is power. Particularly when that involves knowing the whereabouts of the most coveted customers. Newly teamed up with identity resolution company, Neustar, JCD’s insights look stronger than ever. JCD can now understand which of its locations rank higher for any brand’s most desired audiences. All thanks to location Data and real-time behaviour analysis.  Personalised employee training Data doesn’t just boost the results of B2C brands; it can also be a vital shot in the arm for internal security training campaigns. Training provider, CybeReady, for instance, uses a Data science-driven approach to deliver cyber awareness training with a difference: its anti-phishing platform helps security teams quickly roll out and tailor campaigns to individual employees. In big companies, getting employees up to speed is especially challenging. With many locations, languages and time zones to contend with, Information Security teams have their work cut out.  CybeReady eliminates these challenges by delivering 12 personalised, 60-second simulations to each employee. In their first language, every year. What’s more, the training provider uses machine learning to analyse performance on a daily basis. This enables it to provide the most appropriate simulations to each individual. The result? IT teams save 160 hours each month and employee resilience increases five-fold. There’s no limit to what Data can do. If you’re a fan, we may have a role for you. Take a look at our latest opportunities or get in touch with our expert consultants.  

Recently Viewed jobs