Lead Data Engineer

New York
US$130000 - US$170000 per year

Lead Data Engineer

New York, New York

$130,000 - $170,000

 

Based in the financial district of NYC, is a growth stage Ad-tech company focusing in working with well-known consumer brands to plan and execute direct mail and e-mail campaigns. They are currently growing out their data team, and they're looking for a Lead Data Engineer to join their growth!

 

THE COMPANY

 

Our client offers the start up culture everyone desires.

 

The company's NY office is in a beautiful building full of amenities.

 

Client is unable to sponsor Visa's at this time.

 

THE ROLE

 

In this Lead Data Engineer role, you will execute the strategic development of data and analytics solutions by architecting throughput data pipelines and creating new infrastructure. You will be leading a team of two data analysts at the moment, but will be responsible for the growth of the data and software engineers on your team. You will also be reporting directly into the CTO, offering high visibility and lots of growth opportunity. They are seeking the best engineering talent on the market and are keen to have you happily on board for the long term. You will have the desire to work in an innovative, fast-paced environment and the ability to work with lots of data.

In particular you can expect to be involved in the following:

 

  • Architect, build, and deploy efficient data pipelines into production.
  • Working with mid-large sets of data and challenges daily
  • Working on a greenfield project.
  • Work with a self-starter attitude with an attention to detail

 

YOUR SKILLS AND EXPERIENCE

 

The successful Lead Data Engineer will likely have the following skills and experience:

 

  • Bachelor's or Master's degree in a discipline such as Computer Science, Engineering, Data Science or similar field
  • Expertise with AWS
  • Expertise in Python
  • Strong communication skills with an ability to present your thoughts and solutions, and resolve problems in a highly professional manner is highly important
  • Experience in Kafka or Kinesis is preferred, as well as Ad-Tech experience
  • Team leadership skills/mentoring skills will come in handy

 

THE BENEFITS

 

A competitive base salary of $130,000 - $170,000 plus great benefits. Lots of fun happy hours, outings and trips to join, (optional of course!)

 

HOW TO APPLY

 

Please register your interest by sending your résumé to Maria Scalici via the Apply link on this page.

 

KEYWORDS

 

Engineer | Python | AWS | ETL | Hadoop | Engineering | Scala | Storm | Data | Analytics | Spark | Big Data | #ZR

Send similar jobs by email
27960
New York
US$130000 - US$170000 per year
  1. Permanent
  2. Big Data

Similar Jobs

Salary

US$160000 - US$200000 per year

Location

New York

Description

Lead Data Manager - Political Organization

Salary

US$160000 - US$200000 per year + Amazing Work Life Balance and Growth

Location

New York

Description

Director, Data Management - Voter Data - Presidential Election

Salary

US$464 - US$504 per day

Location

Seattle, Washington

Description

Join a top-notch consultancy working with exciting clients as a multi-faceted data engineering.

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

Data Engineers: The Workers Behind the Curtain

We’re halfway through the year and our salary guide is out. If you wonder where you are, where you’re going, and if you’re a business, how you’re going to get there. Well, then, you’ve come to the right place. Articles have touted Data Scientists as the “rock stars” of the 21st century, but even rock stars need their managers and roadies. Who else will build the stage and plan the tour? And in the world of data, it all begins with the Data Engineer, laying the groundwork, the foundation, and the framework. These are the stars behind the scenes who make it possible for Data and Data Scientists to be front and center. Send a Data Engineer Over As prevalent as Data has become in our lives and as its importance grows, there remains the challenge of Data Management. If you don’t know why something is built or how to navigate the structure, the Data you do receive may not make much sense. Your guide in this journey is the Data Engineer, one of the most important pieces of your Data Management puzzle.  These highly skilled and sought-after professionals should not be confused with a Software Engineer, though some elements may be transferable between the two. The building blocks to put massive amounts of Data into a scalable system both reliable and secure takes a unique set of skills.  Humans at the Helm as Skills Shift  As much as we depend on Data today to help determine actionable insights for our business and as much as we hear about the rise of machines in the form of Artificial Intelligence, Machine Learning, and Deep Learning, it is ultimately humans who are at the helm.  It is the people behind the curtain of Data who will build it, run it, and make it work. It is also people who are typically the biggest costs in a project. Finding the balance and ideal candidate, the right person with the right skills for the job, is critical to success. And if you’re starting from the ground up, Data Engineers who can work with the core tools of databases and Spark, for example, will see their opportunities grow.  In our Salary Guide for 2019, we learned one of the skills most sought after by companies today is knowing AWS/Azure and moving Data Lakes into the Cloud. Small businesses and startups are moving to the Cloud to help them scale their Data, but someone still needs to lay the groundwork, whether it’s for the small business or the public cloud providers. Data Engineers are in high demand and it doesn’t look as though things will be slowing down anytime soon. The field is slick with potential. The Time Has Come for Transparency Data is binary gold and, with enough of it, you can read or estimate the mind of your customer or you can wreak havoc on someone’s life. Just a year ago, the European Union put into place rules and regulations as well as financial consequences for poor Data Governance under the General Data and Protections Regulation Act (GDPR). Though the U.S. doesn’t yet have a similar law, there are still plenty of mandates to be aware of by states, unions, and countries.  One Final Thought As roles and technology evolves, it’s important for businesses, employees, and stakeholders to evolve as well. Whether that means making sure to implement practices for Data transparency or upskilling and reskilling your workforce to keep up or simply knowing the trends of forward-thinking companies to scale your own business. Data fuels digital innovation and organizations who are prepared to find solutions will benefit. Want to know what else is trending in big data? Here are a few trends in Big Data forward-looking organizations should look out for in this year and toward the next. Are you a business who knows you’re ready to scale up and hire a Data professional? We have a strong candidate pool and may have just the person you need to fill your role. Are you a candidate looking for a role in Big Data & Analytics? We specialize in junior and senior roles. Check out our current vacancies or contact one of our recruitment consultants to learn more.  For our West Coast Team, call (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast Teams, call (212) 796 - 6070 or send an email to newyorkinfo@harnham.com.

A Data Engineer is a Unique Blend of Data Professional

From startup and small business to large enterprises, each type of business requires a unique blend of Data professional. Though in today’s world, much of the Data being gathered, catalogued, and analyzed happens both in the Cloud and on a hard drive, each type of business has a different need, budget, goals, and objectives. But there is one thing each and every business will have in common. At the heart of the Data team will be a Data Engineer. The Three Main Roles of a Data Engineer This is an analytics role in high demand. It is a growing and lucrative field with steps and stages for nearly every level of business and education experience. For example, a Data Scientist interested in stepping into a Data Engineer role might begin as a Generalist. In all, there are three main roles for each level and type of business – Generalist, Pipeline-Centric, and Data-Centric. Let’s take a quick look at each of the roles with an eye toward the type of person who might be the best fit: Generalist – Most often found on a small team, this type of Data Engineer is most likely the only Data-focused person in the company. They may have to do everything from build the system to analyze it, and while it carries its own unique set of skills, it doesn’t require heavy architecture knowledge as smaller companies may not yet be focusing on scale. In a nutshell, this might be a good entry point for a Data Scientist interested in upskilling and reskilling themselves to transition into a Data Engineering role.Pipeline-centric – This focus requires more in-depth knowledge working with more complex Data science needs. This type of role is found more often in mid-sized companies as they grow and incorporate a team of Data professionals to help analyze and offer actionable insight for the business. In a nutshell, this role creates a useful format for analysts to gather, collect, and analyze each bit of Data at each stage of development.Database-centric – This role is found most often in larger companies and deals not only with Data warehouses, but is focused on setting up analytics databases. Though there are some elements of the pipeline, this is more fine-tuned. In a nutshell, this role deals with many analysts across a wide distribution of databases. A Fine Balance Between Technical Skills, Soft Skills, and Business Acumen While it’s important for anyone filing this role to have deep knowledge of database design as well as a variety of programming languages, its equally important to understand company objectives. In other words, once the groundwork is laid and the datasets established, it’ll be important to explain what it is the business executives need to know to make the best decisions for their business.  Knowing how and what to communicate to executives, stakeholders, and your Data team also means understanding how to best retrieve and optimize the information for reporting. Depending on your organization’s size, you may need both a Data Analyst or Scientist and a Data Engineer. Though this is less likely in medium and larger enterprises. On the flip side, in order to understand the business’ needs, you’ll also need to be good at creating reliable pipelines, architecting systems and Data stores, and collaborating with your Data Science team to build the right solutions. Each of these skills are meant to help you understand concepts to build real-world systems no matter the size of your business. One Final Thought… Do you like to build things? Tweak systems? Take things apart and see how they work, then put them back together better and more efficient than before? Then Data Engineering might be for you. Are you a business who knows you’re ready to scale up and hire a Data professional? We have a strong candidate pool and may have just the person you need to fill your role. Are you a candidate looking for a role in big Data and analytics? We specialize in junior and senior roles. Check out our current vacancies or contact one of our recruitment consultants to learn more.  For our West Coast Team, call (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast Teams, call (212) 796 - 6070 or send an email to newyorkinfo@harnham.com.

Recently Viewed jobs