Lead Data Engineer - Scala, Cloud

New York
US$170000 - US$200000 per annum + Additional Benefits

Lead Data Engineer - Scala, Cloud

New York, New York

$170,000-$200,000

THE COMPANY

This digital real estate platform is looking to bring on a highly experienced professional in data engineering to lead their offsite engineering team in developing and expanding their core product lines.

Are you a Scala enthusiast excited with the opportunity to become a digitalized pioneer in the real estate space?

If so, this could be your next role!

THE ROLE

As the Lead Data Engineer heading up a team of data engineers and scientists, you will be responsible for the following:

  • You will be replacing their offshore data architect working closely with the product manager to design and build data pipelines and infrastructure and write code primarily in Scala
  • You will make sure all 3rd party data is properly ingested
  • You will mainly work with AWS Redshift, Scala and Databricks

YOUR SKILLS AND EXPERIENCE

  • You have senior level data engineering professional experience
  • You have cloud experience preferably in AWS, but they are also open to GCP and Azure
  • You have a high level of programming competency in a professional setting with Scala specifically

THE BENEFITS

  • $170,000-$200,000 base salary
  • Comprehensive equity offered
  • Medical, Dental, Vision Insurance
  • PTO and sick day benefits

HOW TO APPLY

Please register your interest by sending your résumé to Kavya Kannan via the Apply link on this page.

Send similar jobs by email
71960/KK2
New York
US$170000 - US$200000 per annum + Additional Benefits
  1. Permanent
  2. Big Data

Similar Jobs

Salary

US$160000 - US$180000 per year

Location

New York

Description

Are you looking to join rapidly growing tech business where you can build an engineering team from scratch?

Salary

US$130000 - US$145000 per annum + Additional Benefits

Location

Hartford, Connecticut

Description

Hi All, I'm currently recruiting for this position. Please click on the job title below to view the Job Description and apply to it!

Salary

US$200000 - US$250000 per annum + Additional Benefits

Location

New York

Description

A Data Analytics leader local to NYC is looking to bring on a Principal level Data Architect and Engineer passionate and experienced in the Healthcare domain!

Salary

US$100000 - US$160000 per annum + Additional Benefits

Location

Cincinnati, Ohio

Description

Interested to work for one of the world's largest business conglomerates as a high-impact data engineer? Read below to see if you are suited!

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

Which Skillset Do You Need: Data Science or Advanced Analytics?

According to our 2020 US Data & Analytics Salary Guide, there has been a recent uptick in leadership roles within the Data & Analytics industry. Stemming from the skillset which is equally balanced between technical and communicative abilities, this field is fast approaching a 50/50 gender split. These are the leadership roles for which businesses are seeking employees who can translate business objectives into actionable insights, and yet, too often businesses think this is the role of the Data Scientist. As Data Science, Machine Learning, and other terms in the Data industry change to encompass new roles, it is imperative businesses understand what skillset they need to fill which role. So, here’s a quick comparison to help navigate which role has the best skillset for your needs. TRADITIONAL DUTIES OF A DATA SCIENTIST  Understand one or more coding languages such as R, Hadoop, SQL, Apache Spark, etc.Able to collect, gather, and analyze Data from past and current applications for business recommendations.Craft statistical models for planning and implementing strategies. While it’s true these three duties are similar to an Advanced Analytics Skillset, the advanced skillset takes things a bit further.  TRADITIONAL DUTIES OF A CHIEF DATA OR ANALYTICS OFFICER As this role leans a bit more toward the Advanced Analytics skillset, let’s take a look at where it jumps off from the traditional Data Scientist role. Create a Data Strategy and communicate the vision of that strategy.Create Data access policies and strategize with business executives. Oversee a variety of functions including Data Management, Data Governance. Whether the title is Chief Data Officer or Chief Analytics Officer, these are the high-level roles which might report to the CEO or COO rather than the CIO. The Chief Data Officer falls within the senior executive team and is responsible for not only the Data Strategy and its governance, but explaining its benefits in clear language to the other executives. WHEN BUSINESS & CANDIDATE EXPECTATIONS ALIGN  Though Advanced Analytics teams have remained strong during the pandemic, and the field is ever-changing as businesses understand which skillset they need for what job, there has been some turnover in the past.  So, why the turnover if it’s an expanding field? The answer is two-fold in that oftentimes, the candidate and business expectations aren’t aligned. And to that end, it often stems from businesses believing once they’ve hired someone their problems are solved.  However, when the right person with the right skillset is in the right place. And when businesses understand that person can help them solve the problem once there is a strategy and processes in place, then the two are more efficiently aligned.  WHERE TO LOOK FOR ADVANCED ANALYTICS & INSIGHT ROLES If you’re a candidate and have five years or more experience in the Analytics industry, there is a huge growth in demand from EdTech and TeleHealth enterprises. As businesses have gone online and virtual, it’s important to have someone in place who can navigate the changing nature of education and medicine within the Data & Analytics field. One of the key ingredients businesses hunger for are candidates who can blend statistical analysis with the communication skills. For businesses, candidates want to grow with the business and have the opportunity to make an impact. In our recently released 2020 Salary Guide we discuss each specialism; what’s working, what isn’t, and how businesses can hire and retain top talent to keep their projects on track and their businesses running smoothly. If you’re interested in Data and Technology, Risk or Digital Analytics, Life Science Analytics, Marketing and Insight, Data Science, or Computer Vision, we invite you to check out our current vacancies. If you’d like to learn more, contact one of our expert consultant. For our West Coast Team, contact us at (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast teams contact us at (212) 796-6070 or send an email to newyorkinfo@harnham.com.  

Computer Vision in Our Day-to-Day Lives

We make micro adjustments every day to what we wear, how we shop, and how we drive. Our healthcare and industrial verticals are working with AI and Computer Vision to enhance our experiences from the user to the professional. There are a variety of computer vision applications to make life easier, more efficient, and safer. In other words, our computers have eyes. Every industry, it seems, is now touched by Computer Vision. From retail to healthcare to agriculture to banking, AI technology combines with deep learning and machine learning to help computers “see” where a car goes, an individual’s health, and what outfit might look best for any given outing. So, let’s take a look at some of the industries currently using Computer Vision. AUTOMOTIVE Human error and distractions often lead to car accidents and fatalities. According to the WHO, it’s estimated traffic accidents will be the seventh leading cause of death by 2030. To help alleviate this prediction, there is work being done on a self-driving car with sensor technology. Though autonomous cars have been tried before, this next incarnation has worked to ensure it can detect not only other cars and other large obstacles, but also pedestrians and cyclists at a distance. As it navigates through the streets autonomously, it follows traffic regulations as well as detect hand signals, and more. Efforts to train the vehicles use deep learning to predict, plan, and map its way through various scenarios. HEALTHCARE The advent of Computer Vision in technology has been a boon to the industry. It can help determine conditions of illness, reduce or eliminate misdiagnoses, and can even monitor blood loss during medical situations.  Captured images on items such as surgical sponges can be processed using Computer Vision using Machine Learning. In comparison with the human eye, the computer’s estimates were more accurate.  RETAIL  Retail has been at the forefront of many changes within the tech industry. And now, as online shopping, e-commerce, and virtual events take over traditional venues and brick-and-mortar stores, even the task of trying on clothes has gone virtual. From a virtual mirror which uses Computer Vision to help identify what outfit looks best. What may be most appropriate in what situation. Something like a movie montage, but in real time for a real person.  Retail takes things a step further by stepping up security. Using Computer Vision, retail security apps can monitor what is being recorded, what has been taken from shelves, and items being fake scanned. This information and knowledge can lead to reduced theft and other losses in stores. While other industries such as banking and agriculture have also seen a rise in Computer Vision, it’s the above which we might see in our day-to-day lives sooner rather than later. ONE FINAL THOUGHT Business processes have shifted online, looking for your next job has become more daunting than ever before. But here’s the good news. Everyone’s on the same page. Leaders, hiring managers, recruiters, and prospective employees are all navigating a new way of doing business and finding talent to keep those businesses running. In the wake of work-from-home policies, remote working, and the shifting landscape of working outside the office, technology, and particularly biotechnology careers are prime opportunities to both gain increased knowledge in your chosen field or begin your career path.  If you’re interested in Big Data & Analytics or other Data professional opportunities, check out our current vacancies or contact one of our recruitment consultants to learn more.   For our West Coast Team, contact us at (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.  For our Mid-West and East Coast teams contact us at (212) 796-6070 or send an email to newyorkinfo@harnham.com.  

Recently Viewed jobs