Big Data Engineer

New York
US$120000 - US$150000 per annum + Unlimited PTO - 401k Match

Big Data Engineer

Data Intelligence Product Company

New York, NY

The Company

A growing data intelligence product company that works with their clients in the advertising spend space is looking to hire a Data Engineer. The company offers an amazing start-up culture, unlimited PTO, extended vacation periods, fully covered benefits, a 401k match and training opportunities. Along with their original data products they are now looking to grow their teams and expand the number of products that they offer by leveraging the newest technology and best development protocol. This opportunity will allow for an immediate impact within the team and provide significant opportunities to enhance your technical abilities.

Data Engineer Responsibilities

  • Maintaining existing data pipelines in the traditional data warehouse (Microsoft SQL Server-based) and building new pipelines in their new cloud environment (AWS)
  • Supporting the existing product environment and the development of future products
  • Leveraging Airflow, Kubernetes and Docker to automate and manage data flows within AWS
  • Interact with the VP of Data and Senior Stakeholders to define new analytical products
  • Work within a CI/CD environment to develop high quality systems

Your Skills and Experience

  • Experience managing full data life cycles within environment and an understanding of how it effects analytical data products
  • Previous experience using MS SQL for development and the full MS Development Stack
  • Current experience working within an AWS environment
  • Understanding data warehousing flows with MS SQL Server
  • Experience with scheduling and containerization tools like Airflow, Docker, Kubernetes
  • Experience with Python is highly desirable for this role

The Benefits

You will receive a base compensation of up to $150k with benefits, unlimited PTO, a start-up environment within an established organization and a 401k match.

How to Apply

Please register your interest by sending your CV to Tommy Daughtrey via the Apply link on this page. REF ID 70595

Send similar jobs by email
70595
New York
US$120000 - US$150000 per annum + Unlimited PTO - 401k Match
  1. Permanent
  2. Big Data

Similar Jobs

Salary

US$440 - US$520 per day + Additional Benefits

Location

New York

Description

Hi All, I'm currently recruiting for this position. Please click on the job title below to view the Job Description and apply to it!

Salary

US$243850 - US$268235 per annum + Benefits

Location

New York

Description

A fast-growing tech company is looking for a Staff Data Engineer to join them in the heart of New York City! The salary is up to $220k, click below to apply!

Salary

US$185000 - US$210000 per annum

Location

San Francisco, California

Description

Work with one of the largest Hadoop clusters in the world as our client looks to migrate PBs of data to empower their client's customers.

Salary

US$170000 - US$200000 per year + Bonus

Location

San Francisco, California

Description

The Lead Data Engineer will work at a global leader in their field who due to an increase in business are looking to grow their Data Engineering team.

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

Drawing the Line Between Work and Family When Working Remotely

So, you’ve been told to work from home. Finally, more time with the family… Wait, more time with the family? How will you get your work done while also homeschooling your children? Maybe you’re married and your spouse is home, too. The routine of work has been disrupted, and though many businesses were already turning to remote work, this is something else.  So, how do you morph from leaving the house to go to the office to simply walking into your kitchen or home office to begin your day? In other words, how do you draw the line between work and family when you’re working from home? We know it can be difficult and unsettling in this troubled time, so we have a few tips to get you started. Getting Started in Your Remote Working Lifestyle DEFINE YOUR WORK SPACE What room can you designate in your house to be your “office.” It’s best to have someplace with a door, but this isn’t always possible. Is it the kitchen table? Ok, but this will mean you need to set strict ground rules about the hours you’re “on.” Make sure everyone understands when you’re “at work.” Whether it’s your kitchen table, a quiet room, or the end of your sofa with your laptop, these are your remote working tools. In some cases, it may even be a good idea to invest in noise-canceling headphones to help you stay focused. HAVE SET HOURS Define what hours you’re working and stick to them. Begin and end your day at the same time. Don’t forget to schedule breaks – coffee break, lunch, a stretch of the legs – around the same time each day as well. Work with your team to set hours for when you’ll be online working and respond to off-hour messages within your working hours. Without designated hours, it can feel like you’re constantly available and always “on” blurring the lines between work and family. Get some fresh air when you can. Step outside for a walk or a coffee, whatever brings you outside can help recharge and energize you for the work ahead. ENSURE YOU HAVE THE RIGHT TOOLS Remote working apps, videoconferencing tools, and cloud-based filing systems help ensure the job gets done. Make sure you keep your passwords in a safe place and be extra cautious when logging in from a new location. Is your computer up-to-date? Does it have all the security measures and capacity in place for the additional online tools and apps you may need to add? Making sure you address these things can help to solidify your workspace and ensure you’re able to meet with your team online and get the job done. FOLLOW THE 20-20-20 RULE The American Academy of Ophthalmology recommends the 20-20-20 rule: every 20 minutes look away from your screen and focus your eyes on something 20 feet away for 20 seconds. TAKE A BREAK FROM TALKING ABOUT WORK If you’re not used to working-from-home, loneliness can quickly set in. Remember those quick hallway chats or discussions over lunch or coffee? Take that impulse and use it when talking with your team. Have a virtual coffee break. Take a break from work and talk about hobbies, something funny that happened to you, or even just how you’re feeling away from everyone. You won’t be alone in these feelings with everyone in the same work-from-home boat. These tips can help you put your best foot forward for your remote working lifestyle. But don’t forget, you can use these same rules for family time, too. In the wake of work-from-home policies, remote working, and the shifting landscape of working outside the office, technology careers are prime opportunities to both gain increased knowledge in your chosen field or begin your career path.  If you’re interested in remote Big Data & Analytics opportunities, we may have a role for you. Take a look at our current vacancies or contact one of our expert consultants to find out more.   For our West Coast Team, contact us at (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast teams contact us at (212) 796-6070 or send an email to newyorkinfo@harnham.com.  

How Computer Vision Engineers Develop the Eyes of AI

Facial Recognition software. Autonomous vehicles. Drone delivery. Robotics in manufacturing. 3D Printing. No longer the stuff of science fiction, these advancements are at the heart of the next evolution in the digital age. Developments are not just being made in the tech hubs of Silicon Valley, Austin, or New York, but in the mid-West. Ann Arbor, Michigan home to the University of Michigan and not too far from where Henry Ford first introduced mass production with the help of automation has been advancing robotic technologies across a variety of fields.  Giving machines their own set of eyes does require someone to ensure they have the right information to do their jobs. Enter the Computer Vision Engineer. It’s estimated this field will see a rise of 19% demand through 2026. It’s also a relatively small field with only 5,400 new job openings. So, like many professions, demand is high yet a shortage remains of those Data professionals with the right skillsets. The Business of a Computer Vision Engineer While there are a variety of roles within the field of Computer Vision, the role of Computer Vision engineer focuses on two areas. Those areas are: Writing code in Python/C++ Integrate Data Visualization, image analysis, and imaging simulation controls In addition to these areas, these scientists focus on research, implementation, reaching across teams both human and machine to help solve real world problems. And as important as knowledge and application theory are, it’s the hands-on experience which raises the bar for most employers and client companies.  Using image recognition, machine learning, and segmentation can help machines learn to differentiate various images. Being able to “see” what the computer may see and correcting it to ensure it’s more like human vision takes a special skillset. This can include: Computer Vision librariesDatabase managementComponent or object-oriented softwareAnalytical, logical, and critical thinkingClear reasoning It’s these skillsets along with a background in mathematics and computer languages like C++ which pave the Computer Vision engineer career path.  The Future of Computer Vision  The days of the generalist are long behind us. Now, more than ever, technologies like machine vision require a dedicated focus. With every field from healthcare to law enforcement to manufacturing utilizing these technologies, the future of Computer Vision performs a broader range of functions.   In Ann Arbor, at the University of Michigan and in partnership with Ford Motor Company, advancements race through every field not the least of which is manufacturing. As they transition toward full automation using the Internet of Things and more autonomous processes, it’s even more important to ensure Computer Vision models understand what they’re “seeing.” Computer Vision engineers will help to advance technologies which make machines easier to train and more easily figure out images better than they do now. Used in conjunction with other technologies like neural networks and other subsets of AI, machines will be able to see and interpret in the same way humans see and interpret.  And as far as we’ve come, there remains more applications and benefits not yet explored. The possibilities are endless. Current and future advancements will pave the way for AI to be as human as we are bringing our once science fiction ideas to life.  One Final Thought… Though Computer Vision engineering can be drilled down to even more focused professions, the term itself is broad. But the specializations are basic with a demand for not only highly skilled professionals with the right educational background, but also hands-on experience. This detail is more important now than ever before, especially for Computer Vision teams seeking leadership roles who can take their applications to the next level and on a global scale.  Some of the basic specializaitons include, but are not limited to: Camera imaging geometryFeature detection and matchingImage classification and scene analysis In the wake of work-from-home policies, remote working, and the shifting landscape of working outside the office, technology careers are prime opportunities to both gain increased knowledge in your chosen field or begin your career path.  If you’re ready to take the next step in your career, we may be able to help. Take a look at our current vacancies or get in touch with one of our expert consultants to learn more.   For our West Coast Team, contact us at (415) 614 - 4999 or send an email to sanfraninfo@harnham.com.   For our Mid-West and East Coast teams contact us at (212) 796-6070 or send an email to newyorkinfo@harnham.com.  

Recently Viewed jobs