Senio Big Data Architect Lead

San Francisco, California
US$150000 - US$180000 per year + equity

This vacancy has now expired. Please see similar roles below...

Senior Big Data Lead Architect

San Francisco, Bay Area

$1500,000-$180,000 + Equity

Harnham has partnered with a selfless Fintech company that is looking to change the lives of billions of people around the world by allowing financial access to individuals would not have access otherwise. This company partners with telecommunication companies to utilize machine learning/deep learning to create an identity-based relationship with anonymous prepaid users, opening up access to otherwise unattainable mobile financial services.

ROLE OVERVIEW- Senior Lead Architect

As a Senior Lead Architect, you will report to the VP Engineering. You will be hands-on end to end leading the design and development of data solutions providing and establishing efficient, scalable financial platforms that will serve billions of people that have insufficient access to banks.

The Senior Lead Architect position will help establish a bulletproof architecture that will be able to scale as the company continues to skyrocket. You will build and scale internal analytics, reporting, and dynamic decisioning platforms; while helping spearhead technical direction, driving the necessary changes and making appropriate technology choices working collaboratively with the DevOps, Product and Engineering Teams in an AWS environment

REQUIRED SKILLS & EXPERIENCE

Ideal candidates will possess:

  • 4+ years commercial experience in AWS (S3, DynamoDB, EMR, Redshfit, EC2)
  • 2+ years of real-time streaming exposure (Kafka, Spark Streaming, Kinesis)
  • 3+ Spark (Scala/Python)
  • 4+ years working cross-functionally (w/DevOps. Product, Data Science, and Infrastructure teams)
  • 4+ years of experience with ETL workflow (Airflow, Pinball, Luigi)
  • Experience/Examples of creating highly scalable infrastructure
  • Experience with Docker, Kubernetes, Terraform.

BENEFITS

  • Medical, 401k, dental, etc





Send similar jobs by email
33445
San Francisco, California
US$150000 - US$180000 per year + equity

Similar Jobs

Salary

£50000 - £65000 per annum + Benefits

Location

London

Description

If your dream is to work with internationally recognised brands, designing and creating Software and Solutions for them using Java, this role is for you!

Salary

£650 - £700 per day

Location

City of London, London

Description

AWS Architect Central London 6 months £650-700 a day

Salary

£55000 - £70000 per annum + Bonus

Location

London

Description

Working across multiple platforms and technologies to create a set of microservices that is consistent, highly usable, reliable and performant.

Salary

Up to £94000 per annum + 15% Bonus + Unlimited Holiday

Location

City of London, London

Description

Be part of the next biggest development in transport technology! Be one of the first Senior Java Developers to bring this start up's vision into reality!

Salary

£75000 - £85000 per annum + Benefits

Location

London

Description

Want to work for one of the bigggest brands in the UK as a Principle Software Engineer? This is your chance! Use Java and the latest tech in this one-time role

Harnham blog & news

With over 10 years experience working solely in the Data & Analytics sector our consultants are able to offer detailed insights into the industry.

Visit our Blogs & News portal or check out our recent posts below.

Harnham Named one of the Sunday Times' Top 100 Companies to Work For

I am thrilled to announce that we've been named one of The Sunday Times' Top 100 Small Companies to Work For 2019.   This is the first year we've been eligible for the award and, fantastically, we've managed to place 26th.   Coming off the back of our three-star accreditation from Best Companies for 'Extraordinary Levels' of workplace engagement, and being named APSCo's Recruitment Company of the Year (£10m-£50m) this is something else for the whole business to be proud of.  Crucially, for both myself and the leadership team, is the fact that this accolade is based entirely on employee feedback. Our success has always been built on the success of our employees and we have always tried to nurture an environment where they can flourish. To be recognised for our efforts. and to know that our staff are happy here, means a tremendous amount to us. And, as ever, we're looking to grow our team. If you're determined, ambitious and driven, get in touch about our latest opportunities. 

3 questions to ask yourself before your next BI hire

Data & Analytics are a vital part of every organisation nowadays, so it is not surprising that the importance of Business Intelligence keeps growing. With increasing demands from executive management, operations, and sales, a stronger and better BI team is essential.  The responsibilities of the BI team include but are not limited to: performing Data validation and Data Analysis, delivering KPI related reports and dashboards, and working with end users to define business requirements and needs. However, as every company is different, every BI department is different as well. This means that from one BI team to another, the needed skills can vary completely. To get the most out of your team, it is important to have a clear understanding of what skills you already have, which skills you need to add with your next hire, and whether this is realistic for your business.  Here are three important questions to ask yourself before your next BI hire:  1) What does your team look like at this moment? To be successful in expanding your team, it is vital to take a closer look at the type of profiles and skillsets you already have. This is a good time to map out where the skills are in your team and see what is lacking, or what can be improved. To do so, you should consider three key elements: how (much) Data is used and made available, how this Data is structured and what is being done with this Data. The following three questions are important here:  Do you get the right Data out of your Datawarehouse/Data Lake? How is the Data structured now, and do you get the reports and dashboards needed?  Are you able to provide stakeholders with the right insights? These questions can function as starting point of deciding what skills you have now, and which areas to focus on with your next BI hire to fill in gaps or improve the areas where needed. 2) What does your Data Roadmap look like?  It is important to have a clear vision of where you want to go with your BI team and how to leverage your Data. At the highest level, your vision will be determined in a Data Strategy. On a more practical, day-to-day level, the steps to take are outlined in a Data Roadmap, with every part of the process requiring a different skillset. 
 What we often see is that companies who are at the start of their Data Roadmap, first hire a Data Analyst. Typically, a Data Analyst knows how to work with the Data and has a strong business sense but is not a specialist in either field. On the other hand, when the Data infrastructure has been set up, the need is higher for someone who can make sense of the Data and present this in reports and dashboards.  Two key points to consider: What is the next step in your Data Roadmap?  What type of skillset is needed to get to that next step? For example, this can be technical skills such as building Data Pipelines or stronger analytical skills to get insights from the Data.  By having a clear understanding what phase of your Data roadmap is next, it will be easier to hire the next member of your team. 3) What is realistic for your business? While you may know what type of profile(s) to hire next, it is important to determine whether this is feasible. The following factors are important to consider: As with every field of expertise, the salary ranges depend on which type of profile you are looking to hire. It is vital here to ask yourself where to invest your money best. For example, it is great to have an Insights Analyst in the team, but is this type of profile the main priority? You might want to first hire a Data Analyst to structure the Data and build useful reports. The candidate market within Data & Analytics is tight, so think about what you can give them in return to attract the best talent. A training program for personal development and the possibility to work flexible hours are two selling points that make your company stand out from the rest.  Location is key for many candidates. Businesses in larger cities are more popular with strong candidates in comparison to more remote businesses.  It is clear, therefore, that multiple factors are involved in determining what your next BI hire should be in terms of skillset and profile.  If you are looking to expand your BI function but not sure where to start, get in touch and I can advise you on the best next steps.  

Recently Viewed jobs