Staff Machine Learning Engineer | Generative AI

arrow

PALO ALTO or NYC / $400000 - $650000 annum

INFO

Salary

SALARY:

$400000 - $650000

Location

LOCATION

PALO ALTO or NYC

Job Type
JOB TYPE

Permanent

About the Role

We are partnering with a Fortune 100 financial institution on a Staff Machine Learning Engineer opportunity within its enterprise AI organization. The team is responsible for developing and scaling LLM-powered products and reusable AI services that support AI adoption across the organization.

The firm's enterprise LLM platform is used by more than 320,000 employees, with AI applications spanning chatbots, text-to-code, database interactions, workflow automation, and AI agents.

What You'll Do

  • Build and optimize scalable LLM-based products and AI applications.
  • Combine large-scale data assets with cutting-edge AI, including LLMs and multimodal LLMs.
  • Bridge scientific research and software engineering, taking ideas from research into production.
  • Design and deliver production architectures in collaboration with Cloud and SRE teams.
  • Build reusable backend APIs that allow other teams to leverage AI capabilities within their own products.
  • Prototype, code, and deploy ML solutions independently.
  • Design systems capable of handling large volumes of requests while maintaining performance and reliability.
  • Work across applications including:
    • Chatbots
    • Text-to-code
    • SQL/database interactions
    • Workflow automation
    • AI agents

Scale & Impact

  • Enterprise LLM platform used by 320,000+ employees.
  • Platform enables employees to accelerate their ML adoption, going from 0-80% in their ML journey in approximately three days instead of months.
  • First-week releases can produce tools used by 100,000 employees.
  • Strong emphasis on adoption, productivity, and measurable enterprise impact.

What We're Looking For

  • Strong production Machine Learning Engineering background.
  • Deep understanding of ML/AI foundational models and API-based LLM integrations.
  • Experience building and deploying production ML systems independently.
  • Strong software engineering and system design fundamentals.
  • Experience designing scalable systems and production architectures.
  • Ability to bridge research, ML engineering, and production software development.
  • Experience working with cloud and infrastructure teams.
  • Strong analytical and problem-solving skills.
  • Ability to work independently and move quickly from problem definition to production solution.

Compensation & Location

  • Location: New York City or Palo Alto
  • Work Arrangement: 5 days per week onsite
  • Compensation: Up to $650K total compensation, depending on level and experience.

Why This Opportunity

This is an opportunity to work on enterprise-scale Generative AI with direct, measurable impact across a global organization. The team is focused on building production AI systems that can reach hundreds of thousands of users and meaningfully change how employees work.

CONTACT

SIMILAR
JOB RESULTS

4k-Harnham_DA copy
CAN’T FIND THE RIGHT OPPORTUNITY?

STILL
LOOKING?

If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.