Senior Software Engineer – ML Platform

arrow

Jersey City / $80 - $100 hour

INFO

Salary
SALARY:

$80 - $100

Location

LOCATION

Jersey City

Job Type
JOB TYPE

Contract

Senior Software Engineer - ML Platform

About the Role

We're looking for a Senior Software Engineer to help build and scale a next‑generation Machine Learning Platform that enables teams across the organization to efficiently productionize ML models at global scale. You'll apply modern MLOps practices to streamline deployment, simplify operations, and create reliable infrastructure that empowers data scientists, ML engineers, and product teams to deliver value quickly and confidently.

In this role, you'll design systems that support model deployment, monitoring, and lifecycle management for both GPU and CPU workloads. You'll also help enable live testing scenarios such as A/B experiments and shadow traffic, and build tools for versioning, observability, and reproducible ML environments. Your work will make machine learning easier to adopt and operate across diverse product teams.


Responsibilities

  • Design and implement ML inference infrastructure for real-time and batch model serving, including CPU/GPU-aware scheduling and automated deployment pipelines
  • Collaborate with research, data science, and product engineering teams to understand requirements and build reusable, scalable platform solutions
  • Contribute to CI/CD workflows for ML artifacts to enable rapid iteration and safe promotion from development to production
  • Build and maintain tooling for dependency and environment management (e.g., Conda, Poetry, container image hardening) to ensure reproducible ML runtimes
  • Implement observability features including monitoring, drift detection, latency metrics, and resource utilization tracking
  • Support ML deployment best practices such as multi-version serving, blue/green rollouts, shadow deployments, and rollback strategies
  • Focus on improving developer experience and iteratively refining platform usability
  • Contribute to platform architecture decisions and long-term roadmap planning
  • Partner with shared infrastructure teams to contribute upstream and establish effective collaboration models

Required Qualifications

  • 4+ years of software engineering experience, with significant time spent on platform, infrastructure, or backend systems
  • Experience building and operating distributed systems or production ML platforms
  • Hands-on experience with cloud-native technologies (e.g., Kubernetes, containerization, autoscaling, observability stacks)
  • Experience with one or more model serving frameworks (e.g., NVIDIA Triton, KServe, TorchServe, BentoML, Seldon Core)
  • Knowledge of GPU orchestration, performance tuning, and cost-aware scheduling
  • Strong background in CI/CD automation, infrastructure-as-code tools (e.g., Terraform), and artifact management
  • Experience working with Python ML ecosystems, environment/package management tools (Poetry, Conda), and vulnerability scanning workflows
  • Strong communication skills and the ability to collaborate across engineering, data science, and product teams

Desired Qualifications

  • Experience building ML infrastructure for low-latency or real-time use cases
  • Familiarity with ML workflow tools such as MLflow, DVC, LakeFS, and drift monitoring strategies
  • Exposure to online experimentation frameworks and A/B testing for model evaluation
  • Experience contributing to greenfield platform initiatives, particularly involving multi-tenancy or self-service capabilities
  • Interest or experience in creative technology, interactive applications, or large-scale consumer platforms
  • Familiarity with deployment requirements for international markets (nice to have, not required)

Location: Remote (EST Time Zone Preferred)

Utilization: 40 hours / week

Duration: 12 Months (Strong potential for extension)

Rate: $80/hr - $100/hr, dependent on experience

**WE ARE NOT USING THIRD PARTIES FOR THIS SEARCH**


CONTACT

SIMILAR
JOB RESULTS

4k-Harnham_DA copy
CAN’T FIND THE RIGHT OPPORTUNITY?

STILL
LOOKING?

If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.