Senior Software Engineer. Data Platfrom

arrow

Costa Mesa / $150000 - $200000 annum

INFO

Salary

SALARY:

$150000 - $200000

Location

LOCATION

Costa Mesa

Job Type
JOB TYPE

Permanent

Company: Confidential

Location: Costa Mesa, California, United States

Job Type: Full-Time, Hybrid

Compensation: $150,000 - $200,000

About Our Client

Our client is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century's most innovative companies to the defense industry, our client is changing how military systems are designed, built, and sold. Their family of systems is powered by Lattice OS, an AI-powered operating system that turns thousands of data streams into a real-time, 3D command and control center. As the world enters an era of strategic competition, our client is committed to bringing cutting-edge autonomy, AI, computer vision, sensor fusion, and networking technology to the military in months, not years.

About the Team

As a Senior Software Engineer on the Analytics Team, you will be collaborating with stakeholders across the company to design, build, and implement data pipelines and models that enable our next-generation technology to be deployed around the world. You will have a hand in helping shape the data platform vision at our client.

We're looking for software and data engineers who are seeking high-impact, collaborative roles focused on driving operational execution. Ideally, you are looking to learn what it takes to build the next generation of defense technology.

What You'll Do

  • Lead the design and roadmap: Take charge of the design and roadmap for the data platform.
  • Cross-functional partnerships: Partner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure for the various data needs.
  • Own data frameworks: Manage the ingest and egress frameworks for data pipelines that stitch together various data sources to produce valuable data products that drive the business.
  • Palantir Foundry management: Utilize Palantir Foundry as the central hub for data-driven applications, visualizations, and large-scale data analysis across our client's organization. Manage a large user base and provide true data self-service at scale.
  • Data transformations: We use SQLMesh for data transformations, giving engineers the ability to work with SQL while enjoying software engineering best practices like version control, testing, and CI/CD for data pipelines.
  • Data lake analytics: For querying data, we utilize AWS Athena, an AWS serverless solution that allows the team to run analytics directly on the data lake without managing infrastructure.
  • Table formats: We have implemented Apache Iceberg as our table format, providing advanced data management capabilities like schema evolution and time travel queries.
  • Orchestration: We use Flyte for orchestration; it is a highly scalable, Kubernetes-native modern orchestration platform similar to Airflow or Dagster.

Qualifications

  • Experience: 5+ years of experience in a data engineering role building products, ideally in a fast-paced environment.
  • Mission Alignment: You are motivated by our client's mission; they are working to solve the biggest problems in defense.
  • Programming Foundations: Good foundations in Python or another language.
  • Technical Tools: Experience with Spark, PySpark, SQL, and dbt.
  • Enterprise Data Systems: Experience with Enterprise Data Systems like Palantir Foundry.
  • Data Services & Products: Experience with or interest in learning how to develop data services and data products.
  • Cloud & Ecosystems: Experience with AWS, Azure, or GCP security ecosystems, containerization, and associated tooling.
  • Data Visualization: Knowledge of data and visualization tools, such as Tableau.
  • Security Awareness: Understand the importance of engineering with security's best practices in mind.
  • Soft Skills: You are empathetic (eager to see the world from your users' perspective), a self-starter, and energized by business impact to drive the direction of ambiguous projects.
  • Ownership: Drive to take ownership of and debug complex data transformation pipelines and data models.
  • Citizenship Requirement: Must be a U.S. Person due to required access to U.S. export-controlled information or facilities.

CONTACT

Anthony Goodvin

Sourcing Consultant

SIMILAR
JOB RESULTS

4k-Harnham_DA copy
CAN’T FIND THE RIGHT OPPORTUNITY?

STILL
LOOKING?

If you can’t see what you’re looking for right now, send us your CV anyway – we’re always getting fresh new roles through the door.