Software Engineer, Inference
- Countries
- USA
- Job Types
- software & tech
- Experience
- mid
- Organization Types
- startups, logistics & supply chain
- Location
- San Francisco
- Posted Date
- Company
- Sierra
- Salary
- $230K – $390K • Offers Equity
AI Summary
Job Description
As a Software Engineer on the Inference team, you will help define Sierra's inference architecture for AI agents. You will work on systems for serving, routing, and optimizing inference for speed, reliability, and cost. This role involves distributed infrastructure, AI, and complex systems problems.
Hard Requirements
- Deep systems thinking and strong distributed systems fundamentals
- Experience designing, building, and operating large-scale production systems
- Strong judgment around tradeoffs involving latency, reliability, capacity, and cost
- Experience taking ownership of complex infrastructure from architecture through production operation
- Excitement about applying systems expertise to AI infrastructure and learning quickly
Soft Requirements
- Experience with ML infrastructure, MLOps, or production inference systems
- Experience serving LLMs or other large models at scale
- Experience operating self-hosted inference and GPU infrastructure
- Familiarity with inference frameworks such as vLLM or SGLang
- Experience with post-training infrastructure or inference-performance optimization