Software Engineer, Inference

US$ 230,000 – 390,000 al año · Tiempo completo · Presencial

  • San Francisco · CA
  • Publicada hace 43 días
Postularme en el sitio de la empresa

Verificada en la fuente hace 3 h

Con tu cuenta gratuita de Joonow, vas al sitio de la empresa y la vacante queda en tus postulaciones.

Ninguna empresa seria cobra cuotas, cursos, exámenes ni uniformes. ¿Te pareció raro?

Descripción del empleo

About us

Sierra is the leading platform for customer-facing AI agents, working with many of the world's biggest brands — including The GAP, Rocket Mortgage, SoFi, Sutter Health, and SoftBank — to transform how they serve customers and grow their businesses. We are primarily an in-person company based in San Francisco, with growing offices across North America, Europe, and Asia.

We are guided by a set of values that are at the core of our actions and define our culture: Trust, Customer Obsession, Craftsmanship, Intensity, and a commitment to balancing Family along the way. These values are the foundation of our work, and we are committed to upholding them in everything we do.

Sierra was co-founded by Bret Taylor and Clay Bavor who first met while working together at Google over 20 years ago. Bret currently serves as Chairman of the Board of Open AI. Previously, he was co-CEO of Salesforce and CTO of Facebook. Clay spent 18 years at Google, where he most recently led Google Labs.

About the role

Sierra’s AI agents depend on foundation models to reason and act in real time. The Inference team builds the systems that make those models fast, reliable, and efficient at scale.

As a Software Engineer on Inference, you’ll help define Sierra’s inference architecture across both self-hosted models and third-party inference providers. You’ll work on the systems responsible for serving and routing inference, managing capacity and quota, and optimizing for latency, reliability, and cost.

This is a systems-first role at the intersection of distributed infrastructure and AI. You don’t need to be an ML researcher—we’re looking for engineers who love complex systems problems and are excited to apply that expertise to one of the fastest-moving areas of AI infrastructure.

What you'll do

  • Partner with frontier labs and providers. At our scale, we rely on frontier labs, and inference providers to supply capacity, training and inference infrastructure.

  • Shape Sierra’s inference architecture. Design how inference traffic flows across models, infrastructure, and providers, including new serving and proxy layers as Sierra scales.

  • Build for low latency and high reliability. Develop systems for routing, failover, capacity management, and quota that keep inference performant and available across large-scale production workloads.

  • Build and operate self-hosted inference. Run models on GPU infrastructure, from building containers and operating inference engines to managing the underlying compute capacity.

  • Optimize inference performance. Work with the Applied Research team on techniques such as speculative decoding and serving-engine optimizations that improve latency, throughput, and cost.

  • Build across a hybrid inference stack. Work with both Sierra-managed infrastructure and leading inference platforms, making architectural decisions about where and how workloads should run.

  • Push the serving stack forward. Work closely with inference providers to tune engines and infrastructure for Sierra’s workloads.

  • Support the broader model lifecycle. Contribute to infrastructure that enables post-training while partnering closely with our Models and Agent Runtime teams.

What you'll bring

  • Deep systems thinking and strong distributed systems fundamentals.

  • Experience designing, building, and operating large-scale production systems.

  • Strong judgment around tradeoffs involving latency, reliability, capacity, and cost.

  • Experience taking ownership of complex infrastructure from architecture through production operation.

  • Excitement about applying systems expertise to AI infrastructure and learning quickly as the underlying technology evolves.

Even better

  • Experience with ML infrastructure, MLOps, or production inference systems.

  • Experience serving LLMs or other large models at scale.

  • Experience operating self-hosted inference and GPU infrastructure.

  • Familiarity with inference frameworks such as vLLM or SGLang.

  • Experience with post-training infrastructure or inference-performance optimization.

Our values

  • Trust: We do the right thing, even when no one is looking, and even when it’s hard. When we screw up, we take accountability, fully and completely. We act in such a way that if all of our actions were completely visible to our customers, we would be proud.

  • Customer Obsession: Our entire business is designed to ensure every agent built on Sierra succeeds, and that we are accountable to our customers and their success. We do whatever it takes to make our customers successful, and we go the extra mile in how we show up as a partner with unreasonable hospitality.

  • Craftsmanship: A great company is the aggregation of thousands of things done well. As they say, “how you do anything is how you do everything”. Most important is craftsmanship in building agents that are so great that people thank them at the end of a call. That’s the standard.

  • Intensity: We operate with urgency, and we want to win. We are never complacent. We fight to win every deal, big or small, using the full force of the company. And when we fail, we talk about it openly and without blame so we succeed the next time.

  • Family: We know that balance and intensity are compatible, and we model it in our actions and processes. We work hard, and turn on the afterburners when needed. But we pick up our parents at the airport when they’re visiting from out of town. We go to our kids’ events. And we show up for one another, in moments of celebration and hardship.

What we offer

We want our benefits to reflect our values and offer the following to full-time employees:

  • Flexible (unlimited) paid time off

  • Medical, dental, and vision benefits for you and your family

  • Life insurance and disability benefits

  • Retirement plan dependent on country of employment

  • Parental leave

  • Fertility and family building benefits

  • Lunch, as well as delicious snacks and coffee to keep you energized when working onsite

  • Discretionary benefit stipend giving people the ability to spend where it matters most

  • Free alphorn lessons

These benefits are further detailed in Sierra's policies, may vary by region and employment type, and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans. Eligible full-time employees can participate in Sierra's equity plans subject to the terms of the applicable plans and policies.

Be you, with us

We're working to bring the transformative power of AI to every organization in the world. To do so, it is important to us that the diversity of our employees represents the diversity of our customers. We believe that our work and culture are better when we encourage, support, and respect different skills and experiences represented within our team. We encourage you to apply through the link on this page even if your experience doesn't precisely match the job description.

Sierra is a proud equal opportunity employer. All qualified applicants will receive consideration for employment without regard to any characteristic protected by applicable federal, state or local laws, including veteran status and disability status. Hiring decisions are made by people, based on merit. If you need a reasonable accommodation for a disability, a religious practice, pregnancy or any related condition at any point in the application or interview process, contact us at accommodations@sierra.ai. Requests are handled confidentially and do not affect your candidacy.

We will consider qualified applicants with arrest and conviction records in accordance with applicable fair chance laws.

Prepárate para esta vacante

Postularme