JobToo

Software Engineer - Inference Product

Baseten

Описание

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

Обязанности

We're looking for product-minded backend and distributed systems engineers to build the API layer that powers Model APIs, Baseten's hosted endpoints for the latest open-source models. Every request to Model APIs passes through the systems this team owns: authentication, rate limiting, routing, metering and billing. You'll make that layer fast, reliable and easy to build on, and use it to ship new products that change how developers use models at scale. You'll work where infrastructure meets product. The systems you build decide how customers experience performance, how capacity is shared across a global GPU fleet, and how inference is packaged and sold. You'll join a small, high-impact team that partners closely with inference, and product, and you'll own your work from design through production. This role is ideal for engineers who like owning high-scale production…

Вакансия на сайте компании

Откликнуться в JobToo

Вакансии этой компании

Похожие вакансии