JobToo

AI Engineer

Litellm

Описание

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.

WHAT YOU WILL BE WORKING ON

Skills: Python, LLM APIs, FastAPI

As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

WHO WE ARE LOOKING FOR

Вакансия на сайте компании

Откликнуться в JobToo

Вакансии этой компании

Похожие вакансии