Performance Engineer, Inference
Sarvam
- КомпанияSarvam
- СтранаИндия
- ГрафикOnSite
- АдресBengaluru
Описание
PERFORMANCE ENGINEER, INFERENCE
Part of Sarvam's Performance Engineering team. We are hiring two specialized performance roles - Inference (this posting) and Kernels (companion posting). They are a vertical stack: the kernels team authors the µs-level GPU code, and the inference team integrates it into a running serving stack and owns the system-level numbers. If your depth genuinely spans both, apply to either and tell us - but most candidates are strongest in one, and we hire for that depth.
Location: [Bengaluru / Chennai / Hybrid / On-site] · Team: Performance Engineering · Level: Senior
ABOUT THE TEAM
Sarvam serves multiple model families - small and large LLMs, Mixture-of-Experts, Indic ASR & TTS, streaming models and multimodal models - across a multi-node, multi-tenant fleet of Hoppers and Blackwells. The Performance Engineering team owns the numbers the rest of the company plans against: how fast we serve, how much it costs, and how much we get out of every GPU. This team works at the intersection of the serving runtime, the kernel layer, and the SRE org that keeps the fleet alive.
ABOUT THE ROLE
You will own Sarvam's production serving path for large distributed models end to end. You should be source-level fluent in at least one of SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM - able to read and modify it where stock behavior does not fit our workloads - and you should operate and extend a distributed-serving stack at depth: disaggregated prefill-decode across…
Вакансии этой компании
- Data Scientist - Evaluations, Chanakya — Sarvam, Индия
- Embedded Data Scientist, Chanakya — Sarvam, Индия
- Embedded Infrastructure Engineer, Chanakya — Sarvam, Индия
- Product Manager (Models) — Sarvam, Индия
- Strategic Deployment Engineer, Chanakya — Sarvam, Индия
Похожие вакансии
- Engineering Manager, Performance Optimization — Zoox
- Engineering Manager, ML Performance Optimization — Zoox
- Automation Engineer - Compute Software Performance — Zoox
- Senior Staff Machine Learning Performance Engineer — Xpeng Motors, США
- AI Infra Onboard Performance Intern — Xpeng Motors, США
- Performance Marketing Specialist (100% Remote - Chicago Area Preferred) — Win Home Inspection, США
- Performance Marketing Specialist (Fully Remote) — Win Home Inspection, Индия
- Senior / Staff Software Engineer, High-Performance Onboard Algorithms — Waabi, Канада