Staff Engineer, Distributed Storage & AI Infrastructure
Together AI
- КомпанияTogether AI
- СтранаСША
- УровеньLead
- АдресSan Francisco
Описание
About the Role
In this role, you will operate, scale, and optimize multi-petabyte storage systems purpose-built for the world’s largest AI training and inference workloads. Storage now sits on the inference critical path as well, so you’ll also build the caching and data-movement layers that deliver KV cache and model weights directly into GPU memory at fabric speed. You’ll manage and scale high-performance parallel filesystems and object stores, evaluate and integrate cutting-edge technologies such as Vast, Weka, Ceph, and Lustre, and solve the complex engineering challenges of operating at extreme throughput, low-latency data paths, and massive cluster-scale storage operations.
You will also build Kubernetes-native storage operators and self-service platforms that provide automated provisioning, strict multi-tenancy, performance isolation, and quota enforcement at cluster scale. Day-to-day, you’ll optimize end-to-end data paths for 10-50 GB/s per node, design multi-tier caching architectures, implement intelligent prefetching and model-weight distribution, build KV-cache offload and reuse tiers for inference, and tune parallel filesystems for AI workloads.
Обязанности
- Architect and implement the technical strategy and storage roadmap for Together AI, driving high-performance architectural decisions as we scale our GPU fleet.
- Engineer and scale multi-petabyte AI/ML storage systems by integrating Vast, Weka, and Ceph while executing deep cost optimization through…
Вакансии этой компании
- Lead Product Designer — Together AI, США
- Infrastructure Security Lead — Together AI, США
- CX Ops Specialist — Together AI, США
- Engineering Manager, Kubernetes Bare Metal Infrastructure — Together AI, США
- Senior Web & Inbound Growth Manager — Together AI, США
Похожие вакансии
- Backend Engineer Intern, Data Infrastructure - Big Data Platform (Spring 2027) — Sea Group / Shopee
- Regional Network & IT Infrastructure Engineer — Platinumlist, ОАЭ
- Founding Engineer, Infrastructure — Clera, США
- Backend / Systems Engineer, Agent Infrastructure — Clera, Германия
- Platform Engineer (Backend Infrastructure) — Focal Systems, Польша
- Sr. Software Engineer, Machine Learning & Data Infrastructure — OKX, США
- Infrastructure Developer Уровень Senior Подразделение Техническая дирекция — Arenadata
- Senior Infrastructure Engineer — TRM Labs, США