Inference Optimization Engineer
Hedra
- КомпанияHedra
- СтранаСША
- АдресSan Francisco
Описание
ABOUT HEDRA
Hedra is a research and infrastructure lab advancing post-training and inference for multimodal and physical AI. Our ambition is to bring recursive self-improvement to models that learn from and interact with the real world.
We combine reinforcement learning research with GPU compute and optimized inference to help teams post-train, serve and continuously improve models they own.
We're backed by Index Ventures, a16z and Abstract Ventures. Our team works fully in person in San Francisco.
We're looking for people with startup experience who take ownership of their work and care deeply about the problems our customers need to solve. You'll help build the technology, products and business that turn this research into a lasting company.
Обязанности
- Work directly with research scientists and engineers to make new visual models fast and efficient at inference time.
- Profile model architectures and workloads to understand bottlenecks across compute, memory, communication, and model execution.
- Develop and implement new approaches to improving inference latency, throughput, memory efficiency, and GPU utilization.
- Explore algorithmic optimizations including quantization, sparsity, caching, compilation, attention optimizations, and alternative execution strategies.
- Build or optimize GPU kernels using CUDA, Triton, or similar technologies when existing implementations leave performance on the table.
- Optimize model execution across single-GPU…
Вакансии этой компании
- Research Scientist — Hedra, США
- Senior/Staff Software Engineer, Distributed Systems — Hedra, США
- Research Engineer — Hedra, США
- Senior Video Producer — Hedra, США
- Account Executive — Hedra, США
Похожие вакансии
- Director, Engineering Optimization (FinOps) — Mastercontrol, США
- Senior Software Engineer, Forecasting & Real-Time Optimization — Lyft, США
- Senior Software Engineer, Forecasting & Real-Time Optimization — Lyft, США
- ML Research Engineer, Performance Optimization — Lila Sciences, США
- Compiler Optimization Engineer — Lemurian Labs, Канада
- Senior Process Optimization Specialist, iQueue for Infusion Centers — Leantaas
- Media Buyer - Creative Testing & Optimization — Kalshi, США
- Optimization Engineer, Grid Systems — Gridcare