Machine Learning Engineer — Inference Optimization

Featherless AI

КомпанияFeatherless AI
ФорматУдалённо
АдресRemote (world)

Описание

ABOUT THE ROLE

We’re looking for a Machine Learning Engineer to own and push the limits of model inference performance at scale. You’ll work at the intersection of research and production—turning cutting-edge models into fast, reliable, and cost-efficient systems that serve real users.

This role is ideal for someone who enjoys deep technical work, profiling systems down to the kernel/GPU level, and translating research ideas into production-grade performance gains.

Обязанности

Optimize inference latency, throughput, and cost for large-scale ML models in production

Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO)

Implement and tune techniques such as:

Quantization (fp16, bf16, int8, fp8)

KV-cache optimization & reuse

Speculative decoding, batching, and streaming

Model pruning or architectural simplifications for inference

Collaborate with research engineers to productionize new model architectures

Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks)

Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups

Improve system reliability, observability, and cost efficiency under real workloads

Требования

Strong experience in ML inference optimization or high-performance ML systems

Solid understanding of deep learning internals (attention, memory layout, compute graphs)

Hands-on experience with PyTorch (or similar) and model…

Вакансия на сайте компании

Откликнуться в JobToo

Machine Learning Engineer — Inference Optimization

Описание

Обязанности

Требования

Вакансии этой компании

Похожие вакансии