Software Engineer – AI Inference Engine
Friendliai
- КомпанияFriendliai
- СтранаСША
- ФорматГибрид
- ГрафикHybrid
- АдресSan Francisco
Описание
ABOUT THE JOB
We are seeking a highly technical Inference Engine Engineer to optimize the performance and efficiency of our core inference engine. In this role, you will focus on designing, implementing, and optimizing GPU kernels and supporting infrastructure for next-generation generative and agentic AI workloads. Your work will directly power the most latency-critical and compute-intensive systems deployed by our customers.
We are looking for an exceptional engineer with a strong foundation in GPU programming and compiler infrastructure. The ideal candidate enjoys pushing performance boundaries and has experience supporting production-scale machine learning applications.
Обязанности
- Design and optimize custom GPU kernels for AI (e.g., transformer and diffusion) workloads
- Contribute to the development of FriendliAI’s kernel compiler, memory planner, runtime, and other core components.
- Collaborate with cloud and infrastructure engineers to ensure end-to-end inference performance
- Analyze performance bottlenecks across the software and hardware stack, and implement targeted optimizations
- Drive support for new model architectures and tensor compute patterns
- Maintain production-grade performance infrastructure, including profiling, benchmarking, and validation tools
Требования
- 5+ years of experience in production or high-impact research environments
- Production-level expertise in Python and C++
- Bachelor’s or Master's degree in Computer…
Вакансии этой компании
- Software Engineer – Platform Security — Friendliai, США
- Senior Product Manager — Friendliai, Южная Корея
- Software Engineer – Senior Backend — Friendliai, Южная Корея
- Software Engineer – Platform Security — Friendliai, Южная Корея
- Software Engineer – Python Developer Tools — Friendliai, Южная Корея
Похожие вакансии
- Member of Technical Staff - GPU Inference Engineer — Liquid Ai, США
- Sr. Inference Engineer (LLM Serving) — Gooddata, Чехия
- Software Engineer - Inference Product — Baseten, США
- ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM) — Toptal
- Backend Software Engineer, ML Inference — Prior Labs, Германия
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data, Мексика
- Senior Machine Learning Scientist, Applied Causal Inference — Doordash Usa, США