Software Engineer – GPU Kernel
Friendliai
- КомпанияFriendliai
- СтранаЮжная Корея
- ГрафикOnSite
- АдресSeoul
Описание
ABOUT THE JOB
FriendliAI is looking for a GPU Kernel Engineer to design, build, and optimize the low-level compute kernels that power our large-scale, GPU-accelerated AI inference platform. You will be delivering world-class inference speed across NVIDIA and AMD GPUs. With our recent $20M funding, we are scaling our team to meet market demand.
This is a deeply technical, high-impact role where you will write GPU code, implement advanced optimizations. As part of our engine team, you will contribute directly to the company’s proprietary inference engine which supports over 600,000 models on Hugging Face. You will work with the inventors of continuous batching and collaborate with the platform team to deploy your work into production.
Обязанности
- Design, implement, and optimize high-performance GPU kernels for AI inference (e.g., GEMM, attention, routing)
- Develop and maintain GPU code in CUDA and C++, including low-level assembly when needed
- Implement reduced-precision and quantized kernels (FP8/FP4) for low-latency or high-throughput inference
- Benchmark and ensure cross-vendor performance parity between NVIDIA and AMD hardware
- Contribute to internal GPU libraries and tune performance of performance-critical components
- Accelerate multi-modal model pipelines
- Investigate and integrate next-generation GPU features
Требования
- 3+ years of experience in GPU programming, HPC, or performance-critical systems
- Bachelor’s or Master’s degrees in…
Вакансии этой компании
- Software Engineer – AI Inference Engine — Friendliai, США
- Software Engineer – Platform Security — Friendliai, США
- Senior Product Manager — Friendliai, Южная Корея
- Software Engineer – Senior Backend — Friendliai, Южная Корея
- Software Engineer – Python Developer Tools — Friendliai, Южная Корея
Похожие вакансии
- Senior Software Engineer, Home Lending — Upstart, США
- ISV Partner Manager (f/m/d) Cloud Software — IONOS
- Senior Software Engineer - Product Core Team — BLP Digital, Швейцария
- Robotics Software Deployment & Operations Engineer (m/f/d) — Agile Robots, Германия
- Staff Software Engineer (PHP) — Lendable, Мексика
- Senior Software Engineer, International Payments — Toast, Ирландия
- Software Engineer, Vercel Agent — Vercel, США
- Lead Software Engineer — WPP, Дания