Sr. Inference Engineer (LLM Serving)
Gooddata
- КомпанияGooddata
- СтранаЧехия
- УровеньSenior
- АдресPrague
Описание
Our platform turns governed business data into answers, reports and agents that companies put in front of their own customers. To make that AI trustworthy, private and affordable, we run it on our own inference: open-weight models on our own GPUs, so customer data never has to leave our boundary.
Обязанности
You will own the serving layer of GoodData Native Inference. That means the models, the engine and the GPUs behind every AI answer our customers get. You will join the team that builds GoodData AI and become the person the whole company turns to for anything about running models in production.
- Deploy, operate and upgrade open-weight LLMs and smaller task models (guardrails, PII detection, classifiers, judges) on our GPUs, in production and across regions.
- Make inference fast and cheap: tune batching, KV and prefix caching, quantization and parallelism, and track time to first token, tokens per second per GPU, p95 latency and cost per answer.
- Choose the models: put new open-weight models through our evaluation harness on real analytics workloads, and recommend what goes to production.
- Grow our inference gateway: routing by intent and complexity across models, a semantic cache, and validation that escalates weak answers.
- Adapt models to our use cases with LoRA adapters and fine-tuning, such as generating queries for our semantic layer, root-cause analysis and narrative reports.
Требования
- 5+ years of software engineering, including…
Вакансии этой компании
- Enterprise Account Executive — Gooddata, США
- Sr. Solution & Product Analyst — Gooddata, Чехия
- Sr. Software Engineer (Backend) — Gooddata, Чехия
- Sales Engineer — Gooddata, США
- BI Solution Architect - Agentic Analytics — Gooddata, Чехия
Похожие вакансии
- Member of Technical Staff - GPU Inference Engineer — Liquid Ai, США
- Software Engineer - Inference Product — Baseten, США
- ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM) — Toptal
- Backend Software Engineer, ML Inference — Prior Labs, Германия
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data, Мексика
- Senior Machine Learning Scientist, Applied Causal Inference — Doordash Usa, США
- Senior/Staff Software Engineer, ML Inference Optimization — Zoox