ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)
Toptal
- КомпанияToptal
- ФорматУдалённо
- АдресAnywhere in the World
Описание
Overview
We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges. Each task includes the environment, a working solution, and an automated check that proves the result is correct.
*THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS.*
Обязанности
⢠Design expert-level Terminal-Bench tasks that turn real, paid ML inference work from your own experience into challenges an AI agent must solve end to end.
⢠Define the files, systems and environments each task runs on, such as model serving with streaming, so the challenge is realistic, reproducible and command-line solvable.
⢠Write a working reference solution for every task and verify it runs end to end, sized for about 60 to 75 minutes of expert effort.
⢠Build automated checks that objectively prove a result is correct, including cases where ML outputs go wrong silently, such as numerical drift or metric bugs.
⢠Package tasks with Docker and Git so they are reproducible, and document the systems, tools, data and rules involved so reviewers can validate difficulty.
⢠Iterate on tasks based on reviewer feedback and agent test runs, adjusting difficulty and fixing ambiguities so each task stays expert-level, fair and objectively gradable.
Skills/Experience
⢠3+ years doing ML…
Вакансии этой компании
- Agile Program Manager — Toptal
- Operations Expert with Python for AI Supply Chain Task Design — Toptal
- Client Partner, Consumer Products & Services - US-Based — Toptal, США
- Client Partner, Consumer Products & Services — Toptal, Канада
- Enterprise Sales Executive, AI Solutions — Toptal, Великобритания
Похожие вакансии
- Backend Software Engineer, ML Inference — Prior Labs, Германия
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data
- Data Scientist Senior - Causal Inference - Databricks — Mutt Data, Мексика
- Senior Machine Learning Scientist, Applied Causal Inference — Doordash Usa, США
- Software Engineer, ML Inference Optimization — Zoox
- Senior/Staff Software Engineer, ML Inference Optimization — Zoox
- Software Engineer, AI Inference / HPC — Topaz Labs, США
- ML Inference Engineer — Spaitial, Великобритания