Staff Applied Scientist
Robots And Pencils
- КомпанияRobots And Pencils
- ФорматУдалённо
- УровеньLead
- АдресCA Remote
Описание
We're looking for a Staff Applied Scientist to lead the design and build of an evaluation framework for an enterprise planner-based agent. You will work directly with the client's EA engineering team to benchmark their agent across planner models, executor LLMs and inference optimization levers. Every proposed change, whether a model upgrade, a harness change or a routing strategy, becomes a controlled, statistically sound experiment with a measurable dollar outcome.
This is a research-heavy, customer-facing role with a significant build component. You will own both the experimental method and the tooling that makes it repeatable: a scenario-driven user simulator, isolated experiment execution, statistical comparison, and automated insights in a locally hosted dashboard the client can adopt as their own. The work runs in three overlapping streams (evaluation pipeline, grading and statistics, dashboard and experiment campaign) and ends in a recommendation the client can act on.
Why This Role Matters
At Robots & Pencils, we design AI systems for a human world. Our name says it all. Robots and pencils means engineering paired with creativity, because every agent we ship has to work for real people in real workflows. That balance is baked into how we operate.
Agents are only as good as the evidence behind them. Today, most teams pick a model or switch on a cost lever on instinct. Here, you replace instinct with data: you build the system that tells the client which planner…
Вакансии этой компании
- Sr. AI Product Manager — Robots And Pencils, Колумбия
- Staff AI Developer - Canada — Robots And Pencils
- Staff Data Scientist — Robots And Pencils, Аргентина
- Senior Strategist — Robots And Pencils, США
- SVP, Client Partner - Energy/Utilities — Robots And Pencils, США
Похожие вакансии
- Data Scientist — НЛМК ИТ, Москва
- Data Scientist (Рекомендательные системы) — ANCOR, Москва
- Data Scientist — МТС Банк, Москва
- Data Scientist (NLP, LLM) — Фарпост
- Data Scientist — Лига Цифровой Экономики, Москва
- Principal Data Scientist, Creator — Roblox, США
- Adv Pilot Scientist — Novo Nordisk, Дания
- Scientist II, Analytical Development - Oligonucleotides — Novo Nordisk, США