Senior Software Engineer, Model Evaluation
Clera
- КомпанияClera
- СтранаСША
- ГрафикOnSite
- УровеньSenior
- АдресSan Francisco
Описание
ABOUT THE ROLE
Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.
Обязанности
- Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
- Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
- Train and fine-tune models, using evaluation results to guide experiments.
- Identify agent failures, improve production systems, and measure whether changes work.
- Help establish the team's research and evaluation practices.
Требования
- At least 3 years of experience, operating at a senior or staff level.
- Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
- Practical experience training and fine-tuning models, not only using models through APIs.
- Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
- Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.
COMPENSATION & BENEFITS
Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.
LOCATION
Hybrid in San Francisco, California, United States.
Вакансии этой компании
- Founder's Associate (Operations) — Clera, Германия
- Legal Expert (EU Law), AI Evaluation — Clera
- Application Engineer (FAE/AE) — Clera, США
- Founding AI / Backend Engineer — Clera, США
- Technical Program Manager — Clera, США
Похожие вакансии
- Technology Leaders: Interview on AI Platform Evaluation — Terac, США
- GigaChat Audio Evaluation Lead — Сбер, Москва
- Data Analytics Experts: Benchmark Evaluation Project — Terac, США
- Manager - Model Evaluation — Zoox
- Data Scientist - Behavior Evaluation — Zoox
- Contract Student Worker - Freeways Data Evaluation (20 hrs/wk) — Zoox
- Member of Technical Staff, Evaluations — Xdof
- Test & Evaluation Operator — Waabi, США