Senior Software Engineer, Model Evaluation
Clera
- КомпанияClera
- ФорматУдалённо
- УровеньSenior
- Адресremote
Описание
ABOUT THE ROLE
Join an early-stage AI company building agents for manufacturing and supply chain operations. In this research-focused engineering role, you will work with procurement and manufacturing experts to create benchmarks, train models, and improve agents used in real operational workflows.
Обязанности
- Design benchmarks and evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
- Work with domain experts to scope tasks, write reference answers and rubrics, and build graders.
- Train and fine-tune models hands-on, using evaluation results to guide experiments.
- Identify agent failures, develop improvements, and validate those improvements with measured results.
- Help establish research and evaluation practices as an early member of the team.
Требования
- At least 3 years of experience, with senior- or staff-level capability.
- Experience designing and writing benchmarks or evaluations.
- Experience authoring tasks, including defining scope, creating reference solutions or rubrics, and checking task quality.
- Hands-on experience training and fine-tuning models, beyond using models through APIs.
- Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
- Supply chain, procurement, manufacturing, or early-stage startup experience is a plus.
COMPENSATION & BENEFITS
Base salary is $180,000 to $250,000 annually, plus equity…
Вакансии этой компании
- Automation Engineer, Dealership Integrations (Software Engineer) — Clera
- Business Development Representative — Clera, США
- Founding Backend Engineer — Clera, США
- Founding Infrastructure Engineer — Clera, США
- Product Engineer (Consumer, Design Heavy) — Clera, США
Похожие вакансии
- Technical Lead, Evaluation, Validation & Simulation — 42dot, США
- LLM Data Evaluation Engineer — Сбер, Москва
- Industrial Plant Reliability & Maintenance Expert, AI Evaluation — Clera
- Technology Leaders: Interview on AI Platform Evaluation — Terac, США
- Senior Software Engineer, Model Evaluation — Clera, США
- Legal Expert (EU Law), AI Evaluation — Clera
- GigaChat Audio Evaluation Lead — Сбер, Москва
- Data Analytics Experts: Benchmark Evaluation Project — Terac, США