JobTooFounding Engineer, Environments and Data
Clera
- КомпанияClera
- СтранаСША
- ГрафикOnSite
- АдресSan Francisco
Описание
ABOUT THE ROLE
Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, shaping how agent competence is measured.
Обязанности
- Design synthetic company environments with realistic email, records, and files for extended agent use.
- Create robust graders and evaluation systems that can assess agents beyond the expertise of human reviewers.
- Develop benchmarks that correlate with real-world production performance.
- Find and fix evaluation failures, including reward hacking and benchmark gaming.
- Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.
Требования
- Hands-on experience with synthetic data pipelines, benchmarks, evaluations, or post-training; this is a research and engineering role, not a pure infrastructure position.
- Experience building environments or benchmarks used to train or evaluate agents, and designing graders or evaluation systems for AI agents.
- Experience simulating complex software systems for agent tool use, and identifying benchmark flaws or fixing reward hacking.
- At least 1 to 2 years at a fast-growing or AI-focused startup, with relevant AI research or engineering experience.
- Strong startup experience, such as founding a company or participating in an accelerator, and…
Вакансии этой компании
- Lead AI Engineer — Clera, Испания
- Founding Forward Deployed Engineer — Clera, США
- Account Executive — Clera, США
- Senior Mechanical Engineer — Clera, США
- Technical Program Manager — Clera, США
Похожие вакансии
- Product Manager, Environments — Mercor, США
- Onboard Software Engineer - Deployment & Runtime Environments — Loftorbital, Франция
- Onboard Software Engineer - Deployment & Runtime Environments — Loftorbital, США
- Release, Environments, and Change Engineer (C2) — Kaluza, Великобритания
- Founding Engineer, Environments + Data — Clera, США
- Research Engineer Intern - Environments, Data and Post-Training — Mercor, США
- Research Scientist - Environments, Data and Post-Training — Mercor, США
- Software Engineer, Applied AI - Environments Platform — Mercor, США