Founding Engineer, Environments and Data
Clera
- КомпанияClera
- СтранаСША
- ГрафикOnSite
- АдресSan Francisco
Описание
ABOUT THE ROLE
Build evaluation environments and benchmarks that measure whether AI agents can perform real-world company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, with work that shapes how agent competence is measured.
Обязанности
- Design synthetic company environments with realistic email, records, and files for agents to use over extended tasks.
- Build graders and evaluation systems that can reliably assess advanced AI agents.
- Develop benchmarks that correlate with real-world production performance.
- Find and address evaluation failure modes, including reward hacking and benchmark gaming.
- Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.
Требования
- Mid-level or senior engineering or research experience, including at least 1 to 2 years at a fast-growing or AI-focused startup.
- Hands-on AI research or engineering experience with synthetic data pipelines, benchmarks, evaluations, or post-training. This is a research-oriented role, not solely infrastructure engineering.
- Experience building environments or benchmarks used to train or evaluate agents, and designing and implementing agent graders or evaluation systems.
- Experience simulating complex software systems for agent tool use, identifying flaws in established benchmarks, and detecting and fixing reward hacking.
- Background…
Вакансии этой компании
- Founding Backend / AI Engineer — Clera, США
- Head of Operations / COO — Clera, США
- Founding Member of Technical Staff — Clera, США
- Research Engineer, Synthetic Data — Clera, Сингапур
- GTM Intern — Clera, США
Похожие вакансии
- Senior, Systems Engineer - Functional Safety & Safety Architecture (Unstructured Environments) — Torc Robotics
- Staff, Software Engineer - Motion Planning (Unstructured Environments) — Torc Robotics, США
- Offensive Cybersecurity Engineers: Build RL Environments for AI Evaluation — Terac, США
- Dynamic Environments Engineer (Mid-Sr) — Stoke Space Technologies
- Senior Technical Artist (Environments) — Skybox Labs
- Lead, Dynamic Environments Engineering — Relativity, США
- Research Engineer, Evals & RL Environments — Nolla Health, США
- Member of Technical Staff, Post-Training, RL Environments — Mirendil, США