Expert Talent Pool, Evals and Benchmarks (Associate)
- Location
- 🌍Remote · Worldwide
- Posted
- (today)
- Type
- RemoteFull-time
- Salary
- $30 – $60 / hr
- Field
- HR & Recruiting
About the job
Join a team that designs and runs human-led evaluations of AI models. You will help measure model capabilities by creating rigorous questions, rubrics, and comparative assessments, contributing to better understanding of AI performance. What You'll Do • Write questions and tasks that test specific model capabilities. • Develop rubrics that define strong, partial, and weak answers. • Create reference answers and edge-case scenarios to challenge models. • Grade model outputs…
Listed on Himalayas. Full description and application there.
View on Himalayas