Clera is hiring an
Expert Talent Pool, Evals and Benchmarks (Associate)
Join a team that designs and runs human-led evaluations of AI models. You will help measure model capabilities by creating rigorous questions, rubrics, and comparative assessments, contributing to better understanding of AI performance.
Write questions and tasks that test specific model capabilities.
Develop rubrics that define strong, partial, and weak answers.
Create reference answers and edge-case scenarios to challenge models.
Grade model outputs against rubrics and explain each score clearly.
Analyze incorrect answers, group error patterns, and document findings.
Compare multiple models using the same prompts.
Validate benchmarks and flag questions that may no longer provide reliable measurements.
Support small studies of how people evaluate or interact with model outputs.
Zero to five years of professional experience; prior AI-data work is not required.
Experience or training in QA, test engineering, assessment design, psychometrics, UX research, data analysis, ML evaluation, research support, or a subject area involving rigorous question writing.
Experience writing test cases, exam questions, rubrics, or evaluation tasks, and reviewing work consistently against written criteria.
Ability to use spreadsheets or Python to organize and analyze results, and to identify and document error causes.
Experience with evaluation tools such as Inspect, lm-eval-harness, HELM, or promptfoo, model comparisons, or user and rating studies is useful.
Clear, professional written communication.
Compensation is $30 to $60 per hour, depending on project, field, and experience. Payment is for hours worked.
Fully remote. Projects typically run from one week to several months.
You will be sent to the employer's application page.
Clera lists the location as "remote". If your country is not named, check the job description for eligibility rules before applying.
Yes. Every role on Euro Remote Talent is remote. This one is full-time, for candidates based in .
Clera has not published a salary for this role. Ask about the range in your first conversation; our salary calculator helps you set expectations.
Click Apply now. Create an account if you don't have one, or log in to your account, then apply to the job. Applications close on May 21, 2027.
Healthcare, Dermatology
Apply nowAbout Clera
Clera is a cold sore treatment product that uses a patented stannous fluoride formula to prevent and treat herpes simplex labialis.
Based in North York, Ontario, Clera is designed to provide rapid relief and help clear cold sores in 2 days when applied at the first tingle of symptoms.
Clera is a cold sore treatment product that uses a patented stannous fluoride formula to prevent and treat herpes simplex labialis. Based in North York, Ontario, Clera is designed to provide rapid relief and help clear cold sores in 2 days when applied at the first tingle of symptoms.
Euro Remote Talent LLC
30 N Gould St Ste N
Sheridan, WY 82801, USA
๐ Land your next remote job in Europe
Join 1,000,000+ European remote professionals. Create your free profile to save jobs, keep your CV ready and track every application.
Run by a headhunter with 1,500+ placements
Create your free profile