job posting · smartrecruiters
SERVICENOW, INC.: Staff Software Engineer, Agent Eval Platform
Observed on the employer’s careers system, last checked 2026-09-05.
- Employer
- SERVICENOW, INC.
- Location
- Santa Clara
- Category
- Engineering
- Posted
- 2026-08-20
- Careers system
- smartrecruiters
- Observed
- 2026-09-05
Role description
Verbatim from the employer’s posting, rendered as plain text.
The Role Moveworks' AI agents don't just generate text — they act. They plan, call tools, and change real state in enterprise systems on behalf of 5.5 million employees. That makes the central problem of our team an unusually hard measurement problem: how do you score what an agent did — across a multi-step trajectory through a world it changed — precisely enough that the score can teach it to do better? That signal is what this role owns. You'll build the judgement layer of our agent evaluation platform: the rubrics, the judges, the calibration against human labels, the methodology that makes a score mean something. And the payoff is larger than a report card — a judge good enough to grade a trajectory is a judge good enough to train against . The same calibrated signal that explains why an agent failed becomes the reward signal that stops it failing. This isn't a pretraining role, and…
Provenance
744000144602090