Day 96 / 100 · Advanced · Evaluating prompts at scale

Test like an engineer.

Day 78 was five cases by hand. A prompt that runs thousands of times needs a proper test set and a score you track.

Build a test set

Real, redacted cases with known right answers. Include the hard ones.

Define pass

Exact checks where possible, a rubric where not.

Run it every time

On every prompt change and every model change.

Track the score

Compare versions. Never ship a drop by accident.

No test set, no rollout.