Guide · Quality
Lightweight evaluation loops
Use a fixed set of 20 tasks. Score 1–5 on correctness, clarity, and safety. Average weekly. Do not invent new rubrics mid-pilot.
Keep it small
- Same scorer for the full pilot if possible
- Record model / temperature / prompt id on every row
- Ship a one-page summary, not a deck