X_EVAL_THRESHOLD
Means
an eval scored below its tolerance
Typical cause
a prompt edit regressed cases against the recorded baseline
Fix
x test <eval> for per-case scores; ULTIMATE_EVAL_RECORD=1 x test eval to accept new numbers as a reviewed diff
an eval scored below its tolerance
a prompt edit regressed cases against the recorded baseline
x test <eval> for per-case scores; ULTIMATE_EVAL_RECORD=1 x test eval to accept new numbers as a reviewed diff