test(benchmark): tighten the relative gate to the measured speed

After #302, the development machine's protocol takes about 41 seconds
instead of 232. The budget multipliers now add about 1.5 times headroom
to the new ratios (0.1 for typed obligations, which leaves room for
runner jitter), and the hang guard drops from 600 to 240 seconds, with
a 210-second test timeout: about three times the expected run on
srvhome, which is about 1.9 times slower than nessar-desktop.

Part of #286 and #302. The gate still needs a passing CI benchmark on
two runners.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
nessarandClaude Opus 5.5 committed 2026-10-18 21:36:37 +02:00
1 parent 6c9ff4ae34
commit 676ea24410
7 files changed
+75 -31

No files matched your search

+6 -6
View File
@@ -301,15 +301,15 @@ export function benchmarkReport(measurements: BenchmarkMeasurement[]): string {
].join('\n');
}
// Measured on the development machine (ratio to the frozen two-years run), tightened by #286.
// About 1.5x the development machine's ratios to the calibration run after #302 (#286).
export const BENCHMARK_BUDGET_MULTIPLIERS: Record<string, number> = {
'representative year': 0.25,
'typed obligations': 3,
'representative year': 0.15,
'typed obligations': 0.1,
'chained earned entitlements': 0.05,
'deliberate conflict': 0.05,
'loaded year': 25,
'two years': 1,
'three years': 3.5,
'loaded year': 2.5,
'two years': 0.5,
'three years': 1.5,
};
/** One message per scenario whose mean planning time exceeds multiplier x calibration, or that has no multiplier. */