Skip to content

Fail the benchmark when a baseline case disappears - #171

Merged
jmjava merged 3 commits into
mainfrom
verify/docgen-17-baseline-ids
Oct 7, 2026
Merged

jmjava merged 3 commits into
mainfrom
verify/docgen-17-baseline-ids

Conversation

@jmjava

@jmjava jmjava commented Sep 27, 2026

Copy link
Copy Markdown
Owner

Summary

  • Fail the benchmark when a baseline case disappears
  • Verification branch from the burn-down. CI did not run on the branch push because the workflow listens for pull requests (or pushes to main).

Test plan

  • CI on this PR is green

@jmjava
jmjava force-pushed the verify/docgen-17-baseline-ids branch from 11d347e to 3460370 Compare October 7, 2026 23:01
The hotspot gate fails any edit to that file, so a filtered run marks its scores and compare_to_baseline scopes the missing-id check.

Co-authored-by: Cursor <cursoragent@cursor.com>
@jmjava
jmjava merged commit 3db0f16 into main Oct 7, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant