Skip to content

Remove submission schema version field#57

Draft
isPANN wants to merge 3 commits into
mainfrom
codex/clarify-submission-contract
Draft

Remove submission schema version field#57
isPANN wants to merge 3 commits into
mainfrom
codex/clarify-submission-contract

Conversation

@isPANN

@isPANN isPANN commented Jul 18, 2026

Copy link
Copy Markdown
Collaborator

What changed

  • remove schema_version from runner output, intake validation, private scored results, and both JSON schemas
  • have the official scorer recognize the current ledger-backed structure directly
  • retain shape-based handling only for historical local data; official submissions require the current ledger fields
  • document the current problem-reductions tag/full commit and pred version in README
  • clarify that the runner records library_commit and the scorer owns the round gate
  • add drift tests linking README to the code-level round pins

Validation

  • uv run pytest -q: 217 passed, 4 skipped
  • focused runner/submit/ledger/scorer/docs tests: 79 passed
  • generated a fake runner submission, confirmed schema_version is absent, and passed benchmark.submit --dry-run --test
  • simplify review: reuse, quality, and efficiency passes completed; actionable cleanup applied

@isPANN isPANN changed the title Clarify submission schema ownership Remove submission schema version field Jul 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant