EqualifyEverything / benchmarks-ai-alt

Add projects/ and the corpus construction project
First project: build the corpus of functional images and gold standard alt text the benchmark scores against. Two agents in a loop, a seeking agent and an adversarial reviewer, with a stop condition that no agent can declare. - directives/00 states the spec: item definition, coverage, difficulty and diversity targets, collection constraints, acceptance criteria. - directives/01 and 02 are the seeking and adversarial review directives. - directives/03 and run.sh sequence the rounds and stop on two consecutive quiet review rounds. - tools/validate.mjs enforces the schema and computes the stop condition, with a fixture self-test. No dependencies. - run.sh --selftest exercises the whole loop against a stub agent, no API calls. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Blake Bertuccelli-Booth Blake Bertuccelli-Booth committed on Aug 27, 2026, 05:32 PM
Showing 14 changed files +2099 additions -0 deletions
Browse files at this commit →