WORK IN PROGRESS · cards marked draft have not passed review · nothing here is teaching content yet

How this repository checks itself

The approach follows Anthropic's published guidance: "How the Claude Code team thinks about verification" (16 November 2026) and "Reduce hallucinations". Read on 2026-11-20.

PracticeWhat we do hereWhereState
Write down what "done" meansRequirements F1 to F8.sdlc/intents/fact-base/done
Verification means running the change--online fetches every cited page; render is read as a parent wouldverify skilldone
End-to-end testA card passes only if its quotes are on the live pagesfactcheck.py --onlinedone
Property test2,000 random texts per run: normalising twice changes nothing; a copied quote is found againfactcheck.py selftestdone
Differential testNot used: there is no older system to compare with-n/a
Check that the checks workselftest breaks a good card 16 ways and breaks each real card; every break must failfactcheck.py selftestdone
Three failed rounds, then a personA written ruleAGENTS.mddone
Checks say why they failedEvery failure names the card, the field and the fixfactcheck.pydone
A checklist triggered by the diffNine triggersREVIEW.mddone
One reviewer, several roundsRound 1 attacks the card; round 2 builds on it and ties the answer to the factsfact-review skilldone
A change cannot modify its own checksOwners on the rule files; card work never edits them.github/CODEOWNERSwaits for GitHub
Cheap checks firstThe gate runs before every commitlefthook.yml, scripts/pre-commit-gate.shdone
Start a new gate in observe mode; stamp commitsA Checked: line on every commit, logged when missing, not blocked yetlefthook.yml, scripts/checked-stamp.shobserve
Test the reviewer on what mattersTwelve test cards on neutral topics: eight with one planted flaw each, four clean. A reviewer reads them blind; a separate scorer compares its findings with the keyevals/run 1: found 8 of 8; no false alarm on the 4 clean cards; 2 clean cards marked weakened
Turn misses into rules; prune themA log; a rule needs two missesdocs/lessons.mdstarted
Let the model say "I don't know"could_not_verify on every verified cardgatedone
Ground in direct quotesEvery source carries the exact words, 5 to 40 of themgatedone
Verify with citations; retract what has no quoteanswer_claims: a sentence with no fact behind it is removedgate, fact-review skilldone
Compare independent runsTwo review rounds by an agent that did not write the cardgatedone
Use only the provided documentsCards are written from fetched pages, not from memoryAGENTS.md, skillsdone

On top of that guidance, a verified fact needs three reliable, independent sources. Governments and advocacy groups may be cited, but do not count toward the three. Outlets carrying one news agency's story count once. A fact that states what a named record says (a census, a law, a ruling, a vote) is verified by the record itself, read by us, plus two reliable sources that report the same content.