Fabraix Red Team Playground
Free · Open source
AI security researchers
Governance logs full of 'the team approved it' and timestamps with no witness are not oversight — they are paper trails that collapse under the first audit. The Legibility Field Kit exists to catch exactly that before the auditor does.
The kit is a zero-dependency Python CLI that runs three checks against your AI decision records: does every change name a specific human owner, is time-to-reverse recorded for reversible actions, and does each entry carry a complete OTW receipt — Owner, Time, Witness. Run `audit` against a directory of governance files and it surfaces every defect in seconds. The scoring command turns those findings into a maturity grade across the three tests, giving compliance teams a number to track sprint over sprint. The wall appears fast: the kit reads files, flags gaps, and stops — it does not integrate with your ticketing system, your CI pipeline, or your approval workflow.
Bottom line: Reach for this when you need to prove your governance files are not theater; look elsewhere when you need the tool to enforce accountability at the point where decisions are actually made.
Find your fit
More options in Guardrails & Safety. Compare pricing, platforms, and features side by side.
Free · Open source
AI security researchers
Freemium
Legal professionals handling confidential cases
Most AI governance processes fail the same way: approval records name a role or a team instead of a person, reversible actions ship without a rollback window documented, and the witness field is blank or missing entirely. The Legibility Field Kit is an open-source CLI auditor — Apache-2.0 licensed, no external dependencies — that runs three legibility tests against your existing governance file structure. The core workflow is three commands: `init` scaffolds compliant governance files for a new system, `audit` walks a directory and emits a finding for every violation of the owner, reversibility, or OTW (Owner, Time, Witness) rules, and `score` grades the system’s governance maturity across those three axes.
The differentiating design choice is what the tool refuses to do. It performs static checks on files you already maintain — it does not act as an agent, does not call external APIs, and carries zero runtime dependencies. That means there is nothing to provision, no credentials to rotate, and no vendor call path that breaks when a third-party service has an outage. The audit of a demo system runs in under a minute from a fresh clone.
The kit fits teams that already produce governance artifacts — decision logs, change records, approval files — and need a repeatable, auditable way to prove those artifacts meet a legibility standard. It fits regulated environments where a named human must sign off on AI-touched decisions and that signature must be verifiable. It breaks when the problem is upstream: if your process does not yet produce structured governance files, the kit has nothing to audit. The vendor offers a commercial kit at forgedculture.com for teams that need extended capabilities beyond the open core.
The repository ships with a `demo_system` directory and a `check.sh` script so the audit command produces real output against a sample set of files on first run. The PDF `ThreeTests_LegibilityFieldKit.pdf` documents the three-test framework the scoring logic implements, which is the artifact compliance teams are most likely to present to an external auditor.
Sign in to rate this tool or suggest an edit.