Fabraix Red Team Playground
Free · Open source
AI security researchers
Your agent has full database credentials and an invoice mailbox — and the only thing standing between it and a fraudulent wire transfer is whether the model happens to notice the email looked wrong. Stonefold puts a checkpoint between the agent and every action it attempts, so the model's judgment stops being the last line of defense.
Stonefold intercepts each action an agent tries to take, checks it against rules your team wrote and approved, routes sensitive ones to a named person for sign-off, and writes every attempt to an audit record — regardless of outcome. The vendor's own test is the clearest argument for it: a cheap model fell for a planted fraud email twelve out of twelve times, while an expensive model caught it every time, but with Stonefold's bank-detail rule in place, neither model let money reach the attacker. The checkpoint lives outside the model, so swapping models doesn't change your exposure. The project is at specification v0.4 and explicitly described as a working prototype — not a hardened production system.
Bottom line: Pick Stonefold when you need an auditable paper trail showing that a human reviewed and signed off on the policies governing what your agents can touch; plan for significant integration engineering if your agent stack doesn't already expose discrete action calls you can wrap.
Find your fit
More options in Guardrails & Safety. Compare pricing, platforms, and features side by side.
Free · Open source
AI security researchers
Freemium
Legal professionals handling confidential cases
Your agent has full database credentials and an invoice mailbox — and the only thing standing between it and a fraudulent wire transfer is whether the model happens to notice the email looked wrong. Stonefold puts a checkpoint between the agent and every action it attempts.
Stonefold intercepts each action an agent tries to take, checks it against rules your team wrote and approved, routes sensitive ones to a named person for sign-off, and writes every attempt to an audit record regardless of outcome. The vendor states that in their test a cheap model fell for a planted fraud email twelve out of twelve times while an expensive model caught it every time, yet with Stonefold’s bank-detail rule in place neither model let money reach the attacker. The checkpoint lives outside the model so swapping models does not change exposure. It is free, ships as a Python package, offers an API, and supports self-hosting.
Enforce payment approval workflows with human sign-off on bank-detail changes. Audit all agent actions against clinical worklist rules. Block or hold cloud infrastructure changes like database deletions. Record every attempt for compliance review.
Policy enforcement lives outside the model, which means swapping the underlying LLM does not change what actions are allowed or blocked. Every action attempt writes an audit record so compliance reviews have a named decision trace. High-stakes actions route to a named human for sign-off before executing. The project is at specification v0.4 and described as a working prototype; teams using it in production accept pre-stable APIs and carry the risk of breaking changes without documented migration support. It also requires agents to expose actions as individual interceptable steps.
Best for teams running agents with real system access in environments that need explicit policy review over model trust and auditable deployments with named approvers. Skip it if your agents run through opaque tool chains or if you require stable production APIs today.
Sign in to rate this tool or suggest an edit.