RiddleRun vs Skillful

RiddleRun and Skillful are both workflow automation tracked by AIDiveForge. Below is a side-by-side comparison of pricing, capabilities, platforms, and ownership — sourced from each tool's live website and verified before publishing.

RiddleRun

RiddleRun combines a CLI and an optional self-hosted web app, both running inside Docker, so your test environment travels with the repo rather than living on someone's laptop. You define a user journey in JSON — steps, assertions, expected outcomes — and a Playwright/browser-use agent executes the whole sequence autonomously. The Docker-first setup means teams can wire it into CI without installing a browser stack on the build machine. The project has two GitHub stars and one open issue at the time of curation, which signals early-stage maturity — documentation depth and community support are thin, and the agent's decision logic is largely a black box to the teams running it.

Skillful

The core mechanic is symlink-based installation: one source folder, linked into Claude Code, Codex, Cursor, Copilot, Gemini CLI, Junie, opencode, or any custom folder target you define. Edit the source and every linked install picks up the change. The docs describe broken-symlink detection and one-click repair, which matters when tools update their config paths and silently drop your workflows. There is no backend, no account, and no telemetry — the library is a folder on your disk, so git is your version control and your backup strategy. Public skill repositories on GitHub can open directly into Skillful's import dialog, which makes trialing shared libraries faster than copying URLs by hand.

Attribute	RiddleRun	Skillful
Pricing	Free	Free
Free trial	No	No
Open source	Yes	Yes
Has API	No	No
Self-hosted option	Yes	Yes
Platforms	Docker, CLI, self-hosted web app	macOS, Windows, Linux
Pros	JSON-defined test journeys decouple test authorship from code, so a product manager or QA analyst can write and update test cases without touching a Playwright script. Docker-first deployment means the entire test environment — browser, agent, backend — is version-controlled and reproducible, so 'works on my machine' test failures stop being a sprint tax. Autonomous agent execution adapts when UI elements shift position or change labels, so a redesign doesn't immediately invalidate your entire test suite the way selector-based tests do. Fully open-source with no paid tier, so there is no usage ceiling, no API key cost, and no vendor lock-in — the full source is forkable and auditable. Optional self-hosted web app alongside the CLI, so teams that want a visual interface for running and reviewing tests get one without leaving their own infrastructure.	Symlink-based installs across all linked AI tools, which means editing a prompt once in Skillful propagates the change everywhere — without this you are manually hunting down which copy of the workflow drifted. No account, no telemetry, no backend server, so your prompts and agents never leave your machine and you are not dependent on a vendor's uptime or data-retention policy. Plain-folder library structure, so git handles version history and diff review without any export or migration step — auditing what changed in a workflow is a standard git blame away. Broken-symlink detection surfaces in the sidebar and repairs in one click, so a tool update that silently drops your config path does not leave you debugging missing workflows across five editors. Direct GitHub import links let public skill repositories open straight into the import dialog, so trialing a shared library takes seconds rather than manually copying repository URLs.
Cons	Agent decision logic is opaque: when a test fails, the JSON output and logs do not currently expose a step-by-step trace of what the agent attempted, which means debugging a false negative on a critical checkout flow requires re-running the test manually and watching the browser — not reading a structured failure report. The project carries two GitHub stars and one open issue at curation, which means there is precious little community knowledge to draw on when the agent misinterprets a journey step; teams hit a wall and wait on the single maintainer rather than searching a forum or Stack Overflow thread. Complex assertion logic — verifying specific data values, confirming API responses correlate with UI state, or testing accessibility properties — is not described anywhere in the documented feature set; teams needing that depth will add a Playwright test layer alongside RiddleRun, at which point they are maintaining two systems. Teams whose CI pipeline requires parallel test execution across multiple environments will find no documented support for distributed runs; at the point where a single Docker container's serial execution makes the test suite a bottleneck, the likely move is to a Playwright-native framework or a hosted AI testing service with built-in parallelism.	The library is filesystem-first and requires comfort with folders, symlinks, and git: non-technical collaborators who need to browse, edit, or approve workflows through a web interface cannot do that here, and teams with that requirement switch to a cloud-based prompt management platform instead. There is no access control, sharing layer, or team workspace: a solo developer or a team where everyone commits to the same git repo is fine, but the moment you need role-based permissions on who can edit or see which skills, this model has no answer. Custom install targets require you to know the exact folder path each tool expects, and when a tool changes that path the symlinks break silently until Skillful's broken-link detector surfaces them — teams running many tools with frequent updates carry an ongoing maintenance cost here.

Bottom line

RiddleRun and Skillful are closely matched on pricing model, openness, and API availability — pick by feature set and platform support in the table above.

Frequently asked questions

What is the difference between RiddleRun and Skillful?

RiddleRun is Free and open source, while Skillful is Free and open source. Compare pricing, free trial, API, platforms, and pros/cons in the table above on AIDiveForge.

Is RiddleRun better than Skillful?

It depends on your workflow. Use the side-by-side attributes (pricing, open source, API, self-hosted, platforms) to decide. AIDiveForge does not rank a universal winner — we publish verified facts so you can choose.