Bloom vs kodwai

Bloom and kodwai are both coding assistants tracked by AIDiveForge. Below is a side-by-side comparison of pricing, capabilities, platforms, and ownership — sourced from each tool's live website and verified before publishing.

Bloom

Bloom generates targeted evaluation suites for arbitrary behavioral traits.

kodwai

The platform delivers ticket-sized coding challenges you run on your own machine with your own agent — Claude Code, Cursor, or Codex. A CLI via npx downloads the problem, initialises a git repo, and starts the clock. When you submit, it packages your code, git history, test runs, agent transcript, and elapsed time, then scores you across three axes: Direction, Outcome, and Lift. A one-shot prompt that flukes a green test suite still scores low — the scorer reads the whole session, not just the final diff. The leaderboard is public, so your score builds a visible track record of agent oversight skill.

Attribute	Bloom	kodwai
Pricing	Free	Free
Free trial	No	No
Open source	No	Yes
Has API	Yes	No
Self-hosted option	Yes	No
Platforms	Python; integrates with Anthropic and OpenAI models via LiteLLM; supports Weights & Biases	Web, CLI (npm)
Languages	Python	—
Released	2025-12-20	—
Pros	Reproducible and targeted evaluations that quantify frequency and severity across automatically generated scenarios Evaluations correlate strongly with hand-labelled judgments and reliably separate baseline models from intentionally misaligned ones Researchers can extensively configure Bloom's behavior, through choosing models for each stage, adjusting interactions' length and modality Using Bloom evaluations took only a few days to conceptualize, refine and generate Integrates with Weights & Biases for experiments at scale and exports Inspect-compatible transcripts	Scores the full agent session rather than just the final diff, which means a one-shot guess that accidentally passes tests gets exposed as the non-skill it is — something a green CI badge will never surface. Runs entirely on your own machine with your own agent, so the problem-solving environment matches production reality rather than a constrained sandbox, and you get a score that reflects how you actually build. CLI setup via npx with no installation friction, so you can start a timed challenge without fighting a new environment before the clock even matters. Public leaderboard rankings give developers a portable, shareable record of agent-direction skill — filling the gap left by assessments that only measure what you memorized. Fully free with no paid tier, so there is no point at which access to challenges or scoring gets gated behind a paywall.
Cons	Bloom is only as robust as the seeds and judging logic that power it; teams should treat seeds as living governance artifacts, and for ambiguous or highly contextual behaviors, periodic manual review is still necessary Bloom's evaluation suite is unlikely to match the precise distribution of scenarios found in existing benchmarks, and since model behavior can be sensitive to context and prompt variations, direct comparisons are unreliable	The challenge catalogue is fixed and curated by the vendor — when you exhaust the available problems or need a domain-specific scenario (internal tooling, proprietary stack, compliance-sensitive context), there is no way to author private challenges, and teams end up building a separate internal evaluation framework. No API and no self-hosted option means the platform cannot be embedded into a hiring pipeline, team onboarding flow, or CI-adjacent workflow; teams that need scored agent-direction assessments at scale or inside their own infrastructure hit this wall immediately and move to building custom evaluation harnesses. Agent access is entirely your responsibility — Claude Code, Cursor, or Codex subscriptions are prerequisites, so developers without existing access to one of those three tools cannot use the platform at all, and the platform provides no fallback.

Bottom line

Kodwai is open source; only Bloom exposes a public API. Choose based on which difference matters most for your workflow.

Frequently asked questions

What is the difference between Bloom and kodwai?

Bloom is Free, while kodwai is Free and open source. Compare pricing, free trial, API, platforms, and pros/cons in the table above on AIDiveForge.

Is Bloom better than kodwai?

It depends on your workflow. Use the side-by-side attributes (pricing, open source, API, self-hosted, platforms) to decide. AIDiveForge does not rank a universal winner — we publish verified facts so you can choose.

Bloom vs kodwai: which should I pick?

Pick Bloom if its pricing model, openness, or platform fit matches your constraints; pick kodwai otherwise. Check free-trial availability on each listing if you want to test before committing.

Comparison data is sourced and verified by the AIDiveForge data pipeline. AIDiveForge is editorially independent.